I have the confines of a sub terranean shared garage to warm my bike up which is great! But even then after a couple of seconds on say half choke I ease it right down so the motor ticks over at about 1500rpm.
That neighbour of yours is for sure a PITA. But be careful, she knows enough that you have the baffle out...she could make problems.