Look at your wiring diagram. There is a BROWN wire that is switched VDC that feeds your turn signal relay. SWITCHED means coming off the ignition switch and it goes through a main connector up in your headlight shell or near the steering neck. The brown wire wiggling you did earlier in this exercise obviously was close to the loose connection. TRACE THE BROWN WIRE OFF YOUR IGNITION SWITCH AND ASCERTAIN EACH CONNECTION! Moving the bars obviously is causing the connection that is a problem to show up. The bad connection is one that contains the brown wire connection and is near your handlebars. If you have a multimeter, when the turn signals are not working, it won't take much investigating to figure out where the problem is... you could try using the meter to check for voltage starting with the relay and working back; in other words even a test light will work here. Put the POS probe in the brown socket that connects to the flasher relay and the NEG probe on a frame ground. Put the meter in VDC scale. You should get no voltage if the relay isn't getting any... trace that brown wire back towards the front of the bike to the next connector! Test for voltage here. No power? repeat! If you find voltage, the bad connection or connector will be the one downstream on the flasher relay side. If you find ALL the brown connections back to the ignition switch have power, the problem will be in the flasher relay itself (you can check voltage OUT of the relay as well by activating a turn signal)... I think this should be an orange wire going to your left/right turn signal switch. Could also be a ground associated with the turn signals but if you try figuring this out logically, it shouldn't take all that long.