On my
Hondas the mirror stem itself and the locknut (22 in the diagram) has a
LEFT HAND thread, the adapter (18 ) into the lever mount has a right hand thread (both sides exactly the same).
I don't know if the SV is the same arrangement but worth a check, my friend's Triumph was like this. This pic from
https://www.bike-parts-honda.com/