Just dropping by here because I spent almost 30minutes looking for this settings, basically I accidentally turned on “Autofetch” and I wanted to disable it
Here’s the settings: File > Preferences > Settings (Ctrl + ,)
Turn off “Autofetch” under Extensions > Git

Of course there are tons of other things to play with, but this is the thing that frustrates me the most 30minutes ago..
Cheers!
Nick