As we know, to turn on follow mode you have to long press the location button. The button changes color, we get a flash notification. It is convenient, intuitive and works well.
My suggestion is to disable follow mode using the same method, i.e. long press of the location button.
Currently, when follow mode is active and we move the map manually, we have to wait to automatically return to the current location (depending on the setting, this may take a long time, what we don’t want). Touching the location button only turns off follow mode and moves the map somewhere there. Perhaps it should go back to current location and continue with the follow mode.