Yesterday everything worked like a charm, today with no reaseon it pauses and unpauses itself when moving the camera.
Does this for all options (Mouse to Edge/Keyboard/Drag Mouse) reseting controls didn't help.
Edit: The Borderless Fullscreen was the problem. Switched back to normal fullscreen and it worked again.