driverdis solution looks plausible, but I'm not able to get the bug again.
However, I've found out, that the game pauses while dragging the screen around with my mouse - In a multiplayer game…
Could be another bug but here's the video anyway: https://youtu.be/GtfYmlKBRXw watch the pause-button and notice the slowdown while I drag the screen.