State is not cleaned after debugger is turned off

[soke1556]

Repro:

• Turn on debugger.
• Change something in several files (It will record the time as debugging, which is correct).
• Go to VS Code and stay focused in a file. Turn off the debugger. (Time will be recorded from now on as debugging instead as coding).