High NVMe usage with nohting running

As you can see on the screenshot. Task Manager is saying that the Active Time of my NVM.e system drive has a lot of peaks that start to happen after a few minutes of using the PC and they won't go away unless I restart. I have tried so many things that I gave up and formatted the whole drive and reinstalled Windows from scratch. I have also tried the chkdsk command and this problem won't go away. This started to happen just a few days ago, out of the blue. The whole system freezes at every peak you see on the screenshot and the main tab of Task Manager reports the Disk Usage as being ~1%, so there is no process using the disk. Resource Monitor is also reporting the same thing.

Edit: I have narrowed down the problem to a insanely high Response Time on Resource Monitor (up to 2000ms). It is usually the “System” process that is having this high Response Time. Any way of fixing or at least knowing the root cause of this?