So when I shut it down and then start it again, mostly Google Chrome or Firefox open and no, it is not on autostart but what I had the last time comes
Perhaps this is due to the quick start of Windows 10.
Try to deactivate this time. If it doesn't work, you can simply activate it again.
I've had that since the last Windows update too. Then there was an update, then it was gone again.