Dual monitor issue: windows move to other monitor after screen lock

Whenever I walk away from my computer and it turns the screen lock on, some windows have moved from one monitor to the other after I unlock the screen. It's generally speaking just 1 or 2 windows (from a lot more) and I can't seem to find a logic behind which windows will move and which ones stay in place.

I have a Samsung 32" 4K monitor and an AOC 23" HD monitor connected via an Nvidia Geforce GTX1070 running in their native resolutions. Running Ubuntu Desktop (22.04) fully updated.

It is especially annoying when some windows move from a 4K monitor that are too large to fit on the Full HD screen and always takes away from productivity by needing to rearrange windows after unlocking.

Does anyone know a solution to prevent this behaviour?