Multi-monitor with different refresh rates stuck at 60Hz

I am on Ubuntu 20.04 and have 2x 60Hz monitors and my primary 144Hz monitor, I can set them to their native refresh rates, but the desktop and any windows I open only refresh at 60Hz with all 3 monitors on. I tried both X11 and Wayland. 144Hz works just fine if I turn off both 60Hz monitors.

I think windows should refresh at 144Hz when on my 144Hz monitor, without needing to turn off my other monitors.