Comment 8 for bug 658581

My problem was fixed by removing the Nouveau driver entirely.
If anybody still having this issue and you happen to have a Nvidia card, consider using Nvidia's driver and uninstalling xserver-xorg-video-nouveau for the upgrade.