installing freeglut3-dev would remove lots of GUI related packages

I am trying to install freeglut3-dev in my Ubuntu 12.04.4 installation.
When I try to install it via command line apt says that a lot of packages would be removed when I continued.

To be more accurate:

$ sudo apt-get install freeglut3-dev
Reading package lists... Done
Building dependency tree
Reading state information... Done
The following packages were automatically installed and are no longer required:
  x11-apps x11-session-utils x11-xfs-utils xinit libfs6
Use 'apt-get autoremove' to remove them.
The following extra packages will be installed:
  libgl1-mesa-dev libgl1-mesa-glx libgl1-mesa-glx:i386 libglapi-mesa libglapi-mesa:i386 libglu1-mesa-dev
  libx11-xcb-dev libxcb-glx0-dev libxdamage-dev libxext-dev libxfixes-dev libxxf86vm-dev
  x11proto-damage-dev x11proto-dri2-dev x11proto-fixes-dev x11proto-gl-dev x11proto-xext-dev
  x11proto-xf86vidmode-dev xserver-xorg xserver-xorg-core xserver-xorg-input-evdev
Suggested packages:
  xfonts-100dpi xfonts-75dpi
The following packages will be REMOVED:
  libegl1-mesa-drivers-lts-saucy libegl1-mesa-lts-saucy libgbm1-lts-saucy libgl1-mesa-dri-lts-saucy
  libgl1-mesa-dri-lts-saucy:i386 libgl1-mesa-glx-lts-saucy libgl1-mesa-glx-lts-saucy:i386 libglamor-ltss0
  libglapi-mesa-lts-saucy libglapi-mesa-lts-saucy:i386 libopenvg1-mesa-lts-saucy libxatracker1-lts-saucy
  ubuntu-desktop x11-xserver-utils-lts-saucy xorg xserver-common-lts-saucy xserver-xorg-core-lts-saucy
  xserver-xorg-glamoregl-lts-saucy xserver-xorg-input-all-lts-saucy xserver-xorg-input-evdev-lts-saucy
  xserver-xorg-input-mouse-lts-saucy xserver-xorg-input-synaptics-lts-saucy
  xserver-xorg-input-vmmouse-lts-saucy xserver-xorg-input-wacom-lts-saucy xserver-xorg-lts-saucy
  xserver-xorg-video-all-lts-saucy xserver-xorg-video-ati-lts-saucy xserver-xorg-video-cirrus-lts-saucy
  xserver-xorg-video-fbdev-lts-saucy xserver-xorg-video-intel-lts-saucy xserver-xorg-video-mach64-lts-saucy
  xserver-xorg-video-mga-lts-saucy xserver-xorg-video-modesetting-lts-saucy
  xserver-xorg-video-neomagic-lts-saucy xserver-xorg-video-nouveau-lts-saucy
  xserver-xorg-video-openchrome-lts-saucy xserver-xorg-video-r128-lts-saucy
  xserver-xorg-video-radeon-lts-saucy xserver-xorg-video-s3-lts-saucy xserver-xorg-video-savage-lts-saucy
  xserver-xorg-video-siliconmotion-lts-saucy xserver-xorg-video-sis-lts-saucy
  xserver-xorg-video-sisusb-lts-saucy xserver-xorg-video-tdfx-lts-saucy
  xserver-xorg-video-trident-lts-saucy xserver-xorg-video-vesa-lts-saucy
  xserver-xorg-video-vmware-lts-saucy
The following NEW packages will be installed:
  freeglut3-dev libgl1-mesa-dev libgl1-mesa-glx libgl1-mesa-glx:i386 libglapi-mesa libglapi-mesa:i386
  libglu1-mesa-dev libx11-xcb-dev libxcb-glx0-dev libxdamage-dev libxext-dev libxfixes-dev libxxf86vm-dev
  x11proto-damage-dev x11proto-dri2-dev x11proto-fixes-dev x11proto-gl-dev x11proto-xext-dev
  x11proto-xf86vidmode-dev xserver-xorg xserver-xorg-core xserver-xorg-input-evdev
0 upgraded, 22 newly installed, 47 to remove and 0 not upgraded.
Need to get 3,158 kB of archives.
After this operation, 42.4 MB disk space will be freed.
Do you want to continue [Y/n]?

I am not sure if all programs that would be removed are needed, but I am sure that xorg should not be removed.

How can I install freeglut3-dev without removing those programs?