Xubuntu does not come loaded with a Remote package out of the box like Ubuntu does. So I installed x11vnc
apt-get install x11vnc
set a parseword for it.
x11vnc -storeparsewd parseword /etc/vncparsewd
I just need to set it so that the vnc server is always running. Right now i start the service by SSH'ing into the box using Putty.
