optimize

hey any advice for optimizing a ssh tunneled vnc session? I am running debian SID on the server end. It runs a little slow and i'd like to try and speed it up. Also can VNC be run without starting the Xserver? I don't need it to be on locally. Anything to speed it up, its a 550mhz box w\ 192 mb of ram.