You can even go a step further setting up a wireless connection between your two computers.
Google the article "Making the Wireless Home Network Connection in Windows XP Without a Router". This Microsoft article explains how to create a network without the use of a router.
Hope it helps