Again, you're trying to delete from two tables at once.
DELETE Table2.*, Table1.gid
Unfortunately, this generally can't be done unless, as you said, you enforce referential integrity. Also, I'm not sure why you are specifying a single column:
Table1.gid
You can't delete a column like...