>Just using the table will open it up in the client memory space, so yes, it will move the whole table.

If you have ever opened a 500 MB file over a network connection, then you should know that that this is incorrect. See Ed Rauh's reply for a more accurate description of what gets pulled down.