Joe,
Although I can't provide specifics, I can almost accept the results. Since you're using linked tables to access the data, Access is doing the join at the workstation and probably without the help of any indexes.
I'm not familiar with Access so I can't post any solution Access solution. You could always create a view (within SQL Server) of the two tables joined and then create a linked table against the view.
-Mike