Mark,
It could be one or a combination of many things. How much memory can SQL Server access? Are there other services (like Exchange) running on the machine? Is the table severly fragmented? If you run QA on another computer, do you get the same results? And finally, we people evaluate moving to SQL Server, performance is rarely one of the considerations <s>.
-Mike