>What would be your preference - buy online or buy from the store?
Or you can build your own :))

Don't forget to buy the balls. I recommend 3 star balls, competition level. Anything less than 3 star is junk.
As far as paddles, buy the set of paddles (usually low quality) only if you play ping pong casually and don't care about advancing your skills.
Otherwise, a good paddle goes for at least 40-50 bucks.

Try http://www.totaltabletennis.com/home.php. It looks like they have a great selection of ping pong stuff and they have free curbside delivery.

Compare their offer with Sports authority, Dick's and Modell's.
Good luck.