I think if your projects are specific to the single solution you are building then including the project in the solution and referencing the project is the way to go.

If your project is shared between many solutions, perhaps a control library or something then I would just add a dll reference. You should reference the bin\release dll. In this case, as you said, the dll will not be rebuit each time.

HTH,
BOb