Because you wrote class library, I think the best way is application, which uses your class, to get settings and pass them to your class...
Anyway, you have other options as well. Check "Application Settings in VB .NET" article by Eric Moreau in May issue of UT Magazine (page 59-61). Here he explain another three methods for storing configuration settings.