Hobby Lobby, maybe?

Here in NY I find that the small nursery has a great selection of beautiful pottery.

Have you tried searching in your general area for people who are actual potters and may sell or will create exactly what you're looking for? Are there any craft type villages/areas? I did a general google and came up with a non profit organization that lists a studio directory of different artisians sites, several are listed for Connecticut, possibly one of them might be of help:
http://ceramicartsdaily.org/potters-council/studio-listing/

Here is a link that might be useful: Studio Listing

Another thing to look for is a pottery class. Even if you don't want to try and make your own there are sometimes persons there who take the class to use the equipment and will make pottery to your specifications for a price. Look for classes somewhere that they have a kiln. The kiln will attract serious armatures and semi-professionals.

Good privately owned garden centers will carry nice pots. Also look in the home decor outlets. Forget the big box stores for anything unique or interesting.

Community colleges?
Who knows, you might find one-of-a-kind or slightly imperfect practice pieces
that students are willing to sell...

Josh