One of my favorite non-furniture shops on Warren Street in Hudson, NY is Ornamentum. This gallery displays jewelry as art. Some of the more interesting pieces are almost un-wearable, but would be beautifully displayed on a wall in a home. Each piece it like a little sculpture, however, they have some more wearable pieces as well (as shown below).
(Their website could definitely use a makeover by James Monroe.. it really needs to match up with the awesomeness of their store and merchandise)
Here are a few of my favorite pieces- (to be honest though, there is a lot more in the shop, and everything looks so cool in person. Check it out if you ever find yourself in Hudson!)