I don't listen to a lot of "hipster music", but The Unicorns are probably the hipsterest (hipstest?) band to whom I listen. It sounds like a mix between off-brand synthesizers and industrial machinery. And it is wonderful.
The band's history is kind of interesting, as well. The Unicorns, as you can probably guess, did not have much money, so they had to do without agents or managers or anything and handled it all themselves. They eventually disbanded mid-tour in 2003 when the stress proved too much for them.
Still, they did enough to earn a small shout-out in How I Met Your Mother's 100th episode, and another one here.