For pourover coffee, a burr grinder along the lines of the Baratza Encore (around $130) will do just fine. I think it's hard to spend much less than that on a grinder and get consistent grinds (although a porlex manual grinder would be fine too). Other equipment you ought to have include a gram scale and some sort of brewer (and the filters that work with that particular brewer). I used to use a Chemex every morning but now use the Kalita Wave, which I find delivers a more consistently delicious brew (get the stainless version though---not the one with plastic, which retains stale coffee oils). Finally, while you could make do with any old water kettle, the gooseneck-syle ones (Bonavita and Hario make them, and I find the electric versions more convenient than stovetop) make it much easier to brew pourover coffee without scalding yourself.
As for beans, it's gotten a lot easier over the last few years to get terrific fresh-roasted beans in Manhattan. Two of the best places to find them are the Joe Pro Shop (in the West 20s) and Box Kite Coffee on West 72nd Street---both of those places offer beans from a rotating group of excellent roasters, so the variety is nice. Other good places to find fresh beans include all the Joe, Stumptown, Cafe Grumpy, and Kafee 1666 locations.
I agree with others who have warned you about espresso---that is a much more expensive proposition if you want to make the good stuff.