I guess I always end up in the wrong parts of NYC because I kept finding that all the restaurants closed at 10pm (during the week, at least)... say, in Chelsea.
Chelsea doesn't have the best food options. You could go south to Meatpacking which is a bit better but I'd just walk east. Flatiron / Union Square has tons of food options that are open late plus solid bars. Walk even further to the East Village and you're golden, there's like two twenty-four hour restaurants within a block's radius of each other.
