You really SHOULD see the city, it's vibrant and alive and pretty darn special. We were there 2 weekends ago for 4 days and it was amazing. Clean, fewer homeless than we expected, the subways were running on time and are cheap, and we walked and walked all over the place.
Ignore what you see on curated TV and websites and ask people who have been there