An unexpected little slice of New England in the Bronx (of all places). City Island's residential streets boast adorable homes in various styles including American Craftsman and Colonial Revival with great sea views. There are plenty of antique shops for your browsing pleasure, but not nearly as many as there are seafood restaurants.
For the best deal I have to recommend the Original Crab Shanty, one of the oldest island establishments that has a special of a 1 1/8lb. lobster, two clams, a large shrimp, soup or salad, and a side of linguini. Although none of the meal, sides especially, made the shanty stand out compared to your average seafood joint, the price of 14.95 for all of it sure did.