City debates downsizing, but finds downside