Graham Norton recently sold his New York townhouse that was situated in an area that was a hit with celebrities like rockstar Lenny Kravitz and the composer Cole Porter