The comedian, previously a tradesman, recalled his "weird" conversation with King Charles after telling the monarch about his past work at Buckingham Palace