Lancaster told Stewart she ‘can’t go anywhere near’ US president – and her husband soon followed suit