Following the man's arrest military personnel at a barracks near Windsor Castle in Windsor, Berkshire were reportedly warned not to leave the grounds in uniform