He's suing his trust's fiduciary, who previously served as Britney Spears' conservator after her father was removed from the role.