Princess Diana's brother says she was "really brought low by all that criticism" and he saw her in "tears of despair".