Members of the high court have exchanged accusations after one justice was accused of involvement in a bank scandal.