Kirsten Schwalbe has denied she was an active member of the party, claiming ‘back then, wives didn't get involved in things like that’