"Forget" his birthday once and if he comes after you just say "Hey it's not a big deal, it happens to you all the time!" Maybe he'll remember yours after that.