I expect you have your nativity scene displayed already. If you decorate for Christmas, it is a requirement. After all without the birth of Christ, we wouldn’t be celebrating the holiday at all.
Do be kind enough to give him a bit of room on your mantel at least. Then take the time to investigate why there is a Christ in Christmas