I'm with the OP on not wanting someone else to use my hairbrush or combs. You just never know...they could easily have head lice...and that's a quick way to spread those nasty little fuckers.
HOWEVER, I suspect that if the OP would simply tell her to leave his hair brush alone, she would. Perhaps she just doesn't know.