This is not an issue, not in my family.
Got his complaint: you don't spend time with me, i knew it's just for fun.
Some men, no matter how old they get, seem to enjoy acting like a child.
BTW, my only child is growing up and she's happily exploring her independence.