My Ball

Me: Oh man, I'm so not on my ball today.
Anna: Don't you mean 'the' ball, as in the proverbial ball that everyone has?
Me: No no, it is 'my' ball.
I play with 'my' ball in 'the' game, why does everyone else confuse this?