Every day or so I send my boss an email with a question. I do this rather than phone him, and because we literally spend 30 minutes a month together - yet still he doesn't delegate. But enough of that.
He phoned me earlier with a request. I answered it with an email., he emailled me back, etc. I then thought "Eh up - I could slip in a question here and he might answer me."
Of course, he then immediately shut up! Leaving me with another unanswered question.
So, the moral of the story is "If you want your boss to shut up and stop hassling you - ask him a question..."