As this is an old thread, you may have already found the answer.
A colleague of mine had the same trouble, and to remove the pop-up, simply do the following:
In Word, click on the Review tab, click on the Translate drop-down, and notice that the Mini Translator is highlighted. Click on...