Translation is designed to require the tool to be enabled for use. If it works without the tool enabled, it means all the text you see is stored in the local cache.
Once new text appears, it will revert to the original source or cause the game to freeze.