OK, I finally got to the bottom of this.
There were dependencies in the application on Outlook and Excel so removing the full Office install broke the dependency and prevented AutoExec from even starting running when using the runtime. This explains the failure of my diagnostic message box to...