Look into using fbs on top of pyinstaller

[sublime09]

fbs might be a better way of packaging and handling distribution.

Tutorial for using fbs with PyQt5

Simple process for getting an executable

I see functionality for automated testing too.
Must see if debugging is fairly supported. Pyinstaller's 'onefile' option does give back good stacktraces for errors that occur.