You can disable the Power Apps tab by choosing where you want the tab to be shown in the support tab.
Alternatively you can go to SIL™ Engine add-on and expand it's modules. There you can disable "Super Page (super-page-link-top-nav)" module and the tab will disappear. See attached prints below.
