[Feature Request] Implementation of some further semi-crucial native UI features for couch gaming

[dio-gh]

Original Post (click to expand)

I was recently testing Nier with my laptop hooked up to the TV, and while the native UI features that are already in are nice and appreciated, the lack of on-screen keyboard integration lead me to almost believe that the game has hung, whilst creating a new game.

This was due to the game waiting for me to enter a name which I unfortunately couldn't type in, as:

• I didn't have my keyboard nearby anymore,
• the qt dialog for it spawned under the game, meaning even if I got said kb back to me, the game would look unresponsive, unless I'd have the smarts to realize that beside quitting, minimizing with alt+tab is also an option I have left.

Due to this, I'd like to have on-screen keyboard support implemented into the native ui.

Similarly to what has been said above, I need my keyboard to quit games (or pause, which afaik isn't really possible yet), and that is also quite uncomfortable. With the merge of #5426, and the hearsay about possibly more settings becoming to be possible to tuned while in game, I propose the idea of creating a sort-of pause menu, accessible by the PS-button, that lets the user modify the modifyable settings, quit the game, or other stuff people want, idk.

Of course, not only would this not be an easy feat, but might even prove to be in vain if VSH becomes usable one day. I still think though that this feature would make the emulator finally be completely usable, while in-game, without a keyboard on hand, and thus, make this a worthwhile effort.

Long story short, I'd like if you could quit and configure (the dynamic) settings from the native UI via a pause menu triggered by the PS button. This would enable users the full couch experience for RPCS3, as there would be nothing you couldn't do that you could with kbm at hand.

This would also include restructuring the startup process, so that the PPU and SPU module loading and compilation would also be communicated through the native UI instead. The ultimate goal would be to be able to launch RPCS3 games from a shortcut and not suffer any shortcomings.

Overview:

• Implement on-screen keyboard support to the native ui
• Implement pause menu with a quit game button at least
• Implement native UI integrated dynamic configuration overriding
• Restructure loading phases so that they're all displayed in the game window via the native UI
• Add controller key-combos for emulator specific features (e.g. screenshots)

[kd-11]

I planned on doing native OSK for some time now, should be a nice side-project to take my attention off all the hardcore RSX stuff for a while. Likely will be finished in mid-late January though.

[kd-11]

Native OSK is done. The other features require the 'PS button' to be properly detected, something that doesn't work with xinput afaik. It is however trivial to implement the menus themselves.

[dio-gh]

Thank you! 👍

[Megamouse]

@kd-11
The PS button works on XInput without a problem.
All you need to do is disable opening the Windows Game Bar with the Guide Button since it intercepts that.
If you have Steam installed you also need to disable opening it with the Guide button.
If you do those precautions there is no real problem with Guide buttons and thus the PS-Button on XInput

[dio-gh]

Updated as of March 2020.

[stevenvachon]

All you need to do is disable opening the Windows Game Bar with the Guide Button since it intercepts that.
If you have Steam installed you also need to disable opening it with the Guide button.

I have done this and the "guide" button on my XBox One (Bluetooth) controller performs no action, despite being bound as the "PS" button.

[dio-gh]

I'm certain that the tasks in this ticket will eventually be completed, but I won't be here to test or offer feedback anymore.

Due to this, and the maintainers being able to tick the tasks complete, I'll leave the ticket open and just unsubscribe. Best of luck to the team in tackling them.