I got some time to work a little bit on this yesterday after work. I managed to make a simple eventing system on top of (text) messages so you now can send separate events and screen can respond differently to them. Here’s a basic joystick 8 directional movement:
screen events
controller events
and here’s a video from AirConsole simulator: