Enabling Text Inputs on Any Remote GUI on Android (LT)

https://teamlab.connpass.com/event/405164/

Transcript

1. Enabling Text Inputs on Any Remote GUI on Android atsushieno
2. What's done here?
3. Windowing manager on Compose
4. Remote Compose UI (but not about Remote Compose this time)
5. Remote as in different apks (KMP version at https://github.com/atsushieno/uapmd-kmp )
6. Problem: IME not showing up (and UI gone unresponsive) Supporting IME on remote UI is not that easy. - What do we transfer? Bare text? Input method events? All of those? Remote Compose does not support text inputs either, and no plan to support them (according to the developers)
7. What do the IME dev. folks say...? (totally unrelated to their session talk) "the underlying View system should transfer the relevant input events" (Android View system is still maintained for them) But does it? => surprisingly(?) YES
8. Solution: use InputTransferToken (API Level 35) With focusable SurfaceControlViewHost.LayoutParams. Code details: • • • https://github.com/atsushieno/aap-core/blob/6e3f34d9/androidaudioplugin/src/main/j ava/org/androidaudioplugin/AudioPluginViewService.kt#L301 https://github.com/atsushieno/aap-core/commit/d5fd61e2 https://github.com/atsushieno/aap-core/commit/529a6366
9. Summary We can build remote GUI with text input support (for Android 15 or later) Join DroidKaigi to discuss your issues with the Google / JetBrains insiders(?)