Do you like improving your environment? 環境カイゼンは好きですか？ > Many programmers, myself included, like to customize our environment to our liking. They are happy when it improves their efficiency, even if only a little. > You could call them a kind of "Environment Improvement Geek". > Matz 私を含めて多くのプログラマは，自分の環境を自分の好みに合わせてカスタマイズすることを好みます。それによってほんのわずかでも自分の効率が向上すると喜びを感じるのです。 ある種の 「環境改善オタク」と呼んでもよいでしょう。 ［改訂新版］Emacs実践入門──思考を直感的にコード化し、開発を加速する より 本書に寄せて まつもと ゆきひろ
How to use Fusuma Fusumaの使い方 Install libinput-tools 1 Add $USER to Input group 2 Customize ~/.config/fusuma/config.yml 5 Run $ fusuma from the CLI 4 Install Fusuma with $ gem i fusuma 3
Touchpad drivers on Linux ● Well-known touchpad drivers, around 2010 ● only X.Org ● Many Configuration options ● Gestures were not supported ● Release of libinput 1.0 in 2015 ● Used in Wayland and X.Org ● No configuration file ● Improvements to gesture support Synaptics 2015 libinput 2010 2020 Libinput Synaptics Linuxのタッチパッドドライバ
Seeking multitouch Gestures ● Desire for Mac-like trackpad gestures ● Test different laptops' gesture behavior in electronics store Prototype on Synaptics Synapticsドライバでのプロトタイプ Released xSwipe in 2012 ● Discovered logging capability with `$ synclient -m` for synaptics ● Read and parse logs in loop ● Detect direction and send shortcut ● Written in Perl Synaptics 2015 libinput 2010 2020 My first DIY
Synaptics to Libinput SynapticsからLibinputへ Synaptics replaced by libinput ● synaptics driver in maintenance mode ● xSwipe only worked with Synaptics driver ● Frustration with inability to use gestures My First Gem Synaptics 2015 libinput 2010 2020 Released Fusuma in 2016 ● Use `libinput debug-events` ● Rewrite xSwipe in Ruby for libinput ● `rake release`! 🪦
● Execute libinput using Open3.popen3 ● Output lines without buffering using `stdbuf -oL` ● convert a line to a event $stdout to event in real-time リアルタイムで標準出力をイベントに Input
Gesture detection ジェスチャーの検知 Gesture State Time fingers delta x delta y SWIPE BEGIN +37.492s 3 10.23 -1.14 SWIPE UPDATE. +37.492s 3 10.54 -1.17 SWIPE UPDATE. +37.499s 3 7.62 -1.76 SWIPE UPDATE. +37.506s 3 10.25 -2.64 Detect a left swipe with three fingers => `swipe / 3 / right` Compare the average movement with threshold Detector Create Event with search index
Executor Executing Actions アクションの実行 ● Execute command assigned to a gesture ● Use Process.spawn to avoid slowing down the main loop ● Use Process.detach to avoid zombie Detect a left swipe with three fingers `swipe /3 / right` => { command: ‘xdotool key alt+Left’ }
Extend Pipeline with Plugins Each tasks in pipeline are implemented with a plug-in system プラグインでパイプラインを拡張する ● Depends on result(event) previous tasks ● Unified interface for each task ○ e.g) Input#io, Executor#execute ● Pipeline just call methods along the interface ● Additional features using Gem ● Implement tasks that satisfy interface pipeline plugins Input Buffer Detector Executor Libinput Tap Gesture Timer Swipe Pinch Rotate Hold Command Timer App Tap App Tap App Keypress Keypress Sendkey Wmctrl
Internal plugins(default) Internal plugins Each task in pipeline is a plugin 内部プラグイン Input Buffer Detector Executor Libinput Timer Gesture Timer Swipe Pinch Rotate Hold Command
● Uses evdev to send key events as from keyboard device ○ evdev is a generic kernel interface used by both X11 and Wayland ○ Using libevdev requires ffi ■ need to install ruby-dev fusuma-plugin-sendkey evdevを利用したキーイベント送信プラグイン
fusuma-plugin-appmatcher アプリ毎に設定を切り替えできるプラグイン ● Configure application-specific gestures and actions in config.yml ● Switches the config according to the active application ● Supports X11 and Gnome shell(Wayland) ○ X11: xprop -spy ○ Gnome: Gnome Extension and D-Bus
Call registered plugins 登録したプラグインの呼び出し ● Get plugin classes from Manager ● Initialize plugins to start pipeline in main process Initialize registered plugins lib/fusuma.rb
Pros / Cons of plugin and pipeline Pros 🙆 Event-based coding simplifies understanding and testing 🙆 Easily decide where to place the source code Cons 🙅 Processing can be redundant 🙅 State management can be difficult Pipeline Plugin Pros 🙆 Release of experimental features 🙆 Pipeline no longer dependent on plug-ins Cons 🙅 Code maintenance can be complicated 🙅 Difficult to detect conflicts and interference between external plugins, resulting in bugs プラグインとパイプラインのメリット・デメリット
Limitations of Dragging gestures on Touchpad タッチパッドのドラッグ操作って難しい 🙅 Tap and drag with one finger ends when the finger leaves the touchpad 🙅 3-finger dragging is also difficult to operate due to the narrow range of movement 🙅 Difficult to move and scroll the workspace while dragging operation is in progress
Rekimoto, Jun. "ThumbSense: Automatic input mode sensing for touchpad-based interactions." _CHI'03 Extended Abstracts on Human Factors in Computing Systems_. 2003. https://www2.sonycsl.co.jp/person/rekimoto/papers/chi03tsense.pdf ThumbSense タッチパッドは修飾キー Only when the finger is on the touchpad ● Switch specific keys to left-click or right-click ● Replace with any command or keybinding
fusuma-plugin-thumbsense タッチ中にキーリマップできるプラグイン Only when the finger is on the touchpad ● Convert specific keys to left-click or right-click ● Replace with any command or keybinding
DEMO デモ ● Click ○ J/F keys remapped to LEFT Click while touching on Touchpad ● Drag ○ Scrolling and swiping can be used simultaneously ○ Works well with touchpad gestures.
Advantages of separating Remapper リマッパーを分離したポイント ○ Remapper only converts keys, while Fusuma only detects events ○ As a side effect, Appmatcher + Remapper allows you to define customizable key remappers for specific app ○ Remapper can also call existing executor plugin such as command/wmctrl/sendkey
psj59129
shibe23
mitchan
ari_mharada
monicaribeiro
rabbitmagician1
akitotsukahara
ogiwarat
fornewid
sr2mg4
tosite
iimokoy
addyosmani
schacon
samanthasiow
zakiyama
3n
dougneiner
tenderlove
kneath
edds
caitiem20
denniskardys
cromwellryan