Getting started with controlling LEGO using Swift

Transcript

1. Hiromu Tsuruta / Shinichiro Oba Getting started with controlling LEGO using Swift try! Swift Tokyo 2024 Workshop
2. 　　　　　　　　　　　　　　 <Company> 　　　　　　　　　　　　　　 ・Rakuten Group, Inc 　　　　　　　　 <Application> 　　　　　　　　 ・Rakuma 　　　<Role> 　　　・iOS Developer 　　　・Developer Relations 　　　　　　　　　　　　　 <Account> 　　　　　　　　　　　　　　 ・Twitter：@hcrane14 Tech Lead
3. Workshop Contents • About Bluetooth • About Bluetooth LE • About GATT • About Core Bluetooth • Demonstrate littleBits STAR WARS R2-D2
5. What do you associate with Bluetooth ? ϒϧʔτΡʔε͔ΒԿΛ࿈૝͢Δʁ
6. What is Bluetooth ?
7. About Bluetooth • Wireless communication technology ɹແઢ௨৴ٕज़ͷͻͱͭ Quoteɿhttps://k-tai.sharp.co.jp/appli/useful/10sen/01bluetooth.html • Communication standard designed for short distances ɹ୹ڑ཭޲͖ͷ௨৴ن֨
8. In 1997, Jim Kardach of Intel proposed the name “Bluetooth”. 1997೥ɺΠϯςϧͷδϜɾέϧμοΫ͕
 ʮϒϧʔτΡʔεʯͱ͍͏໊લΛఏҊͨ͠ɻ Quoteɿhttps://commons.wikimedia.org/wiki/File:Jim_Kardach_Mr_Bluetooh.png
9. Why ?
10. Nordic Countries ๺Ԥ
11. Nordic Countries Quoteɿhttps://nordiclifescience.org/different-covid-19-strategies-in-the-nordic-countries/
12. Harald Gormsen Blåtand Quoteɿhttps://www.thoughtco.com/harald-bluetooth-profile-1788985 • King of Denmark in the 10th century ɹ̍̌ੈلͷσϯϚʔΫԦ • Unified Norway and Denmark ɹϊϧ΢ΣʔͱσϯϚʔΫΛ౷Ұͨ͠ ϋϥϧυɾΰϧϜηϯɾϒϩλϯ
13. Quoteɿhttps://www.thoughtco.com/harald-bluetooth-profile-1788985 Harald had a blue tooth Harald Gormsen Blåtand ϋϥϧυɾΰϧϜηϯɾϒϩλϯ
14. Harald Gormsen Blåtand Quoteɿhttps://www.thoughtco.com/harald-bluetooth-profile-1788985 His nickname is ’Blåtan’ χοΫωʔϜ͸੨ࣃԦͩͬͨ ϋϥϧυɾΰϧϜηϯɾϒϩλϯ → ’Blåtan’ = blue tooth ɹϒϩλϯ = ੨͍ࣃ
15. Quoteɿhttps://commons.wikimedia.org/wiki/File:Jim_Kardach_Mr_Bluetooh.png He chose this name because he hoped that Bluetooth would unify communication protocols like King Harald united countries. ൴͕͜ͷ໊લΛબΜͩͷ͸ɺϋϥϧυԦ͕ࠃΛ౷ Ұͨ͠Α͏ʹɺϒϧʔτΡʔε͕௨৴ϓϩτίϧ Λ౷Ұ͢Δ͜ͱΛ๬Μ͔ͩΒͰ͋Δɻ
16. Quoteɿhttps://twitter.com/Bluetooth_Japan/status/1138135930974326784 The logo is a combination of the runic letters "H" and "B" from Harald Blåtand initials. ϩΰ͸ϋϥϧυɾϒϩλϯͷΠχγϟϧͰɺϧʔϯจࣈͷʮHʯͱʮBʯΛ૊Έ߹Θͤͨ΋ͷɻ Bluetooth logo
17. Bluetooth History
18. Bluetooth History Quoteɿhttps://www.tjsys.co.jp/focuson/clme-bluetooth/index_j.htm Bluetooth 4.0
19. Bluetooth Low Energy (Bluetooth LE)
20. Bluetooth Classic and Bluetooth Low Energy Quoteɿhttps://www.global-tag.com/bluetooth-low-energy-ble-overview/ Bluetooth Classic Bluetooth Low Energy Versions 4.x and later are generally referred to as Bluetooth LE, but also include Bluetooth Classic. 4.xҎ߱ͷόʔδϣϯ͸ҰൠʹBluetooth LEͱݺ͹ΕΔ͕ɺBluetooth Classic΋ؚ·Ε͍ͯΔɻ
21. Bluetooth LE is fantastic
22. What is the difference ? Bluetooth Classic Bluetooth Low Energy
23. ᶃ Connectivity ௨৴
24. Quoteɿhttps://www.musen-connect.co.jp/blog/course/product/analyze-bluetooth-pairing-problems-with-protocol-analyzer/ Bluetooth 1.x, 2.x 3.x Bluetooth 4.x, 5.x Active Scan Passive Scan ΞΫςΟϒεΩϟϯ ύογϒεΩϟϯ Communication flow of Bluetooth
25. Ϛελʔ εϨʔϒ Bluetooth Classic (1.x, 2.x, 3.x) ᶃ Inquiry Slave (Child) Master (Parent) ᶄ Response Note: The flow is a bit more complex, but has been omitted. ࣮ࡍͷϑϩʔ͸΋͏গ͠ෳࡶ͕ͩলུ͍ͯ͠Δɻ Active Scan ᶅ Connection
26. Central (Parent) Peripheral (Child) ηϯτϥϧ ϖϦϑΣϥϧ Bluetooth LE (4.x, 5.x) Note: The flow is a bit more complex, but has been omitted. ࣮ࡍͷϑϩʔ͸΋͏গ͠ෳࡶ͕ͩলུ͍ͯ͠Δɻ Passive Scan ᶄ Receive ᶅ Connection ᶃ Broadcast
27. Swift can handle Bluetooth easily than before They look the same in the diagram, but... Swift ͰҎલΑΓ΋؆୯ʹϒϧʔτΡʔεΛѻ͑ΔΑ͏ʹͳͬͨ ਤͰ͸ಉ͡Α͏ʹݟ͑·͕͢...
28. ᶄ Simultaneous Connections ಉ࣌઀ଓ
29. Bluetooth Classic (1.0~) Pairing Connection One device can only establish one pairing. 1ͭͷσόΠεཱ͕֬Ͱ͖ΔϖΞϦϯά͸1͚ͭͩɻ
30. Bluetooth Classic (2.1~) Pairing Connection Pairing One device can have multiple pairings (limited), but only one connection at a time. 1୆ͷσόΠεͰෳ਺ͷϖΞϦϯάʢ੍ݶ͋Γʣ͕Մೳ͕ͩɺҰ౓ʹ઀ଓͰ͖Δͷ͸1ͭͷΈɻ
31. Bluetooth LE (4.x~) Pairing Connection Pairing Connection One device can have multiple pairings, and multiple connection at a time. 1୆ͷσόΠεͰෳ਺ͷϖΞϦϯά͕ՄೳͰɺҰ౓ʹෳ਺ͷ઀ଓ͕Ͱ͖Δɻ
32. ᶅ Communication Profile ௨৴ϓϩϑΝΠϧ
33. Connection Communication Profile ϓϩϑΝΠϧɿBluetoothσόΠεؒͷ௨৴΍σʔλަ׵Λఆٛ͢Δ࢓༷ Profile: Specifications for communication and data exchange between Bluetooth devices
34. Before Bluetooth LE emerged… Hands-Free Profile Advanced Audio Distribution Profile Human Interface Device Profile Serial Port Profile Bluetooth LE ͕ग़Δલ͸… There were several profiles, each requiring customized implementation ͍͔ͭ͘ͷϓϩϑΝΠϧ͕͋Γɺن֨͝ͱʹݸผʹ࣮૷͕ඞཁͩͬͨɻ
35. After Bluetooth LE emerged… Generic Attribute Profile ʢGATTʣ Note: Not all Bluetooth LE uses GATT. ͢΂ͯͷBluetooth LE͕GATTΛ࢖༻͍ͯ͠ΔΘ͚Ͱ͸ͳ͍ɻ Bluetooth LE ͕ग़͔ͯΒ͸… GATT has unified profiles and made implementation easier. GATTʹن͕֨౷Ұ͞Εͯɺ؆୯ʹͳͬͨɻ
36. What is GATT ?
37. About GATT GATT Service Characteristic Declaration Value Descriptor (Optional) Feature Attribute Bluetooth௨৴ʹඞཁͳ৘ใ Information required for communication between Bluetooth devices ʨ ػೳ ଐੑ
38. Permissions Quoteɿhttps://devzone.nordicsemi.com/f/nordic-q-a/64286/basic-concept-of-sending-and-receiving-data-with-ble Read Write Notify
39. GATT Example Quoteɿhttps://www.microchip.com/en-us/solutions/medical/demonstrations-and-design-files/wearable-heart-rate-monitor Peripheral (Child) Central (Parent) GATT Wearable Heart Rate Monitor
40. GATT Example Quoteɿhttps://developerhelp.microchip.com/xwiki/bin/view/applications/ble/introduction/bluetooth-architecture/bluetooth-host-layer/bluetooth-generic-attribute-profile-gatt/Data-Organization/ ʨ ʨ ʨ
41. littleBits STAR WARS R2-D2 Quoteɿ https://www.littlebits-jp.com/single-post/2018/04/10
42. Quoteɿhttps://www.littlebits-jp.com/single-post/2018/04/10 littleBits STAR WARS R2-D2 littleBits was acquired, and the app is no longer downloadable ϦτϧϏοπ͸ങऩ͞ΕɺΞϓϦ͸μ΢ϯϩʔυͰ͖ͳ͘ͳͬͯ͠·ͬͨ
43. DroidKit / crane-hiromu @ GitHub
44. littleBits STAR WARS R2-D2 - GATT GATT Service FW Version Bitsnap Control Audio Upload ʹ Operation Feature ʹ ʹ Firmware Feature Voice Record Feature ΦϖϨʔγϣϯػೳ ϑΝʔϜ΢ΣΞػೳ ΦʔσΟΦػೳ Demo
45. Core Bluetooth iOS͓ΑͼApple͕ఏڙ͢ΔଞͷΦϖϨʔςΟϯάɾγεςϜʹ͓͚ΔBluetooth௨৴ͷͨΊͷϑϨʔϜϫʔΫ Framework for Bluetooth communication in iOS and other Apple-provided operating systems Peripheral (Child) ϖϦϑΣϥϧ ηϯτϥϧ Central (Parent)
46. CBPeripheralDelegate Core Bluetooth Protocols for handling events related to devices acting as a ‘Peripheral’ ϖϦϑΣϥϧͱͯ͠ಈ࡞͢ΔσόΠεʹؔ࿈͢ΔΠϕϯτ Λॲཧ͢ΔͨΊͷϓϩτίϧ Peripheral (Child) ϖϦϑΣϥϧ ηϯτϥϧ Central (Parent) CBCentralManagerDelegate Protocols for handling events related to devices acting as a ‘Central’ ηϯτϥϧͱͯ͠ಈ࡞͢ΔσόΠεʹؔ࿈͢ΔΠϕϯτ Λॲཧ͢ΔͨΊͷϓϩτίϧ
47. CBCentralManagerDelegate CBPeripheralDelegate Example code Central (Parent) Peripheral (Child) ηϯτϥϧ ϖϦϑΣϥϧ Control peripheral Handle peripheral Handle central Control central
48. Quoteɿhttps://medium.com/macoclock/core-bluetooth-ble-swift-d2e7b84ea98e
49. Peripheral (Child) ϖϦϑΣϥϧ Quoteɿhttps://www.musen-connect.co.jp/blog/course/trial-production/ble-beginner-2/ Step 1 - Receive advertisement packet ηϯτϥϧ Central (Parent) packet packet packet packet packet
50. Quoteɿhttps://www.musen-connect.co.jp/blog/course/trial-production/ble-beginner-2/ Step 1 - Receive advertisement packet packet packet packet packet packet Scan Result
51. Quoteɿhttps://www.musen-connect.co.jp/blog/course/trial-production/ble-beginner-2/ Step 1 - Receive advertisement packet packet packet packet packet packet ηϯτϥϧͷपғʹ͋Δ͢΂ͯͷBluetooth LEσόΠε͕ݕग़͞ΕΔͷͰɺඞཁͳσόΠε͚ͩΛ୳͢ɻ It detects all Bluetooth LE devices around Central, so it only looks for the ones it needs.
52. Step 2 - Establish a connection Peripheral (Child) ϖϦϑΣϥϧ ηϯτϥϧ Central (Parent)
53. Step 2 - Establish a connection Peripheral (Child) ϖϦϑΣϥϧ ηϯτϥϧ Central (Parent) CBPeripheralDelegate
54. Service FW Version Bitsnap Control Audio Upload ʹ Operation Feature ʹ ʹ Firmware Feature Voice Record Feature ΦϖϨʔγϣϯػೳ ϑΝʔϜ΢ΣΞػೳ ΦʔσΟΦػೳ Step 3 - Discover Service
55. Peripheral (Child) ϖϦϑΣϥϧ ηϯτϥϧ Central (Parent) Step 3 - Discover service
56. Peripheral (Child) ϖϦϑΣϥϧ ηϯτϥϧ Central (Parent) Step 3 - Discover service
57. Service FW Version Bitsnap Control Audio Upload ʹ Operation Feature ʹ ʹ Firmware Feature Voice Record Feature ΦϖϨʔγϣϯػೳ ϑΝʔϜ΢ΣΞػೳ ΦʔσΟΦػೳ Step 4 - Discover characteristics
58. Peripheral (Child) ϖϦϑΣϥϧ ηϯτϥϧ Central (Parent) Step 4 - Discover characteristics
59. Peripheral (Child) ϖϦϑΣϥϧ ηϯτϥϧ Central (Parent) Step 4 - Discover characteristics FW Version Bitsnap Control Audio Upload ! ! " Filter UUID
60. Peripheral (Child) ϖϦϑΣϥϧ ηϯτϥϧ Central (Parent) Permission - Write value
61. Example Write Value - Sound [0x1E, 0x01, 0x00, 0xE1, 0xF0] [0x1E, 0x01, 0x01, 0xF1, 0xD1] [0x1E, 0x01, 0x02, 0xC1, 0xB2] Sound Type Sound Command
62. Other examples [0x12, 0x03, 0x00, 0x00, 0xFF, 0xD2, 0x6C] [0x12, 0x03, 0xFF, 0x00, 0x00, 0x03, 0xFF] Color Command Color Type [0x14, 0x02, 0x02, 0xFF, 0x65, 0x9D] [0x14, 0x02, 0x02, 0x99, 0x69, 0xFD] Move Command Move Type Move Speed