Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Introduction to Actions on google

ymnder
June 18, 2017

Introduction to Actions on google

umeda.apk #3

ymnder

June 18, 2017
Tweet

More Decks by ymnder

Other Decks in Programming

Transcript

  1. 4

  2. topics ᶃ What is actions on google ᶄ How to

    develop app ᶅ Why design is important? ᶆ Appendix
  3. topics ᶃ What is actions on google ᶄ How to

    develop app ᶅ Why design is important? ᶆ Appendix
  4. What is actions on google Actions on Google lets you

    build apps for the Google Assistant. Your apps can help you engage users through Google Home, eligible Android phones, iPhones, and in the future, through every experience where the Google Assistant is available.
  5. What is actions on google Actions on Google lets you

    build apps for the Google Assistant. Your apps can help you engage users through Google Home, eligible Android phones, iPhones, and in the future, through every experience where the Google Assistant is available.
  6. topics ᶃ What is actions on google ᶄ How to

    develop app ᶅ Why design is important? ᶆ Appendix
  7. Get started ᶃ actions on googleͷget startedΛ΍Δ • ͱΓ͋͑ͣಈ͔ͤΔʗ֓ཁΛ௫ΊΔ •

    ։ൃ؀ڥ͕ߏஙͰ͖Δ ᶄ code labsΛ΍Δ • ҰਓͰͰ͖ΔΑ͏ʹ࡞ΒΕ͍ͯΔ ᶅ Google I/OͷSessionΛݟΔ • Building Apps for the Google Assistant
  8. Assistant AppͷىಈτϦΨʔ • Actions on googleͰΞϓϦΛ࡞੒ͨ͠৔߹ • default App name:

    test app • “ok google, talk to my test app” • App InformationͰApp nameΛࢦఆͰ͖Δ
  9. Rich Response • جຊతͳฦ౴ Text Response • Ϧονͳฦ౴ • Card

    • List • Suggestion Chips • Carousel card • ฦ౴ઌͷ࿈ܞ • Facebook messenger, Slack, Telegram…
  10. Api.ai: Entities • நग़͍ͨ͠ޠ۟Λఆٛ͢Δ • Ϣʔβʔͷࣗવݴޠ͔ΒύϥϝʔλΛऔΓग़͢ • ༧૝͞ΕΔೖྗΛ͜͜Ͱఆٛ͢Δ • reference

    valueʹෳ਺ͷsynonymΛఆٛ͢Δ • ϓϦηοτ΋͍Ζ͍Ζ༻ҙ͞Ε͍ͯΔ • ஍໊ɾ୯Ґɾ࣌ؒɾਓ໊ͳͲ https://docs.api.ai/docs/concept-entities
  11. Api.ai: Fulfilment / ಡΈ্͛ • speak • rootʹهड़͢Δ • <speak>Hello

    World</speak> • break • ϙʔζ͢Δ • <speak>Wait a while <break time="5s" />calm down.</speak>
  12. Api.ai: Fulfilment / ಡΈ্͛ • say-as • ޠ۟ͷ৘ใΛهࡌ͢Δ • 1984

    • one thousand nine hundred and eighty four • nineteen hundred, eighty four? • can • ͖ΌΜ • ͠ʔ͑ʔ͑͵
  13. Api.ai: Fulfilment / ಡΈ্͛ • say-as • ޠ۟ͷ৘ใΛهࡌ͢Δ • 1984

    • <say-as interpret-as="cardinal">1984</say-as> • <say-as interpret-as="date" format="yyyy">1984</say-as> • can • <say-as interpret-as="characters">can</say-as>
  14. Api.ai: Fulfilment / ಡΈ্͛ • audio • ΦʔσΟΦϑΝΠϧΛ࢖͑Δ • جຊతʹ͸ޮՌԻͳͲΛ໐Β͢ͷʹ࢖͏ʁ

    • mp3, ogg, wav(deprecated) • ࠷େ̎෼Ҏ಺ • 5MB • httpsͰఏڙ͢Δ͜ͱ
  15. Api.ai: Local࣮ߦ • npm install -g @google-cloud/functions-emulator • npm install

    • functions start • functions deploy appName --trigger-http • ngrok http 8010
  16. topics ᶃ What is actions on google ᶄ How to

    develop app ᶅ Why design is important? ᶆ Appendix
  17. Design • Voice User Interface (VUI) • ୯७ʹจࣈΛಡΈ্͛Ε͹ྑ͍༁Ͱ͸ͳ͍ • ਓͱձ࿩͢Δͱ͖ͱಉ͡

    • ձ࿩͸୺తʹɺ৑௕తͰͳ͘ • creating persona ref: https://developers.google.com/actions/design/
  18. Design • Assistant have 3 interaction • audio (for Google

    Home) • visual (for mobile or TV) • haptic (for mobile) • Input / Output interaction is sometimes not same • Ϣʔβʔͷஔ͔Ε͍ͯΔঢ়گͰมΘΔ • out: eye, ear X in: camera, mic, touch
  19. Design (for Home) • Don’t read, listen • ಡΉจষ≠ฉ͘จষ •

    Avoid information overload • ৘ใΛΘͬͱग़͢ͱϢʔβʔ΋ࠔΔ • ࿩Λ୹͘·ͱΊɺࡉ͔͍ΠϯλϥΫγϣϯΛ • Answer the question • Ͱ͖ͳ͔ͬͨ৔߹Ͱ΋౴͑ํ͕͋Δ
  20. Design (for mobile) • if one mode goes away, the

    other should take over • optimize for the strongest mode, but allow both • Leverage the strengths of each mode & avoid redundancy across modalities
  21. topics ᶃ What is actions on google ᶄ How to

    develop app ᶅ Why design is important? ᶆ Appendix
  22. Sessions about Google Assistant • Building Apps for the Google

    Assistant • Defining Multimodal Interactions: One Size Does Not Fit All • Finding the Right Voice Interactions for your App • In Conversation, There Are No Errors • PullString: Storytelling in the Age of Conversational Interfaces • Applying Built-in Hacks of Conversation to Your Voice UI • Bringing the Google Assistant to Any Device • Transactions with the Google Assistant • Building rich cross-platform conversational UX with API.AI
  23. Google Home • Google Home is powered by the Google

    Assistant. • ࠓ೥ͷՆҎ߱ʹ೔ຊ্཮
  24. Google Home Updated • Proactive Assistance • Visual Response •

    hands free calling • Bluetooth Audio Support
  25. Google Home Updated: Proactive Assistance • Google Homeʹݺͼ͔͚ͳͯ͘΋৘ใΛڭ͑ͯ͘ΕΔ • ಓ࿏ͷࠞࡶ৘ใΛڭ͑ͯ͘ΕΔσϞ͕͋ͬͨ

    • χϡʔε΍Ϛʔέοτͷಈ͖Λ఻͑Δ͜ͱ͕Ͱ͖Δʁ • push notificationͷΑ͏ͳ࢓૊Έ͕͋Δ͔ʁ
  26. Google Home Updated: hands free calling • ϋϯζϑϦʔͰͰ͖Δ͜ͱ͕͍Ζ͍Ζ૿͑ͨ • ίϯςΩετ

    / ൃ࿩ऀͷ൑ผ • Call my mother -> ൃ࿩ऀͷ฼਌Λೝࣝ͢Δ • ΞϝϦΧͱΧφμ͸HomeͰແྉͰి࿩͕͔͚ΒΕΔ
  27. References • https://tech.recruit-mp.co.jp/event/post-12166/ • http://tech.mercari.com/entry/2017/05/30/100000 • https://cyberagent.connpass.com/event/55405/ • https://tech.recruit-mp.co.jp/mobile/post-12285/ •

    https://speakerdeck.com/srym/o-2017-short-report • https://docs.google.com/presentation/d/ 1ea5Touf3c5hgJXmoYL1WmkplF7m6XKYL7YyKPD7OWvY/pub? start=false&loop=false&delayms=60000&slide=id.g22d0f56c70_0_2 7 • https://github.com/vvakame/pubg-assistant/blob/master/ README.md