Upgrade to Pro — share decks privately, control downloads, hide ads and more …

AIY Voicekit workshop

AIY Voicekit workshop

Lee Boonstra

April 05, 2018
Tweet

More Decks by Lee Boonstra

Other Decks in Technology

Transcript

  1. Confidential & Proprietary of web browsing sessions will be done

    without a screen. of all searches will be voice. of customer interactions will be managed without a human. Gartner ComScore Gartner 30% 50% >85% By 2020...
  2. Confidential & Proprietary This is possible through webservices and APIs...

    { “id”: “4f932d9-5678902”, “timestamp”: “2017-05-26”, “lang”: “en”, “result”: { “source”: “agent”, “action: “flight.book”, “parameters”: {“geo-city”: “Los Angeles”, “geo-state-us”: “Hawaii”, “price”: { “amount”: 300, “currency”: “USD” } }
  3. Confidential & Proprietary Google Home — Voice-activated speaker powered Google

    Assistant — A conversation between you and Google that helps you get more done in your world
  4. Confidential & Proprietary Get help, anytime, anywhere • Manage tasks

    • Plan the day • Get answers • Make memories • Control your home • Enjoy Entertainment
  5. 12 • Learn about the Google Assistant • Setting up

    the Assistant • Labs 4 (5 & 6) What we will do today? • Let’s make groups of 2. • In case you didn’t install the software on the micro-sd card, let me know, so I can install.
  6. 13 • Enable Internet • Verify if audio and mic

    works • Setting up device • Use Scripts • Use Google Cloud Software
  7. 16 • End-to-end development suite for building conversational UI. •

    Previously known as API.AI • Sept 2016, acquired by Google • Powered by Machine Learning Dialogflow
  8. 17 Why Dialogflow • Powered by Machine Learning (NLP) •

    Scalable: separate your conversation text from code • Build faster with the Web UI • Advanced fulfillment options and multi channel integrations • Analytics • Speech / Voice Integration • Multi-lingual bot support (20+ languages) • Part of Google Cloud (60+ cloud services) Intent Recognition (NLP) ... Web Console Powerful SDK Supervised Training Cross-platfor m
  9. 19 https://aiyprojects.withgoogle.com/voice#assembly-guide-5-connect-and-boot-the-devic e • Chapter 4 from the booklet. •

    Chapter 5 from the booklet ◦ Step 13: src/examples/voice/assistant_library_demo.py ◦ src/examples/voice/assistant_library_with_button_demo.py Optional • Use this script to make it headless / work after reboot: ◦ https://goo.gl/KbaFHo Try out Dialogflow, and build your own custom action: http://console.dialogflow.com How to setup the software? WIFI CODE: TODO Note: when using phone tethering. Use a 2.4Ghz network.
  10. 20 Note: the steps provided by the website and booklet

    are out of date. (Due to new type of Raspberry, and release of Google Vision Kit.) You can use the following steps, to get your kit up and running: 1. Download Raspbian with desktop - 2018-03-13 from: https://www.raspberrypi.org/downloads/raspbian/ 2. Use a tool like Etcher.io to flash the micro SD card. 3. Boot your RaspberryPi with the micro SD card inserted, and choose a Wifi network. 4. Open a terminal window with CTRL + ALT + T 5. Execute: git clone https://github.com/google/aiyprojects-raspbian.git AIY-projects-python Raspberry Pi 3B+
  11. 21 You will need a Python3 virtual environment. Download the

    following libraries and dependencies by executing the following commands: sudo apt-get install python-virtualenv virtualenv -p python3 env source env/bin/activate cd AIY-projects-python/ scripts/install-deps.sh sudo scripts/install-services.sh pip install -e src/ pip install RPi.GPIO sudo scripts/install-alsa-config.sh reboot Raspberry Pi 3B+
  12. 22 Now, you will need to configure drivers. You can

    use the following commands: source env/bin/activate cd AIY-projects-python/ python3 checkpoints/check_wifi.py sudo scripts/configure-driver.sh reboot source env/bin/activate cd AIY-projects-python/ python3 checkpoints/check_audio.py Raspberry Pi 3B+
  13. 23 Now you can continue with setting up the Google

    Assistant: • Chapter 5 from the booklet ◦ Step 13: src/examples/voice/assistant_library_with_button_demo.py Optional • Use this script to make it headless / work after reboot: ◦ https://goo.gl/KbaFHo Raspberry Pi 3B+