OK Computer: WXG [and notes]

OK Computer WXG, 25/09/15

Peter Gasston C.T. at +rehabstudio @stopsatgreen broken-links.com

@stopsatgreen ASCI Red. Intel’s last supercomputer. £43 million (today). Could
process 1.8 teraﬂops. 1,800,000,000,000. Retired in 2000.

@stopsatgreen PS3. Launched in 2005. 1.8 teraﬂops. £425.

@stopsatgreen In 2012, Google used 16,000 connected processors to teach
a computer how to detect a cat in a photo. >> Jim Wilson, NYT.

@stopsatgreen In 2015, it recognises this as “man using his
laptop while his cat looks at the screen”. 5% error rate. https://twitter.com/timClicks/status/619734363362557953

@stopsatgreen IBM Watson. Beat human contestant at Jeopardy. 10 years
of development. Hard to get costs, but at least £12 million.

@stopsatgreen Cognitoys Dino. £80. Powered by Watson.

@stopsatgreen Artificial Intelligence is becoming very good, very quickly. Lots
of diﬀerent strands to AI, but the revolution has been in deep learning.

How deep learning works Artiﬁcial neural network. Data is passed
through layers; each layer does a job, then passes the result up to the next layer. Layers can perform pattern analysis or classiﬁcation. Can give quick rough answer, slower perfect answer.

@stopsatgreen Computer scientists in Germany have used this to understand
the content of an image and the painting styles of old masters.  >> http://arxiv.org/abs/1508.06576 https://github.com/jcjohnson/neural-style

@stopsatgreen B. Turner, C. Van Gogh, D. Munch Not just
adding a ﬁlter; it understands the areas of diﬀerentiation (sky, buildings, water).

@stopsatgreen Now the AIs are coming for your job.

Is your job at risk? Abstractions People Pictures Words Numbers
Routine Variety You’re alright Get nervous Bye Bye >> http://blogs.gartner.com/martin-kihn/how-to-know-if-a-robot-will-take-your-marketing-job/

@stopsatgreen A shallow magnitude 4.7 earthquake was reported Monday morning
ﬁve miles from Westwood, California, according to the U.S. Geological Survey. The temblor occurred at 6:25 a.m. Paciﬁc time at a depth of 5.0 miles. Copywriters are at risk. This is text generated by Quakebot.

@stopsatgreen Kitty couldn’t fall asleep for a long time. Her
nerves were strained as two tight strings, and even a glass of hot wine, that Vronsky made her drink, did not help her. Lying in bed she kept going over and over that monstrous scene at the meadow. Russian novel, ‘True Love’, written by computer. The NYT did a quiz asking you to recognise paras written by robots or humans. I got 2/8 right. >> http://www.nytimes.com/interactive/2015/03/08/opinion/sunday/algorithm-human-quiz.html?_r=0

@stopsatgreen >> http://www.bbc.co.uk/news/technology-34066941

@stopsatgreen One in five of us could be out of
work. That’s one in ﬁve.

@stopsatgreen https://dwnld.me

@stopsatgreen http://www.appmachine.com/instant/

@stopsatgreen https://thegrid.io

@stopsatgreen ‘That will just make identikit websites’. Well, people made
these. Looks like it could be easily automated.

@stopsatgreen –Travis Gertz “The work we produce is repeatable and
predictable. It panders to a common denominator. We build buckets and templates to hold every kind of content, then move on to the next component of the system. Digital design is a human assembly line.” Travis Gertz, ‘Design Machines’ https://louderthanten.com/articles/story/design-machines

Is your job at risk? Abstractions People Pictures Words Numbers
Routine Variety You’re alright Get nervous Bye Bye A human assembly line…

@stopsatgreen Developers might be feeling a bit smug, but they
really shouldn’t be. Hone lets designers change apps without writing code. https://hone.tools

@stopsatgreen – Wired “[muScalpel] successfully transplanted a video coding format
from one media player to another. It took the automated system 26 hours to complete the transplant, while VLC's manual addition of the code happened over a period of 20 days.” Automated system to take code from one base and move it to another. Currently C only, but could work in any language. http://www.wired.co.uk/news/archive/2015-07/30/code-organ-transplant-software-myscalpel

@stopsatgreen – MIT news “Helium is a system that revamps
and ﬁne- tunes code without ever needing the original source, in a matter of hours or even minutes.” Performance increases between 75% and 500% in tests. http://news.mit.edu/2015/computer-program-ﬁxes-old-code-faster-than-expert-engineers-0609 The developers are probably feeling less smug now.

@stopsatgreen AI can’t do our job, but it can do
bits of our job. We become more eﬃcient, can do more, fewer staﬀ needed. 20% of jobs lost, probably starting with the junior ones.

@stopsatgreen – Travis Gertz “While we’ve been streamlining our processes
and perfecting our machine-like assembly techniques, others have been watching closely and assembling their own machines. We’ve designed ourselves right into an environment ripe for automation.” All of the workﬂow tools we’ve built make our jobs automatable. These quotes are from a fairly mandatory article, ‘Design Machines’ by Travis Gertz. But the best thing about the article is that he also suggests a solution to the problem:

@stopsatgreen

@stopsatgreen – Travis Gertz “We need to be better than
the machines. It’s time to step up and design with heart.” This is the last quote from that article.

@stopsatgreen Deepdream is Google’s tool for visualising neural networks. https://twitter.com/brendandawes/status/617969546079678464

@stopsatgreen – Cameron Moll “Mastery of creation and composition is
much more important than mastery of tools.” http://aneventapart.com/news/post/mastery-of-creation-is-more-important-than-mastery-of-tools

@stopsatgreen – Andrew Ng “We need to enable a lot
of people to do non- routine, non-repetitive tasks. Teaching innovation and creativity could be one way to get there.” Andrew Ng is a major player in Google and Baidu’s AI. He has major concerns about the eﬀects of automation and AI on employment. http://www.huﬃngtonpost.com/2015/05/13/andrew-ng_n_7267682.html

@stopsatgreen We should welcome the benefits of AI into our
builds.

@stopsatgreen – Cennydd Bowles “AI is becoming a cornerstone of
user experience. This is going to be interesting (read: diﬃcult) for designers.” http://www.cennydd.com/blog/ai-and-future-user-experience

@stopsatgreen visual motion interaction experience service emotion design intelligence

@stopsatgreen – Cennydd Bowles “We’ll have to create frameworks /
scaﬀolds / templates for AIs to deliver output through. These scaﬀolds may be sonic, tactile, and linguistic as well as visual.”

@stopsatgreen Much of The Grid’s featureset is repackaged existing tech.
A lot of what the Grid does is easy (conﬁrm this).

@stopsatgreen Smart Image Cropping.

@stopsatgreen http://thumbor.org

@stopsatgreen Color Thief is good for intelligent colour palettes. http://lokeshdhakar.com/projects/color-thief/

@stopsatgreen Packery or Susy for intelligent layouts. http://susy.oddbird.net http://packery.metaﬁzzy.co

@stopsatgreen We can use AI to provide better services to
our users.

@stopsatgreen Artificial Intelligence is becoming very good, very quickly. Previously
the domain of a few internet giants, now many products and services.

@stopsatgreen Artificial Intelligence is becoming very good, very quickly. Artificial
Intelligence is becoming very available, very quickly. Previously the domain of a few internet giants, now many products and services.

@stopsatgreen Remember Watson?

@stopsatgreen IBM Developer Cloud gives you access to all of
Watson’s capabilities, using Node/Java and a range of RESTFUL APIs. They just brought a whole range into general availability. They want to be the ubiquitous platform of AI, as Windows was to the home PC and Android to mobile. http://www.ibm.com/smarterplanet/us/en/ibmwatson/watson-cloud.html

@stopsatgreen Visual Recognition goes beyond simple face detection, to understand
the content of an image. It’s like the Google tool I showed at the start.

@stopsatgreen Has a bizarre ﬁxation on wrestling.

@stopsatgreen El luchador.

@stopsatgreen The more you train deep learning systems, the better
they get.

@stopsatgreen Google Photos, Flickr, EyeEm all do this.

@stopsatgreen

@stopsatgreen At a certain point your users’ expectations will be
raised. Your dumb photo system will seem outdated.

@stopsatgreen New tool released yesterday: visual insights. Give it a
batch of images, it will ﬁnd common themes.

@stopsatgreen Personality Insights ﬁnd persona characteristics from the content provided
by users. Better targeted promotions. This is the type of information that other sites gather on you. Now you can gather it on your users!

@stopsatgreen Tradeoﬀ Analytics are used to make comparisons, helping users
make better choices between products or objectives.

@stopsatgreen Watson not the only game in town. MS have
Project Oxford, the power behind Cortana. Although you have to know .Net or Android for now. https://www.projectoxford.ai

@stopsatgreen Has visual recognition. This seems to not be quite
as evolved as Watson’s, but also adds ‘racy’ content detection, clever colour extraction, character recognition and intelligent cropping.

@stopsatgreen Project Oxford also has very good Face APIs, able
to detect, recognise, verify, deduce age, ﬁnd similar faces, and so on. I like it because it guessed my age as a few years younger than I really am.

@stopsatgreen MetaMind is a new startup with image and text
tools. https://www.metamind.io/ Also http://www.skymind.io/

@stopsatgreen Image recognition seems to get very good results.

@stopsatgreen Natural language processing is the ‘killer app’ of deep
learning.

@stopsatgreen Natural language understanding to get answers from the content
of your site. Understand what a question is about. Temperature or weather. Conversations which continue asking until all details are gathered.

@stopsatgreen Alchemy API, an IBM acquisition, analyses text for sentiment,
relations, entities… it learns and recommends based on that learning.

@stopsatgreen Pocket and Shutterstock recommendations. Amazon, Netﬂix, Google News, etc,
all use these types of service. 2/3 of Netﬂix views are from recommendations.

@stopsatgreen Natural language coming to Spotlight in El Capitan.

@stopsatgreen The real advantage of AI is in conversation.

@stopsatgreen Machine: hi, this is <name> from helpdesk connect, what
can i help you with today? Human: hi, i forgot my password. can you tell me how i can recover it? Machine: i’ll need to verify who it is at that machine. can we do a hangout? Human: yes Machine: <a hangout ensues> Human: cool, i am good now Google trained the system using old support calls. http://www.wired.com/2015/06/google-made-chatbot-debates-meaning-life/

@stopsatgreen This is about more than chatbots. Chatbots are boring.
IKEA have had Anna since at least 2008.

@stopsatgreen –Kyle Dent “A conversation is a sequence of turns
where each utterance follows from what’s already been said and is relevant to the overall interaction. Dialog systems must maintain a context over several turns.” http://radar.oreilly.com/2015/09/talking-to-the-iot.html

@stopsatgreen Virtual assistants are everybody’s new jam.

@stopsatgreen Amazon Echo is the ﬁrst home manifestation of the
virtual assistant. Siri in Apple TV, Apple Car, Apple Watch etc. Google Voice Search, also in Android, Chrome, Wear, Auto, TV, etc. … in your Windows 10 laptop.

@stopsatgreen https://www.jibo.com/ https://www.kickstarter.com/projects/aiforeveryone/mycroft-an-open-source-artiﬁcial-intelligence-for

@stopsatgreen

@stopsatgreen Conversation doesn’t need to be vocal, but it helps.

@stopsatgreen Making computers talk is easy. Bell labs, 1961

@stopsatgreen In browsers using the Web Speech API, supported in
Chrome, Opera, Safari, Firefox (behind ﬂag) http://www.broken-links.com/2013/09/20/web-speech-api-part-one-speech-synthesis/

@stopsatgreen Just one of many artiﬁcial voice services available. AT&T,
Neospeech. https://www.ivona.com http://developer.att.com/apis/speech http://www.neospeech.com/

@stopsatgreen Making computers listen is easy… now. Bell Labs, 1952.
Could recognise numbers spoken by one person. 1980s Hidden Markov method. Recently deep learning.

@stopsatgreen Since 2012 Google’s voice recognition error rate has dropped
from 26% to 8%. That’s from one word in 4 to one word in 12. This was a few months ago - a recent update is even better. Baidu, ‘China’s Google’, says theirs is 6% - one word in 17.

@stopsatgreen 10% of Baidu search queries are by voice. That’s
approx. 500m per day.

@stopsatgreen Web Speech API. Chrome & Firefox OS (soon). https://developers.google.com/web/updates/2013/01/Voice-Driven-Web-Apps-Introduction-to-the-Web-Speech-API?hl=en

@stopsatgreen Project Oxford native only. Useful in limited cases.

@stopsatgreen ! All need WebRTC or Flash fallback, so forget
Safari/iOS.

@stopsatgreen Making computers understand is hard. But possible. Only recognises
words (string matching), don’t understand intent.

@stopsatgreen https://www.luis.ai

@stopsatgreen https://api.ai

@stopsatgreen https://wit.ai

@stopsatgreen

@stopsatgreen Why natural language is good: train machines, multiple steps,
takes minutes for what can be a quite simple query.

@stopsatgreen Even on the web that’s about 10 clicks, some
typing - nationalrail.co.uk

@stopsatgreen Note that I don’t have to enter dates manually.
Not all options are available, but I can train it to use them. I used Chicago because an unfortunate drawback is that they don’t always recognise British English.

@stopsatgreen This is what powers M. AI & HI. This
is the wave of the future. https://www.facebook.com/Davemarcus/posts/10156070660595195

@stopsatgreen From GUI to CUI. >> http://www.wired.com/2013/03/conversational-user-interface/

@stopsatgreen http://x.ai Also https://claralabs.com/

@stopsatgreen There’s a reason that WhatsApp is valued at $19billion.
Shutterstock via http://www.wired.co.uk/news/archive/2014-02/19/whatsapp-exclusive

@stopsatgreen https://www.chatshopper.com

@stopsatgreen http://www.ericsson.com/res/docs/2015/consumerlab/ericsson-consumerlab-communication-in-the-world-of-apps.pdf

@stopsatgreen http://a16z.com/2015/08/06/wechat-china-mobile-ﬁrst/

@stopsatgreen Conversational UI is an idea whose time has come.
Natural language understanding is now at the point where this is possible.

@stopsatgreen intelligence visual motion interaction experience service emotion design conversation

@stopsatgreen Old problems still apply to  new interaction models.

@stopsatgreen Security is hard. Privacy even harder. Deep learning is
impossible without some kind of human training. Samsung TV. http://www.theguardian.com/technology/2015/feb/27/samsung-voice-recording-smart-tv-breach-privacy-law-campaigners-claim

@stopsatgreen Be transparent. https://history.google.com/history/audio

@stopsatgreen Bollocks. http://www.huﬃngtonpost.com/2015/02/09/my-friend-cayla-hacked_n_6647046.html

@stopsatgreen The ready availability of deep learning happened so quickly
that we barely realised. This is an opportunity.

@stopsatgreen AI is improving rapidly. AI will take some jobs.
AI can’t create like people. AI can make your work better.

@stopsatgreen @stopsatgreen

OK Computer: WXG [and notes]

OK Computer: WXG [and notes]

More Decks by Peter Gasston

Other Decks in Technology

Featured

Transcript