OK Computer [FOWA, with notes]

OK Computer FOWA, 07/10/15

Peter Gasston C.T. at +rehabstudio @stopsatgreen broken-links.com

@stopsatgreen ASCI Red. Intel’s last supercomputer. £43 million (today). Could
process 1.8 teraﬂops. 1,800,000,000,000. Retired in 2000.

@stopsatgreen PS3. Launched in 2005. 1.8 teraﬂops. £425.

@stopsatgreen In 2012, Google used 16,000 connected processors to teach
a computer how to detect a cat in a photo. >> Jim Wilson, NYT.

@stopsatgreen In 2015, it recognises this as “man using his
laptop while his cat looks at the screen”. 5% error rate. https://twitter.com/timClicks/status/619734363362557953

@stopsatgreen IBM Watson. Built to beat human contestant at Jeopardy.
10 years of development. Hard to get costs, but at least £12 million.

@stopsatgreen In 2011, beat human contestant at Jeopardy. By 3x.

@stopsatgreen Cognitoys Dino. £80. Powered by Watson. https://cognitoys.com/

@stopsatgreen Artificial Intelligence is becoming very good, very quickly. Lots
of diﬀerent strands to AI, but the revolution has been in deep learning.

How deep learning works Input Input Output Classiﬁcation Artiﬁcial neural
network. Data is passed through layers; each layer does a job, then passes the result up to the next layer.

How deep learning works Layers can perform pattern analysis or
classiﬁcation. Can give quick rough answer, slower perfect answer. Even this is simpliﬁed; can pass 25 layers in smartest systems.

@stopsatgreen Computer scientists in Germany have used this to understand
the content of an image and the painting styles of old masters.  >> http://arxiv.org/abs/1508.06576 https://github.com/jcjohnson/neural-style

@stopsatgreen B. Turner, C. Van Gogh, D. Munch Not just
adding a ﬁlter; it understands the areas of diﬀerentiation (sky, buildings, water).

@stopsatgreen Now A.I. is coming for your job.

Is your job at risk? Abstractions People Pictures Words Numbers
Routine Variety You’re alright Get nervous Bye Bye >> http://blogs.gartner.com/martin-kihn/how-to-know-if-a-robot-will-take-your-marketing-job/

@stopsatgreen “web design & dev pro” >> http://www.bbc.co.uk/news/technology-34066941

@stopsatgreen One in five of us  could be out of
work. Not saying we’ll all be laid oﬀ, but increased eﬃciency will shrink the job pool.

@stopsatgreen https://dwnld.me/

@stopsatgreen http://www.appmachine.com/instant/

@stopsatgreen https://thegrid.io/

@stopsatgreen ‘That will just make identikit websites’. Well, people made
these. Looks like it could be easily automated.

@stopsatgreen –Travis Gertz “The work we produce is repeatable and
predictable. It panders to a common denominator. We build buckets and templates to hold every kind of content, then move on to the next component of the system. Digital design is a human assembly line.” Travis Gertz, ‘Design Machines’ >> https://louderthanten.com/articles/story/design-machines

Is your job at risk? Abstractions People Pictures Words Numbers
Routine Variety You’re alright Get nervous Bye Bye A human assembly line…

@stopsatgreen Developers might be feeling a bit smug, but they
really shouldn’t be. Hone lets designers change apps without writing code. https://hone.tools/

@stopsatgreen – Wired “[muScalpel] successfully transplanted a video coding format
from one media player to another. It took the automated system 26 hours to complete the transplant, while VLC's manual addition of the code happened over a period of 20 days.” Automated system to take code from one base and move it to another. Currently C only, but could work in any language. http://www.wired.co.uk/news/archive/2015-07/30/code-organ-transplant-software-myscalpel

@stopsatgreen – MIT news “Helium is a system that revamps
and ﬁne- tunes code without ever needing the original source, in a matter of hours or even minutes.” Performance increases between 75% and 500% in tests. http://news.mit.edu/2015/computer-program-ﬁxes-old-code-faster-than-expert-engineers-0609 The developers are probably feeling less smug now.

@stopsatgreen AI can’t do our jobs, but it can do
bits of our jobs. We become more eﬃcient, can do more, fewer staﬀ needed. 20% of jobs lost, probably starting with the junior ones.

@stopsatgreen The future of web apps  is partly automated.

@stopsatgreen – Travis Gertz “While we’ve been streamlining our processes
and perfecting our machine-like assembly techniques, others have been watching closely and assembling their own machines. We’ve designed ourselves right into an environment ripe for automation.” All of the workﬂow tools we’ve built make our jobs automatable. These quotes are from a fairly mandatory article, ‘Design Machines’ by Travis Gertz. But the best thing about the article is that he also suggests a solution to the problem:

@stopsatgreen

@stopsatgreen Deepdream is Google’s tool for visualising neural networks. >>
https://twitter.com/brendandawes/status/617969546079678464

@stopsatgreen Turing vs Lovelace. Creativity should be the benchmark of
humanlike intelligence. Lovelace Test: artiﬁcial agent must produce an original program (music, poem, etc) that it was not engineered to produce. Must be reproducible, and unexplainable. http://www.slate.com/articles/health_and_science/new_scientist/2014/12/lovelace_test_of_artiﬁcial_intelligence_creativity_better_than_the_turing.html

@stopsatgreen – Cameron Moll “Mastery of creation and composition is
much more important than mastery of tools.” http://aneventapart.com/news/post/mastery-of-creation-is-more-important-than-mastery-of-tools

@stopsatgreen – Andrew Ng “We need to enable a lot
of people to do non- routine, non-repetitive tasks.  Teaching innovation and creativity could be one way to get there.” Andrew Ng is a major player in Google and Baidu’s AI. He has major concerns about the eﬀects of automation and AI on employment. http://www.huﬃngtonpost.com/2015/05/13/andrew-ng_n_7267682.html

@stopsatgreen We should use A.I. to our own benefit.

@stopsatgreen You can do what The Grid does. It’s all
existing tech. Smart, rather than intelligent.

@stopsatgreen Smart Image Cropping. http://thumbor.org

@stopsatgreen Color Thief is good for intelligent colour palettes. http://lokeshdhakar.com/projects/color-thief/

@stopsatgreen http://gridstylesheets.org/

@stopsatgreen We can use A.I. to provide better services to
our users.

@stopsatgreen – Cennydd Bowles “AI is becoming a cornerstone of
user experience. This is going to be interesting (read: diﬃcult) for designers.” http://www.cennydd.com/blog/ai-and-future-user-experience

@stopsatgreen visual motion interaction experience service emotion design intelligence

@stopsatgreen – Cennydd Bowles “We’ll have to create frameworks /
scaﬀolds / templates for AIs to deliver output through. These scaﬀolds may be sonic, tactile, and linguistic as well as visual.”

@stopsatgreen Artificial Intelligence is becoming very good, very quickly. Artificial
Intelligence is becoming very available, very quickly. Previously the domain of a few internet giants, now many products and services.

@stopsatgreen Remember Watson?

@stopsatgreen IBM Developer Cloud gives you access to all of
Watson’s capabilities, using Node/Java and a range of RESTFUL APIs. They just brought a whole range into general availability. They want to be the ubiquitous platform of AI, as Windows was to the home PC and Android to mobile. http://www.ibm.com/smarterplanet/us/en/ibmwatson/developercloud/

Watson tech stack BLUEMIX WATSON NODE.JS WWW Bluemix is a
cloud platform like Amazon Web Services, Google Cloud Platform, or Microsoft Azure.

@stopsatgreen Visual Recognition goes beyond simple face detection, to understand
the content of an image. It’s like the Google tool I showed at the start.

@stopsatgreen Has a bizarre ﬁxation on wrestling.

@stopsatgreen … unless it’s seen this picture. But I don’t
show this picture to anyone.

@stopsatgreen The more you train deep learning systems, the better
they get.

@stopsatgreen Google Photos, Flickr, EyeEm all do this.

@stopsatgreen

@stopsatgreen At a certain point your users’ expectations will be
raised. Your dumb photo system will seem outdated.

@stopsatgreen Visual insights. Give it a batch of images, it
will ﬁnd common themes.

@stopsatgreen Personality Insights ﬁnd persona characteristics from the content provided
by users. Better targeted promotions. This is the type of information that other sites gather on you. Now you can gather it on your users!

@stopsatgreen Tradeoﬀ Analytics are used to make comparisons, helping users
make better choices between products or objectives.

@stopsatgreen Watson not the only game in town. MS have
Project Oxford, the power behind Cortana. Although you have to know .Net or Android for now. https://www.projectoxford.ai/

@stopsatgreen Has visual recognition. This seems to not be quite
as evolved as Watson’s, but also adds ‘racy’ content detection, clever colour extraction, character recognition and intelligent cropping.

@stopsatgreen Project Oxford also has very good Face APIs, able
to detect, recognise, verify, deduce age, ﬁnd similar faces, and so on. I like it because it guessed my age as a few years younger than I really am.

@stopsatgreen https://www.metamind.io/ is a new startup with image and text
tools. Also http://www.skymind.io/ for Enterprise.

@stopsatgreen MetaMind image recognition seems to get very good results.

@stopsatgreen The ‘killer app’ of A.I. is natural language understanding.

@stopsatgreen

@stopsatgreen Natural language understanding to get answers from the content
of your site. Understand what a question is about. Temperature or weather.

@stopsatgreen Pocket and Shutterstock recommendations. Amazon, Netﬂix, Google News, etc,
all use these types of service. 2/3 of Netﬂix views are from recommendations.

@stopsatgreen Alchemy API, an IBM acquisition, analyses text for sentiment,
relations, entities… it learns and recommends based on that learning. http://www.alchemyapi.com/

@stopsatgreen A.I. excels at conversation.

@stopsatgreen This is about more than chatbots. Chatbots are boring.
IKEA have had Anna since at least 2008.

@stopsatgreen Machine: hi, this is <name> from helpdesk connect, what
can i help you with today? Human: hi, i forgot my password. can you tell me how i can recover it? Machine: i’ll need to verify who it is at that machine. can we do a hangout? Human: yes Machine: <a hangout ensues> Human: cool, i am good now Google trained the system using old support calls. http://www.wired.com/2015/06/google-made-chatbot-debates-meaning-life/

@stopsatgreen –Kyle Dent “A conversation is a sequence of turns
where each utterance follows from what’s already been said and is relevant to the overall interaction. Dialog systems must maintain a context over several turns.” http://radar.oreilly.com/2015/09/talking-to-the-iot.html

@stopsatgreen Virtual assistants are everybody’s new jam.

@stopsatgreen Amazon Echo is the ﬁrst home manifestation of the
virtual assistant. Siri in Apple TV, Apple Car, Apple Watch etc. Google Voice Search, also in Android, Chrome, Wear, Auto, TV, etc. … in your Windows 10 laptop.

@stopsatgreen https://www.jibo.com/ https://mycroft.ai/

@stopsatgreen

@stopsatgreen Conversation doesn’t need to be vocal, but it helps.

@stopsatgreen Making computers talk is easy. Bell labs, 1961

@stopsatgreen In browsers using the Web Speech API, supported in
Chrome, Opera, Safari, Firefox (behind ﬂag)

@stopsatgreen https://www.ivona.com/ just one of many artiﬁcial voice services available.
Also http://developer.att.com/apis/speech and http://neospeech.com/

@stopsatgreen Making computers listen is easy… now. Bell Labs, 1952.
Could recognise numbers spoken by one person. 1980s Hidden Markov method. Recently deep learning.

@stopsatgreen Since 2012 Google’s voice recognition error rate has dropped
from 26% to 8%. That’s from one word in 4 to one word in 12. This was a few months ago - a recent update is even better. Baidu, ‘China’s Google’, says theirs is 6% - one word in 17.

@stopsatgreen 10% of Baidu search queries are by voice. That’s
approx. 500m per day.

@stopsatgreen Web Speech API. Chrome & Firefox OS (soon).

@stopsatgreen Project Oxford native only. Useful in limited cases.

@stopsatgreen ! All need WebRTC or Flash fallback, so forget
Safari/iOS.

@stopsatgreen Making computers understand is hard. But possible. Only recognises
words (string matching), don’t understand intent.

@stopsatgreen https://www.luis.ai/

@stopsatgreen https://www.houndify.com/

@stopsatgreen https://api.ai/

@stopsatgreen https://wit.ai/

@stopsatgreen

@stopsatgreen Why natural language is good. Train machines, multiple steps,
takes minutes for what can be a quite simple query.

@stopsatgreen Even on the web that’s about 10 clicks, some
typing - nationalrail.co.uk

@stopsatgreen Note that I don’t have to enter dates manually.
Not all options are available, but I can train it to use them. I used Chicago because an unfortunate drawback is that they don’t always recognise British English.

@stopsatgreen This is what powers M. AI & HI. This
is the wave of the future. https://www.facebook.com/Davemarcus/posts/10156070660595195

@stopsatgreen (A) Future of Web Apps:  From GUI to CUI.
>> http://www.wired.com/2013/03/conversational-user-interface/

@stopsatgreen https://x.ai/ Also https://claralabs.com/

@stopsatgreen There’s a reason that WhatsApp is valued at $19billion.
Image: Shutterstock via http://www.wired.co.uk/news/archive/2014-02/19/whatsapp-exclusive

@stopsatgreen http://www.ericsson.com/res/docs/2015/consumerlab/ericsson-consumerlab-communication-in-the-world-of-apps.pdf

@stopsatgreen http://techcrunch.com/2015/09/29/forget-apps-now-the-bots-take-over/

@stopsatgreen https://www.chatshopper.com https://digit.co/

@stopsatgreen http://a16z.com/2015/08/06/wechat-china-mobile-ﬁrst/

@stopsatgreen Conversational UI is an idea whose time has come.
Natural language understanding is now at the point where this is possible.

@stopsatgreen https://reinfer.io/

@stopsatgreen Conversations which continue asking until all details are gathered.

@stopsatgreen intelligence visual motion interaction experience service emotion design conversation

@stopsatgreen Old problems still apply to  new interaction models. Re:
Jenn Riggins’ talk, The Good, The Bad & The Ugly.

@stopsatgreen Security is hard. Privacy even harder. Deep learning is
impossible without some kind of human training. Samsung TV.

@stopsatgreen Hello Barbie. http://www.nytimes.com/2015/09/20/magazine/barbie-wants-to-get-to-know-your-child.html

@stopsatgreen Be transparent. Especially because this stuﬀ’s going to go
in front of new markets.

@stopsatgreen Bollocks. http://www.huﬃngtonpost.com/2015/02/09/my-friend-cayla-hacked_n_6647046.html

@stopsatgreen The ready availability of deep learning happened so quickly
that we barely realised. This is an opportunity.

@stopsatgreen A.I. is improving rapidly. A.I. will take some jobs.
A.I. can’t create like people. A.I. can improve your work.

@stopsatgreen @stopsatgreen

OK Computer [FOWA, with notes]

OK Computer [FOWA, with notes]

More Decks by Peter Gasston

Other Decks in Technology

Featured

Transcript