Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Learning AI with Van Gogh, Solar, and Cruz-Diez

Raul Pino
September 13, 2018

Learning AI with Van Gogh, Solar, and Cruz-Diez

Every time somebody mention AI news in the office, you wonder on the glorious future beyond your daily data taming or pipelines monitoring. In this talk you will be introduced to Neural Networks applied to arts, using a paper "A Neural Algorithm of Artistic Style" as a "deep" start.

Presented in SciTech La Plata 2018 - http://www.scitechmeetup.com
Repo: https://github.com/p1nox/learning_ai_with_art

Raul Pino

September 13, 2018
Tweet

More Decks by Raul Pino

Other Decks in Technology

Transcript

  1. Who am I? » Born in Venezuela » Living in

    Chile » Elementus » uBiome » Groupon » <3 DS, AI, Coffee, Diving Github/Twitter: @p1nox 4
  2. Agenda » Artificial Intelligence » Machine Learning » Deep Learning

    » Artistic Style » High level implementation » Live example » Related research, Implementations, Takeaways 5
  3. Wait, why Art? "The principles of true art is not

    to portray, but to evoke." - Kosinski. "We all know that Art is not truth. Art is a lie that makes us realize truth, at least the truth that is given us to understand." - Picasso. 6
  4. Artificial intelligence Sub-problems * Reasoning * Knowledge representation * Planning

    * Learning: Machine Learning * Natural language processing * Perception * Motion and manipulation * Social intelligence * General intelligence 7
  5. Machine Learning Data >[ Model ]> Prediction Approaches * Deep

    learning: Artificial Neural Networks - Structured data - Unstructured data 8
  6. Artistic Style A Neural Algorithm of Artistic Style. Leon Gatys,

    Alexander Ecker, Matthias Bethge - 2015 In a Convolutional Neural Network, "Content" is independent from "Style"! 14
  7. Convolutional Neural Network Pre-trained VGG19 model (University of Oxford) »

    14-million images » 1000 categories Identify objects in images checked! 15
  8. Layer Extraction » Content = conv layer 5_2 » Style

    = conv layers 1_1, 2_1, 3_1, 4_1 and 5_1 Mix content and style! iterate cont = get_content(content_img) style = get_style(style_img) cost fn() compare(content_img, get_content(cont)) compare(content_img, get_style(style)) 19
  9. Live Example » Pre-trained VGG19 model » TensorFlow » NumPy

    » SciPy » Docker Repo: learningaiwith_art 20
  10. Related research » Inceptionism: Going Deeper into Neural Networks »

    Using Machine Learning for Identification of Art Paintings » Artistic style transfer for videos » Artistic style transfer for videos and spherical images 21
  11. Takeaways » Adictive & fun! » Imitating first like an

    artist? » Future art simulation/ classification? Beauty, meaning, uniqueness, intention... 23
  12. Sources & Resources » A Neural Algorithm of Artistic Style

    » Deep Learning & Art: Neural Style Transfer » Siraj collection on AI and Art » Painting like Van Gogh with Convolutional Neural Networks » VGG19 - MatConvNet » Vincent: AI Artist 24
  13. Sources & Resources » Deep Learning Course - Coursera »

    Creating art with deep neural networks » Computer algorithm can accurately identify Jackson Pollock paintings » When A Machine Learning Algorithm Studied Fine Art Paintings, It Saw Things Art Historians Had Never Noticed » Is Art Created by AI Really Art? 25
  14. Sources & Resources » Putting the art in artificial intelligence

    » Why AI is a revolution » JWT's 'The Next Rembrandt' Wins Two Grand Prix at Cannes, in Cyber and Creative Data » Delivering real-time AI in the palm of your hand » TensorFlow Implementation of "A Neural Algorithm of Artistic Style" 26
  15. Paintings » Cover 1: » Pegaso de Sol » Ciudá

    lagui » Induction Chromatique » Physichromie 625 » The Starry Night 27
  16. Paintings » Cover 2: » Red Vision » Cariatide délivrée

    » Induction Chromatique » Physichromie 625 » The Starry Night 28
  17. Paintings » Cover 3: » The Study of Vermeer »

    Rubens and His Wife » Induction Chromatique » Physichromie 625 » The Starry Night 29
  18. Paintings » Slide 2: Fisicromía 2250 » Slide 3: Kitchen

    Table » Slide 4: Guernica » Slide 5: Study on the proportions of head and eyes » Slide 6: Flying machine » Slide 11: The Starry Night » Slide 20: The School of Athens 30
  19. Paintings » Slide 21: Blue (Moby Dick) » Slide 22:

    » The Girl with a Pearl Earring » The Study of Vermeer » Menina (After Velazquez) » Las Meninas 31