Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Learning AI with Van Gogh, Matta, and Cruz-Diez

Raul Pino
October 02, 2018

Learning AI with Van Gogh, Matta, and Cruz-Diez

Every time somebody mention AI news in the office, you wonder on the glorious future beyond your daily data taming or pipelines monitoring. In this talk you will be introduced to Neural Networks applied to arts, using a paper "A Neural Algorithm of Artistic Style" as a "deep" start.

Presented in Globant DevWeek Santiago 2018 - https://devweekchile.com/
Repo: https://github.com/p1nox/learning_ai_with_art

Raul Pino

October 02, 2018
Tweet

More Decks by Raul Pino

Other Decks in Technology

Transcript

  1. Learning AI with Van Gogh, Matta, and Cruz-Diez by Raul

    Pino Development Week Santiago 2018 1
  2. Who am I? » Born in Venezuela » Living in

    Chile » Elementus » uBiome » Groupon » <3 DS, AI, Coffee, Diving Github/Twitter: @p1nox 3
  3. Agenda » Artificial Intelligence » Machine Learning » Deep Learning

    » Artistic Style » High level implementation » Live example » Related research, Implementations, Takeaways 4
  4. Wait, why Art? "The principles of true art is not

    to portray, but to evoke." - Kosinski. "We all know that Art is not truth. Art is a lie that makes us realize truth, at least the truth that is given us to understand." - Picasso. 5
  5. Artificial intelligence Sub-problems * Reasoning * Knowledge representation * Planning

    * Learning: Machine Learning * Natural language processing * Perception * Motion and manipulation * Social intelligence * General intelligence 6
  6. Machine Learning Data >[ Model ]> Prediction Approaches * Deep

    learning: Artificial Neural Networks - Structured data - Unstructured data 7
  7. Artistic Style A Neural Algorithm of Artistic Style. Leon Gatys,

    Alexander Ecker, Matthias Bethge - 2015 In a Convolutional Neural Network, "Content" is independent from "Style"! 13
  8. Convolutional Neural Network Pre-trained VGG19 model (University of Oxford) »

    14-million images » 1000 categories Identify objects in images checked! 14
  9. Layer Extraction » Content = conv layer 5_2 » Style

    = conv layers 1_1, 2_1, 3_1, 4_1 and 5_1 Mix content and style! iterate cont = get_content(content_img) style = get_style(style_img) cost fn() compare(content_img, get_content(cont)) compare(content_img, get_style(style)) 18
  10. Live Example » Pre-trained VGG19 model » TensorFlow » NumPy

    » SciPy » Docker Repo: learningaiwith_art 19
  11. Related research » Inceptionism: Going Deeper into Neural Networks »

    Using Machine Learning for Identification of Art Paintings » Artistic style transfer for videos » Artistic style transfer for videos and spherical images 20
  12. Takeaways » Adictive & fun! » Imitating first like an

    artist? » Future art simulation/ classification? Beauty, meaning, uniqueness, intention... 22
  13. Sources & Resources » A Neural Algorithm of Artistic Style

    » Deep Learning & Art: Neural Style Transfer » Siraj collection on AI and Art » Painting like Van Gogh with Convolutional Neural Networks » VGG19 - MatConvNet » Vincent: AI Artist 23
  14. Sources & Resources » Deep Learning Course - Coursera »

    Creating art with deep neural networks » Computer algorithm can accurately identify Jackson Pollock paintings » When A Machine Learning Algorithm Studied Fine Art Paintings, It Saw Things Art Historians Had Never Noticed » Is Art Created by AI Really Art? 24
  15. Sources & Resources » Putting the art in artificial intelligence

    » Why AI is a revolution » JWT's 'The Next Rembrandt' Wins Two Grand Prix at Cannes, in Cyber and Creative Data » Delivering real-time AI in the palm of your hand » TensorFlow Implementation of "A Neural Algorithm of Artistic Style" 25
  16. Paintings » Cover 1: » Morphology » Redness of Blue

    » Induction Chromatique » Physichromie 625 » The Starry Night 26
  17. Paintings » Cover 2: » The Study of Vermeer »

    Rubens and His Wife » Induction Chromatique » Physichromie 625 » The Starry Night 27
  18. Paintings » Slide 2: Fisicromía 2250 » Slide 3: Kitchen

    Table » Slide 4: Guernica » Slide 5: Study on the proportions of head and eyes » Slide 6: Flying machine » Slide 11: The Starry Night » Slide 20: The School of Athens 28
  19. Paintings » Slide 21: Blue (Moby Dick) » Slide 22:

    » The Girl with a Pearl Earring » The Study of Vermeer » Menina (After Velazquez) » Las Meninas 29