Taming the Data Beast with Drupal & Open Source Technology!
Data...we love DATA! It's everywhere right, but how to tame it. What is data, how is it changing and how can you manage that with Drupal and other Open Source tools? What other interesting things are other people doing with data too?
do we mean by data? • What challenges are presented by data? WHAT ARE WE GOING TO DISCOVER TODAY? • What open source tools exist for data? • How do we handle data in systems? • How is data handled in the real world? TAMING THE DATA BEAST EXPLOITING DIGITAL 17/07/2015 2
since 2000 • Website, smartphone apps and social media projects for Stella Artois, Eli Lilly and Encyclopedia Britannica WHO IS STANDING BEFORE YOU? flowmoco - web and mobile development studio based in Newquay, Cornwall • Relatively new - formed in 2012 • Relatively small – 13 staff • Relative specialist - Enterprise and Open source TAMING THE DATA BEAST EXPLOITING DIGITAL 17/07/2015 4
• Microdata WHAT DO WE MEAN BY DATA? TAMING THE DATA BEAST EXPLOITING DIGITAL 17/07/2015 11 • Type: • Temporal • Spatial • Personal • Relational • Archive
a cache for quicker access • Reduced setup time • Cost of provision CHALLENGE 2: STORAGE • Cloud storage • Global rights agreements • CDN coverage • Resilience and backup • Cloud services e.g. video encoding, big data processing, TAMING THE DATA BEAST EXPLOITING DIGITAL 17/07/2015 14
future needs? • Responsive images • 4K video • Photospheres CHALLENGE 3: LONGEVITY • Is your data flexible, movable and transferable? • Data guide - structures • Import / export • Cleansing • Fuzzy logic TAMING THE DATA BEAST EXPLOITING DIGITAL 17/07/2015 15
• PUPPET OPEN SOURCE TOOL O.O.O. ! • Can you guess the Odd One Out, which isn’t an open source tool? • Endless amounts • Constantly developed • Community focus TAMING THE DATA BEAST EXPLOITING DIGITAL 17/07/2015 18
further on, modular • Integrations possible with other systems DRUPAL AS A PLATFORM • No vendor lock-in, Drupal open source • Create open APIs for data sharing • Provides web, app and future platforms TAMING THE DATA BEAST EXPLOITING DIGITAL 17/07/2015 19
framework • Flexible, headless, local • 1,000s of modules already exist DRUPAL AS A HAMMER • If there isn’t a module – you can build one! • Represents the combined effort of thousands of developers TAMING THE DATA BEAST EXPLOITING DIGITAL 17/07/2015 20
of Defence think so)! “The continuous and broad peer- review enabled by publicly available source code supports software reliability and security efforts… DRUPAL AS A PADLOCK …through the identification and elimination of defects that might otherwise go unrecognized by a more limited core development team.”! • “Security through obscurity just doesn’t work” TAMING THE DATA BEAST EXPLOITING DIGITAL 17/07/2015 21
visibility • Interact with existing systems and data DATA: VISUALISATIONS • EBRI @ Aston University • Nasa Buzzroom • US Department of Information Security • Vodafone UK HQ TAMING THE DATA BEAST EXPLOITING DIGITAL 17/07/2015 23
data from display • Management, storage and manipulation are key DATA: HEADLESS • US Pharmaceutical iPad app for sales data • US sales tool to control sales demo tool • UK charity funding site, with data integrations TAMING THE DATA BEAST EXPLOITING DIGITAL 17/07/2015 25
• Integrating with APIs and hardware to send / receive data • OS frameworks such as Apache Cordova DATA: MOBILE • Plotting national traneds from beehives equipped with Arduino sensor kits • Skullcandy Headphones, follow the skate tour around the EU TAMING THE DATA BEAST EXPLOITING DIGITAL 17/07/2015 26