Upgrade to Pro — share decks privately, control downloads, hide ads and more …

Autonomous APIs

Sponsored · Your Podcast. Everywhere. Effortlessly. Share. Educate. Inspire. Entertain. You do you. We'll handle the rest. →
Z
July 06, 2017

Autonomous APIs

We need a new approach to our automatic APIs if we are to keep up with the increasing demand for APIs, digital transformation and the tremendous challenge in IoT (and later in AI). This talk, aimed at the IoT digital transformation in logistics, was presented at API Days Logistics and Transformation & OUIShareFest 2017 on 6th of July 2017

Z

July 06, 2017

Transcript

119 slides
  1. GOOD API 50B IOT DEVICES BY 2020 Gartner Says 8.4

    Billion Connected "Things" Will Be in Use in 2017, Up 31 Percent From 2016
  2. GOOD API API LIFECYCLE MARKET SIZE API management market was

    worth around $647 million in 2014 and $726M in 2015 double-digit growth (12.4%).
  3. GOOD API PUBLIC APIS 15 000 Public APIs on Programmable

    Web, 50 000 Public APIs on API Hound HTTP APIs Only
  4. GOOD API PRIVATE APIS It is estimated that there is

    5 to 9 times more private APIs than public APIs.
  5. GOOD API TOTAL NUMBER OF APIS My guess is at

    least 500 000 APIs in 2017, with trends promising double digit YtY growth.
  6. GOOD API INCREASING DEMAND FOR APIS • Global Internet Users

    • Digital Transformation • Ubiquitous computing • Internet of Everything • Decomposition into micro services • Serverless functions • Developer Experience • Quality of Service • Availability • Reliability Drivers Expectations
  7. GOOD API DIGITAL TRANSFORMATION + IOT IN LOGISTICS Self Driving

    Warehousing UAV Tracking & Monitoring Big Data & Management Customer Satisfaction *images on this slide courtesy of DHL
  8. GOOD API APIS ARE GLUING IOT DEVICES, SMARTPHONES, AR GLASSES,

    PARCELS, FLEETS, MANAGEMENT SYSTEMS AND CUSTOMERS TOGETHER. ALL THE WAY FROM A FISHERMAN'S CATCH TO THE BUYER’S TABLE.
  9. GOOD API $1.9T IOT OPPORTUNITY It is estimated that by

    2020, more than 50 billion objects will be connected to the Internet, presenting an immense $1.9 trillion opportunity in logistics.
  10. GOOD API $1.9T IOT OPPORTUNITY However, only a few logistics

    applications with substantial business impact have materialized so far. This is largely due to a shortage of standards in the industry, security concerns, and the fact that recent IoT innovations have mainly been developed for the consumer market. DHL LOGISITICS TREND RADAR
  11. GOOD API MONEY AT STAKE • Increasing number of APIs

    • driven by Digital Transformation • … and by huge number of IoT devices • We have $1.9T at stake • But we miss standards • …and enterprise, industry specific architecture • What do we do?
  12. GOOD API PEOPLE IN M2M COMMUNICATION SERVICE EXPOSES INTERFACE ANOTHER

    HUMAN READS DOCUMENTATION HUMAN WRITES DOCUMENTATION ANOTHER APPLICATION IS PROGRAMMED TO USE THE PARTICULAR INTERFACE HUMANS MEET $ $
  13. GOOD API NO CLIENT REUSE New API 㱺 New client,

    albeit the API is within the same domain Smart Pallet Vendor A Smart Pallet Vendor B
  14. GOOD API HARD TO EVOLVE $ time & money spent

    INTERFACE CHANGED CLIENT FIXED BROKEN CLIENT
  15. GOOD API SYNCHRONICITY INTERFACE ACTUALLY EXPOSED INTERFACE DOCUMENTED INTERFACED USED

    are they the same? are they the same? are they the same?
  16. GOOD API AUTOMATIC APIS • Do exactly as they were

    programmed • Tightly coupled to a particular service • No client reuse • Human intervention needed to bring an application from one service to another or update in response to a changing service • Costly and error-prone API consumption and service maintenance • Difficult to evolve • Developed in isolation, no reuse of existing functionality • Difficult to scale the number of APIs (hire more developers)
  17. GOOD API PEOPLE IN M2M COMMUNICATION SERVICE EXPOSES INTERFACE ANOTHER

    HUMAN READS DOCUMENTATION HUMAN WRITES DOCUMENTATION ANOTHER APPLICATION IS PROGRAMMED TO USE THE PARTICULAR INTERFACE HUMANS MEET $ $
  18. GOOD API PEOPLE IN M2M COMMUNICATION SERVICE EXPOSES INTERFACE PROGRAMMING

    FOR THE INTERFACE $ $ API DISCOVERY Understanding WHAT & HOW
  19. GOOD API PEOPLE IN M2M COMMUNICATION • Definition of the

    domain • Definition of the available data & affordances • Definition of the interface • Programming of the interface Providing Automatic API
  20. GOOD API PEOPLE IN M2M COMMUNICATION • Service Discovery •

    Understanding the domain • Understanding available data & affordances • Understanding the interface • Programming for the interface Consuming Automatic API
  21. GOOD API PEOPLE IN M2M COMMUNICATION • Definition of the

    domain • Definition of the available data & affordances • Definition of the interface • Programming of the interface • Programming of the service Providing Autonomous API
  22. GOOD API PEOPLE IN M2M COMMUNICATION • Service Discovery •

    Understanding the domain • Understanding available data & affordances • Understanding the interface • Programming for the interface • Programming for the domain Consuming Autonomous API
  23. GOOD API AUTONOMOUS API SERVICE EXPOSES UNIFORM INTERFACE & PROFILE

    AND REGISTER ITSELF AT DISCOVERY SERVICE CLIENT IS PROGRAMMED TO USE A VOCABULARY & DISCOVERY SERVICE API DISCOVERY SERVICE
  24. GOOD API AUTONOMOUS API • Understanding shared at the runtime

    • Programming for vocabulary not interface • Autonomous service discovery
  25. GOOD API CONSISTENT INTERFACE • REST architectural style • Query

    Languages (tunneling architectural styles) • Proprietary function libraries (RPC-like architectural styles) • Domain-specific standards
  26. GOOD API REST ARCHITECTURAL STYLE • Great in theory •

    In reality very few follows it making the interfaces incompatible • Workarounds possible via explicit standards & governance e.g. Oracle+Apiary API Style Guide
  27. GOOD API SIMILAR TO MICROSERVICES DISCOVERY (NETFLIX EUREKA) BUT WITH

    DISCOVERY BASED ON REQUESTED DATA AND FUNCTIONALITY
  28. GOOD API NON-PROGRAMMATIC REGISTRIES • HitchHQ • Programmable Web •

    Rapid API • APIHound Good for humans to discover APIs but not useful for Autonomous APIs
  29. GOOD API PROGRAMMING FOR INTERFACE // Find Avatar movie -

    tight coupling with particular API URI layout movie = GET /movies?title=Avatar // Retrieve its director - tight coupling with expected JSON data structure director = movie.director // Retrieve all movies with the same director - another tight coupling with particular API URI layout GET /movies?director=$director These points prevents service interface change, use of another service, and data structure change.
  30. GOOD API NOTE: IT WOULD BE POSSIBLE TO DECLARATIVELY PROGRAM

    FOR DOMAIN WITH REST API IF ALL ITS CONSTRAINTS ARE FOLLOWED
  31. GOOD API NEW BUSINESS MODELS Use service registry to find

    the best 3PL fulfillment service ServiceRegistry.find(gs1:Offer, { service: gs1:3PLFullfilmentService, terms: { origin: gs1:Place destination: gs1:Place quantity: … } }) Different 3PL providers will register at service discovery based on their availability. Digital Marketplace for Services
  32. GOOD API 4 PILLARS OF AUTONOMOUS APIS Domain Vocabulary Uniform

    Interface Service Discovery Programming for Domain AUTONOMOUS API Client Service used used implemented registers followed uses uses
  33. GOOD API RELIABILITY & QUALITY • No need for documentation

    an its interpretation • Everything is always in sync • No misunderstanding • No room for error • Thanks to discovery faulty services can be automatically replaced by healthy ones
  34. GOOD API COST REDUCTION, ADAPTABILITY • Clients can be reused

    with different services without the need for reprogramming • Clients can adapt benefit of functionality that wasn’t previously available • Existing functionality can be discovered reducing the risk of re-implementing existing services • Fewer people needed reduces the cost of human resources
  35. GOOD API AVAILABILITY, TIME TO MARKET • Faster time to

    market thanks to reuse & higher level of abstraction when writing clients (lower complexity = easier programming) • Easier scaling in the number of APIs as fewer people are required
  36. GOOD API THE SUCCESS OF IOT The success of IoT

    in the logistics industry lies in the convergence between the parts of the supply chain. The different horizontals and verticals must be made interoperable.
  37. GOOD API THE CONCEPT OF AUTONOMOUS APIS IS THE FACILITATOR

    OF THE MACHINE TO MACHINE NETWORKING IN ANY DOMAIN
  38. GOOD API AUTONOMOUS APIS ALLOWS FOR SEAMLESS, EFFECTIVE, AND SCALEABLE

    INTEROPERABILITY IN HETEROGENEOUS ENVIRONMENTS
  39. GOOD API AS SUCH AUTONOMOUS APIS HAVE THE POTENTIAL TO

    BE THE ENABLING ARCHITECTURE FOR THE SUCCESS OF IOT IN LOGISTICS
  40. GOOD API WITH $1.9 T AT STAKE DEFINING DOMAIN VOCABULARY,

    SETTLING ON UNIFORM INTERFACE AND BUILDING SERVICE DISCOVERY IS A SMALL PRICE TO PAY FOR ACHIEVING INTEROPERABILITY
  41. GOOD API SOURCES & REFERENCES • http://goodapi.co • https://apiary.io •

    www.kpcb.com/internet-trends • heidicohen.com/2014-mobile-data-reach-audience-mobile • www.marketsandmarkets.com/PressReleases/digital-transformation.asp • https://www.slideshare.net/duvalunionconsulting/digital-transformation-42259397 • www.gartner.com/newsroom/id/3598917 • https://iot-analytics.com/iot-market-forecasts-overview • nordicapis.com/tracking-the-growth-of-the-api-economy • www.dhl.com/en/about_us/logistics_insights/dhl_trend_research/trendradar.htm • www.dhl.com/en/about_us/logistics_insights/dhl_trend_research/internet_of_things.html • https://www.palletech.co/why.html • https://azure.microsoft.com/en-us/services/iot-hub/ • https://aws.amazon.com/iot-platform/ • https://www.gs1.org/voc • https://grakn.ai • http://graphql.org • https://www.w3.org/TR/rdf-sparql-query/ • https://stdlib.com • https://algorithmia.com • https://evansdata.com/reports/viewRelease.php?reportID=9 • http://deira.ai
  42. GOOD API NUMBER OF DEVELOPERS There is about 21M developers

    worldwide including hobbyists. 12M of them are mobile developers (therefore API consumers). There is 4.4M developers in U.S. alone.

More Decks by Z

Other Decks in Programming