KNVB Data Expo 2024

Transcript

1. ONS VOETBAL KLEURT DE WERELD ORANJE KNVB
2. KNVB MAARTEN SCHUIT, TECHLEAD Data afficionado Really bad at football 2
3. KNVB 1st half: Selecting technology How your organization affects the selection of technology 2nd half: Change through technology How technology can affect your organization IN TODAY’S MATCH 3
4. KNVB 4 ORGANIZATION DATA Goal: Commercial Data maturity: Medium Income stream: Variable Data complexity: Medium
5. KNVB 5 ORGANIZATION DATA Goal: Commercial Data maturity: High Income stream: Constant Data complexity: High
6. KNVB 6 ORGANIZATION DATA Goal: Commercial Data maturity: Very High Income stream: Constant Data complexity: High
7. KNVB 7 ORGANIZATION DATA Goal: Commercial Data maturity: High Income stream: Constant Data complexity: High
8. KNVB The KNVB is the Royal Dutch Football Association The KNVB has the goal of maintaining and improving all aspects of football in The Netherlands. OVERVIEW KNVB 8 Organisation Goal Data maturity Data complexity Income stream IHC Merwede commercial medium low variable Spil Games commercial high high constant De Bijenkorf commercial very high high constant Navan commercial high high constant KNVB social medium medium variable
9. 9 STRATEGY 2022 – 2026 WINNING A MAJOR TOURNAMENT ATTRACTING MORE FANS AND SUPPORTERS VISIBLE IMPACT ON SOCIETY FUTURE-PROOF AMATEUR CLUBS GROWING THE NUMBER OF PLAYERS A HIGHER LEVEL OF PROFESSIONAL FOOTBALL
10. CONWAY’S LAW [O]rganizations which design systems (in the broad sense used here) are constrained to produce designs which are copies of the communication structures of these organizations. - www.wikipedia.org
11. PERFORMANCE TEAM DATA INTELLIGENCE TEAM ETL & INFRA BUSINESS LOGIC REPORTING, ANALITICS SUPPLIER 2 SUPPLIER 1 SUPPLIER 7 SUPPLIER 6 SUPPLIER 5 SUPPLIER 5 SUPPLIER 4 SUPPLIER 3 EXTERNAL COLLABORATORS
12. KNVB PLATFORM FEATURES 1 2 Central intake & storage Machine learning Central definitions User friendly Analytics Secure
13. PERFORMANCE TEAM DATA INTELLIGENCE TEAM ETL & INFRA BUSINESS LOGIC REPORTING, ANALITICS REACHING GOALS WITH CO-OPERATION CENTRALIZED DEFINITIONS DATA PLATFORM (TEAM) DATA WAREHOUSE EXTERNAL COLLABORATORS (EXTERNAL) CONSUMERS EXTERNAL SUPPORT
14. KNVB KNOCKOUT CRITERIA 1 4 Functionality Availability Reliability Observability Security
15. KNVB DECISION CRITERIA 1 5 Longevity Ease of use Replacebility Cost
16. KNVB EXAMPLE OF THE DESISCION OPTIONS 1 6 Chosen solution: Dagster Azure Airflow Dagster Longevity Very Good Good Replaceability Good Good Ease of use Average Very Good Cost Average Very Good
17. KNVB 1 7 DATA PLATFORM TOOLING SELECTION Extraction Transformation Load / Ingestion Production Consumption Governance Loading Scheduling Terraform: User & access management Github Version Control Code quality management Codespaces: Uniform development environment Confluence & Jira: Documentation AI (TBD)
18. KNVB 1 8 EXAMPLE DAGSTER • Selected for control, ease of use and maintainability data supplier data lake database dbt dwh dbt export db external consumer
19. KNVB  ETL Automation: −removed 97% of manual actions −Reduced the ETL throughput time by 60% −Reduced latency by 99% for critical data flows  Central storage & cloud computing −Real-time marketing targetting (EK fanzone in Leipzig) TECHNICAL RESULTS SO FAR 1 9
20. Inversing Conway’s law CHANGE THROUGH TECHNOLOGY
21. KNVB CENTRAL VENDOR INTEGRATION STANDARDS AND PROCESSES 2 1 Technology: Central data ingestion Change enabled: Data integration standard Value created: Better ETL integration (observability, freshness) Value created: More use of supplied data Change enabled: Organization information request process Value created: Business user has easy access to new systems
22. KNVB CENTRAL DEVELOPMENT PLATFORM 2 2 Technology: Central development platform Change enabled: External collaborators on KNVB platform Value created: Smaller projects Value created: Reduction in external systems Value created: Continuity improvement after project completion
23. KNVB CENTRALIZED DEFINITIONS 2 3 Technology: Central definitions Change enabled: (Data) governance Value created: (data) vendor agreements Change enabled: Domain ownership Value created: KNVB wide analytics Value created: Data access observability and control
24. KNVB CENTRALISED DATA 2 4 Technology: Central data content Change enabled: Data sharing Value created: External consumers have ready to use data Change enabled: (National) data set Value created: More support for prof. & amateur clubs Value created: Data marketplace
25. KNVB SUMMARY 2 5  Organizational nature and data needs should drive technology selection  The technology you build can be a force for change
26. KNVB THE END 2 6