240422AI and data society

Transcript

1. IT Promotion Agency Japan AI accelerates the data society. 2024-04-22 Kenji Hiramoto Director General of Digital Infrastructure Center Deputy Executive Director of AI Safety Institute IT Promotion Agency, Japan Executive Officer for International Data Strategy Digital Agency, Japan
2. Japan Director General of Digital Infrastructure Center (DISC), IT Promotion Agency (IPA) Executive Officer for International Data Strategy, Digital Agency Profile  In 2021, I served as Head of Data Strategy and Executive Officer of the Digital Agency, responsible for the National Data Strategy and the Government Interoperability Framework.  In 2023, I became the Director General of DISC, IPA. In 2024, he became the Deputy Executive Director and Secretary General of the Japan AI Safety Institute.  I’m in charge of AI, Data, Software engineering, Digital transformation and innovation.  I began my career at NTT Data in 1990 as a systems engineer.  In 1998, I served at the Ministry of Economy, Trade and Industry (METI). I was in charge of the policy for software R＆D and educational technology.  In 2002, I served at a consulting firm.  In 2008, I returned to the government as Executive Advisor to the Government CIO. In 2012, I became Chief Strategist(IT) in the cabinet secretariat, responsible for digital strategy.
3. Japan Other ministries  IPA Support digital-related government organizations. 3 Overview of Government Organizations Cabinet Office (Science & Technology) Ministry of Economy, Trade and Industry Digital Agency Other ministries IT Promotion Agency National Information Security Center AI Data Space Software Digital Transformation Digital HR Incubation Security Digital and Data Ministries Cabinet level Organizations Government Funded Organizations Other Independent Administration Agencies
4. Japan  Over 550 specialists work in IPA. 4 Overview of IPA IPA Digital Architecture Design Center Digital Infrastructure Center Digital Human resource Development Center Industrial Cyber Security Center of Excellence Information Security Center AI System • Utilization • Safety(Risk management) Data Space • Data space and platform • Interoperability Software Engineering • Software Engineering(including LegalTech) • Data engineering Digital Transformation Human resource Security Staffs:550+ Staffs:100+
5. Japan Trends around the data society 5
6. Japan  Increased image, drawing, sensor, and geospatial data as well as text data. Explosion of data https://www.wevolver.com/article/2023-edge-ai-technology-report https://www.lfedge.org/wp-content/uploads/2020/04/SOTE2020.pdf Edge
7. Japan rule Platform Data rule Platform Data rule Platform Data rule Platform Data rule Platform Data rule Platform Data rule Platform Data rule Platform Data rule Platform Data  Difficult to manage due to large number of stakeholders and rapid pace of change.  We want to realize Japan one team with various organizations working together. 7 Various stakeholders and light speed rule Platform Data rule Platform Data rule Platform Data Cross Industry Cross Border Cross Expertise Supply chain Recycle chain
8. Japan Main topics 8
9. Japan  We aim to realize a digital society by integrating digital and data strategies. 9 Digital and Data Strategy Digital Strategy Data Strategy Digital Strategy Data Strategy 2023 01010100110100101000101 00010100101010010010100 10100101010101001010100 2022 2021
10. 10 The big wave of AI.
11.  We are focusing on AI and data as key elements of the digital society. Digital Strategy & Data Strategy 11 Deregulation Smart city International Cyber security AI Data Web3.0 Digital Strategy(2023-06) Principles 7 Basic Strategies Action Plan for Public & Private Data Supply and Sharing in the AI Era(2023-12) Qualified data Supply Mechanism Data Standards Authorized data Open data Platforms Tools Data governance Organizations
12.  Anyone get and harness data, easily and safety  Anyone can use AI system and maximize the capability of AI systems. Vision for 2030 citizen-centric digital society High value data sets Statistics Realtime sensor data Base registries • Person • Legal entities • Land • Administration data • Traffic • Weather Digital Twin Service providers keep their services, sustainably. Trust & Safety Once only services Citizen can use various services Open data Data from private sectors Platform Anyone get data easily Reduce the duplicate cost Reduce city maintenance cost 12
13. Japan  To make it a sustainable initiative, it is important to build on the foundation. 13 The steps for realizing the data-driven society Findable •Data catalogue •Service catalogue •Platform Usable • Structured data model • Quality management Processable •Machine readable Automatable • Auto-check • RPA（Robotic Process Automation） Analyzable • AI •Big data analysis We are here. Base registries & High value datasets Open data
14. 14 Digital infrastructure center(2023-07) AI Safety Institute(2024-02) Society Industry B2B Organization Artificial Intelligence • Maximize the value of data Data space • Treat data as assets and knowledge. Data sharing • Collaborate across industries and borders Data management • Provide quality data in a sustainable way Digital Transformation
15. Japan Issues  High-quality data  Trustful source  Bias-less data  Log management  Traceable learning data  Intellectual property  Prevention of mis/dis information  Ethics 15 There are many requests from AI team Platform  Data catalog  Data market  Ontology  Data cleansing tool  Data verification tool  Trust-related tool  Log management tool  Trace management tool Findability Quality Trust
16. Japan Our approach to the data lifecycle Design Collect Merge Import Analyze Publish Store API access Abolish 1. Rule 2. Platform 3, Data supply AI Other sources Findable Processable data Qualified and trusted data Various data Compliance info.
17. 17 There are many rules in each countries and organizations.
18. Japan Data related legislation in Japan  Public-Private Data Act  Digital First Act  Digital Society Basic Realize Act  Personal Information Protection Act  Intellectual Property Act  Cyber Security Act  Productivity Enhancement Act  Next generation Healthcare Infrastructure Act  Local government Information System Standardize Act  Soft laws (Guidelines)
19. Japan  Enhance the LegalTech activities • We need repositories of laws and guidelines for findability。 • We need machine-readable laws and regulations. • We need a framework to change laws agile.  Establish Institutional Arrangement for Partnership (IAP) • An international mechanism for operationalizing DFFT 19 New activities
20. Japan  There are many frameworks. We can check the other guidelines easily. 20 Crosswalk is first step of rule IoP ISO-IEC-42001 NIST AI Risk Management Framework(RMF) Reference FDIS23894 OECD/EU/EO13960 Singapore AI Verify BSA Framework AI Taxonomy of trustworthiness for AI Japan AI Guideline for Business(GfB) Working
21. 21 交差点 信号 Efficient, sustainable and safety platform
22. Japan  There are many services and tools. • Already in practical use and spreading  We need inter-platform interoperability in the next stage. • University of Tokyo launched IDSA hub for it. 22 Platform for data sharing EC DG CONNECT Digital building blocks fiware IDSA Gaia-X DSA DATA-EX EC DG INFOMATICS Interoperable Europe EC DG Publications Data.eu DSA IPA Digital Agency Ministry of Economy, Trade and Industry EC Organization in EC Japan
23. 23 ジュースサーバ ガソリンスタンド Data and the quality
24. Japan Policy for the diversity of data  Policy • Cabinet secretariat had already set the basic guideline for open data in 2017. • The Digital Agency is currently in the process of public consultation on the revised guidelines.(Central government->Local government) • The secretariat of Council for Science, Technology and Innovation(CSTI) in the Cabinet office published the action plan to promote the provision of AI learning data in 2023
25. Japan Catalogue for the diversity of data  National Data catalogue(e-Gov Data portal) • The Digital Agency launched a new open data catalogue in 2023. (https://data.e-gov.go.jp/) • It include about 19000 data set.  Local government Data catalogue • BODIK(Big data and Open Data Initiative, Kyusyu) • BODIC provide an open data catalogue services to 300 municipalities • Municipalities can manage open data easily, • Kyoto data marketplace • This is one stop service open data from public sectors and data market from public sectors.
26. Japan  GIF is a part of our National Data Strategy.  We define the GIF architecture.  It especially focus on the Rule, Platform and Data layer. GIF provide rules, tools, data models and technical guidelines. 26 Overview of GIF Trust （DFFT） Data Building blocks for data services Rule Security / Privacy / ID Organization and Human resource Business and Service Building blocks for connection Strategy Asset Data model Platform
27. Japan  GIF is essential infrastructure for data- driven society.  All services, including AI and mobility services, will be based on this infrastructure. 27 Role of GIF Reduction of design cost and time Ease of integration and scalability Improvement of user experience GIF Lower design and operating costs and time because it utilizes a reference model Utilizes a reference model, making it easier to collaborate with other organizations and leverage existing applications Improve the convenience of services by redirecting the design effort to service enhancement one. (Once-Only services) GIF System System Service DATA DATA System DATA DATA DATA Reference model
28. Japan  Data models play an important role in improving data quality.  Using data models to design data and API can make it easier to produce high quality data.  Data models have matured after years of work by various organizations. 28 Reference data model projects EU Joinup Core Voc. &EIF Start point: administration JAPAN GIF data models (Government Interoperability Framework) Start point: administration US NIEM Start point: Safety Private sector Schema.org Start point: Web search Private sector fiware Smart Data Models Start point: Data sharing India IUDX Korea
29. Japan Data Code Character Data （Japanese/English） Core data parts Core vocabulary Numeric data （Sensing data） Core data models Service data model［DM］ Base registry DM Date & Time Address Postal code Geo coding Phone POI code Point of contact Nursing info. Accessibilit y Person Legal entity Facility Equipment Metadata Admen. G. Land G. Legal entity G. Smart city DM (Local service) Moving object Feature Map Disaster rm, DM Support activity Status report Shelter and evacuation site Education DM Contents Student ＆ Stakeholders School Government DM Use case Evidence and Information Application Service catalogue Report and material Event Service and program Service delivery point Activity Address BR Support program BR Business location BR Legal entity BR List of school List of evacuation site List of shelter List of hospital Event BR Public Facility BR List of code Activity Afflicted people ・・・ Others  GIF Data Models and guidebooks support to make structured and high-quality data. 29 Guidebooks and Data models Acquisition Guidebooks GIF Guidebook Character data guidebook Master data design guidebook Code design guidebook API guidebook Data management guidebook Data specialist guidebook Architecture guidebook Data quality guidebook Metadata guidebook Land Building Event Combine blocks to build a data model Image data Geospatial data BR: Base registry
30. Japan  GIF is not standards but reference models. Anyone can enhance or make subset them for their implementation. 30 How to use the data models Before IMI GIF Service data model Title Implementation Subset Enhance Title Title Title Title
31. Japan GIF Data standard for schools Data standard for smart city Data standard for Disaster risk management MS Power Platform International activities Data standard for municipalities Address BR Enterprise BR Open data catalogue GIF DCAT GIF Address GIF Enterprise GIF Core data models Date, Address Use core data parts Facility Use core data models Facility, Object Use Regional service models Facility, Object Use Regional service models GIF core data models Check the interoperability  From core data models to domain models. Expansion of GIF
32.  Data connect to the world, so global interoperability is essential. Data quality and Data governance 32 Data Process Governance • Is the data of sufficient quality? • ISO25012 • Are there any issues with the process? • ISO25024 • Is the data being managed strategically? • ISO8000-61 Usage USER SIDE SUPPLY SIDE Are users making use of the data? Geospatial data Platformer AI IOT • ISO19157 • DSA whitepaper in Japan • Quality Assurance for AI guideline in Japan
33. Japan  Government initiatives are important to improve data quality.  As governments release high-quality data and related tools, society's data will become higher quality. 33 Mechanisms for supplying high quality data Design Collect Merge Import Analyze Publish Store API access Abolish Other sources Data engineering methodology Open data Base registries Data market Validation tools Data fusion tools Data models Ontology Cleansing tools
34. Japan Data in the public sectors High-value Dataset  Base registries are authorized data set by public sectors. 34 Base registries and High-value dataset Base registries (Person, Enterprise, Land, etc.) Basic data in the public sectors Open data policy Data management policy (in GIF)
35.  Identifiers and taxonomies are important for efficient data management. • ID • My number(Personal ID number) • Corporate Number • Real property ID • Address block ID • Code • Point of Interest code • Codes in the statistics • Controlled vocabularies • GIF date models defines codes. ID, Code and controlled vocabularies 35
36. Japan  Geospatial data is essential information for society. • Address base registry • Digital agency have created a database storing town block names from all over Japan. • Land Information database • Ministry of Justice are trying to launch a database of land rights information based on real estate IDs. • Maps • GSI(Geospatial Information Authority of Japan) provide national maps. • Infrastructure • Ministry of Infrastructure, Land and Transportation provide ILT platform. 36 Geospatial data
37. Use case 37
38.  A framework is being established and is being implemented in public service areas. • Healthcare, Education, Disaster risk management and so on 38 Use cases Use case in the education area Government-wide core data standard • Person • Facility • Others Educational data Standard • Student • Parents • School • Others Systems for school • Real data Harnessing AI • Analyze Digital agency & IPA Ministry of Education, sport and culture Municipalities Feedback
39. Japan • IPA view Perspective for future data society 39
40. Japan Global Data Ecosystem 40 Goal: Competitive economy and well-being life （Anyone launch and use digital services, anytime） Certificated traceable data Circular Economy Design Disposal Supply chain Recycle chain Data Space Commerce Cross-domain data space Digital Infrastructure Data Data Space Battery Data Space Building Data Space Robot Data Space ・・・ Data Space Public Services Data Space PJ PF PF PF PF PF PF PF Product, Money Usage PF Rules, Tools and Data model Methodology for governance Human resource Management Security DX Building Blocks DX Rules, Tools and Data model Standards
41. Japan  Data Space connect to Digital Engineering 41 Digital twin include various data CAD Drawing data Digital mockup BIM/CIM Geospatial data Manufacturing Process Production data Trading process Transaction data Legal Software Base registries Open data Modeling Modeling Modeling Modeling Modeling Data space Data supply Modeling Social activities/ Environment Realtime data Society5.0 (Digital Twin) Sensor Object City ASOT Authoritative Source of Truth Data supply Asset Knowledge
42. Japan Need for efforts 42
43. Japan  There is a strong lack of human resources related to data as well as AI. 43 Human resource is a critical factor -50 -25 0 +25 +50 Fraction of current workforce (%) New jobs and lost jobs, 2023-2027 Future of Jobs Report 2023 INSIGHT REPORT MAY 2023 https://www3.weforum.org/docs/WEF_Future_of_Jobs_2023.pdf
44.  We needs training courses and use cases. 44 Human resource Skill standard Courseware Use case Community Talent for digital transformation Talent for Innovation Talent for digital infrastructure
45. 45 Digital transformation Bundling movements to create a solid stream to the data society. Digital engineering Digital twin AI
46. 46 Digital Infrastructure Center Think globally and Think about the future.