Nasdaq data now discoverable on the Databricks Marketplace and accessible via Delta Sharing, we will enable customers to access data in an open way across their tools of choice and accelerate their time.” —Bill Dague Vice President and Head of Data Product at Nasdaq “The Databricks Marketplace simplifies the process of discovering and evaluating external data with pre-built notebooks, without locking us into a single vendor or prolonging procurement cycles. With just a few clicks, we can access the data within our Databricks workspaces. We also look forward to leveraging the notebooks, dashboards, and ML models through the Marketplace to enhance our analytics and AI initiatives.” —Greg Rokita AVP Technology at Edmunds “As the adoption of AI grows, we are excited to partner with Databricks to help customers drive faster time to insights. The marketplace partnership aims to empower businesses with fostering open collaboration, real-time unified access, and driving enhanced analytics and quantitative decision-making capabilities in the financial industry and beyond.” —Stuart Brown Group Head of Enterprise Data Solutions at London Stock Exchange
AI Models with Delta Sharing 企業内、パートナー間でAIモデルをセキュアに管理 21 Public Preview available now クラウド、プラットフォーム、 リージョン横断で容易にAIモデルを 共有 不必要なコピーなしにBUやパートナー横断で シームレスにAIモデルを共有 集中管理のガバナンスやセキュリティのためにネイティブで Unity Catalogと連携 リアルタイム、バッチ推論のために Databricksデータイン テリジェンスプラットフォームを用いて AI機能をデプロイ Demo: AI Model Sharing with Delta Sharing
AI Models on Marketplace オープンマーケットプレースを通じたAIモデルの配布、アクセス 22 Public Preview available now AIの発見、収益化、お使いのデータソ リューションへの組み込み OSS + プロプライエタリのAIモデルへのアクセス そのままモデルを活用、あるいはファインチューン リアルタイム、バッチ推論のために Databricksデータイン テリジェンスプラットフォーム上ですぐに活用 可能 Demo: Installing AI models by John Snow Labs Demo: Installing Foundation Model
Data Link Digital Assets Market needed to support financial institutions with seamless access to their vast data sets for 2K+ crypto-currency pairs across 15 exchanges. Data changes on a microsecond basis across many different data stores, working with copies of data, and needing to operate in real-time. Solution Delta Sharing helped streamline their data delivery process for large datasets. Enabled clients to bring their compute environments to read new, curated data with minimal integration. Databricks Marketplace provides trade listings to help inform cross-exchange opportunities, trade impact, flow and analyses. “With Nasdaq data now discoverable on the Databricks Marketplace and accessible via Delta Sharing, we will enable customers to access data in an open way across their tools of choice and accelerate their time.” —Bill Dague, Vice President and Head of Data Product at Nasdaq Real-time data access, insights Impact Reduce ETL of large datasets from months to minutes Faster insights by bringing datasets across global markets to enable access and discovery
Challenge Anker was hampered by a legacy data warehouse, which required significant DevOps support to integrate relevant services and left little bandwidth for opportunities like granular forecasting or generative AI to accelerate product fit insights. Additionally, data governance was challenging as data engineering and science teams used different tooling, which made it impossible for business users, analysts and data scientists to access the data they needed to make decisions. Solution Once their data was in the Lakehouse, Anker was able to use Delta Sharing to make data available to the data analytics and business teams, and Unity Catalog for governance. Working with Unity Catalog, they were able to give users access for the first time and govern data access at the table level. This made their data easy to share without compromising on governance. Impact 500+ employees were able to collaborate by sharing data easily and securely 200TB+ of data from business, product, marketing and sales sources were unified on the Lakehouse to enable access and accelerate insights
the future Challenge Coastal Community Bank based in WA with 40K customers had a vision to offer BaaS (Banking-as-a-Service) and support more customers through their CCBX partner network. Apart from scaling, they needed to streamline, modernize operations for complex legacy banking infra- structure, processes and provide a better customer experience. Solution Delta Sharing allowed CCB to scale and modernize by connecting data almost instantly with myriad partner network, as well as providing simplified governance. This enabled them to provide personalized financial products, better risk assessment, automated reporting, as well as adherence to regulatory requirements. “With Delta Sharing, we don’t have to move data around anymore. Delta Sharing is so easy as it’s wrapped within the parameters of the platform. No multiple handoffs, or only seeing siloed views.” —Barb MacLean, Head of Technology, Coastal Community Bank Impact 6M+ customers are now supported on partner network, scaling from 40K 10 minutes to start ingesting data from ONE, an emerging fintech startup, a CCB partner
Challenge Mastercard is facing the challenge of providing clients access to its valuable proprietary data sets, as privacy and security constraints impede direct sharing. The company aims to engage in custom, joint analytics with third parties, yet faces a hurdle in the inability to directly share data between the involved parties. Additionally, within Mastercard, different Lines of Business (LOB) are eager to leverage each other's data assets, but existing usage rights present constraints on direct data sharing. Solution Databricks Clean Rooms allow for Mastercard to unlock the value of its data and insights in collaborations with clients, academics and others while maintaining the needed security, privacy and utility of its data assets. Mastercard wants to give clients access to data in a secure clean room environment where clients can run jobs that merge their data with Mastercard’s after running pre-checks and post-checks to validate data quality. Mastercard says clean rooms could unlock 7-figures worth of potential revenue. Impact Data minimization by transferring data into a clean room allows for privacy and legal checks Flexibility Ability to use notebooks for privacy checks at any point– data ingest, analysis and results sharing CONFIDENTIAL - FOR INTERNAL USE ONLY
sharing Challenge YipitData needs to gain visibility into active and inactive datasets, improve performance for BI integrations, and open new channels to deliver data to clients. Solution Datasets are easier to consume for clients using Delta Sharing and BI tools. Our clients can consume our analytics in simpler ways than before while we internally keep the data preparation for those experiences lean, performant, and consistent with open standards. “Unity Catalog and Delta Sharing increased utilization of datasets, and made data accessible to external systems and clients in a thoughtful way” —Anup Segu, Co-Head of Data Engineering at YipitData Impact 70% reduction in cloud infrastructure resources 45% reduction in SQL warehouse cost
solution Challenge Allium needed to build a cost-efficient data storage and sharing solution that met their customers’ needs across financial products, including managed blockchain databases, enriched data schemas, and real-time notification Solution The combination of Delta Sharing with Cloudflare R2 has provided Allium with a cost-effective and secure data sharing solution, taking advantage of zero egress costs since there is no need for complex replications or vendor lock-in. “Combining both Delta Sharing and Cloudflare R2 together allows us to deliver data to our customers reliably and cost-effectively. We deliver the highest quality blockchain data to our customers in their preferred environment, while minimizing our storage and egress costs, saving up to $645K per year.” —Ethan Chan, Co-Founder and CEO of Allium Impact $645K / year savings due to minimizing storage and egress costs 1PB / mo. data transfer monthly in last quarter + growing
AI, apps and solutions in a unified way Open ecosystem for massive reach Privacy-safe collaboration Simplify data, AI, apps and solution sharing and collaboration across the enterprise Powered by: Databricks is a platform for trusted collaboration
increase collaboration - across clouds, platforms or regions This industry-specific eBook is aimed at executive leaders and articulates the value they can achieve with data sharing and collaboration. CDOs promoting data sharing have 3x greater economic performance, as compared to their peers. Learn more about: • Industry-specific use cases • Customer stories and proof points • Partners to help get started with Databricks N EW Accelerate Industry Innovation with Data Sharing Download eBook →
Marketplace! Open marketplace for all your data, analytics, and AI Explore Databricks Marketplace: marketplace.databricks.com Learn more: databricks.com/product/marketplace
Data Provider Partner Program Access the broad, open ecosystem of data consumers with Databricks and monetize data assets all from a single platform. Our partners can leverage the Databricks Lakehouse Platform to: • Reach more customers • Reduce time and costs • Provide a best-in-class customer experience for all their data sharing needs Databricks natively integrates with Delta Sharing and is endorsed by a broad ecosystem of open source and commercial clients and data vendors. Apply at Databricks Partner Program
on Databricks Marketplace Consumers interested in listing can request more information. Contact information is shared with data provider to follow-up on data consumer on desired dataset. • Providers can provide sample data (optional) • Provider can share notebooks and dashboards (optional) Commercials are directly completed between provider and consumer. Databricks is not involved and does not take a fee.
How are you solving sensitive data use cases today? 37 Sign up today → Visit our website → Read our definitive technical guide 37 Download the eBook → Join our private preview Learn more about Databricks Clean Rooms
databricksjapan
tenforward
phaya72
____rina____
keropiyo
yusuke
kioto
rishigami
nishiuma
ufried
tahia910
kimitashoichi
o11yfes2023
jeffersonlam
scottboms
hatefulcrawdad
jlugia
lauravandoore
keathley
speakerdeck
mclloyd
samlambert
zakiwarfel
paulrobertlloyd
searls
