Technologies: Databricks
Topics: Data & AI

Workshop Delta Lake Sharing – Databricks – Nov 4

November 4, 2021 08:15 - 10:15
Online - In person at: Wibautstraat 202, 1091 GS Amsterdam

In May of this year, Databricks released Delta Sharing, an open protocol for the secure exchange of massive datasets. Through the generation of pre-signed, short-lived URLs pointing directly at requested data, and their distribution to authenticated data consumers, Delta Sharing facilitates real-time, platform-agnostic access to an organization’s information. This makes Delta Sharing well-suited as a means to inter-domain dataset distribution in the Data Mesh. Data Mesh is an architectural paradigm that erupted into the public consciousness at around the same time. This code breakfast consists of two parts.

Details

Schedule

8:15 am

Data requests via Delta Sharing

In part one, Kris Geusebroek will introduce you to the details of the Delta Sharing protocol and perform a live demonstration of a data request via the protocol using Apache Spark.
9:15 am

Introduction to Data Mesh

In part two, Robert Rodger will give a brief introduction to the Data Mesh concept and describe the role Delta Sharing can play in it.

Guests

Robert Rodger Data Scientist