Preview Delta Lake with Apache Spark using Scala

Back

Introduction

Course Introduction

Introduction to Delta Lake

Introduction to Data Lake

Key Features of Delta Lake

Elements of Delta Lake

Introduction to Spark

(Old) Free Account creation in Databricks

(New) Free Account creation in Databricks

Provisioning a Spark Cluster

Basics about notebooks

Dataframes

(Hands On) Create a Delta table

Download Data for the Course

Download Source Code for the Course

(Hands On) Write into a Delta table

(Hands On) Read a table

Schema Validation

(Hands On) Update table schema

Table Metadata

Delete from a table

Update a Table

Vacuum

History

Concurrency Control

Optimistic concurrency control

Migrate Workloads to Delta Lake

Optimize Performance with File Management

Auto Optimize

Optimize Performance with Caching

Delta and Apache Spark caching

Cache a subset of the data

Isolation Levels

Best Practices

FAQ (Interview Question on Optimization) 1

FAQ (Interview Question on Optimization) 2

FAQ (Interview Question on Optimization) 3

FAQ (Interview Question on Auto Optimize) 4

FAQ (Interview Question on Auto Optimize) 5

FAQ (Interview Question) 6

FAQ (Interview Question) 7

FAQ (Interview Question) 8

FAQ (Interview Question) 9

FAQ (Interview Question) 10

FAQ (Interview Question) 11

FAQ (Interview Question) 12

FAQ13

FAQ14

FAQ15

FAQ16

FAQ17

FAQ18

FAQ19

Preview - Delta Lake with Apache Spark using Scala