Skip to Content

The Data Engineering

Logo image courtesy of pojok d - Flaticon: href="https://www.flaticon.com/free-icons/technology" title="technology icons" Technology icons created by pojok d - Flaticon

About Foundational Knowledge Data Ingestion Data Modeling & Storage Data Transformation Data Orchestration Data Quality & Governance Data Operations Data Visualization & Reporting Learning Paths Interview Preparation

About
- Foundational Knowledge
- Core Concepts
- Programming Essentials
- Programming Essentials
- Systems & Infrastructure
- - Command Line Interface (CLI)
  - Linux Fundamentals
- - HTTP and TCP/IP
  - IP Addressing, DNS, Ports
- - IaaS, PaaS, SaaS Models
  - Major Cloud Providers Overview (AWS, Azure, GCP)
- - Docker Concepts
  - Dockerfiles and Images
- - Virtual Machine Concepts
Learning Paths
Interview Preparation

Data Transformation
Concepts
Batch Processing
- ELT using SQL in Warehouses/Lakehouses
- Apache Spark Core Concepts for Batch
- Spark SQL and DataFrames
- dbt Core Concepts
- dbt Models and Tests
Stream Processing
- Apache Flink Architecture
- Apache Flink Use Cases
- Micro-batching Concepts
- Spark Structured Streaming
- Kafka Streams API
- ksqlDB Overview
Libraries

Question? Give us feedback

Join our Free Newsletter

Practical Data Engineering,
Straight to your Inbox.

Data Transformation Spark StreamingSpark Structured Streaming

Spark Structured Streaming

Micro-batching Concepts Kafka Streams API

The Data Engineering

Logo image courtesy of pojok d - Flaticon: href="https://www.flaticon.com/free-icons/technology" title="technology icons" Technology icons created by pojok d - Flaticon

Where Data Engineers Grow Together