My DE Learning Logs

⌘Ctrlk

My DE Learning Logs

My Data Engineering Learnings
Additional learning resources
Database Systems
SQL
Data Storage Formats and Data Compaction
Bash
- Commands and Scripting
- Cron jobs
Data Modeling
Batch processing
stream processing
Data Strategy
Open-source OLAP systems
Open Table Formats
Event-Streaming / Message Brokers
DE design patterns
Networking
- Networking Fundamentals
Version control
- Git
DataOps: IaC, CI/CD, Workflow orchestration
Cloud Platforms
Container Orchestration
Programming paradigms
Programming languages
- Python
- Golang
Testing for programming and DE
Serving Data
Make
- Make and Makefiles
YAML
- YAML
Jinja templating
- Cheatsheet
Cost Optimization and Business Value
- FinOps, TCO, TOCO
Security and Privacy in DE
- Best practices for Security and Privacy in DE
Thinking like a Data Engineer
Various topics
- Glossary of terms
MCP protocol
- Page 1
Linux OS
- Untitled

Powered by GitBook

On this page

DataOps: IaC, CI/CD, Workflow orchestration
Workflow orchestration
Airflow

Defining dependencies between tasks

PreviousHow Airflow interacts with external databases NextInstalling external providers

Last updated 9 days ago