·12 min read
AWS Step Functions Data Engineering Project
Event-driven serverless pipeline that automatically ingests CSV files from S3, validates schema, deduplicates rows, and loads data into RDS PostgreSQL — with email alerts for every outcome.
← cd ..
#data-engineering
$ grep -l "#data-engineering" projects/*.md — 5 matches
·5 min read
Introduction to Databricks — Simple Guide
A friendly, easy-to-understand guide to Databricks: core concepts, examples, and setup tips for Windows/Linux.
·5 min read
Introduction to Apache Airflow — Simple Guide
A simple, easy-to-understand introduction to Apache Airflow with examples and setup steps for Windows and Linux.
·3 min read
Snowflake + DBT Setup in Linux (Part 1)
Learn how to install dbt with the Snowflake adapter on Linux, configure a Snowflake connection, and create your first dbt project from scratch.
·4 min read
Snowflake Basics for Data Engineers
Learn the fundamentals of Snowflake, including architecture, virtual warehouses, data loading, Time Travel, and key concepts used in modern data engineering.