·12 min read
AWS Step Functions Data Engineering Project
Event-driven serverless pipeline that automatically ingests CSV files from S3, validates schema, deduplicates rows, and loads data into RDS PostgreSQL — with email alerts for every outcome.
$ whoami
Mani
AWS Cloud and Data Engineer
$ ls -lt projects/
·5 min read
Introduction to Databricks — Simple Guide
A friendly, easy-to-understand guide to Databricks: core concepts, examples, and setup tips for Windows/Linux.
·5 min read
Introduction to Apache Airflow — Simple Guide
A simple, easy-to-understand introduction to Apache Airflow with examples and setup steps for Windows and Linux.
·3 min read
Snowflake + DBT Setup in Linux (Part 1)
Learn how to install dbt with the Snowflake adapter on Linux, configure a Snowflake connection, and create your first dbt project from scratch.
·7 min read
Serverless Portfolio Ingestion Pipeline
A secure, serverless data pipeline that ingests trade CSV reports, processes them asynchronously, updates portfolio averages and realized P&L in RDS MySQL, and emails HTML reports using Amazon SES.
·4 min read
Snowflake Basics for Data Engineers
Learn the fundamentals of Snowflake, including architecture, virtual warehouses, data loading, Time Travel, and key concepts used in modern data engineering.