A full-scale, containerized data engineering project demonstrating real-time data collection, processing, and storage using a modern tech stack. Built with Apache Airflow, Kafka, Spark, Cassandra, and Docker, the pipeline ingests synthetic data via API, streams it through Kafka, processes it with Spark, and stores results in Cassandra—all orchestrated seamlessly with Airflow.