Data Engineer at HashedIn by Deloitte

This DBT project utilizes the DVD rental database and implements various transformations to clean and structure the data. A dashboard is then created to display the insights and analysis derived from the transformed data.The project demonstrates the use of DBT to perform data modeling and manipulation tasks, as well as the ability to create a user-friendly interface for data visualization.

Data Transformation Pipeline on DVD Rental Dataset

Worked on the "Modeling Economic Well-Being through Machine Learning and Satellite Imaging" project.

Utilized multi-spectral satellite imagery and ground truth data, including census data and economic indexes such as NDVI, NDWI, and health index, to develop a solution for measuring economic well-being in a specific location (with a focus on India).

Acquired knowledge of satellite image analysis and familiarized myself with various data sources, including Sentinel Hub and Google Earth Engine, during the course of the project.

Successfully designed, developed, and deployed a highly efficient Akka Stream application that significantly increased data processing speed to near real-time and reduced legacy dependencies.

Redesigned a major component of the existing finite state machine, reducing dependencies within the data and ensuring minimal data loss due to data quality issues.

Collaborated effectively with cross-functional teams to resolve complex infrastructure issues, contributing to the overall success of the project.

Assumed a proactive role in troubleshooting and resolving various application bugs, leading to improved system stability and reliability.

Provided technical guidance and mentorship to team members, sharing knowledge of project architecture and tech stack.

Completed a 2-month internship with Hashedin University, featuring a 4-week training program followed by a month of hands-on project work.

Developed a range of technical skills, including HTML, CSS, Typescript, Java SpringBoot, Angular, data engineering principles, Amazon Athena, S3 Buckets, Python, and SQL.

Contributed to the development of a dynamic and responsive website, a billing system with APIs, an Angular website, and a desktop application using Electron.

Demonstrated strong problem-solving and team collaboration skills, successfully completing an end-to-end project from scratch with a self-selected team.

Gained valuable hands-on experience applying learned concepts and techniques to real-world projects, enhancing practical skills and understanding of data engineering.

During my internship, I worked on implementing a Face Mask Detection and Social Distancing Detection system

I utilized Transfer Learning to train a model for Face Mask Detection using publicly available data. Despite the lack of benchmark datasets for this relatively new problem, I was able to achieve an accuracy of 70% on the test set of 200 images.

For the Social Distancing Detection project, I collaborated with a co-intern to come up with a solution.

Worked on a team of 6 members on the "Pneumonia Classification using x-ray images" project.

Conducted research and explored data to identify the best approach for the project.

Tried various machine learning and deep learning models, including VGG16, ResNet50, and InceptionV3, and used them as feature extractors with SVM for classification.

Achieved the best results with InceptionV3, achieving an accuracy of 97% on 624 test images.

Assumed a key role in identifying and resolving various issues related to data quality in multiple applications.

Provided technical guidance and support to team members, addressing doubts and queries on application code and other technical topics.

Contributed to the overall success of the team by sharing knowledge and expertise, fostering a positive and collaborative team culture.

Akka

Scala

Aditya Gupta

Data Engineer at HashedIn by Deloitte