• Led the design and implementation of a sophisticated data visualization tool, driving a 15% rise in customer engagement metrics and a 20% reduction in customer churn rate.
• Engineered a Kafka-based data pipeline for migrating data from MySQL to ClickHouse in batches, significantly enhancing system efficiency with a 60% reduction in query execution time and a 30% increase in overall performance.
• Implemented scylla as storage solution for high-volume pre-processed data, enhancing data retrieval efficiency.
• Employed Kafka with Avro serialization for efficient scheduling of resource-intensive tasks, optimizing workflow process
• Developed scalable APIs for ETL operations, facilitating data consolidation from diverse sources into a unified database; achieved 30% reduction in data processing errors and streamlined data governance practices.
• Established Django as a primary backend, designed microservice architecture for enhanced modularity and scalability.
