About Me
Experienced Data Engineer with 5+ years in advanced data solutions and ETL optimization. Led implementation, increasing productivity by 30% and cutting costs by 20%. Proficient in AWS, Azure and GCP, driving data-driven …
Experienced Data Engineer with 5+ years in advanced data solutions and ETL optimization. Led implementation, increasing productivity by 30% and cutting costs by 20%. Proficient in AWS, Azure and GCP, driving data-driven insights and operational efficiency.
Experience
Graduate assistant - Data Engineer
• Architected and deployed an efficient ETL system integrating Canvas course data using GCP, Snowflake, and SODA API.Managed 4 courses, resulting in a 40% boost in data accuracy and a 30% decrease in processing duration.
• Implemented automation to detect and filter inactive students, resulting in a 20% increase in student engagement and targeted email notifications to instructors.
• Harnessed Canvas LMS API to extract detailed student data and analytics, facilitating intervention strategies and personalized support initiatives. This resulted in a 25% increase in student retention and a 30% improvement in course completion rates.
Graduate Assistant | Data Engineer
Architected and deployed an efficient ETL system integrating Canvas course data using GCP, Snowflake, and SODA API.
Managed 4 courses, resulting in a 40% boost in data accuracy and a 30% decrease in processing duration.
Implemented automation to detect and filter inactive students, resulting in a 20% increase in student engagement and targeted email notifications to instructors.
Harnessed Canvas LMS API to extract detailed student data and analytics, facilitating intervention strategies and personalized support initiatives.
This resulted in a 25% increase in student retention and a 30% improvement in course completion rates.
Data Engineer
Designed an ETL pipeline for a multi-location restaurant group using Azure Data Factory, automating data extraction and loading from SFTP to Azure Synapse, ensuring 100% data availability within a 7-day window.
Implemented error-handling mechanisms with automated retries and alerts, ensuring data integrity.
Developed a real-time monitoring dashboard, tracking ETL process status and failures, enhancing operational efficiency.
Devised Google Cloud Functions to process daily CSV/json uploads, appending data to BigQuery, achieving 99% pipeline reliability with real-time failure monitoring.
Associate Data Engineer
Designed and maintained scalable data pipelines using AWS services (including S3, EC2, IAM, Athena, Glue, Lambda functions, SNS, and Redshift) and Databricks, optimizing data flow and storage to reduce processing time by 30%.
Engineered and optimized ETL processes using PySpark on Databricks and Kafka for real-time analytics and led successful migration of legacy systems to AWS, resulting in a 20% cost savings and enhanced data availability for data-driven decision-making.