Result-driven Data Engineer with over 4 years of experience specializing in AWS services, Python, Spark, Scala, Airflow, SQL, and ETL processes. Proven track record in designing and optimizing robust data pipelines, enha…
Result-driven Data Engineer with over 4 years of experience specializing in AWS services, Python, Spark, Scala, Airflow, SQL, and ETL processes. Proven track record in designing and optimizing robust data pipelines, enhancing data workflows, and maintaining data integrity across multiple projects. Dedicated to utilizing technology to generate actionable insights and support informed decision-making. Enthusiastic about connecting with industry professionals and exploring collaborative opportunities for growth in data engineering.
Designed and developed ETL processes to load enterprise data into a Data Warehouse using Python scripts.
Developed and maintained data pipelines in AWS S3, ensuring efficient data ingestion, storage, processing, and analysis.
Utilized Apache Airflow to design and manage workflows, automating and streamlining data processing pipelines with efficient task execution and error handling.
Designed and deployed AWS Lambda functions for real-time data processing.
Developed Spark applications on Hadoop clusters (EMR) for complex analytics operations, optimizing data processing and analysis.
Configured and managed AWS CloudWatch for monitoring and logging, proactively identifying and resolving performance issues.
Created interactive dashboards and reports using AWS QuickSight.
Maintained version control with GitLab, tracking code changes and managing collaborative development.
Configured IAM roles for secure access control within the AWS environment.
Implemented feature changes to existing data pipelines within an agile workspace, ensuring adaptability and continuous improvement.
Mentored a group of skilled developers and served as Project approver to ensure adherence to objectives and successful project outcomes.
Designed and developed ETL processes to load enterprise data into a Data Warehouse using Python scripts., Developed and maintained data pipelines in AWS S3, ensuring efficient data ingestion, storage, processing, and analysis., Utilized Apache Airflow to design and manage workflows, automating and streamlining data processing pipelines with efficient task execution and error handling., Designed and deployed AWS Lambda functions for real-time data processing., Developed Spark applications on Hadoop clusters (EMR) for complex analytics operations, optimizing data processing and analysis., Configured and managed AWS CloudWatch for monitoring and logging, proactively identifying and resolving performance issues., Created interactive dashboards and reports using AWS QuickSight., Maintained version control with GitLab, tracking code changes and managing collaborative development., Configured IAM roles for secure access control within the AWS environment., Implemented feature changes to existing data pipelines within an agile workspace, ensuring adaptability and continuous improvement., Mentored a group of skilled developers and served as Project approver to ensure adherence to objectives and successful project outcomes.
The AI-first Recruitment Operating System that unifies and automates the entire hiring lifecycle for modern enterprises worldwide.
Dr Job FZ LLC. 2026 © All Rights Reserved
