Results-driven Data Engineer (2 Years Experience) specializing in ETL modernization, cloud data migration, and high-performance pipeline engineering. Proven expertise in refactoring legacy Talend/SQL workflows into scala…
Results-driven Data Engineer (2 Years Experience) specializing in ETL modernization, cloud data migration, and high-performance pipeline engineering. Proven expertise in refactoring legacy Talend/SQL workflows into scalable Databricks and PySpark solutions. Expert in orchestrating complex dataflows with Apache Airflow, automating CI/CD on AWS, and building Multi-Cloud (AWS & Azure) architectures. Multi-certified: Databricks Professional, AWS, and Snowflake.
Modernized 50+ legacy Talend workflows and Greenplum SQL scripts by converting them into optimized PySpark codebases, improving data processing logic to slash execution time by 35%.
Architected a reusable, modular ETL framework using custom PySpark/SQL UDFs, standardizing code quality across the team and accelerating new feature development by 40%.
Optimized the enterprise Apache Airflow framework by engineering advanced, YAML-driven DAGs, which streamlined complex scheduling dependencies and ensured automated error recovery.
Developed custom PySpark API outgestion jobs to automate data delivery to external web platforms, migrating legacy PostgreSQL integration logic to Databricks and ensuring reliable downstream availability.
Directed weekly production releases via CI/CD pipelines using AWS DevOps and Databricks Asset Bundles (DABs), achieving a 100% deployment success rate with zero downtime.
Modernized 50+ legacy Talend workflows and Greenplum SQL scripts by converting them into optimized PySpark codebases, improving data processing logic to slash execution time by 35%., Architected a reusable, modular ETL framework using custom PySpark/SQL UDFs, standardizing code quality across the team and accelerating new feature development by 40%., Optimized the enterprise Apache Airflow framework by engineering advanced, YAML-driven DAGs, which streamlined complex scheduling dependencies and ensured automated error recovery., Developed custom PySpark API outgestion jobs to automate data delivery to external web platforms, migrating legacy PostgreSQL integration logic to Databricks and ensuring reliable downstream availability., Directed weekly production releases via CI/CD pipelines using AWS DevOps and Databricks Asset Bundles (DABs), achieving a 100% deployment success rate with zero downtime.
Completed the intensive ‘Skydive’ Data Engineering training program, gaining hands-on proficiency in Azure Data Factory, Databricks, Blob Storage, and Azure SQL for cloud-native data analytics.
Implemented an end-to-end ETL pipeline as a key internship initiative, successfully migrating financial datasets from on-premise systems to Azure and transforming them into analytics-ready tables using PySpark.
The AI-first Recruitment Operating System that unifies and automates the entire hiring lifecycle for modern enterprises worldwide.
Dr Job FZ LLC. 2026 © All Rights Reserved
