نبذة عني
Data Engineer with 3 years of experience focused on end-to-end data pipeline management, from design and implementation to optimization and maintenance. Expertise in Python, SQL, Apache Airflow, and PySpark, with a stron…
Data Engineer with 3 years of experience focused on end-to-end data pipeline management, from design and implementation to optimization and maintenance. Expertise in Python, SQL, Apache Airflow, and PySpark, with a strong understanding of Google Cloud Platform (GCP) and related tools like Google BigQuery.
الخبرة
Data Engineer
Automated data pipelines using Apache Airflow, decreasing manual processing by 50% and accelerating workflow efficiency by 30%., Leveraged Google Cloud Platform’s serverless Dataproc service to enhance data extraction from on-premise systems, reducing process time by 40% and minimizing infrastructure costs., Tuned SQL queries in Google BigQuery, delivering improved query efficiency and a 20% drop in operational costs., Re-architected PySpark data processing, accomplishing a 50% decrease in extraction time and a 40% increase in processing performance., Modernized SQL reporting, resulting in a 30% reduction in query execution time and a 25% improvement in report generation speed., Integrated SCD Type 1 and Type 2 strategies, speeding up data updates by 40% and ensuring timely, high-quality reports., Implemented data quality checks, curtailing errors by 30% and fortifying the reliability of business-critical reports., Partnered with cross-functional teams to revamp data pipelines, producing a 30% decrease in reporting discrepancies and a 25% increase in data accuracy., Constructed comprehensive training materials and conducted onboarding sessions, trimming new hire training time by 20%.
Data Engineer
Automated data pipelines using Apache Airflow, decreasing manual processing by 50% and accelerating workflow efficiency by 30%.
Leveraged Google Cloud Platform’s serverless Dataproc service to enhance data extraction from on-premise systems, reducing process time by 40% and minimizing infrastructure costs.
Tuned SQL queries in Google BigQuery, delivering improved query efficiency and a 20% drop in operational costs.
Re-architected PySpark data processing, accomplishing a 50% decrease in extraction time and a 40% increase in processing performance.
Modernized SQL reporting, resulting in a 30% reduction in query execution time and a 25% improvement in report generation speed.
Integrated SCD Type 1 and Type 2 strategies, speeding up data updates by 40% and ensuring timely, high-quality reports.
Implemented data quality checks, curtailing errors by 30% and fortifying the reliability of business-critical reports.
Partnered with cross-functional teams to revamp data pipelines, producing a 30% decrease in reporting discrepancies and a 25% increase in data accuracy.
Constructed comprehensive training materials and conducted onboarding sessions, trimming new hire training time by 20%.
Project
Spearheaded the migration of 5 TB of on-premise data to Google Cloud Platform, preserving data integrity and ensuring zero downtime.
Optimized ELT workflows, accelerating data processing time by 35% and facilitating faster decision-making across departments.
Expedited data ingestion, transformation, and reporting, minimizing manual intervention by 60% and enhancing reporting accuracy by 40%.
Restructured data models for real-time business intelligence, generating a 25% increase in actionable insights and expediting report delivery.