نبذة عني
Data Engineer with 1.10+ years of experience at IBM in designing, developing, and optimizing scalable data pipelines. Skilled in Python, PySpark, SQL, AWS, Snowflake, Azure Data Factory, Databricks, and ETL/ELT developme…
Data Engineer with 1.10+ years of experience at IBM in designing, developing, and optimizing scalable data pipelines. Skilled in Python, PySpark, SQL, AWS, Snowflake, Azure Data Factory, Databricks, and ETL/ELT development.
الخبرة
Data Engineer
Designed and developed scalable ETL pipelines using PySpark and AWS Glue.
Built data ingestion frameworks to load data from APIs and databases into AWS S3 data lake.
Performed data cleansing, transformation, enrichment, and validation for enterprise datasets.
Loaded processed datasets into Snowflake to support reporting and analytics workloads.
Implemented workflow orchestration using Azure Data Factory for reliable pipeline execution.
Applied data quality checks to ensure consistency, accuracy, and integrity of data.
Optimized ETL jobs and PySpark workloads to improve performance and scalability.
Collaborated with business and technical teams to gather requirements and deliver data solutions.
Worked on schema evolution handling, partitioning strategies, and large-scale data processing.