About Me
An enthusiast problem solver with a strong background in Data Engineering, Software Development, and Computer Science, having 3 years’ experience in working with Big Data, designing Data Warehouses, and developing Data P…
An enthusiast problem solver with a strong background in Data Engineering, Software Development, and Computer Science, having 3 years’ experience in working with Big Data, designing Data Warehouses, and developing Data Pipelines.
Experience
Data Engineer
Building ETL pipelines using Python
Developing Stored Procedures
Developing spark jobs using pyspark
Orchestrating DAGs in airflow
Automating data jobs
Building and observability project to log jobs
Data Engineering Specialist
Designing, Orchestrating and Implementing Jahez Data Warehouse.
Developing ETL pipelines with more than +4 billions records of data using AWS Glue, Spark, S3, Redshift, Airflow and PostgreSQL.
Building a logging system using Fast API that tracks and logs every run of all data jobs in Jahez, and automatically alerts stakeholders in the case of failure.
Productionizing Jahez End of Year Project, which includes building data jobs that analyzes each Jahez’s customer behavior during the Year 2022.
Data Engineer
Developing ETL pipelines as part of a Data Integration Project at the National Data Bank Department using Informatica & Cloudera as a data infrastructure.
Machine Learning Intern
Worked on data pre-processing and developing machine learning models.