Meriam

Meriam

Data Engineer
United Kingdom

About Me

experience have honed my problem-solving abilities and adaptability to new tech environments. As a recent MSc graduate in Big Data Science, My internships and academic experience have honed my problem-solving abilities a…

Experience

Data Engineer

IRIS Software group
Jun 2023 - Present · 3 years

• Designed and developed a reactive data pipeline using Apache AirWow, AFS
Lambda, and SnowWake to ensure timely data delivery and processing.
• Created and maintained ETL workWows using zivetran to integrate data from
various sources into the SnowWake data warehouse.
• Utiliqed SnowWake's uni/ue multi-cluster, shared data architecture to ensure
scalability, high availability, and optimal performance.
• Forked with SnowWake's tasks and streams to automate data processing and
ensure real-time data availability.
• Developed and optimiqed SQL /ueries for data retrieval and analysis, resulting
in signiOcant performance improvements.
• Built RESTful APIs using AFS API Gateway and Lambda to facilitate data access
and consumption by downstream applications.
• Implemented CI1CD processes using Aqure Dev8ps to automate the build,
testing, and deployment of data engineering pipelines.

Data Engineer

IRIS Software group, london
Jun 2023 - Present · 3 years 1 month

Designed and developed a reactive data pipeline using Apache AirWow, AFS Lambda, and SnowWake to ensure timely data delivery and processing.
Created and maintained ETL workWows using zivetran to integrate data from various sources into the SnowWake data warehouse.
Utiliqed SnowWake's uni/ue multi-cluster, shared data architecture to ensure scalability, high availability, and optimal performance.
Forked with SnowWake's tasks and streams to automate data processing and ensure real-time data availability.
Developed and optimiqed SQL /ueries for data retrieval and analysis, resulting in signiOcant performance improvements.
Built RESTful APIs using AFS API Gateway and Lambda to facilitate data access and consumption by downstream applications.
Implemented CI1CD processes using Aqure Dev8ps to automate the build, testing, and deployment of data engineering pipelines.

Data Engineering Internship

Capita, London
Sep 2022 - Dec 2022 · 3 months

Utiliqed Python to automate data workWows, improving efOciency and reducing manual data handling.
Frote custom scripts for data cleaning and transformation
Implemented deep learning techni/ues for different tasks and natural language processing, contributing to the development of advanced AI solutions.
Utiliqed different machine learning algorithms to improve models accuracy

Skills

Python Hadoop Scala Apache Pig Amazon Web Services (AWS) Kafka Redshift S3 Jupiter notebook SQL SnowWake AFS S31Redshift Aqure Data Lake Microsoft SQL Server AirWow zivetran REST S8AP AFS API Gateway Aqure Dev8ps GitLab Apache Spark Git ConWuence
Report this Profile?