Meriam

Meriam

Data Engineer
United Kingdom

نبذة عني

experience have honed my problem-solving abilities and adaptability to new tech environments. As a recent MSc graduate in Big Data Science, My internships and academic experience have honed my problem-solving abilities a…

الخبرة

Data Engineer

IRIS Software group
Jun 2023 - حتى الآن · 3 سنوات

• Designed and developed a reactive data pipeline using Apache AirWow, AFS
Lambda, and SnowWake to ensure timely data delivery and processing.
• Created and maintained ETL workWows using zivetran to integrate data from
various sources into the SnowWake data warehouse.
• Utiliqed SnowWake's uni/ue multi-cluster, shared data architecture to ensure
scalability, high availability, and optimal performance.
• Forked with SnowWake's tasks and streams to automate data processing and
ensure real-time data availability.
• Developed and optimiqed SQL /ueries for data retrieval and analysis, resulting
in signiOcant performance improvements.
• Built RESTful APIs using AFS API Gateway and Lambda to facilitate data access
and consumption by downstream applications.
• Implemented CI1CD processes using Aqure Dev8ps to automate the build,
testing, and deployment of data engineering pipelines.

Data Engineer

IRIS Software group, london
Jun 2023 - حتى الآن · 3 سنوات 1 شهر

Designed and developed a reactive data pipeline using Apache AirWow, AFS Lambda, and SnowWake to ensure timely data delivery and processing.
Created and maintained ETL workWows using zivetran to integrate data from various sources into the SnowWake data warehouse.
Utiliqed SnowWake's uni/ue multi-cluster, shared data architecture to ensure scalability, high availability, and optimal performance.
Forked with SnowWake's tasks and streams to automate data processing and ensure real-time data availability.
Developed and optimiqed SQL /ueries for data retrieval and analysis, resulting in signiOcant performance improvements.
Built RESTful APIs using AFS API Gateway and Lambda to facilitate data access and consumption by downstream applications.
Implemented CI1CD processes using Aqure Dev8ps to automate the build, testing, and deployment of data engineering pipelines.

Data Engineering Internship

Capita, London
Sep 2022 - Dec 2022 · 3 أشهر

Utiliqed Python to automate data workWows, improving efOciency and reducing manual data handling.
Frote custom scripts for data cleaning and transformation
Implemented deep learning techni/ues for different tasks and natural language processing, contributing to the development of advanced AI solutions.
Utiliqed different machine learning algorithms to improve models accuracy

المهارات

بايثون (لغة برمجة) هادوب (Hadoop) سكالا أباتشي بيغ خدمات أمازون ويب (AWS) كافكا ردشفت (خدمة قاعدة بيانات) إس 3 (خدمة تخزين البيانات على الإنترنت) Jupiter notebook SQL SnowWake AFS S31Redshift Aqure Data Lake Microsoft SQL Server AirWow zivetran REST S8AP AFS API Gateway Aqure Dev8ps GitLab Apache Spark Git ConWuence
الإبلاغ عن هذا الملف الشخصي؟