I am a Data Engineer with 3 years of hands-on experience in end-to-end data transformation and migration processes on the Azure cloud platform specializing in Finance and HR domains.
• Microsoft Certified Azure Data En…
I am a Data Engineer with 3 years of hands-on experience in end-to-end data transformation and migration processes on the Azure cloud platform specializing in Finance and HR domains.
• Microsoft Certified Azure Data Engineer
• Proficient in big data technologies: Apache Spark, Hadoop, Kafka, and Hive.
• Good understanding of Big data storage like Data Lake, Data Warehouse, SQL Databases, Delta Lake, etc.
• Robust skill set in SQL, Python, and Scala.
• Specialized in big data analysis, data extraction, data orchestration, data quality governance, and data cleaning.
• Excel in developing efficient ETL pipelines through Spark jobs using Databricks and Synapse Analytics
• Familiar using Agile Product Management using Microsoft Azure DevOps and version controlling using GitLab.
• I have strong communication and interpersonal skills, enabling effective collaboration with international clients, stakeholders, and cross-functional teams.
I am passionate about continuous learning and innovation, always seeking opportunities to contribute to challenging projects for both personal and professional growth. Let's connect and explore potential collaborations in the rapidly evolving field of data engineering!
I am a Data Engineer with 3 years of hands-on experience in end-to-end data transformation and migration processes on the Azure cloud platform specializing in Finance and HR domains.
• Microsoft Certified Azure Data Engineer
• Proficient in big data technologies: Apache Spark, Hadoop, Kafka, and Hive.
• Good understanding of Big data storage like Data Lake, Data Warehouse, SQL Databases, Delta Lake, etc.
• Robust skill set in SQL, Python, and Scala.
• Specialized in big data analysis, data extraction, data orchestration, data quality governance, and data cleaning.
• Excel in developing efficient ETL pipelines through Spark jobs using Databricks and Synapse Analytics
• Familiar using Agile Product Management using Microsoft Azure DevOps and version controlling using GitLab.
• I have strong communication and interpersonal skills, enabling effective collaboration with international clients, stakeholders, and cross-functional teams.
I am passionate about continuous learning and innovation, always seeking opportunities to contribute to challenging projects for both personal and professional growth. Let's connect and explore potential collaborations in the rapidly evolving field of data engineering!
Worked closely with stakeholders to understand data requirements for real time analytics.
Collaborated on the integration of Kafka as a data stream service, enabling the efficient flow of whitelisted event data for analytical purposes in clickstream applications.
Assisted in the development of Spark-Streaming code for real-time data processing.
Collaborated in loading processed data into partitioned delta tables over S3 storage.
Ensured comprehensive documentation and reporting, capturing key insights and facilitating knowledge transfer within the team.
Participated in a PoC integrating Kafka, Spark, and Cassandra on AWS to build a robust, scalable and low-latency data solution.
Analyzed system and business requirement documents for a comprehensive understanding of the suite encompassing analytics, recommendation, paywall, donation, and user engagement.
Developed PySpark jobs on EMR for processing customer viewership data present in Dynamo DB, generating reports stored in MySQL DB.
Loaded data into Hive target tables from DynamoDB.
Contributed to continuous enhancements and resolution of production issues within the suite.
Implemented data quality checks aligning with business requirements.
نظام التوظيف التشغيلي المعتمد على الذكاء الاصطناعي أولاً، الذي يوحّد ويؤتمت دورة التوظيف بالكامل للمؤسسات الحديثة حول العالم.
د.جوب منطقة حرة ذ.م.م. 2026 © جميع الحقوق محفوظة
