Experienced Data Engineer with 7+ years of expertise in designing and implementing scalable data solutions.
Proven track record in building data warehouses from scratch and developing efficient ELT pipelines for both
bat…
Experienced Data Engineer with 7+ years of expertise in designing and implementing scalable data solutions.
Proven track record in building data warehouses from scratch and developing efficient ELT pipelines for both
batch and stream processing.
Specialized in optimizing data infrastructure and creating robust data architectures that drive business
intelligence. Passionate about staying current with emerging technologies and implementing cutting-edge data
engineering tools to deliver high-performance solutions.
Data pipeline migration from existing ELT (shell script) into Apache Airflow Jobs
Develop ELT system for batch and stream
Setup and Deploy Data Stream CDC with Kafka and Open source data catalog
Implement Data Engineering Portal to manage all DE apps
Manage and optimize Datawarehouse performance
Implement server and app monitoring with Grafana on Data Stream server
Data pipeline migration from existing ELT (shell script) into Apache Airflow Jobs, Develop ELT system for batch and stream, Setup and Deploy Data Stream CDC with Kafka and Open source data catalog, Implement Data Engineering Portal to manage all DE apps, Manage and optimize Datawarehouse performance, Implement server and app monitoring with Grafana on Data Stream server
Help build Datawarehouse in Bigquery
Implement standard good code quality in Apache Airflow tasks for others DE to follow
Create Airflow job unit test using pytest
Develop stream processing in Flink using python then kafka as message broker
Build a dashboard to manage submit, stop & resubmit Flink job
Help data science to build internal Mlflow dashboard
Display experiments and model registry
Deploy Mlflow model registry as API based
Build a data pipeline using Airflow and running on GKE
Read data source from Mysql(replica) and prepare Mysql also as Datawarehouse
Create various tasks like read & write Gsheet data
Read marketing app API
Build (semi) data stream from external data with golang into AWS Redshift
Build & config efficient Airflow docker for ETL setup DBT with start project for star schema
Create unit test on existing Airflow Jobs and setup open source metadata data catalog
Design & Develop New ETL program using python project and ndscheduller for auto running job
Data Pipeline or Extraction from Mysql, Mongodb, Elasticsearch, Dynamodb, Bigquery, Google Analytics, Gsheet and others API Third-party
Automate report via email
Export file gdocs
Push data to SAP
Using Datalake technology with Qubole Service Hive, Sqoop, Spark & Presto
Implement Apache Airflow for new scheduler
Help build Datawarehouse in Bigquery, implement standard good code quality in Apache Airflow tasks for others DE to follow and create Airflow job unit test using pytest, Develop stream processing in Flink using python then kafka as message broker, and build a dashboard to manage (submit, stop & resubmit) flink job, Help data science to build internal Mlflow dashboard (display experiments, model registry, and deploy Mlflow model registry as API based)
Build a data pipeline using Airflow and running on GKE, Read data source from Mysql(replica) and prepare Mysql also as Datawarehouse, Create various tasks like read & write Gsheet data, read marketing app API
Build (semi) data stream from external data with golang into AWS Redshift, Build & config efficient Airflow docker for ETL setup DBT with start project for star schema, Create unit test on existing Airflow Jobs and setup open source metadata data catalog
Design & Develop New ETL program using python project and ndscheduller for auto running job (replacing cron job), Data Pipeline or Extraction from Mysql, Mongodb, Elasticsearch, Dynamodb, Bigquery, Google Analytics, Gsheet and others API Third-party, Automate report via email, export file gdocs, push data to SAP, Using Datalake technology with Qubole Service Hive, Sqoop, Spark & Presto, Implement Apache Airflow for new scheduler
نظام التوظيف التشغيلي المعتمد على الذكاء الاصطناعي أولاً، الذي يوحّد ويؤتمت دورة التوظيف بالكامل للمؤسسات الحديثة حول العالم.
د.جوب منطقة حرة ذ.م.م. 2026 © جميع الحقوق محفوظة
