DATA ENGINEER
شارك هذه الوظيفة
موقع الوظيفة:
الراتب شهرياً:
تاريخ النشر:
نُشرت قبل 2 ساعة
عدد الوظائف الشاغرة:
1 عدد الوظائف الشاغرة
ملخص الوظيفة
KEY RESPONSIBILITIES:
- Design construct and maintain data pipelines for data ingestion transformation and storage
- Ensure data integrity quality and security throughout the data lifecycle.
- Optimize data processing workflows for performance and scalability.
- Collaborate with data scientists and analysts to facilitate data accessibility.
QUALIFICATIONS:
- 5 years of experience in a data engineering or data platform role.
- Strong experience with Azure Databricks Data Lake Storage PySpark and Jupyter Notebooks.
- Proficiency in SQL Python and distributed data processing frameworks.
- Experience working with Azure Data Factory Azure Synapse or similar ETL/ELT tools.
- Understanding of data governance privacy and security best practices.
- Familiarity with supporting ML/AI workflows including data preparation for machine learning pipelines.
- Excellent problem-solving and communication skills
Vertical
Technology
المهارات المطلوبة
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- البيانات الضخمة
- مستودع البيانات
- Kafka
- Scala
عن الشركة
Duncan & Ross Engineering Consulting offers integrated and customer oriented services in the different industries such as Aerospace, Automotive, Construction, Defence, Energy, Life Sciences, Telecom & Transport. We ensure the success of our customers through our long-standing experien ... اعرض المزيد
