Senior Data Engineer....
Senior Data Engineer - Deriv
نُشرت في :
18-04-2024
صاحب العمل نشط
1 وظيفة شاغرة
حالة تأهب وظيفة
سيتم تحديثك بأحدث تنبيهات الوظائف عبر البريد الإلكترونيValid email field required
أرسل الوظائف
حالة تأهب وظيفة
سيتم تحديثك بأحدث تنبيهات الوظائف عبر البريد الإلكترونيValid email field required
أرسل الوظائف
الوصف الوظيفي
رقم الوظيفة : 2731761
Job Information
Job Opening ID
ZR1090JOB
Industry
Business Intelligence
City
Dubai
Country
United Arab Emirates
At Deriv we are looking for a detailoriented Senior Data Engineer with the capability to define the data pipeline of our future data models. You will leverage technologies such as Google Cloud Platform Airflow Python Docker and PostgreSQL to help provide the company with dependable business intelligence solutions. As part of this role you will develop test and maintain architectures for data processing and build Extract Transform and Load (ETL) pipelines. You will be a key contributor to making our data warehouse trustworthy by ensuring data accuracy.
Your challenges
Your challenges
- Ensure data integrity while extracting data from inhouse and thirdparty complex sources and manage its systematic storage. Responsible for data security accuracy and accessibility.
- Provide tangible business solutions and decisions using your expertise in the data engineering domain.
- Design and build highperformance secure and scalable company data warehouse and pipeline to support data science projects following best practices.
- Debug and resolve complex issues and recommend improvements to ensure a wellfunctioning ETL pipelined architecture.
- Transform raw data into easytouse tables for the Data Analysts.
- Keep uptodate on company products and new releases to efficiently plan changes in our data warehouse or pipelines.
Our team
We are the Business Intelligence team. We lead the organisation in cultivating a datadriven culture as our company moves toward the future. We collect meaningful data and analytics for us to deeply understand our consumers and build more valuable products and services. What we do is incredibly important in driving smart marketing decisions optimising our business and increasing profitability.
Requirements
- A minimum of 5 years of experience in the data engineering field
- Expertise in data modelling techniques such as Kimball star schema Anchor modelling and Data vault
- Competence in objectoriented or object function scripting languages such as Python
- Proficiency in relational SQL and NoSQL databases preferably with PostgreSQL PITR Pgbasebackup WAL archival and Replication
- Familiarity with columnoriented storage or data warehouses such as parquet Redshift and Bigquery
- Indepth skills in developing and maintaining ETL/ELT data pipelines and workflow management tools such as Airflow
- Handson experience with Google Cloud Platform (GCP) services such as BigQuery scheduled queries Cloud Storage and Cloud Functions
- Familiar with alerting and selfrecovery methods concerning data accuracy
- Analytical skills with the ability to transform data into optimal business decisions
- Expertise in peer reviewing pipeline codes and suggesting improvements when required
- Experience in helping teams make informed business decisions with data
- Strong communication and presentation skills
- Fluency in spoken and written English
Whats good to have
- A good background in cybersecurity and data protection
- Proficiency in using data pipeline and workflow management tools such as Luigi
- Exposure to maintaining and monitoring database health and resolving errors
- Experience in managing stakeholders expectations and technical requirement gathering
- Familiarity with container technologies such as Docker
- A fintech background
Benefits
- Marketbased salary
- Annual performance bonus
- Medical insurance
- Housing and transportation allowance
- Casual dress code
- Work permit
More jobs on
نوع التوظيف
دوام كامل
المهارات المطلوبة
الإبلاغ عن هذه الوظيفة
إخلاء المسؤولية: د.جوب هو مجرد منصة تربط بين الباحثين عن عمل وأصحاب العمل. ننصح المتقدمين بإجراء بحث مستقل خاص بهم في أوراق اعتماد صاحب العمل المحتمل.
نحن نحرص على ألا يتم طلب أي مدفوعات مالية من قبل عملائنا، وبالتالي فإننا ننصح بعدم مشاركة أي معلومات شخصية أو متعلقة بالحسابات المصرفية مع أي طرف ثالث. إذا كنت تشك في وقوع أي احتيال أو سوء تصرف، فيرجى التواصل معنا من خلال تعبئة النموذج الموجود على الصفحة اتصل بنا
