Databricks Senior Data Engineer - Luxoft
Employer Active
Job Alert
You will be updated with latest job alerts via email
Share
Job Alert
You will be updated with latest job alerts via email
Job Description
Abu Dhabi United Arab Emirates
Relocation friendly
ETL (Informatica Ab Initio etc.)
BCM Industry
06/08/2024
Req. VR107048
Project description
We are hiring for projects in the Middle East. The team comprises frontend and backend developers data analysts and data scientists architects analysts and project managers. You will work with modern technologies and be an integral part of continuing to evolve our highperforming platforms. If you are serious about being a part of this fastpaced and exciting journey this project should be top of the list!
This role will be primarily responsible for closely collaborating with a business SME to implement data validation rules.
Responsibilities
Collaborating with a business SME to implement data validation rules.
Understand business requirements and actively provide input from a data perspective.
Understand the underlying data and flow of data.
Understand overall platform architecture and capabilities and how to load data effectively.
Recognize and adapt to the changes in processes.
Skills
Must have
7 years of relevant experience.
Proficient handson experience with Azure Databricks (3y).
Proficiency in Python and PySpark (5y).
Advanced knowledge in SQL (5y).
Should be able to analyse and understand complex data.
Knowledge of Azure data/delta lake Azure DevOps CI/CD and Git is essential.
Should clearly understand the data platform lifecycle and contribute to preparing Design documents Unit Test plans and Code review reports.
Knowledge of data Lake house and business intelligence architecture.
Experience working in an Agile environment (Scrum Agile) is a plus.
Interpersonal/communication skills (both oral/written) with the ability to communicate at various levels with clarity & precision.
Bachelors degree in IT/Computer Science or related field
Nice to have
Knowledge of the financial markets portfolio theory and risk management is a plus
Other
Languages
English: C1 Advanced
Seniority
Senior
More jobs on
Employment Type
Full Time
