Big Data Engineer - Government Sector - 1
Job Summary
Apt Resourcesis seeking an experiencedBig Data Engineerfor agovernment client in Abu Dhabi. You will design and implement large-scale data solutions to support AI/ML initiatives and public sector digital transformation.
Key Responsibilities:
Data Pipeline Development:
- Build robust data pipelines usingPython SQL/NoSQL and Airflow
- DevelopETL/ELT processesfor structured/unstructured data
- Managedata lakesand optimize storage solutions
Data Infrastructure:
- Design efficientdata modelsfor analytics
- Implementdata governanceand quality frameworks
- Work withcloud-based data platforms(Azure preferred)
AI/ML Support:
- Prepare and process datasets for machine learning applications
- Collaborate with ML teams on feature engineering
Requirements
- 10-12 yearsof hands-on big data experience
- Expertise in:
- PythonandSQL/NoSQLdatabases
- Airflowfor workflow orchestration
- ETL/ELTpipeline development
- Cloud data platforms(Azure AWS or GCP)
Benefits
To be discussed
Key Skills
About Company
Providing Apt Recruitment Solutions Experts who make sure that your recruitment needs are handled using only best practices Lead by professionals with a collective experience of over 3 decades in the recruitment segment, within various business verticals. Our company has evolved throu ... View more