DescriptionApt Resourcesis seeking an experiencedBig Data Engineerfor agovernment client in Abu Dhabi. You will design and implement large-scale data solutions to support AI/ML initiatives and public sector digital transformation.
Key Responsibilities:
Data Pipeline Development:
- Build robust data pipelines usingPython SQL/NoSQL and Airflow
- DevelopETL/ELT processesfor structured/unstructured data
- Managedata lakesand optimize storage solutions
Data Infrastructure:
- Design efficientdata modelsfor analytics
- Implementdata governanceand quality frameworks
- Work withcloud-based data platforms(Azure preferred)
AI/ML Support:
- Prepare and process datasets for machine learning applications
- Collaborate with ML teams on feature engineering
Requirements - 10-12 yearsof hands-on big data experience
- Expertise in:
- PythonandSQL/NoSQLdatabases
- Airflowfor workflow orchestration
- ETL/ELTpipeline development
- Cloud data platforms(Azure AWS or GCP)
BenefitsTo be discussed