Data Catalog Engineer

Antons Recruitment Agency

Not Interested
Bookmark
الإبلاغ عن هذه الوظيفة

profile موقع الوظيفة:

دبي - الإمارات

profile الراتب شهرياً: لم يكشف
تاريخ النشر: نُشرت منذ أكثر من 30 يومًا
عدد الوظائف الشاغرة: 1 عدد الوظائف الشاغرة

ملخص الوظيفة

We are looking for a Data Catalog Engineer with hands-on experience in implementing and managing Databricks Unity Catalog. The ideal candidate will be skilled in configuring catalog objects automating governance policies and integrating metadata with data pipelines. This role plays a key part in ensuring data discoverability governance lineage and compliance across the organization.

Key Responsibilities

  • Unity Catalog Implementation: Configure and manage Unity Catalog objects including metastores catalogs schemas tables views and volumes in Databricks.

  • Access & Security: Develop and automate RBAC/ABAC policies data masking and access controls for secure data usage.

  • Data Asset Onboarding: Onboard and register data assets from multiple sources with consistent metadata standards.

  • Lineage & Integration: Build and maintain data lineage pipelines and ensure catalog integration with ETL/ELT processes.

  • Governance Tools: Collaborate on metadata and governance initiatives using tools like Microsoft Purview or equivalent.

  • Compliance: Support data privacy and compliance requirements including HIPAA GDPR and CCPA.

Key Skills & Experience

  • 4 years of experience in data engineering data governance or metadata management.

  • Hands-on expertise with Databricks Unity Catalog.

  • Strong knowledge of RBAC/ABAC access controls and data masking techniques.

  • Experience integrating data catalogs with ETL/ELT pipelines.

  • Familiarity with data governance frameworks and tools such as Microsoft Purview.

  • Understanding of data privacy regulations (HIPAA GDPR CCPA).

  • Solid skills in SQL Python or PySpark for data engineering and automation.

Why Join Us

  • Opportunity to work at the forefront of data governance and catalog engineering.

  • Gain hands-on expertise with Databricks Unity Catalog and modern governance tools.

  • Play a critical role in building a trusted enterprise data ecosystem.

  • Competitive salary and career growth opportunities.

We are looking for a Data Catalog Engineer with hands-on experience in implementing and managing Databricks Unity Catalog. The ideal candidate will be skilled in configuring catalog objects automating governance policies and integrating metadata with data pipelines. This role plays a key part in ens...
اعرض المزيد view more

المهارات المطلوبة

  • Apache Hive
  • S3
  • Hadoop
  • Redshift
  • Spark
  • AWS
  • Apache Pig
  • NoSQL
  • البيانات الضخمة
  • مستودع البيانات
  • Kafka
  • Scala