Data Catalog Engineer
Share
Job Location:
Monthly Salary:
Posted on:
Vacancies:
Job Summary
We are looking for a Data Catalog Engineer with hands-on experience in implementing and managing Databricks Unity Catalog. The ideal candidate will be skilled in configuring catalog objects automating governance policies and integrating metadata with data pipelines. This role plays a key part in ensuring data discoverability governance lineage and compliance across the organization.
Key Responsibilities
-
Unity Catalog Implementation: Configure and manage Unity Catalog objects including metastores catalogs schemas tables views and volumes in Databricks.
-
Access & Security: Develop and automate RBAC/ABAC policies data masking and access controls for secure data usage.
-
Data Asset Onboarding: Onboard and register data assets from multiple sources with consistent metadata standards.
-
Lineage & Integration: Build and maintain data lineage pipelines and ensure catalog integration with ETL/ELT processes.
-
Governance Tools: Collaborate on metadata and governance initiatives using tools like Microsoft Purview or equivalent.
-
Compliance: Support data privacy and compliance requirements including HIPAA GDPR and CCPA.
Key Skills & Experience
-
4 years of experience in data engineering data governance or metadata management.
-
Hands-on expertise with Databricks Unity Catalog.
-
Strong knowledge of RBAC/ABAC access controls and data masking techniques.
-
Experience integrating data catalogs with ETL/ELT pipelines.
-
Familiarity with data governance frameworks and tools such as Microsoft Purview.
-
Understanding of data privacy regulations (HIPAA GDPR CCPA).
-
Solid skills in SQL Python or PySpark for data engineering and automation.
Why Join Us
-
Opportunity to work at the forefront of data governance and catalog engineering.
-
Gain hands-on expertise with Databricks Unity Catalog and modern governance tools.
-
Play a critical role in building a trusted enterprise data ecosystem.
-
Competitive salary and career growth opportunities.
Key Skills
- Apache Hive
- S3
- Hadoop
- Redshift
- Spark
- AWS
- Apache Pig
- NoSQL
- Big Data
- Data Warehouse
- Kafka
- Scala
