Product Manager – Data & ML Evaluation (Enterprise) [UAEN]
Job Summary
Our client is seeking a highly analytical and technically strong Product Manager Data & ML Evaluation to lead the strategy and execution of product data experimentation and machine learning evaluation.
In this role you will act as the product owner for data and evaluation frameworks ensuring that AI-driven products are measurable reliable and continuously improving. You will work cross-functionally with Product Engineering Data Science and business stakeholders to deliver high-impact data-driven solutions.
Key Responsibilities:
Product Data & Analytics
Ø Own and manage the end-to-end product data ecosystem including telemetry tracking plans event schemas data quality and warehousing
Ø Define and implement a product metrics framework (north star metrics leading indicators input metrics)
Ø Enable stakeholders with accessible dashboards and actionable insights across products and platforms
ML Evaluation & Experimentation
Ø Design and own machine learning evaluation frameworks including test set curation and KPI definition (quality safety bias latency cost)
Ø Run and optimize offline and online evaluations for AI models and features
Ø Build scalable and reproducible evaluation pipelines integrated with CI/CD workflows
Ø Lead A/B testing and experimentation strategies including designing analyzing and scaling testing frameworks
Strategy & Governance
Ø Drive data-informed pricing strategies by analyzing usage patterns feature value and cost structures
Ø Establish and enforce data governance standards including event naming privacy PII handling and data retention policies
Ø Collaborate with Security Legal and business teams to ensure compliance and best practices.
Requirements
Proven experience owning product analytics instrumentation and experimentation frameworks
Strong proficiency in SQL and data analysis with the ability to validate and interpret experiments independently
Hands-on experience working with machine learning products including model evaluation and monitoring
Strong understanding of A/B testing methodologies and statistical concepts (e.g. power MDE guardrail metrics)
Excellent stakeholder management and communication skills across technical and business teams
Ability to operate effectively in fast-paced cross-functional environments.
Preferred Qualifications
Exposure to LLM / RAG evaluation frameworks safety metrics and AI model testing methodologies
Familiarity with data modeling tools (e.g. dbt) feature stores and observability platforms
Experience working in regulated or privacy-sensitive environments
Comfort leveraging AI tools to prototype analyses dashboards or lightweight data utilities
Work Location
Abu Dhabi
To view other vacancies we have please check our website () and follow us on our social media accounts - LinkedIn / Instagram
Follow the Black Pearl channel on WhatsApp.
Disclaimer: Black Pearl will never ask for money or any form of charge our candidates just to process or consider their application for any of our available vacancies. If you happen to receive such a request from any members of our staff or other individuals claiming to be part of Black Pearl please do call our office ator drop us a message on our website - .
Required Skills:
Candidate Requirements: Bachelors degree (or equivalent) Minimum 5 years of enterprise software sales experience in cybersecurity endpoint security or infrastructure software Strong understanding of UAE cybersecurity landscape and partner ecosystem Proven track record in quota achievement and pipeline generation Experience selling to senior IT and Security stakeholders (CIO CISO level) Fluency in English (Arabic is a strong advantage) Willingness to travel across UAE and GCC Preferred Experience Exposure to ITSM automation or endpoint management tools Experience with enterprise cybersecurity platforms Experience operating in a partner-led sales model within the Middle East Additional Information: Location: Dubai UAE Contract: 2-year renewable contract Competitive compensation (open to negotiation) Candidates outside the UAE may apply if willing to relocate and have Middle East cybersecurity sales experience To know other vacancies we have please feel free to visit our website - Disclaimer: Please note that Black Pearl will never ask any of its candidates for any payment in any form in exchange for our service in helping candidates find a job. Our service is free to our candidates and the recruitment fee is paid by our clients. If you receive any emails SMS or calls requesting you to pay from someone claiming to be an employee of Black Pearl before they can process your application please report and write an email to or contact our office on.
About Company
Black Pearl is a progressive, dynamic and well structured HR solution provider that offers permanent recruitment services, HR consultancy, psychometric assessments, coaching and also professional training services for clients from different corporate sectors in the Middle East. Like a ... View more