نبذة عني
Highly accomplished Data Architect with over 7 years of experience architecting and implementing enterprise-wide data platforms and cloud migrations. Proven ability to design modern data lakes, lakehouses, and real-time …
Highly accomplished Data Architect with over 7 years of experience architecting and implementing enterprise-wide data platforms and cloud migrations. Proven ability to design modern data lakes, lakehouses, and real-time streaming solutions using technologies like Delta Lake, Kafka, and Apache Pinot. Successfully led migration to Delta Lake on EMR, reducing SLAs by 75%, and optimized Spark pipelines, improving compute efficiency by 60%. Adept at stakeholder engagement and team leadership, poised to drive digital and AI transformation initiatives for FP&A.
الخبرة
Architect (Data Platform)
Spearheaded the 3-year enterprise-wide official Data Platform charter, directing engine abstractions for unified querying and converged stream, batch, and real-time analytical processing while grooming and mentoring SDE-3 and SDE-4 engineers. Architected and executed the migration of Meesho’s core data framework from a legacy, unstable Redshift architecture to an enterprise-grade open-source Delta Lakehouse on Amazon EMR, resolving chronic data correctness, uptime, and transactional consistency faults. Designed and implemented high-concurrency ingestion endpoints using reactive-netty and Apache Kafka, reducing processing service level agreements (SLAs) from 2 hours to under 60 minutes, with current design optimizations scaling toward sub-5-minute latencies. Engineered a central messaging queue (mQ) platform abstraction layer, enabling the seamless, zero-downtime cross-cloud migration of all organizational Kafka use cases from AWS MSK to GCP Confluent with zero disruption to consumer teams. Built and scaled a highly resilient in-house open-source Kafka ecosystem utilizing Strimzi operators, Cruise Control, and Aiven tiered storage to ensure robust partition balancing and cost-efficient cold storage. Developed a real-time product analytics platform leveraging Apache Pinot, Apache Superset, and a custom high-performance GoLang-based proxy layer, successfully deprecating expensive third-party tools (Mixpanel). Utilized ReactiveX and custom-designed Stream Extractors to optimize Spark-Scala pipeline execution, accelerating job compute efficiency by 60% and reducing infrastructure overhead by 40% under identical ingestion volumes. Established a highly decoupled, real-time event-driven subscription model to automate model execution pipelines and data streaming consumption for downstream engineering teams. Architected functional multi-agent systems and customized LLM automation frameworks to manage end-to-end software development lifecycles, specializing in code compilation, orchestration, and continuous deployment workflows.
Software Engineer
Designed and engineered an in-house unified UPI payment backend infrastructure from inception, scaling core financial transaction systems to meet intense marketplace demands. Restructured and mathematically optimized high-throughput REST APIs, implementing intensive compute routine optimizations that reduced pipeline execution cycles from 16 hours to under 1 hour. Built a standalone, specialized telemetry and monitoring framework to provide deep observability into real-time transactional performance and market stability metrics.
Developer
Developed microservices-backed REST API systems for enterprise Android clients, integrating Google's SafetyNet APIs to enforce stringent runtime client-side security checks. Orchestrated production cloud deployments, structured environment release management protocols, and received the corporate 'On the Spot' award for rapid delivery of a mission-critical compliance requirement.
المشاريع
Data Platform Vision 2030
Spearheaded the 3-year enterprise-wide official Data Platform charter, directing engine abstractions for unified querying and converged stream, batch, and real-time analytical processing while grooming and mentoring SDE-3 and SDE-4 engineers