Shweta Shinde

Shweta Shinde

Data Engineer
USA
Internship Remote

نبذة عني

Data Engineer with 6+ years building scalable ETL/ELT pipelines, data models, and analytics platforms in regulated and enterprise environments. Experienced in data quality, lineage, validation, and control monitoring acr…

الخبرة

AI/ML Engineer Intern

Completum Health Inc., Remote, United States, CA · Sunnyvale , California , United States of America (USA)
May 2025 - حتى الآن · 1 سنة 2 أشهر

Developed large-scale PySpark transformation workflows processing clinical datasets with performance tuning and partition optimization for efficient data lake processing. Designed and implemented medallion architecture (bronze/silver/gold) data pipelines on Databricks for structured dataset preparation supporting inference and evaluation workflows. Built custom data quality monitoring framework validating null checks, duplicate detection, and schema integrity on load; automated alerting via email logs for pipeline anomalies. Implemented a production AI voice agent from scratch using ElevenLabs and Twilio, integrating real-time inference and context retrieval, reducing response latency and improving call workflow consistency. Supported AI/ML data pipelines by preparing structured datasets for inference, evaluation, and retrieval-augmented generation (RAG) workflows, improving contextual response accuracy and reliability. Containerized and deployed ML services using Docker and Kubernetes with CI/CD pipelines, enabling scalable model serving, versioning, and live performance monitoring across multiple production environments.

Cloud Data Engineer

NTT Data, Pune, India, Client: EXXON MOBIL · Pune , Maharashtra , India
Oct 2021 - Apr 2023 · 1 سنة 6 أشهر

Designed and optimized 20+ ETL/ELT pipelines in Azure Data Factory ingesting enterprise-scale datasets into Snowflake, reducing pipeline failures by 10%. Implemented multi-layer data architecture with curated bronze, silver, and gold datasets supporting stakeholder reporting, operational KPIs, and self-serve analytics. Built audit-defensible lineage documentation, data quality checks, and reconciliation workflows ensuring completeness and accuracy of enterprise datasets across source and target systems. Developed control monitoring dashboards to detect pipeline anomalies, SLA breaches, and data drift, enabling proactive resolution and reliable stakeholder reporting.

Data Engineer

Cognizant, Pune, India, Client: Merck · Pune , Maharashtra , India
May 2016 - Aug 2021 · 5 سنوات 3 أشهر

Engineered and maintained large-scale Informatica ETL pipelines for clinical and pharmaceutical datasets in a GxP-regulated environment, ensuring data integrity, completeness, and traceability across global systems. Translated business requirements into ETL logic and delivered applications across the SDLC, applying advanced knowledge of statistics and data modeling to ensure faster and more reliable data flow. Processed and analyzed large-scale COVID-19 vaccine trial datasets, reducing reporting turnaround time by 40% and supporting data-driven research decisions during the pandemic. Selected for a 2-year on-site assignment in Argentina, driving cross-functional data engineering projects and collaborating with business stakeholders to deliver strategic solutions.

المهارات

Python PySpark SQL Spark Java Scala Dimensional modeling Schema design Medallion architecture Data lake design Databricks Snowflake Azure Data Factory AWS S3 AWS Athena AWS EMR Kafka Airflow dbt Data quality validation frameworks Pipeline logging Automated email alerting SLA monitoring Tableau Power BI Stakeholder enablement Cross-functional communication Documentation Docker Kubernetes CI/CD ElevenLabs Twilio
الإبلاغ عن هذا الملف الشخصي؟