Sauvik Chatterjee

• Led multiple teams on critical projects - a. Migration for Amazon warehouse/associate performance data for all EU SCs - providing metrics like End of Shift, End of Day, TPH, b. Reduce wasted trucks by 2.3% through optimized truck scheduling forecast.
• Implemented GDPR compliance framework for extensive data discovery of PI data across data lakes and clusters, and providing hard/soft deletes on request, while setting up fine-grained access control, Data archival strategy, DQ & Usage metrics QuickSight dashboard.
• Architected Single Source Of Truth petabyte-scale Delta Lake (15 min Ingestion SLA) with Apache Hudi, onboarding batch & streaming datasets, handling delta & deletes, setting up Data discovery with LLMs, ML Feature Store & Data Lineages.
• Drove intiatives to migrate legacy infrastructure into Native AWS across org, built pipelines with Glue, Airflow, Containers, Dynamo DB, SageMaker, SQS, SNS, Cloudwatch dashboards for monitoring & alarms with Gitlab & CDK Infrastructure as Code, Unblocked Redshift clusters by implementing WLM & optimization, reducing execution time by 45%, held design reviews & mentoring sessions.

Led multiple teams on critical projects for migration of Amazon warehouse/associate performance data for all EU SCs, providing metrics like End of Shift, End of Day, and TPH.
Reduced wasted trucks by 2.3% through optimized truck scheduling forecast.
Implemented GDPR compliance framework for extensive data discovery of PI data across data lakes and clusters.
Provided hard/soft deletes on request.
Set up fine-grained access control.
Set up data archival strategy.
Set up DQ & Usage metrics QuickSight dashboard.
Architected Single Source Of Truth petabyte-scale Delta Lake with 15 min Ingestion SLA using Apache Hudi.
Onboarded batch and streaming datasets.
Handled delta and deletes.
Set up data discovery with LLMs.
Set up ML Feature Store.
Set up data lineages.
Drove initiatives to migrate legacy infrastructure into Native AWS across org.
Built pipelines with Glue, Airflow, Containers, Dynamo DB, SageMaker, SQS, SNS, and Cloudwatch dashboards for monitoring and alarms.
Used Gitlab and CDK Infrastructure as Code.
Unblocked Redshift clusters by implementing WLM and optimization.
Reduced execution time by 45%.
Held design reviews and mentoring sessions.

Led a team of financial investors, data scientists and engineers to nowcast an important investment metric, Manufacturing PMI, 1 month before publication.
Performed data extraction, cleansing, and EDA from webscraping financial news articles.
Built NLP models like Financial BERT and LLMs for sentiment analysis and time series.
Built LSTM for forecasting.
Used dbt, Snowflake, and GCP.

Integrated data from HR and Operations Data lakes to create data products for Pre and Post-Covid Trend Analysis and Attendance Prediction models for worldwide MS offices.
Validated KPIs like No Shows, Unique Badge Swipes, and Peak Average Attendance metrics by Leadership and Geography.
Created Hybrid Workplace model global dashboard with a target of 50% Employee flexibility for Strategy and Leadership.
Implemented with IoT data using Databricks Spark, ADF pipelines, Power BI, and CI/CD on Azure DevOps.
Spearheaded ML in Sustainability initiative by ingesting and transforming HVAC IoT data, Badge Swipes, and Weather data.
Improved accuracy metric in Smart Start and Stop time prediction by 4% with a target reduction of Carbon footprint by 30%.
Implemented SARIMA and GBM models on Azure ML Studio deployed with Kubernetes, Synapse, and Databricks Spark and Delta lake.
Led migration efforts for 4 teams of all Scala and Python pipelines and orchestration from Databricks to Synapse as Org PoC.
Served as Team Lead and Scrum Master in a 6 member team.
Executed SDLC.
Ensured modular coding.
Ensured Flake8 linting.
Ensured testing frameworks.
Worked in Agile framework.
Collaborated with PO in writing and story-pointing User Stories on Jira.
Estimated efforts and mitigated risks.

Provided consulting exposure to multiple US, Europe and Australia clients.
Created advanced analytical solutions on RDBMS using ETL technologies like SSIS, ODI, Informatica, SAP BODS.
Worked with NoSQL technologies such as Cosmos DB, Dynamo DB, Mongo DB, and Cassandra DB.
Worked with AWS and Azure.
Worked on multiple architectures, design patterns, batch and stream processing, file formats, and performance optimization.
Built from scratch an in-house multitenant Enterprise Data Hub application for Goods & Services Tax using Kafka and Kinesis streaming.
Developed AWS pipelines using On Demand and Auto scaled EMR, Step Functions, Redshift, Elasticsearch, and Kibana for real time ingestion dashboard.
Performed Scala Spark tuning and optimization.
Built monitoring solutions to terminate lingering EMRs.
Received PwC Award.
Migrated On-prem Big Data Applications and Databases architecture for a multinational bank into tiered Data Lake on Azure Datawarehouse and Cosmos DB.
Implemented FIFO queuing mechanism for requests on Snowflake data loader.
Forecasted predictive maintenance of Transformers for an Energy firm through Health Index dashboard with Alteryx.
Ran ML models with Spark on Azure HDInsight with Apache LIVY.
Used IOT sensor data from Cassandra.

Served as onshore Team lead of 5 Analysts from Amsterdam.
Conducted regular meetings with Data Stewards and stakeholders at CxO level.
Analyzed regions and modalities with 80% share loss, 3 year forecasts, and tracked KPIs including Market Pulse, Share Loss, and V Pts.
Implemented centralized analytical capabilities by integrating data from 33 Operating Concerns.
Performed dimensional modelling of UDM (Universal Data Model).
Built Data Marts.
Built Power BI dashboards and ETL pipelines with Azure Databricks, ADF, and DevOps.
Led migration efforts from legacy ERP and CRM to SAP S/4 Hana Central Finance and Salesforce for a finance client in UK.