Shweta S N – LEAD ETL DEVELOPER | Public Profile on Dr.Job

نبذة عني

I am a Immediate joiner and looking for a ETL Developer/Migration developer role. Experienced professional with 5+ years in Talend Open Studio, SSIS (Sql Server Integration Services), MSBI, SAP BODS, Azure Databricks, Az…

الخبرة

Lead ETL Developer

Sapiens Technologies, Bengaluru, India · Bengaluru , Karnataka , India

Dec 2020 - Apr 2026 · 5 سنوات 4 أشهر

Delivered end-to-end ETL development across multiple large-scale insurance and reinsurance clients using Talend Open Studio, SSIS, SAP BODS, Azure Databricks, and SQL Server.

Lead ETL Developer

Sapiens Technologies

Dec 2020 - Apr 2026 · 5 سنوات 4 أشهر

Delivered end-to-end ETL development across multiple large-scale insurance and reinsurance clients using Talend Open Studio, SSIS, SAP BODS, Azure Databricks, and SQL Server.
Architected and developed scalable ELT pipelines using Azure Databricks, implementing a Delta Lake-based Lakehouse architecture across Bronze, Silver, and Gold layers with schema enforcement to deliver reliable enterprise analytics and BI reporting.
Designed and optimized high-performance data ingestion frameworks using Azure Data Factory (ADF) and Databricks Auto Loader for continuous, scalable ingestion of batch and streaming data from RDBMS sources with automated incremental load processing and ADF-based orchestration and scheduling.
Enforced enterprise-grade data governance and security by implementing Unity Catalog for centralized metadata management, fine-grained access control, data lineage tracking, and audit logging across the Databricks Lakehouse environment.
Implemented comprehensive data quality validation frameworks, error-handling mechanisms, and pipeline monitoring across all Lakehouse layers, ensuring data accuracy, completeness, and reliability while integrating with ADF triggers.
Participated in end-to-end environment setup, configuration, and code deployment across Development and SIT environments for Azure Databricks and ADF.

Lead ETL Developer

Hiscox

Designed and developed dataflows, workflows, and job scripts using SAP BODS, supporting full and incremental data loads across Bronze, Silver, and Gold layers of a medallion data warehouse architecture.
Built and optimized SQL scripts, stored procedures, views, and indexes (Clustered & Non-Clustered) to enhance data transformation performance across SQL Server and Sybase environments using DBeaver and SSMS.
Architected a centralized data warehouse by integrating multiple heterogeneous data sources via SAP BODS, ensuring data consistency, reliability, and seamless migration workflows.
Automated data validation processes and daily batch schedulers for incremental data processing, reducing manual effort, minimizing defects, and ensuring timely data delivery.
Collaborated with business stakeholders to gather requirements, recommend technology solutions, and deliver functional specifications aligned with organizational data goals.

ETL Developer

AIG Reinsurance Master

Designed and developed scalable ETL pipelines using Talend Open Studio and SSIS, extracting and transforming data from multiple heterogeneous sources using components such as tMap, tUnion, tFilterRow, and tSortRow to support large-scale data migration and integration projects.
Optimized complex SQL queries, stored procedures, views, and indexes using SSMS, performing execution plan analysis and query tuning to significantly improve data load performance and pipeline efficiency.
Implemented ETL best practices including modular job design, error handling, logging, data validation, and version control using Git/SVN, ensuring consistent standards across development, testing, and production deployment cycles.
Monitored and resolved production ETL issues by performing root cause analysis on pipeline failures and data discrepancies, minimizing downtime and ensuring SLA compliance for critical data workflows.
Supported and mentored junior ETL developers through code reviews and technical guidance, while maintaining detailed documentation of ETL workflows, data mappings, and pipeline configurations to facilitate knowledge transfer and ongoing maintenance.

المشاريع

Axa-Xl-Re

Sapiens

المدة : 23-Apr-2024 - 22-Apr-2026

Architected and developed scalable ELT pipelines using Azure Databricks, implementing a Delta Lake-based Lakehouse architecture across Bronze, Silver, and Gold layers with schema enforcement to deliver reliable enterprise analytics and BI reporting.Designed and optimized high-performance data ingestion frameworks using Azure Data Factory (ADF) and Databricks Auto Loader for continuous, scalable ingestion of batch and streaming data from RDBMS sources with automated incremental load processing and ADF-based orchestration and scheduling.Enforced enterprise-grade data governance and security by implementing Unity Catalog for centralized metadata management, fine-grained access control, data lineage tracking, and audit logging across the Databricks Lakehouse environment.Implemented comprehensive data quality validation frameworks, error-handling mechanisms, and pipeline monitoring across all Lakehouse layers, ensuring data accuracy, completeness, and reliability while integrating with ADF triggers.Participated in end-to-end environment setup, configuration, and code deployment across Development and SIT environments for Azure Databricks and ADF.

المهارات

تأمين إعادة التأمين خادم SQL سايبيس (نظام إدارة قواعد البيانات) مراجعات الشفرة التحقق من البيانات التوثيق الفني التأمين على الحياة تحليل سبب الجذر ساب BODS إس في إن Talend Open Studio SSIS Azure Databricks Azure Data Factory (ADF) Delta Lake Databricks Auto Loader SSMS (SQL Server Management Studio) DBeaver Stored Procedures Views Indexes (Clustered & Non-Clustered) Query Tuning Execution Plan Analysis Incremental Load Batch Processing Streaming Ingestion Pipeline Orchestration & Scheduling SLA Compliance Error Handling Logging Git Agile/Scrum Mentoring Property & Casualty (P&C) Specialty Risk SQL Server Integration Services Business Objects Data Services Azure Data Factory ADF SSMS SQL Server Management Studio Indexes Pipeline Orchestration Scheduling Agile Scrum Unity Catalog Medallion Architecture Delta Lakehouse Data Warehouse Design SQL Data Governance