About Me
Skilled IT professional with 6 years of experience in areas of Data Engineering, Data Integration, ETL, ELT, Data Migration, Data and Analytics, Business Intelligence, Data Analysis, and Data Warehouse. Proficient in Des…
Skilled IT professional with 6 years of experience in areas of Data Engineering, Data Integration, ETL, ELT, Data Migration, Data and Analytics, Business Intelligence, Data Analysis, and Data Warehouse. Proficient in Designing and Implementing scalable data solutions (Orchestration, Ingestion, Curation, Enrichment) using IICS, Informatica BDM and Power Center. Expert in building and maintaining data pipelines using SQL and Python, in Azure Synapse Analytics and Azure Data Factory. Demonstrated success in automating business and system processes to enhance efficiency and value.
Experience
Senior Data Engineer
Skills:
• Data Engineering: Azure Synapse Analytics, Azure Data Factory, Azure Data Lake, IICS, Informatica Power Center, Informatica Developer
• Data Analytics: ERwin, Informatica Analyst, Informatica Data Quality
• Database Management: Apache Hive; Relational: Netezza, Sybase T-SQL, Oracle, Teradata; Nosql
• Data Integration Methodology: ETL, ELT, EtLT
• Data Warehousing Tools: SQL Developer, Teradata SQL Assistant, Toad Data Point
• Programming Languages & Operating Systems: SQL, Python & UNIX, Linux, Windows
• Scripting Languages: Python Scripting, Shell Scripting
• Job Scheduler: Cron, ESP (CAWorkstation)
• Soft Skills: Agile, Scrum, Project management, Client engagement, Critical Thinking
PROFESSIONAL EXPERIENCE
Largest MNC, Feb 2018 - Jan 2024
Below are each Projects within that Organisation
Senior ETL Developer (Feb 2022 -Jan 2024)
Financial Management External Reporting (BFS) – Project for Largest North American Bank is a business-driven analytical and reporting environment that allows users to integrate information from multiple source systems of different dataset i.e Flat file, XML, JSON, Relational Table, in intuitive manner to support regulatory reports.
Orchestrated the design and implementation of end-to-end ETL, ELT, EtLT processes utilising Informatica Power Center (IPC) for Netezza Database and Informatica Cloud IICS, Informatica BDM for Hive Database to generate MicroStrategy reports.
Designed 20 Informatica BDM/ IICS Workflow/ Taskflow for Data Ingestion, Curation and Enrichment.
Developed data load validation process, Unit Test cases, SIT support, Production Implementation document, and deployed 45 Informatica Power Center Workflows to higher environments.
Managed 75 real-time General Ledger data modification, adhering to a 24-hour SLA.
Hosted Knowledge Transfer Sessions on new learnings, implementation, and mentored new joiner.
ETL Developer/ Data Migration Analyst (Jun 2021 - Jan 2022)
Migrated a specific Database to new appliance, leading to a 35% performance enhancement of Databases within the existing appliance.
Worked as a technical lead, prepared due Diligence Deck, conducted Impact Analysis on Mapping, Workflow, Unix scripts, SAS jobs, and data load validation processes.
Created 12 ETL Workflows with Cross-Database joins, subqueries within Database Views and ETL mapping for seamless data migration.
Performed dry run of Workflows, data load validation processes, Unix scripts, and SAS jobs on a new appliance.
Developed a Python
Senior ETL Developer
Orchestrated the design and implementation of end-to-end ETL, ELT, EtLT processes utilising Informatica Power Center (IPC) for Netezza Database and Informatica Cloud IICS, Informatica BDM for Hive Database to generate MicroStrategy reports.
Designed 20 Informatica BDM/ IICS Workflow/ Taskflow for Data Ingestion, Curation and Enrichment.
Developed data load validation process, Unit Test cases, SIT support, Production Implementation document, and deployed 45 Informatica Power Center Workflows to higher environments.
Managed 75 real-time General Ledger data modification, adhering to a 24-hour SLA.
Hosted Knowledge Transfer Sessions on new learnings, implementation, and mentored new joinee.
ETL Developer/ Data Migration Analyst
Migrated a specific Database to new appliance, leading to a 35% performance enhancement of Databases within the existing appliance.
Worked as a technical lead, prepared due Diligence Deck, conducted Impact Analysis on Mapping, Workflow, Unix scripts, SAS jobs, and data load validation processes.
Created 12 ETL Workflows with Cross-Database joins, subqueries within Database Views and ETL mapping for seamless data migration.
Performed dry run of Workflows, data load validation processes, Unix scripts, and SAS jobs on a new appliance.
Developed a Python Tkinter GUI enabling execution of diverse Unix script for enhanced efficiency.
ETL Developer/ Data Analyst
Led Enterprise data modeling, analysis, profiling, mapping documentation, Metadata creation and built ETL mapping in Informatica Power Center.
Engaged in business requirement gathering, defining source-target design specifications, and formulating transformation rules, logic, and conditions for ETL processes, which focus on BFS customer information.
Engineered a Python automation script to generate monthly metrics for Informatica incident cases, resulting in 93% reduction in manual work.
Data Integration Specialist
Architected and executed a data integration solution to harmonise material numbers in 8 applications post company acquisition.
Successfully eliminated 240 ID conflicts, enhancing data integrity and paving the way for improved downstream operations.
Designed and implemented SQL scripts for impact tables.
Facilitating data modifications within Data Warehouse.
Performed System Integration Testing and monitored data flow, ensuring seamless integration in Teradata and Oracle environments.
Data Migration Analyst
Upgraded 12 Sybase Database Servers from version 15.5 to 16 and cross-platform OS migrated from Unix to Linux for World’s largest Retail Company.
Developed automated tool using Korn Shell for reporting on DB object discrepancies, which reduced 70% manual efforts and reverse- engineered impact Shell Scripts for Crontab scheduling.
Optimised and restructured impact 45 Stored Procedures, 56 Triggers and 32 Views.
As a DBA, execute server-related tasks such as disk initialization, mount point check, binary file build, source and target Server build, data dump and load for servers.