About Me
Methodological and accomplished professional with 13+ years of IT experience in Design, Analysis, Development, Implementation of Data Warehousing applications with Banking and Telecom domain. Extensive knowledge on Data …
Methodological and accomplished professional with 13+ years of IT experience in Design, Analysis, Development, Implementation of Data Warehousing applications with Banking and Telecom domain. Extensive knowledge on Data migration and data integration techniques. Noted for delivering complex projects by stimulating people’s engagement and precise estimation.
Experience
DATA ANALYST/ AB INITIO DEVELOPER
Working closely with the business and technical teams to analyze the information, requirement gathering and provide solution for the same.
Worked on various operation data sources like XMLs, MS SQL and Oracle.
Created data pipeline architecture (ETL flow) to handle huge amount of data and generate multiple financial reports.
Creating PDLs, Plans, Rollup, Scan, Join, Partition by key using Abinitio.
Created generic graphs to perform Data cleansing and XML File validations.
Analyzed the existing legacy system components for BODS (Billing Operational Data Store) to BFODS (Billing financial operating data store) migration activity, where BODS PL/SQL functions were converted to ETL flow with great performance tunning approach.
Worked on Continuous components like Subscriber/Publisher to consume real time messages.
Developed some innovative productivity improvement utilities, which has significantly reduced the amount of work for the team and helped in automation of the application.
One example is reprocessing framework, which has helped team to reprocess easily any past dated transactions.
Provided production support for data migration release activity.
Created generic Unix scripts to monitor the running Abintio plan and generate intermediate reports with all the information like total no of completed modules, name of currently running module, Total number of processed records in current module etc.
This has significantly helped production support team to monitor the process and raise immediate alarm in case of any process failure or database stuck etc.
Mentored and trained development team and testing team to get better understanding on functional and technical knowledge of the application.
Data Engineer
CLIENT: TRAVELLERS INSURANCE (PROJECT – CANADA PROPEL - FODS)
Propel is integrated system to store data from policy center, billing center and claim center. BFODS is financial operating data store to manage billing data and create reports.
• Working closely with the business and technical teams to analyze the information, requirement gathering and provide solution for the same.
• Worked on various operation data sources like XMLs, MS SQL and Oracle. Created data pipeline architecture (ETL flow) to handle huge amount of data and generate multiple financial reports.
• Creating PDLs, Plans, Rollup, Scan, Join, Partition by key using Abinitio. Created generic graphs to perform Data cleansing and XML File validations.
• Analyzed the existing legacy system components for BODS (Billing Operational Data Store) to BFODS (Billing financial operating data store) migration activity, where BODS PL/SQL functions were converted to ETL flow with great performance tunning approach.
• Worked on Continuous components like Subscriber/Publisher to consume real time messages.
• Developed some innovative productivity improvement utilities, which has significantly reduced the amount of work for the team and helped in automation of the application. One example is reprocessing framework, which has helped team to reprocess easily any past dated transactions.
• Provided production support for data migration release activity. Created generic Unix scripts to monitor the running Abintio plan and generate intermediate reports with all the information like total no of completed modules, name of currently running module, Total number of processed records in current module etc. This has significantly helped production support team to monitor the process and raise immediate alarm in case of any process failure or database stuck etc.
• Mentored and trained development team and testing team to get better understanding on functional and technical knowledge of the application.
ETL DEVELOPER - ABINITIO
Worked as lead ETL developer(Abinitio/Talend) in the team.
Created Abinitio graphs by extensively using continuous components like MQueue, Abinitio Queues.
Involved in submitting requests for code migrations between Dev, SIT, UAT and Production.
Prepared all relevant rollout documents like Job Scheduling details, EME Project details, and SIT/UAT Signoff emails etc.
SENIOR ETL DEVELOPER - ABINITIO
Worked extensively with cross site development teams in Canada and USA for design decisions and code walk-through and code review.
Major contribution in Data migration activity from TS1 product processor database to TS2 database.
During this activity around 100 tables containing millions of records have been migrated from one database to another database.
Created generic utilities (Abinitio graphs, plans, xfrs), which has reduced significant amount of development efforts for the team.
Developed some innovative automation utilities.
One example is generic data patch utility which is capable to update any fields in database using different source database or files with some transformations.
This can be used for many tables at the same time.
So, it has reduced significant amount of development efforts for any type of data patches in the database.
DATA SPECIALIST
Analyze the old CSI system data and identify the old system and its resources in place, which helped in development faster.
Extract data from the old system and do the data profiling using Abinitio data profiler.
Worked as an ETL offshore lead developer and had closely interacted with onsite counterparts to analyze the requirements and come up with the design documents representing the same.
Worked on Abinitio integration with Hadoop file system.
Widely used HDFS input and output file components.
Developed shell scripts and wrapper scripts to run Abinitio graphs.
Worked in DQ and rapid team as a developer and Data analyst using SSIS and Abinitio ETL tools.
This team involved in handling small projects having limited and fixed deadline and analyzing already deployed code in the production.
Perform code fix according to requirements.
Handled complex DQ's (data quality issues in production) and provided quick solutions to clients.
ASSOCIATE CONSULTANT
To work with the client’s business team in providing Requirement Gathering, Analysis, Application Design, and Application development activities.
Performed quick analysis on any production failure and provide efficient solution for the same.
PROJECT ENGINEER
Involved in the development of mappings using various transformations like Source Qualifier, Normalizer, Reformat, Lookup, Filter, Join etc.
Performance tuning at mapping level and graph level.
Used ETL (SSIS) to develop jobs for extracting, cleaning, transforming, and loading data into data warehouse.
Developed a package perform various criteria checks on XML input.
Extensively used SSIS transformations such as Lookup, Derived column, Data conversion, Aggregate, Conditional split, SQL task, Script task and Send Mail task etc.
Created SSIS Reusable Packages to extract data from Multi formatted Flat files, Excel, XML files into SQL Server.
Performed operations like Data reconciliation, validation and error handling after Extracting data into SQL Server.
Developed some complex tasks using VB scripting.
Involved in preparing the unit and assemble test cases for entire module.