نبذة عني
Lead Data Engineer (Vice President) with 17 years of experience in Data Ecosystem (Big Data) end-to-end life cycle. Leading the Cloud migration of legacy applications. Extensive work knowledge of Building ETL Data pipeli…
Lead Data Engineer (Vice President) with 17 years of experience in Data Ecosystem (Big Data) end-to-end life cycle. Leading the Cloud migration of legacy applications. Extensive work knowledge of Building ETL Data pipelines and managing large Datawarehouse/Data lakes. Working as Data Solution Architecture (Data Modelling) for Relational and Dimensional models. Extensively worked under AGILE methodology and delivering projects. Played Scrum Master role for 2 years. Handled 24X7 database offshore/onsite models. Good exposure to production environment.
الخبرة
Lead Data Engineer (Vice President)
• Creation of complex Data architecture for each System of
Record (SOR) from file landing area to Data Ingestion into
Hadoop environment and Semantic Consumption Road map.
• Analyze Data and Design and create logical/physical data
models.
•Work with Erwin and Metadata Repository in creating and
maintaining the large data models.
• Work with Senior Leadership team on new data management
strategies Designing and implementations.
• As a Technical leader provide guidance and analysis to team
members.
• Work with Data profiling and quality teams about each of the
SOR level data elements.
• Work with Data analytics team on consumption of HDFS,
Teradata data.
• Perform code review for ETL (Ab-initio, Informatica, DPL
pipelines) graphs, Teradata objects and Control-M schedules.
Lead Data Engineer (Vice President)
Creation of complex Data architecture for each System of Record (SOR) from file landing area to Data Ingestion into Hadoop environment and Semantic Consumption Road map.
Analyze Data and Design and create logical/physical data models.
Work with Erwin and Metadata Repository in creating and maintaining the large data models.
Work with Senior Leadership team on new data management strategies Designing and implementations.
As a Technical leader provide guidance and analysis to team members.
Work with Data profiling and quality teams about each of the SOR level data elements.
Work with Data analytics team on consumption of HDFS, Teradata data.
Perform code review for ETL (Ab-initio, Informatica, DPL pipelines) graphs, Teradata objects and Control-M schedules.
Data Specialist (ETL)
Worked for Data store projects for LPL Financial of San Diego, CA, USA and Dean Health Insurance (DHI) of Madison WI, USA.
Involved in Micro Design document as per requirement mentioned from Business team.
Involved in development Informatica deliverables.
Preparing Test cases required for unit testing according to business requirement.
Handling Defect and providing solutions.
Involved in development of STEPWISE Data Store project for ARMOR (INTG).
Worked with on-site on Data Model creation for Stepwise Data Store.
Developed Informatica and Robo-FTP (Scripts) deliverables to client.
Handled logic modification to Audit Balance Control Mappings.
Involved in analysis and design for Clinical Designs ICD-9 to ICD-10 code conversion module.
Data Engineer
Participated in Requirement Analysis at client location with Business Analysts team.
Closely worked with Data Architect on Logical and Physical Data Modeling of ODS using Erwin.
Involved in ETL design and development of ODS.
Mappings created to populate the Staging Table, ODS and DWH Dimensions and Fact tables.
Point of contact for importing Source/Target Tables from the respective databases/flat file.
Extensively used Debugger to monitor and troubleshoot mappings of peer developers to ensure correct flow of data through mappings.
Participated in System Integration Testing and UAT at client location with both BOB and HP’s Functional and technical teams.
Developed data masking techniques using Java transformations to prevent production data from testing environment.
Performed the data profiling and Referential Integrity checks on the source data.
Involved in doing Unit testing, writing Test Cases, Validations and Performance Tuning and optimization.