About Me
8 years of experience in the IT industry as a Senior Software Developer in Analyzing, Designing, Developing, Testing, and Customer Support on ETL Development
Used various GCP tools and technologies, such as Data Transfer…
8 years of experience in the IT industry as a Senior Software Developer in Analyzing, Designing, Developing, Testing, and Customer Support on ETL Development
Used various GCP tools and technologies, such as Data Transfer Service, Cloud Storage, and Big Query, to execute the migration plan.
Have extensively worked in developing ETL programs for supporting Data Extraction, transformations, and loading using Informatica Power Center.
Developed Python scripts to connect to Oracle databases and retrieve the data for analysis
Utilized the cx_oracle to connect to databases and requests library to access and retrieve data from various services enabling real-time data analysis and reporting
Conducted data processing and analysis tasks using unix shell commands and scripting resulting in improved data accuracy and efficiency
Led a team of five data migration engineers, who were responsible for designing and executing the migration plan.
Expertise in SQL and Experience in integration and transforming of various data sources from Databases like Oracle, DB2, SQL Server, and formats like flat files.
Conducted extensive data validation and cleansing to ensure that the migrated data was accurate and consistent using Python Panda’s framework.
Worked on parsing the data using Python data flow - ETL jobs in GCP and created custom SQL scripts for data load and refresh.
Designed a migration plan that involved using GCP's Data Transfer Service to transfer the data to Cloud Storage, and then using Big Query to analyze the data.
Expertise in SQL, Indexing, and performance tuning.
Experience with dimensional modeling using star schema and snowflake models
Tuned Informatica mappings/sessions for better ETL performance by eliminating bottlenecks.
IBM Infosphere Optim Certified Associate for Data Archiving and Test Data Management Strong knowledge of developing Data Growth solutions, Test Data Management and Data Masking solutions, Application Retirement (Decommissioning)solutions using IBM Infosphere Optim
Good in R&D new technologies and Documentation (Technical Design, Functional Test Scenarios, and Unit Test Cases)
Experience
Data Engineer
Develop Ingestion and Inquiry data models for entity ingestion into Equifax system and return inquiry files based on search & match.
Develop ETL pipelines, and SQL scripts and use GCP services to implement new rules and algorithms to help achieve accuracy goals.
Ensure that Keying & Linking algorithms and attributes are certified pre and postproduction.
Managed a team of four people.
Developed high-level design and strategies for data issues, data refresh, and data quality checks.
Worked on requirement gathering, extraction, design, and development for migrating Full File Fixed and Avro format files data to Google Cloud Platform (GCP) Big Query tables.
Designed a migration plan that involved using GCP's Data Transfer Service to transfer the data to Cloud Storage, and then using Big Query to analyze the data.
Developed Python scripts to connect to Oracle databases and retrieve the data for analysis.
Utilized the cx_oracle to connect to databases and requests library to access and retrieve data from various web services enabling realtime data analysis and reporting.
Conducted data processing and analysis tasks using unix shell commands and scripting resulting in improved data accuracy and efficiency.
Conducted extensive data validation and cleansing to ensure that the migrated data was accurate and consistent using Python Panda’s framework.
Designed and implemented cloud-based solutions using GCP services such as Compute Engine, Kubernetes Engine, Cloud Storage, and Cloud SQL.
Worked on parsing the data using Python data flow jobs in GCP and created custom SQL scripts for data load and refresh.
Determine search and match rules and configure YAML file rules for entity resolution and make sure there is no over-combining or fragmentation.
Managing end-to-end scheduling using Control-M ensuring timely execution of critical process.
Senior Database Engineer
8 years of experience in the IT industry as a Senior Software Developer in Analyzing, Designing, Developing, Testing, and Customer Support on ETL Development
Used various GCP tools and technologies, such as Data Transfer Service, Cloud Storage, and Big Query, to execute the migration plan.
Have extensively worked in developing ETL programs for supporting Data Extraction, transformations, and loading using Informatica Power Center.
Developed Python scripts to connect to Oracle databases and retrieve the data for analysis
Utilized the cx_oracle to connect to databases and requests library to access and retrieve data from various services enabling real-time data analysis and reporting
Conducted data processing and analysis tasks using unix shell commands and scripting resulting in improved data accuracy and efficiency
Led a team of five data migration engineers, who were responsible for designing and executing the migration plan.
Expertise in SQL and Experience in integration and transforming of various data sources from Databases like Oracle, DB2, SQL Server, and formats like flat files.
Conducted extensive data validation and cleansing to ensure that the migrated data was accurate and consistent using Python Panda’s framework.
Worked on parsing the data using Python data flow - ETL jobs in GCP and created custom SQL scripts for data load and refresh.
Designed a migration plan that involved using GCP's Data Transfer Service to transfer the data to Cloud Storage, and then using Big Query to analyze the data.
Expertise in SQL, Indexing, and performance tuning.
Senior Data Engineer/ETL Developer
Worked in all phases of the Software Development Life Cycle (SDLC) and Agile model of data warehouse architecture, from gathering requirements, extraction, manipulation, cleansing, testing, reporting and visualization of the application data.
Developed complex mappings in Informatica Power Center to load the data from various sources using different transformations like Source Qualifier, Lookup (connected and unconnected), Expression, Stored Procedure Aggregate, Update Strategy, Joiner, Filter, and Router.
Used Data Warehousing Concepts like Ralph Kimball Methodology, Bill Inmon Methodology, OLAP, OLTP, Star Schema, Snowflake Schema, Fact Table, and Dimension Table.
Tuned Informatica mappings/sessions for better ETL performance by eliminating bottlenecks.
Created and scheduled Sessions and Batches through the Informatica Server Manager.
Experienced in Repository Configuration/using Transformations, creating Informatica Mappings, Mapplets, Sessions, Worklets, Workflows, Processing tasks using Informatica Designer/Workflow Manager to move data from multiple source systems into targets.
Developed Tableau data visualization using Cross tabs, Heat maps, Box and Whisker charts, Scatter Plots, Geographic Map, Pie Charts Bar Charts, and Density Chart.
Built data warehouses and identified key metrics and built executive facing dashboards using Tableau to track the progress of the business and its highest priority initiatives.
Got involved in designing the Data model for the Data warehouse and for different Data marts.
Performed End to end testing using SQL Queries in Oracle.
Data Engineer
Worked on Informatica power center tool - Source Analyzer, Warehouse Designer, Mapping Designer, Mapplets, and Transformation Developer.
Used Informatica Workflow Manager to create workflows, database connections, sessions, and batches to run the mappings.
Used Variables and Parameters in the mappings to pass the values between mappings and sessions.
Implemented restart strategy and error handling techniques to recover failed sessions.
Used Unix Shell Scripts to automate pre-session and post-session processes.
Build a strategy for data recovery in case of Failures.
Extracted data from various sources like SQL Server, Oracle, CSV, Excel, Text, and JSON files.
Develop best practices, processes, and standards for effectively carrying out data migration activities.
ETL Developer
Worked on Data warehousing projects and developed Slowly Changing Dimensions Type II in the Mapping Designer.
Used Date functions, String functions, and Database functions to manipulate and format source data as a part of the Data cleansing and data profiling process.
Created Clustered and Non-Clustered Indexes on tables for performance optimization.
Developed an interactive transaction to migrate all orders from legacy to the current system.
Created various mappings using Aggregate, Filter, Join, Sequence Generator, Expression, Lookup, Update Strategy, and Router.
Incorporated user-level and row-level security using permissions and filters in Power BI & Tableau.
Drove 97% stability, reliability, and performance by optimizing in-application SQL statements reducing time and expenses by 30% for a $50M project.
Received Applause award.
Experienced in installing and configuring Tableau data sources like Oracle, Snowflake, Hadoop, etc.
Followed PII security controls to protect sensitive data.
Prepared many other reports by using master details, crosstabs, slice and dice, and drill mode as per the requirement of the end-uses.
Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
Data Analyst
Developing large-scale data structures and pipelines to organize, collect and standardize data that helps generate insights and addresses reporting need.
IBM Infosphere Optim Certified Associate for Data Archiving and Test Data Management Strong knowledge of developing Data Growth solutions, Test Data Management and Data Masking solutions, Application Retirement (Decommissioning)solutions using IBM Infosphere Optim.
Implemented TDM solution using IBM Infosphere Optim data management tools.
Created a golden copy of test data using IBM OPTIM.
Created access definitions, relationships, column maps, table maps, and performing extracts, conversions, exports/imports, inserts/loads.
Presented workshops to Client Application teams to showcase Sub - Setting & Masking solution.
Developed data archival solutions and improved speeds for transactions on databases.
Performed data masking on PII and PCI data in the testing environment.
Experience in creating Views, Constraints, Triggers, Joins, Cursors, Temp Table, Table Variable, Functions, Batch Scripts, and numerous stored procedures consumed at various stages of migration/cleansing process, reports, or data validation.
Developed data decommissioning solution using IBM Optim for more than 10 applications (such as Oracle Peoplesoft, Oracle JD Edwards, etc.).
Expertise in SQL, Indexing and performance tuning of Archiving/Extracting Process.
Good in R&D new technologies and Documentation (Technical Design, Functional Test Scenarios, and Unit Test Cases).