About Me
Experienced Big Data Engineer having 3+ years experience, proficient in designing and deploying scalable end-to-end data solutions for enterprises, specializing in data modeling, ETL procedures, data warehousing, and kno…
Experienced Big Data Engineer having 3+ years experience, proficient in designing and deploying scalable end-to-end data solutions for enterprises, specializing in data modeling, ETL procedures, data warehousing, and knowledgeable in data governance and security principles. Skilled in creating and optimizing data pipelines using tools such as Hadoop. Holds a Graduate Certificate in Data Analytics for Business Decision Making with a fundamental understanding of statistics, complemented by knowledge in different machine learning algorithms and their implementation.
Experience
Data Engineer
● Effectively orchestrated the migration of critical datasets from Teradata to cloud-based storage solutions leveraging
Hive and Pyspark technologies.
● Developed and implemented ETL pipelines using IBM Infosphere Data stage for data extraction, transformation, and
loading, resulting in a reduction in processing time and improved data accuracy.
● Led cross-functional collaboration to gather requirements, design data models, and implement solutions, optimizing
migration processes, reducing downtime, and overseeing code deployment, change management, and quality assurance.
● Performed detailed analyses and interpretation of complex data, resulting in actionable insights that led to an increase in
business upliftment.
Data Engineer
Effectively orchestrated the migration of critical datasets from Teradata to cloud-based storage solutions leveraging Hive and Pyspark technologies.
Developed and implemented ETL pipelines using IBM Infosphere Data stage for data extraction, transformation, and loading, resulting in a reduction in processing time and improved data accuracy.
Led cross-functional collaboration to gather requirements, design data models, and implement solutions, optimizing migration processes, reducing downtime, and overseeing code deployment, change management, and quality assurance.
Performed detailed analyses and interpretation of complex data, resulting in actionable insights that led to an increase in business upliftment.
ETL Developer
Developed and executed data analysis techniques in the Informatica power center to identify the correlation between attributes and target variables, resulting in improvement in modeling capabilities, alongside Tidal Workload Automation Software and Autosys for job scheduling and monitoring.
Developed complex SQL queries, stored procedures, and triggers to extract, manipulate, and analyze data from relational databases such as MySQL, Microsoft SQL Server, and Oracle.
Developed data models and schemas tailored to specific application requirements, leveraging the flexibility and scalability of NoSQL databases.
Responsible for gathering, designing, developing, and deploying Power BI reports and dashboards.
Good understanding of ITIL, Incident Management, Problem Management, Change Management, Root cause Analysis.