Rohit Kumar

Rohit Kumar

Azure Data Engineer
Canada

About Me

Over 3+ years of experience in developing, analyzing, designing, and implementing Data Engineering and Analytics solutions by Azure Data Factory, Databricks, Azure Synapse, ADL, Azure SQL, & Power BI
 Highly Skilled in…

Experience

Azure Data Engineer

Manulife, Canada
Jun 2022 - Present · 4 years 1 month

Collaborated with cross-functional team members, and with input from relevant working groups or committees, determine data requirements, and administer several annual and ad hoc data
Designed and developed components and features for the ingestion framework, based on functional and non-functional requirements in Python/PySpark within the Azure platform
Worked on full end-to-end development activities from going live for development in the Azure platform
Developed full pipeline ETL applications to move data within a corporate data management platform, with both MS Azure and MS SQL Server tools
Participated in data integration projects, and worked with other teams to ensure that data is integrated effectively across different systems and applications.
Participated with corporate data user teams, developing data validation and test plans, performing user acceptance testing, and providing feedback to development and sustainment teams
Involved in the core company data pipeline, responsible for scaling up data processing flow to meet the rapid data growth
Developed data processing pipelines in the Azure environment (receiving content, transforming data, and sending to a target)
Responsible for data collection and ingestion from external sources, and optimizing data flow between different systems and environments
Designed and build reusable data extraction, transformation, and loading processes to handle data from various sources
Created and maintained highly scalable data pipelines across Azure Data Lake Storage, and Azure Synapse using Data Factory, Data bricks

Data Engineer

manulife
Jun 2022 - Present · 4 years 1 month

Collaborated with cross-functional team
members, and with input from relevant working
groups or committees, determine data
requirements, and administer several annual and
ad hoc data
 Designed and developed components and
features for the ingestion framework, based on
functional and non-functional requirements in
Python/PySpark within the Azure platform
 Worked on full end-to-end development
activities from going live for development in the
Azure platform
 Developed full pipeline ETL applications to move
data within a corporate data management
platform, with both MS Azure and MS SQL Server
tools
 Participated in data integration projects, and
worked with other teams to ensure that data is
integrated effectively across different systems
and applications.
 Participated with corporate data user teams,
developing data validation and test plans,
performing user acceptance testing, and
providing feedback to development and
sustainment teams
 Involved in the core company data pipeline,
responsible for scaling up data processing flow
to meet the rapid data growth
 Developed data processing pipelines in the
Azure environment (receiving content,
transforming data, and sending to a target)
 Responsible for data collection and ingestion
from external sources, and optimizing data flow
between different systems and environments
 Designed and build reusable data extraction,
transformation, and loading processes to handle
data from various sources
 Created and maintained highly scalable data
pipelines across Azure Data Lake Storage, and
Azure Synapse using Data Factory, Data bricks

ETL Developer

PROGHUT SOLUTIONS, India
Jan 2020 - May 2022 · 2 years 4 months

Designed, created, and maintained SSIS (SQL Server Integration Services) packages to facilitate the migration of data to FNZ databases
Designed and developed Extract, Transform, Load (ETL) workflows adhering to best practices, and create reusable components to optimize the efficiency and effectiveness of data migration processes
Offered post-implementation support once the migration is complete, assisting both the project team and the service and support teams in identifying and resolving issues that may arise
Collaborated effectively with internal teams and client stakeholders to understand their data requirements, gather feedback, and ensure alignment between technical solutions and business needs
Continuously assessed and optimized the performance of ETL workflows and data migration processes to enhance efficiency, minimize processing time, and improve overall system performance
Shared expertise and knowledge with team members, providing training and guidance on data mapping solutions, ETL development best practices, and migration processes

System Administrator

Chandigarh University, India
Jun 2013 - Dec 2019 · 6 years 6 months

Responsible for the planning, deployment, configuration, and maintenance of the university's computer systems, servers, networking devices, and other hardware components. This includes managing the university's data centers, ensuring optimal performance, and addressing any hardware failures or issues.
Involved in installing, configuring, and maintaining operating systems, such as Windows, Linux, or macOS, on university computers. This involves applying patches and updates, managing user accounts and permissions, and ensuring the systems are secure and up to date
Overseeing the university's network infrastructure, including routers, switches, firewalls, and wireless access points. Ensured the network is properly configured, secure, and functioning optimally. which involves monitoring network traffic, troubleshooting network issues, and implementing network upgrades or expansions when necessary.
Provided technical support to faculty, staff, and students, assisting them with any IT-related problems they encounter. Also worked on troubleshooting software and hardware issues, assisting with software installations, and resolving network connectivity
Played a critical role in ensuring the security of the university's data and systems. Involved in implementing security measures such as firewalls, antivirus software, and intrusion detection systems. And also monitored system logs for potential security breaches, conduct security audits, and develop and enforce IT security policies
Responsible for implementing and maintaining backup systems and procedures to protect the university's data from loss or damage.
Worked on regular backups of critical systems and data, testing the backup and recovery processes, and ensuring the availability of data in the event of a disaster.
Managed the software licenses for the university, ensuring compliance with licensing agreements and maintaining an inventory of licensed software.

Skills

Big Data Data Repository Hadoop Scala Spark Apache Hive Apache Pig Amazon Web Services (AWS) Kafka NoSQL Redshift S3 Azure Data Factory Databricks Azure Synapse Azure Data Lake Azure SQL Power BI Python PySpark SQL Tableau MS SQL Server Oracle MySQL IBM DB2 Jupyter PyCharm SQL Server Integration Services SQL Server Reporting Services SQL Server Analysis Services NumPy Pandas RESTful API Azure Storage FTP Azure Queue Storage Agile Lean Scrum
Report this Profile?