About Me
Nearly 4 years of professional experience in Azure Data Engineering, with expertise in retrieving and manipulating data using SQL techniques, Data Ingestion, and creating pipelines
Proficient in Azure Cloud, Azure Data F…
Nearly 4 years of professional experience in Azure Data Engineering, with expertise in retrieving and manipulating data using SQL techniques, Data Ingestion, and creating pipelines
Proficient in Azure Cloud, Azure Data Factory (ADF), Snowflake, Apache Airflow, and reporting tools like Power BI and Tableau
Extensive proficiency in designing, implementing, and managing data pipelines using Azure Data Factory and reduction in ETL processing
Led the implementation and optimization of Azure Data Lake solutions, achieving a notable enhancement in data accessibility and analytics readiness has successfully reduced data errors
Innovative in creating Azure SQL databases, monitoring, and restoring Azure SQL databases, and migrating Microsoft SQL Server to Azure SQL databases and implemented robust monitoring solutions, resulting reduction in response time to database-related issues
Expertise in Azure Databricks for advanced analytics, contributing to a 25% improvement in data processing speed and reduction in time-to-insight by integrated machine learning capabilities, enhancing predictive modelling accuracy by 15%
Dynamic in architecting and managing data warehousing solutions using Azure SQL Data Warehouse and Azure Synapse Analytics, maintaining a quality uptime
Skilled in designing and implementing efficient data ingestion strategies in Azure, leveraging services like Azure Data Factory, Azure Event Hubs, and Azure Logic Apps to seamlessly and securely ingest, transform, and route data from diverse sources to Azure data platforms, enabling timely and data-driven decision-making
Leveraged structured and unstructured data management and modern data transformation methodologies to fulfil data-related requests
Accomplished analytical products for warranty management using Power BI, SQL Server, and Azure, showcasing superior skills in Advanced Excel for data visualization
Excellent people skills, initiative-taking, dedicated, and strong communication skills, with a keen understanding of project timelines and dependencies
Well-versed in Jira and Confluence to streamline project management and collaboration processes, enhancing team productivity and ensuring effective communication and documentation within Agile development environments
Experience
Azure Data Engineer
Contributed to the design and implementation of scalable data architectures, resulting in improvement in system performance
Assisted in the development of data models, supporting efficient query response times, and improving overall data accessibility
Improved data processing pipelines, resulting in reduced processing errors and enhanced data consistency and quality across diverse datasets
Implemented efficient data storage solutions, optimizing Azure Blob Storage utilization for cost savings
Established data retention policies to ensure compliance while reducing storage clutter
Managed robust ETL processes with Azure Data Factory, significantly improving data integration efficiency and processing substantial volumes of data that ensured accuracy and reliability in downstream analytics
Managed and optimized data warehousing operations using Snowflake, facilitating real-time data analytics and improving overall data performance, resulting in increased data-driven decision-making capabilities and operational efficiency
Participated in the implementation of strong data encryption mechanisms, bolstering data security
Played a key role in conducting regular audits to ensure data integrity and compliance with regulatory requirements
Established comprehensive monitoring solutions to enhance operational efficiency
Reduced downtime by proactively identifying issues
Established automated alerting mechanisms to improve incident response times
Stayed current with the latest Azure Data Services through continuous learning and certifications
Mentored junior team members, contributing to their professional growth, and fostering a collaborative work environment
Identified and addressed performance bottlenecks to significantly improve query execution time
Conducted performance tuning on Azure Synapse Analytics, leading to an increase in overall system efficiency
Azure Data Engineer
• Contributed to the design and implementation of scalable data architectures, resulting in improvement in system performance and assisted in the development of data models, supporting efficient query response times, and improving overall data accessibility
• Improved data processing pipelines, resulting in reduced processing errors and enhanced data consistency and quality across diverse datasets
• Implemented efficient data storage solutions, optimizing Azure Blob Storage utilization for cost savings, and established data retention policies to ensure compliance while reducing storage clutter
• Managed robust ETL processes with Azure Data Factory, significantly improving data integration efficiency and processing substantial volumes of data that ensured accuracy and reliability in downstream analytics
• Managed and optimized data warehousing operations using Snowflake, facilitating real-time data analytics and improving overall data performance, resulting in increased data-driven decision-making capabilities and operational efficiency
• Participated in the implementation of strong data encryption mechanisms, bolstering data security and played a key role in conducting regular audits to ensure data integrity and compliance with regulatory requirements
• Established comprehensive monitoring solutions to enhance operational efficiency, reduced downtime by proactively identifying issues and established automated alerting mechanisms to improve incident response times
• Stayed current with the latest Azure Data Services through continuous learning and certifications, mentored junior team members, contributing to their professional growth, and fostering a collaborative work environment
• Identified and addressed performance bottlenecks to significantly improve query execution time and conducted performance tuning on Azure Synapse Analytics, leading to an increase in overall system efficiency
Data Test Analyst
Led extensive testing initiatives across diverse data sets, ensuring high accuracy, completeness, and consistent data quality standards
Implemented systematic testing procedures that significantly reduced data quality issues, fostering a data environment characterized by increased accuracy and minimized discrepancies
Developed and executed comprehensive test plans and strategies for effective data validation and verification, leading to improved testing efficiency and a significant reduction in the time required for data validation processes
Collaborated with cross-functional teams to establish testing objectives and priorities, fostering increased alignment between testing efforts and overarching business goals
Applied advanced data profiling techniques to identify anomalies, patterns, and trends, enhancing early detection of potential data issues and contributing to a significant reduction in data-related incidents
Spearheaded the implementation of robust quality assurance processes, resulting in a notable reduction in data discrepancies and improved data accuracy throughout the data lifecycle
Utilized testing tools and automation scripts to streamline data testing processes
Stayed updated on industry-standard testing tools and incorporating them into the testing framework