jaykumar

jaykumar

Azure Data Engineer
Canada

About Me

Experienced Azure Data Engineer with over 3+ years of expertise in architecting, implementing, and managing end-to-end data solutions utilizing a diverse stack of Azure data services and associated technologies

Experience

Azure Data Engineer

Scotiabank
Oct 2020 - Present · 5 years 9 months

• Experienced Azure Data Engineer with over 3+ years of expertise in architecting, implementing, and managing end-to-end data solutions utilizing a diverse stack of Azure data services and associated technologies
• Proficient in designing and implementing scalable and efficient Data pipelines using Azure Data Factory, Azure Data Lake, and Azure Synapse, ensuring optimal performance and reliability
• Efficient in working with a wide range of Azure services including Azure Blob Storage, Azure Data Explorer, and Azure Cosmos DB, leveraging their capabilities to enhance data processing and analytics
• Leveraged in developing ETL processes using Python and PySpark to extract, transform, and load data from various sources into Azure data repositories, maintaining Data quality and consistency up to 85% throughout the process

Skills

Business Communication Full Stack Development Glass Surfaces Azure Data Factory Azure Data Lake Azure Synapse Azure Blob Storage Azure Data Explorer Azure Cosmos DB Python PySpark ETL Data Warehousing Snowflake Power BI Azure Key Vault SQL Azure Databricks CI/CD Azure Data Pipeline Azure Stream Analytics Jira Confluence Tableau
Report this Profile?