Jayanth

Jayanth

Azure Data Engineer
Canada

About Me

Enthusiastic and insightful Azure Data Engineer with over nearly 2 years of IT experience, specializing in Data Engineering and Data Modelling Hands-on experience in Azure Cloud, Data Bricks, Data Lake, ADF, and reportin…

Experience

Azure Data Engineer

BMO, Toronto, Canada
Present

Designed and developed auto-mated transactional data processing pipelines using Logic Apps, Azure Functions, and other Azure components, improving efficiency and reducing manual work
Created interactive dashboards and reports to provide insights into key banking metrics, such as loan performance, credit risk, and customer behavior, aiding senior management in strategic decision-making
Created and maintained data models and KPI metrics in Power BI, Tableau, and other BI tools, designing and implementing data visualizations and dashboards to provide real-time insights to business stakeholders
Implemented data security measures to protect sensitive financial information, ensuring compliance with data protection regulations like GDPR or HIPAA as relevant to the banking sector
Managed and maintained data security and compliance using Azure Key Vaults and other Azure security services, ensuring data is protected from unauthorized access and meeting regulatory requirements
Designed and developed ETL pipelines using Azure Data Factory, Azure Data Lake, and other ETL tools to move and transform data from various sources to a centralized data repository, ensuring high reliability, scalability, and security
Developed data integration solutions to integrate a variety of data sets from disparate sources into a data model to support BI and analytical requirements, ensuring data is accurate and accessible for advanced analytics
Built a scalable data infrastructure using Azure cloud technologies, reducing infrastructure costs by 30% and improving data processing performance by 50%
Identified and mitigated data privacy risks, security, and quality risks
Worked on documenting databases, data process flows, and maintaining data dictionaries, metadata, and data lineage documentation to provide transparency and traceability of data assets
Built solutions on Azure cloud using technologies like Azure Data Factory, Azure Data bricks, and Azure SQL Server, leveraging cloud computing to increase scalability and reduce costs
Involved in developing and maintaining data ingestion pipelines using Apache Kafka, Azure Event Hubs, and Azure Data Factory, enabling real-time data streaming and processing

Azure Data Engineer

Universal Telecom Solutions - Hyderabad, India

Designed and implemented end-to-end ETL pipelines using Azure Data Factory to efficiently extract, transform, and load data from various sources into Azure data storage solutions
Implemented data partitioning, indexing, and distribution strategies to improve data retrieval speed and overall system performance
Designed and developed data models using tools like Azure Data Lake Store and Azure SQL Database, ensuring efficient storage, retrieval, and analysis of structured and unstructured data
Implemented data cleansing and transformation processes to ensure data quality and consistency using tools like Azure Data Factory and Azure Data bricks
Leveraged Azure Stream Analytics to process and analyze real-time data streams, enabling timely insights and actions based on streaming data sources
Implemented security measures like Azure Active Directory integration, role-based access control, and encryption to safeguard sensitive data throughout the data lifecycle
Implemented anomaly detection algorithms to identify potential fraudulent activities within call records and transactions, safeguarding the company and its customers from fraudulent actions
Established monitoring and alerting systems using Azure Monitor and Application Insights to proactively identify and resolve performance bottlenecks and issues
Collaborated with cross-functional teams including data scientists, analysts, and developers to define data requirements and ensure seamless integration of data solutions
Managed end-to-end data engineering projects, including requirements gathering, planning, execution, and timely delivery within budget
Kept up-to-date with the latest Azure services, features, and best practices through self-learning, online courses, and certifications

Skills

ETL Data Integration and Transformation (ETL) Python SQL Database Data Investigation Analysis Data Warehouse Azure Data Modelling Azure Databricks Pandas Azure Data Factory Azure SQL DB Azure Data Warehouse Azure Synapse Tableau Power BI Data Governance Azure Data Lake Storage Jupyter PyCharm MS SQL Server IBM DB2 Jira Confluence Asana NumPy SciPy CI/CD Agile Lean Scrum Logic Apps Azure Functions Azure Key Vault Apache Kafka Azure Event Hubs Azure Active Directory Role-based access control Encryption Azure Stream Analytics Azure Monitor Application Insights Delta Lake
Report this Profile?