I am an Azure Data Engineer with 2 years of experience in designing and optimizing data pipelines, ETL workflows, and big data solutions. I have a Bachelor’s degree in Automobile Engineering from VTU, but my passion for …
I am an Azure Data Engineer with 2 years of experience in designing and optimizing data pipelines, ETL workflows, and big data solutions. I have a Bachelor’s degree in Automobile Engineering from VTU, but my passion for data engineering and cloud technologies led me to specialize in Azure Databricks, PySpark, SQL, and Azure Data Factory (ADF).
Throughout my career at Technarayana Software Pvt Ltd, I have worked on migrating on-premise data to Azure, implementing ETL pipelines, and optimizing big data transformations. My expertise lies in PySpark for distributed data processing, SQL for data extraction and optimization, and ADF for automating data workflows. I also have experience in handling Delta Lake, troubleshooting data pipeline failures, and ensuring data integrity. My ability to analyze complex datasets and transform them into actionable insights makes me a valuable asset in data-driven environments.
I am looking for opportunities where I can work on challenging data engineering problems, optimize large-scale cloud data solutions, and contribute to innovative projects. My goal is to enhance my skills in big data technologies, cloud computing, and real-time data processing, while also collaborating with teams to drive business impact through data.
If you are looking for a dedicated and results-driven Data Engineer, feel free to connect with me. You can reach me at [email protected] or through LinkedIn. Let's discuss how we can work together to solve complex data challenges!
Creating Azure Data Factory pipelines to copy the data from source to target systems, Creating the linked service for source and target connectivity Based on the requirement, Created Notebooks in data bricks for loading data from source to target, Monitoring daily running Azure pipelines for different applications, Implementation of logics in Data Bricks as per client requirement, Worked on Azure Key vaults to use it in linked services, Troubleshoot, evaluate and resolve connectivity issues for application running on azure, Scheduling a job runs, edit job and manually run jobs in the clusters, Migration of raw data from On-premise to cloud in azure data factory, Configured and managing users, security groups in Azure, Good Understanding of databricks scenarios like Delta Lake (Creation of delta table, JSON, CRC, CHECKPOINT), Transformation and action, Streaming, Joins, Explode, Pivot & Unpivot, Filter, Ingestion of data from Azure, Broadcast, Handling Null Values, Adding the Users to the Active directory group
Creating Azure Data Factory pipelines to copy the data from source to target systems
Creating the linked service for source and target connectivity based on the requirement
Created Notebooks in data bricks for loading data from source to target
Monitoring daily running Azure pipelines for different applications
Implementation of logics in Data Bricks as per client requirement
Worked on Azure Key vaults to use it in linked services
Troubleshoot, evaluate and resolve connectivity issues for application running on azure
Scheduling a job runs, edit job and manually run jobs in the clusters
Migration of raw data from On-premise to cloud in azure data factory
Configured and managing users, security groups in Azure
Good Understanding of databricks scenarios like Delta Lake (Creation of delta table, JSON, CRC, CHECKPOINT), Transformation and action, Streaming, Joins, Explode, Pivot & Unpivot, Filter, Ingestion of data from Azure, Broadcast, Handling Null Values
Adding the Users to the Active directory group
The AI-first Recruitment Operating System that unifies and automates the entire hiring lifecycle for modern enterprises worldwide.
Dr Job FZ LLC. 2026 © All Rights Reserved
