Experienced Data Engineer with over 3 years of expertise in designing, developing, and managing data solutions on Microsoft Azure. Proficient in various data technologies, including Azure Data Factory, SQL, Azure Databri…
Experienced Data Engineer with over 3 years of expertise in designing, developing, and managing data solutions on Microsoft Azure. Proficient in various data technologies, including Azure Data Factory, SQL, Azure Databricks, Proven track record of successfully delivering data projects ontime and within budget. Communication skills with the ability to work efficiently with cross functional teams.
As a Data Engineer, my primary responsibilities include optimizing data performance, designing and managing data pipelines using tools like Azure Data Factory, and ensuring data quality. I work on various file formats, handle Personally Identifiable Information (PII), and collaborate with cross-functional teams. For instance, in projects like Retail Sales Analysis, I've implemented end-to-end ETL processes using Azure Databricks and PySpark, ensuring timely data updates. In summary, I focus on making data accessible, accurate, and efficiently processed."
Optimize data performance and scalability.
Designed, implemented and maintained data pipelines using Azure Data Factory for efficient data ingestion and transformation.
Scheduled jobs/notebooks.
Used workflows to schedule and deploy the notebooks.
Worked on different file formats like CSV, JSON, PARQUET, XML.
Worked with Personally Identifiable Information (PII) and non PII data along with data masking.
Checked data quality, accuracy, completeness and handled null and corrupt records.
Installed required libraries in the cluster based on task.
The AI-first Recruitment Operating System that unifies and automates the entire hiring lifecycle for modern enterprises worldwide.
Dr Job FZ LLC. 2026 © All Rights Reserved
