Over 10+ years of data engineering experience, specializing in ETL development using SSIS and Azure Data Factory, with a strong emphasis on data warehousing and schema design.
Proficient in designing and implementing bot…
Over 10+ years of data engineering experience, specializing in ETL development using SSIS and Azure Data Factory, with a strong emphasis on data warehousing and schema design.
Proficient in designing and implementing both star and snowflake schemas, with a focus on data quality and accessibility for reporting and analysis.
Extensive hands-on experience with Azure Synapse, including the design and implementation of data lakehouse architectures using Spark SQL.
Extensive experience in Microsoft SQL Server, encompassing queries, stored procedures, views, and database operations.
Demonstrated proficiency in GIT within an Azure DevOps environment, showcasing strong version control and collaborative development skills.
Knowledgeable in Microsoft Fabric, with the ability to troubleshoot and resolve data-related issues efficiently.
Experienced in mentoring and providing training to fellow Data Engineers, fostering skill development and knowledge transfer within the team.
Strong understanding of data governance, data quality, and data security frameworks and standards.
Proven ability to create comprehensive developer documentation for data pipelines, processes, and solutions.
Contributed to improving documentation and data governance, providing level II/III support for data-related inquiries.
Actively stay updated with industry trends and best practices related to data warehousing, ETL, and data engineering.
Solid background in using source control to manage and track changes to data pipelines and codebase.
Ability to work independently and collaboratively in a fast-paced, results-driven, team-oriented environment.
Demonstrated ability to use discretion, make sound decisions, and maintain confidentiality.
Proficient in MS Office, modern communication tools for virtual teams, and relevant data engineering technologies.
Experience working in virtual environment with team members in different geographical locations and various time zones. Experience as on-Call production 24/7 support as needed; when issues arise. Experienced in troubleshooting and finding root cause of complex production issues.
Flexible, enthusiastic and project oriented team player with exceptional verbal, written, and interpersonal communication and leadership skills to comprehend and develop resourceful solutions for demanding client requests. Team lead experience with day to day activities – Scrum master. And also have experience using team collaborative workspace ( Confluence). Daily scrum meeting.
Analyze, design and build Modern data solutions using Azure PaaS service to support visualization
of data. Understand current Production state of application and determine the impact of new
implementationon existing business processes.
Creating pipelines, data flows and complex data transformations and manipulations
using Azure Data Factory (ADF) and PySpark with Databricks.
Extract Transform and Load data from Sources Systems to Azure Data Storage services using a
combination of Azure Data Factory, T-SQL, Spark SQL and U-SQL Azure Data Lake Analytics.
Data Ingestion to one or more Azure Services – (Azure Data Lake, Azure Storage, Azure SQL, Azure
DW) and processing the data in Azure Databricks.
REST APIs to retrieve analytics data from different data feeds
Developed HQL, Mappings, tables, external tables in Hive for analysis across different banners and
worked on partitioning, optimization, compilation and execution.
Created Pipelines in ADF using Linked Services/Datasets/Pipelineto perform ETL on data from different
sources like Azure SQL, Blob storage, Azure SQL Data warehouse, write-back tool and backwards.
Developed Spark applications using PySpark and Spark-SQL for data extraction, transformation and
aggregation from multiple file formats for analyzing & transforming the data to uncover insights into the
customer usage patterns.
The AI-first Recruitment Operating System that unifies and automates the entire hiring lifecycle for modern enterprises worldwide.
Dr Job FZ LLC. 2026 © All Rights Reserved
