نبذة عني
Experienced Microsoft professional with 3.6 years of experience in Data Warehousing & Business Intelligence in correspondence with professional expertise in ETL Application design, Development, Testing, Implementation, a…
Experienced Microsoft professional with 3.6 years of experience in Data Warehousing & Business Intelligence in correspondence with professional expertise in ETL Application design, Development, Testing, Implementation, and Maintenance of Data Warehouse and Data Mart & delivering problem-solving situations with an analytical and driven mindset to deliver corporate solutions at all costs.
الخبرة
Azure Data Engineer
Fostered technical documentation as per the business requirements on HLD, LLD, and ETL Design Documentation
Responsible for working with a team of 4 associated employees and tracking their overall progress, assigning them tasks, and troubleshooting the queries
Initiating the code reviewing and data generation, adhering to client specifications as per data mappings and transformations
Specialized in debugging and performance tuning at varying levels, to the target, package level, and data flow levels
Contributing to data analysis and spearheading concepts of data warehousing, staging tables, dimensions, facts, and Star Schema
Managing the setup of Azure cloud sources in correspondence with storage accounts, data lake folder structures, generating SAS tokens for the Source team to access and create linked services, and building the connections with Source Systems, Data Factory, and Resource group creations in ADF
Designing and reviewing ETL pipelines in Azure Data Factory and scheduling the ADF pipelines in the production environment
Adept with the Python notebook creation utilizing Apache Spark clusters using Azure Databricks for data processing activities and loading the processed data to Azure Data Lake
Implementation of highly effective creation of Pipelines, Linked Services, Storage accounts and Datasets and ingesting the data to Azure DataLake
Understanding the business requirements in the BI context and designing data models to convert raw data to meaningful insights using Power BI
Performing DAX queries and functions in Power BI
Data-specific technical documentation on ETL processes, definitions, and mappings
Providing creation of niche test cases and their review, as well as enhancing the process improvements focused on production application stability
Responsible for working with a team of 6 associated employees and tracking their overall progress, assigning them tasks, and troubleshooting queries
Initiating the code reviewing and data generation adhering to client specifications as per data mappings and transformations
Specialized with the domain expertise of debugging and performance tuning at varying levels to the targets, package level, and data flow levels
Contributing to data analysis and spearheading concepts of data warehousing, staging tables, dimensions, facts, and Star Schema, Snowflake Schema
Designing and reviewing ETL pipelines in Azure Data Factory and scheduling the ADF pipelines in the production environment
Adept with the Python notebook creation utilizing Apache Spark clusters for data processing activities and loading the data to Azure Data Lake
Implementation of Pipelines, Linked Services, Python Notebook, Storage accounts and Datasets and ingesting the data to Blobs and Azure DataLake
Data-specific technical documentation on ETL processes, definitions, and mappings
Providing creation of niche test cases and their review as well as enhancing the process improvements focused on production application stability
Implemented stored procedures and functions as per the business requirements
Endured physical backup status and job history as well as exported and imported the data from the SSIS package and deployed the SSIS Packages on Production Servers
Helped in database refresh tasks from production to development and staging servers
Resolved the performance issues using data quality and integrity and worked on the Database Engine Tuning to assess the database performance
Documented the existing ETL program codes and assisted in the optimization of testing scripts using SIT/UAT testers to ensure data accuracy
ETL data creation through heterogeneous data sources like SQL Server, Flat Files, Excel source files and loaded the data into destination tables using SSIS
Administered event handlers using the event handler tab and reported parameters including single-valued parameters, multi-valued parameters
Reporting management including Drill through, Drill down, and cascading Reports as well as scheduling the jobs to send the report and generated reports using SSRS
Revitalized the logic in multiple mappings of reusable transformations and applets
Worked on troubleshooting SQL queries and report Installation, Configuration, and Deployment using the SSRS