Joseph

Joseph

Azure Data Engineer with more than 3 years of Experience
India
English

About Me

Experienced Microsoft professional with 3.6 years of experience in Data Warehousing & Business Intelligence in correspondence with professional expertise in ETL Application design, Development, Testing, Implementation, a…

Experience

Azure Data Engineer

OPTIMA HEALTH UK

Fostered technical documentation as per the business requirements on HLD, LLD, and ETL Design Documentation
Responsible for working with a team of 4 associated employees and tracking their overall progress, assigning them tasks, and troubleshooting the queries
Initiating the code reviewing and data generation, adhering to client specifications as per data mappings and transformations
Specialized in debugging and performance tuning at varying levels, to the target, package level, and data flow levels
Contributing to data analysis and spearheading concepts of data warehousing, staging tables, dimensions, facts, and Star Schema
Managing the setup of Azure cloud sources in correspondence with storage accounts, data lake folder structures, generating SAS tokens for the Source team to access and create linked services, and building the connections with Source Systems, Data Factory, and Resource group creations in ADF
Designing and reviewing ETL pipelines in Azure Data Factory and scheduling the ADF pipelines in the production environment
Adept with the Python notebook creation utilizing Apache Spark clusters using Azure Databricks for data processing activities and loading the processed data to Azure Data Lake
Implementation of highly effective creation of Pipelines, Linked Services, Storage accounts and Datasets and ingesting the data to Azure DataLake
Understanding the business requirements in the BI context and designing data models to convert raw data to meaningful insights using Power BI
Performing DAX queries and functions in Power BI
Data-specific technical documentation on ETL processes, definitions, and mappings
Providing creation of niche test cases and their review, as well as enhancing the process improvements focused on production application stability

Unilever UK

Responsible for working with a team of 6 associated employees and tracking their overall progress, assigning them tasks, and troubleshooting queries
Initiating the code reviewing and data generation adhering to client specifications as per data mappings and transformations
Specialized with the domain expertise of debugging and performance tuning at varying levels to the targets, package level, and data flow levels
Contributing to data analysis and spearheading concepts of data warehousing, staging tables, dimensions, facts, and Star Schema, Snowflake Schema
Designing and reviewing ETL pipelines in Azure Data Factory and scheduling the ADF pipelines in the production environment
Adept with the Python notebook creation utilizing Apache Spark clusters for data processing activities and loading the data to Azure Data Lake
Implementation of Pipelines, Linked Services, Python Notebook, Storage accounts and Datasets and ingesting the data to Blobs and Azure DataLake
Data-specific technical documentation on ETL processes, definitions, and mappings
Providing creation of niche test cases and their review as well as enhancing the process improvements focused on production application stability

Select Service Partner(SSP UK)

Implemented stored procedures and functions as per the business requirements
Endured physical backup status and job history as well as exported and imported the data from the SSIS package and deployed the SSIS Packages on Production Servers
Helped in database refresh tasks from production to development and staging servers
Resolved the performance issues using data quality and integrity and worked on the Database Engine Tuning to assess the database performance
Documented the existing ETL program codes and assisted in the optimization of testing scripts using SIT/UAT testers to ensure data accuracy
ETL data creation through heterogeneous data sources like SQL Server, Flat Files, Excel source files and loaded the data into destination tables using SSIS
Administered event handlers using the event handler tab and reported parameters including single-valued parameters, multi-valued parameters
Reporting management including Drill through, Drill down, and cascading Reports as well as scheduling the jobs to send the report and generated reports using SSRS
Revitalized the logic in multiple mappings of reusable transformations and applets
Worked on troubleshooting SQL queries and report Installation, Configuration, and Deployment using the SSRS

Skills

Microsoft Azure Azure Data Factory Azure SQL Azure Synapse Analytics Apache Spark Azure DevOps Power BI Database Management Data Operations Data Warehousing Data Assessment & Validation Data Documentation ETL Application Designing Project Management Team Management Vendor Management Workflow Optimization Client Servicing Management Master Data Management Reporting Management Analytical Skills Professional Communications Leadership Management SSIS SQL Server Databricks MSSQL Server Visual Studio 2017 Python VSO Jira SSRS SQL T-SQL PL/SQL Azure Blob Storage Azure Data Lake Analytics Azure HDInsight Azure Logic Apps Azure Functions Dynamic SQL Excel-VBA Macros Pivot Tables/Charts VLOOKUP
Report this Profile?