Madhukar

Madhukar

Data Engineer
United States of America

About Me

Data Engineer With 6 years of experience in automating infrastructure management, designing efficient ETL workflows, and leading successful project deliveries. Proficient in Building and maintaining data pipelines using …

Experience

Data Engineer

NextEra
Feb 2022 - Present · 4 years 5 months

Automated infrastructure management with Terraform, reducing deployment time by 51% in AWS Environment
• Designed AWS Data Pipeline workflows for efficient ETL, which reduced data processing time by 42%.
• Utilized Tools S3, EC2, RDS, Redshift, EMR, Snowflake, dbt, ETL, MapReduce, EMR, Glue, SQL, Lambda.
• Analyzed data using Power BI to identify anomalies and limit discrepancies by 26%.
• Led a team of 1 full-time employee and 3 contractors and collaborated with Data Scientists and Data Analysts.
• Implemented scalable Snowflake data warehouses, boosting data transformation efficiency by 30% with dbt.

DATA ENGINEER

NEXTERA ENERGY INC
Feb 2022 - Present · 4 years 5 months

Automated infrastructure management with Terraform, reducing deployment time by 51% in AWS Environment
Designed AWS Data Pipeline workflows for efficient ETL, which reduced data processing time by 42%
Utilized Tools S3, EC2, RDS, Redshift, EMR, Snowflake, dbt, ETL, MapReduce, EMR, Glue, SQL, Lambda
Analyzed data using Power BI to identify anomalies and limit discrepancies by 26%
Led a team of 1 full-time employee and 3 contractors and collaborated with Data Scientists and Data Analysts
Implemented scalable Snowflake data warehouses, boosting data transformation efficiency by 30% with dbt

DATA ENGINEER

TECH MAHINDRA
Mar 2021 - Nov 2021 · 8 months

Developed and Maintained data pipelines using Azure Services resulting 40% increase in data processing speed
Created data transfer pipelines from On-prem system to Azure services, increasing 95% network throughput
Deployed Apache Spark on Azure VMs for 40% more efficient data processing
Automated operations with PowerShell and Azure cloud shell, Increased 30% productivity
Use ADF for ETL workflows, enhancing data processing efficiency and SQL data warehouse optimizations by 50%

BIG DATA ENGINEER

NOBROKER TECHNOLOGIES PVT LTD
Aug 2018 - Mar 2021 · 2 years 7 months

Built and deployed big data solutions using Hadoop and Azure HDInsight, improving data processing efficiency by 30%
Reduced migration costs of large data sets across multiple cloud providers by 50%
Use C++ to develop high-performance data processing applications and systems
Used Azure-based streaming services, Azure Kafka, Azure Event Hubs, Azure Stream Analytics, and Azure Databricks
Proficient in Data Streaming, Elasticsearch, Flink, Hadoop, Java, Kafka, MongoDB, SQL, Spark, and Tableau

DATA ENGINEER

DELOITTE
Jan 2018 - Jun 2018 · 5 months

Created SQL code to extract and transform data for business requirements, increasing accuracy by 95%
Enhanced data processing efficiency by 30% and reduced deployment time by 20%
Automated data pipeline for build, test, release, and deployment using Jenkins
Developed Tableau visuals and dashboards to provide insights into key performance trends
Implemented ETL process to streamline data import from various sources into GCP BigQuery warehouse

Skills

Big Data Data Repository Hadoop Scala Spark Apache Hive Apache Pig Amazon Web Services (AWS) Kafka NoSQL Redshift S3 Snowflake Azure Cloud Computing MySQL ETL Apache Spark SQL Power BI Terraform Python Java C++ Tableau Data Warehousing Informatica Talend Data Streaming Apache Flink MongoDB Machine Learning Pandas NumPy Scikit-Learn R Studio Keras TensorFlow Docker Kubernetes Hive SSIS SSRS Lambda DynamoDB Postgresql YAML Step Functions XML DBT Fivetran Problem-Solving Critical Thinking Effective Communication
Report this Profile?