onkar kadam

onkar kadam

Data Engineer
India
Marathi, English, Hindi
Full-time On-site

نبذة عني

Data Engineer with 1 year of experience in designing, developing, and managing scalable and cost-efficient data pipelines on the AWS Cloud platform. Proficient in data ingestion, transformation, and orchestration using A…

الخبرة

AWS Data Engineer

Ekfrazo Technologies Pvt Ltd, Pune · Pune , Maharashtra , India
Oct 2025 - حتى الآن · 9 أشهر

Developed scalable ETL workflows using Apache Airflow and Redshift, improving pipeline reliability by 30%. Resolved data issues and job failures quickly using ServiceNow, ensuring smooth daily operations. Optimized Apache Spark jobs, improving processing performance and reducing execution time by 30% and compute costs by 15%. Improved Amazon Redshift performance with partitioning, clustering, and SQL tuning, reducing query time by 30%. Automated monitoring and data validation using Python, reducing manual efforts by 40%. Collaborated with analysts to align pipelines with business goals, reducing ad-hoc requests by 30%. Maintained pipeline health by tracking job dependencies, retries, and failure alerts to ensure uninterrupted data processing.

Trainee Engineer

Futops Technologies, Pune · Pune , Maharashtra , India
Aug 2025 - Oct 2025 · 1 شهر

Migrated data from on-premises Sybase database to AWS cloud using AWS DMS. Performed both full load migration and incremental data sync using Change Data Capture (CDC). Validated migrated data to ensure accuracy, completeness, and consistency post-migration. Ensured 100% SLA adherence across 700+ pipelines through proactive job monitoring. Monitored and managed Apache Airflow DAGs, identifying pipeline failures and performing root cause analysis.

المشاريع

Optimized Data Pipeline & Warehousing for E-commerce Analytics (AWS

DATA TECHNOLOGY
المدة : 17-Sep-2024 - 30-Dec-2024

Enhanced an e-commerce ETL pipeline using AWS Glue, Redshift, and Kinesis. Technologies: AWS Glue, Redshift, Kinesis, S3, Lambda Optimized an ETL pipeline for e-commerce data, boosting processing speed by 40% and accuracy by 25% Integrated data from multiple sources into S3 for scalable storage and analysis Implemented Amazon Redshift as a data warehouse, enabling fast querying and analytics of large e-commerce datasets Scalable ETL Pipeline for Customer Transactions • Optimized an ETL data pipeline for customer transactions, improving data ingestion, transformation, and storage Technologies : AWS Glue, Redshift, S3, Python • • • Designed and implemented a scalable ETL pipeline, enhancing data processing efficiency by 50%. Utilized ETL processes to integrate and clean data for visualization through Power BI dashboards. Improved data consistency and accuracy by 20% through validation checks and optimized queries

الشهادات

AWS Certified Data Engineer Associate

udemay · Pune , Maharashtra , India · 2024

المهارات

Data Pipeline Architecture Data Ingestion Data Transformation Workflow Orchestration AWS Azure Spark Optimization AWS Cost Optimization SQL Optimization ETL Design Automation Data Warehousing Redshift Azure DevOps Monitoring Troubleshooting Cross-functional Collaboration Database Migration Python Spark SQL S3 Glue DMS Lambda Blob Storage Data Factory ADF Synapse Analytics Apache Airflow RDBMS Databricks PySpark Apache Spark ServiceNow CDC
الإبلاغ عن هذا الملف الشخصي؟