Rushikesh sane

Rushikesh sane

Data Engineer
India
Marathi, English, Japanese, Hindi

نبذة عني

Data Engineer with 1.10+ years of experience at IBM in designing, developing, and optimizing scalable data pipelines. Skilled in Python, PySpark, SQL, AWS, Snowflake, Azure Data Factory, Databricks, and ETL/ELT developme…

الخبرة

Data Engineer

IBM
Aug 2024 - حتى الآن · 1 سنة 11 أشهر

Designed and developed scalable ETL pipelines using PySpark and AWS Glue.
Built data ingestion frameworks to load data from APIs and databases into AWS S3 data lake.
Performed data cleansing, transformation, enrichment, and validation for enterprise datasets.
Loaded processed datasets into Snowflake to support reporting and analytics workloads.
Implemented workflow orchestration using Azure Data Factory for reliable pipeline execution.
Applied data quality checks to ensure consistency, accuracy, and integrity of data.
Optimized ETL jobs and PySpark workloads to improve performance and scalability.
Collaborated with business and technical teams to gather requirements and deliver data solutions.
Worked on schema evolution handling, partitioning strategies, and large-scale data processing.

المهارات

AWS S3 Glue Lambda Step Functions SNS SQS SES Redshift Azure Data Factory Azure Blob Storage ETL ELT Data Warehousing Data Modeling Data Migration Data Validation Data Mining Python SQL PySpark Apache Spark Hadoop Hive Snowflake Databricks DBT Airflow Data Analysis Data Visualization Business Intelligence
الإبلاغ عن هذا الملف الشخصي؟