Sai Kiran Arvapally

Sai Kiran Arvapally

GCP Data Engineer
India
Telugu, Hindi, English

نبذة عني

Data Engineer with 3 years of experience focused on end-to-end data pipeline management, from design and implementation to optimization and maintenance. Expertise in Python, SQL, Apache Airflow, and PySpark, with a stron…

الخبرة

Data Engineer

Virtusa, Hyderabad, India
May 2022 - حتى الآن · 4 سنوات 1 شهر

Automated data pipelines using Apache Airflow, decreasing manual processing by 50% and accelerating workflow efficiency by 30%., Leveraged Google Cloud Platform’s serverless Dataproc service to enhance data extraction from on-premise systems, reducing process time by 40% and minimizing infrastructure costs., Tuned SQL queries in Google BigQuery, delivering improved query efficiency and a 20% drop in operational costs., Re-architected PySpark data processing, accomplishing a 50% decrease in extraction time and a 40% increase in processing performance., Modernized SQL reporting, resulting in a 30% reduction in query execution time and a 25% improvement in report generation speed., Integrated SCD Type 1 and Type 2 strategies, speeding up data updates by 40% and ensuring timely, high-quality reports., Implemented data quality checks, curtailing errors by 30% and fortifying the reliability of business-critical reports., Partnered with cross-functional teams to revamp data pipelines, producing a 30% decrease in reporting discrepancies and a 25% increase in data accuracy., Constructed comprehensive training materials and conducted onboarding sessions, trimming new hire training time by 20%.

Data Engineer

Virtusa, Hyderabad, India
May 2022 - حتى الآن · 4 سنوات 2 أشهر

Automated data pipelines using Apache Airflow, decreasing manual processing by 50% and accelerating workflow efficiency by 30%.
Leveraged Google Cloud Platform’s serverless Dataproc service to enhance data extraction from on-premise systems, reducing process time by 40% and minimizing infrastructure costs.
Tuned SQL queries in Google BigQuery, delivering improved query efficiency and a 20% drop in operational costs.
Re-architected PySpark data processing, accomplishing a 50% decrease in extraction time and a 40% increase in processing performance.
Modernized SQL reporting, resulting in a 30% reduction in query execution time and a 25% improvement in report generation speed.
Integrated SCD Type 1 and Type 2 strategies, speeding up data updates by 40% and ensuring timely, high-quality reports.
Implemented data quality checks, curtailing errors by 30% and fortifying the reliability of business-critical reports.
Partnered with cross-functional teams to revamp data pipelines, producing a 30% decrease in reporting discrepancies and a 25% increase in data accuracy.
Constructed comprehensive training materials and conducted onboarding sessions, trimming new hire training time by 20%.

Project

Data Migration & Reporting
May 2022

Spearheaded the migration of 5 TB of on-premise data to Google Cloud Platform, preserving data integrity and ensuring zero downtime.
Optimized ELT workflows, accelerating data processing time by 35% and facilitating faster decision-making across departments.
Expedited data ingestion, transformation, and reporting, minimizing manual intervention by 60% and enhancing reporting accuracy by 40%.
Restructured data models for real-time business intelligence, generating a 25% increase in actionable insights and expediting report delivery.

المهارات

بايثون (لغة برمجة) سكرم لغة الاستعلامات الهيكلية (SQL) أجايل تحسين الإجراءات تفسير البيانات منصة GitLab لإدارة التطوير البرمجي المبادرة باي سبارك
الإبلاغ عن هذا الملف الشخصي؟