kavya

kavya

Data Engineer
Egypt

نبذة عني

Skilled data engineer with a track record in building, constructing, and managing reliable infrastructure and data pipelines. Adept at utilizing Flask, SQL, and Pandas to create scalable ETL procedures and data processin…

الخبرة

Big Data Engineer

Saturam Infosystem
Aug 2022 - حتى الآن · 3 سنوات 11 أشهر

I have been working as a big data engineer for 2 years the responsibilities I handle are creating ADF pipelines , Using Pandas to manipulate data and also I have a good amount of experience in working as backend developer in creating web apps for Retail brands ,The tech I have used for this is Flask Apis

Spend Analysis

Saturam Infosystem

Established data pipelines using Azure ADF
Built multiple data transformation pipelines with Airflow in PostgreSQL
Implemented back-end to front-end integration with Flask and JavaScript
Designed a role-based access system for the data platform

RM Demand Planning

Saturam Infosystem

Automated Excel sheets with complex formulas
Wrote well-structured and maintainable code to handle formula calculations, data retrieval, and sheet dependencies
Ensured high performance and error-free execution
Used ADF pipelines to push data from DB2 to Postgres
Collaborated with the UI/UX team to design intuitive user interfaces
Integrated various data sources into the automation system for real-time data updates and dynamic reporting

Service Classification

Saturam Infosystem

Worked on text classification using SpaCy
Classified services based on the given classifications
Generated codes after classification of services

Web Application

Saturam Infosystem

Developed and deployed a web application for major retail brands
Implemented secure login with OTP verification
Created RESTful APIs using Flask for session management, authentication, and user data storage
Integrated a dynamic coupon management system
Designed a rewards system to track and display user points and benefits
Utilized SQLAlchemy for database interactions

المهارات

بايثون (لغة برمجة) فلاسك (إطار عمل لتطبيقات الويب باستخدام Python) مايكروسوفت أزور (خدمة حوسبة سحابية) Airflow Azure data factory DB2 Flask APIs Pandas Postgres Snowflake Spacy Sql SQLAlchemy Azure Azure Data Factory ETL Excel SpaCy SQL JavaScript RESTful APIs OAuth OTP verification Role-Based Access Control
الإبلاغ عن هذا الملف الشخصي؟