نبذة عني
Skilled data engineer with a track record in building, constructing, and managing reliable infrastructure and data pipelines. Adept at utilizing Flask, SQL, and Pandas to create scalable ETL procedures and data processin…
Skilled data engineer with a track record in building, constructing, and managing reliable infrastructure and data pipelines. Adept at utilizing Flask, SQL, and Pandas to create scalable ETL procedures and data processing apps. Competent in communicating with clients, having a track record of returning calls, going to clients offices, and offering technical advice to efficiently complete projects. Capable of overseeing autonomous projects from start to finish while maintaining adherence to deadlines and quality requirements. Adept at working with cross-functional teams to smoothly incorporate data solutions into apps and systems that are already in place. A lifelong student who is passionate about keeping up with the latest developments in data engineering trends and technology. Outstanding ability to solve problems, pay close attention to details, and effectively communicate.
الخبرة
Big Data Engineer
I have been working as a big data engineer for 2 years the responsibilities I handle are creating ADF pipelines , Using Pandas to manipulate data and also I have a good amount of experience in working as backend developer in creating web apps for Retail brands ,The tech I have used for this is Flask Apis
Spend Analysis
Established data pipelines using Azure ADF
Built multiple data transformation pipelines with Airflow in PostgreSQL
Implemented back-end to front-end integration with Flask and JavaScript
Designed a role-based access system for the data platform
RM Demand Planning
Automated Excel sheets with complex formulas
Wrote well-structured and maintainable code to handle formula calculations, data retrieval, and sheet dependencies
Ensured high performance and error-free execution
Used ADF pipelines to push data from DB2 to Postgres
Collaborated with the UI/UX team to design intuitive user interfaces
Integrated various data sources into the automation system for real-time data updates and dynamic reporting
Service Classification
Worked on text classification using SpaCy
Classified services based on the given classifications
Generated codes after classification of services
Web Application
Developed and deployed a web application for major retail brands
Implemented secure login with OTP verification
Created RESTful APIs using Flask for session management, authentication, and user data storage
Integrated a dynamic coupon management system
Designed a rewards system to track and display user points and benefits
Utilized SQLAlchemy for database interactions