نبذة عني
Passionate and experienced data engineer adept at designing and building robust data solutions, implementing scalable ETL pipelines, collaborating with cross-functional teams, and exploring innovative approaches to drive…
Passionate and experienced data engineer adept at designing and building robust data solutions, implementing scalable ETL pipelines, collaborating with cross-functional teams, and exploring innovative approaches to drive continuous improvement and deliver valuable business insights with ensured data accuracy and consistency.
الخبرة
Associate Software Engineer
Orchestrated end-to-end data migration and transformation from PostgreSQL and SQL dump sources to JSON format, facilitating integration with app systems.
Designed and implemented SQL scripts to establish staging tables and optimize data extraction, alongside Python automation for efficient ETL processes.
Integrated Kafka messaging framework to ensure real-time data flow, enhancing communication between systems.
Worked closely with the app integration team to customize JSON outputs according to their requirements, ensuring smooth integration.
Executed rigorous testing procedures and comprehensive documentation to guarantee data integrity and streamline future maintenance.
Associate Software Engineer
Orchestrated end-to-end data migration and transformation from PostgreSQL and SQL dump sources to JSON format, facilitating integration with app systems.
• Designed and implemented SQL scripts to establish staging tables and optimize data extraction, alongside Python automation for efficient ETL processes.
• Integrated Kafka messaging framework to ensure real-time data flow, enhancing communication between systems
• Worked closely with the app integration team to customize JSON outputs according to their requirements, ensuring
smooth integration
• Executed rigorous testing procedures and comprehensive documentation to guarantee data integrity and streamline
future maintenance
Intern
Completed training covering Postgres, ETL processes and data modeling concepts.
Completed hands-on training in PySpark, a big data processing framework that enables distributed data processing using Python programming language.
Completed network fundamentals.