About Me
Databricks Certified Data Engineer with 13+ years of experience building large-scale Data Lakes, real-time pipelines, and analytics platforms across Fintech, Cybersecurity, Health Care, EDtech, and social media domains. …
Databricks Certified Data Engineer with 13+ years of experience building large-scale Data Lakes, real-time pipelines, and analytics platforms across Fintech, Cybersecurity, Health Care, EDtech, and social media domains. Proven track record in delivering high-performance data solutions, large-scale Spark workloads, and major cost optimizations. Strong expertise in architecture, automation, and data governance—leading cross-functional teams to unlock multi-million-dollar business impact.
Experience
Freelance Data Engineer
Design, develop, and optimize multiple data warehouses, data marts, and data lake(house) using Databricks and Spark.
Optimize ETL performance, cost, and execution time using PySpark on Databricks (AWS, GCP, and Azure).
Design cost-efficient and performant solutions, solving complex problems on AWS and Azure cloud.
Freelance Data Engineer
Design develop, and optimize multiple data warehouses, data marts, and data lake(house) using Databricks and Spark. Optimize ETL performance, cost, and execution time using PySpark on Databricks (AWS, GCP, and Azure) Design cost-efficient & performant solutions, solving complex problems on AWS & Azure cloud.
Principal Data Engineer
Tech company focused on social mediaRedesign Datalake infrastructure, leveraging Databricks and SparkDeveloped intricate dimensional models for various data entities including Posts, UsersSuccessfully overhauled the end-to-end real-time user rewards system
Principal Data Engineer
Redesign Datalake infrastructure, leveraging Databricks and Spark.
Developed intricate dimensional models for various data entities including Posts and Users.
Successfully overhauled the end-to-end real-time user rewards system.
Sr. Data Engineer
IT consulting and services company Design, build, and optimize ETL data pipelines in Spark on DatabricksLead the offshore development team and ensure client requirements are met in a timely manner.
Sr. Data Engineer
Design, build, and optimize ETL data pipelines in Spark on Databricks.
Lead the offshore development team and ensure client requirements are met in a timely manner.
Sr. Data Engineer - Big Data
1 - Big Data Consultant – Allied Bank Limited Designed large-scale data pipelines with ODI, Kafka, Spark, and Cloudera CDH, including real-time fraud detection for a major Pakistani bank. Automated the creation of 28,000 ETL jobs using Groovy & ODI SDK, saving 8 months of effort, and deployed predictive models that boosted campaign response by 3x and optimized ATM operations nationwide. Led stakeholder engagements, authored technical documentation, trained 20+ colleagues, and identified $2–3M in new data-driven opportunities, earning an IBM “We Deliver” 2019 nomination. 2 - Sr. Big Data Consultant - United Bank Limited Designed Data Lake and Multiple Datamarts ETL pipelines using Informatica Big Data Suite, HDP, and IBM Watson, including a real-time fraud detection pipeline delivering end-to-end results in under 2 minutes. Built scalable solutions that overcame major product limitations, created a custom automation framework that accelerated pipeline development by 10x, and improved Teradata FSLDM integration.Served as an associate solution architect, authored key technical/architecture documents, and conducted multiple knowledge- sharing sessions on Informatica Big Data Suite, HDP, and the Hadoop ecosystem.
Sr. Data Engineer - Big Data
Designed large-scale data pipelines with ODI, Kafka, Spark, and Cloudera CDH, including real-time fraud detection for a major Pakistani bank.
Automated the creation of 28,000 ETL jobs using Groovy and ODI SDK, saving 8 months of effort.
Deployed predictive models that boosted campaign response by 3x and optimized ATM operations nationwide.
Led stakeholder engagements, authored technical documentation, trained 20+ colleagues, and identified $2–3M in new data-driven opportunities.
Earned an IBM “We Deliver” 2019 nomination.
Data Engineer
Redesigned MapReduce/Hive ETL pipeline to PySpark/Hive, reducing costs and saving $50K annually.
Migrated legacy development platform to Docker and Kubernetes.
Developed the company's 1st hybrid mobile application using React Native.
Data Engineer
Software development company Redesigned MapReduce/Hive ETL pipeline to Pyspark/Hive, reducing costs and saving $50K annuallyMigrated legacy development platform to Docker and Kubernetes Developed the company's 1st hybrid mobile application using React Native
Software Engineer
Software development company Designed & developed web projects using Django, AngularJS, and ReactJSOverseeing and quality controlling backend and frontend development work Practiced agile methodologies and team collaboration
Software Engineer
Designed and developed web projects using Django, AngularJS, and ReactJS.
Overseeing and quality controlling backend and frontend development work.
Practiced agile methodologies and team collaboration.
Software Engineer
Software development company Developed proficiency with Laravel, Codeigniter framework, and jQuery. Conducted thorough unit testing and improved performance through automated testing.Liaised with quality assurance to ensure professional standards
Software Engineer
Developed proficiency with Laravel, CodeIgniter framework, and jQuery.
Conducted thorough unit testing and improved performance through automated testing.
Liaised with quality assurance to ensure professional standards.
Sr. Big Data Consultant
Designed Data Lake and multiple datamarts ETL pipelines using Informatica Big Data Suite, HDP, and IBM Watson, including a real-time fraud detection pipeline delivering end-to-end results in under 2 minutes.
Built scalable solutions that overcame major product limitations.
Created a custom automation framework that accelerated pipeline development by 10x.
Improved Teradata FSLDM integration.
Served as an associate solution architect.
Authored key technical and architecture documents.
Conducted multiple knowledge-sharing sessions on Informatica Big Data Suite, HDP, and the Hadoop ecosystem.