About Me
Data Engineer with experience in data modeling, data pipelines, ETL systems, data visualization, and big data engineering across Azure and GCP environments. Skilled in Python, SQL, Spark, Airflow, Power BI, and a wide ra…
Data Engineer with experience in data modeling, data pipelines, ETL systems, data visualization, and big data engineering across Azure and GCP environments. Skilled in Python, SQL, Spark, Airflow, Power BI, and a wide range of data engineering, DevOps, and cloud tools.
Experience
Data Engineer
Gathering business requirements and translating them into technical specifications
Designing and developing data models and data visualizations using Power BI
Building and managing data pipelines using Azure Data Factory
Using Azure DevOps for deploying the dashboards
Executing Azure VM as workspace to build the projects and installing all the tools
Using Confluence, Jira and Agile methodology for projects management
Data Engineer
Built an automated proposal search using Selenium, resulting in improved efficiency
and increased win ratesfor new business opportunities.
•Developed an automated ETL system to extract, transform, and load data from massive
databases with low data quality, resulting in better data visualization using Looker Studio.
•Built various Event Streaming pipelines using different GCP services to understand
user behavior, depending on data sources and client budget and goals.
•Designed and implemented multiple System Architectures to meet specific
requirements outlined in client request for proposals.
•Building and deploying WhatsAPP botsystem powered with ChatGPT
•Building a crawling system to extract contents from several Linkedin Pages in order to
train ChatGPT to obtain better contents
•Developed a Python-based migration system to migrate data from multiple EC2 into a
centralized server.
•Developed strong relationships with stakeholders throughout the entire product
development process, ensuring that projects were delivered on time and on budget.
•Documented several data team projects in Confluence, outlining best practices and
technologies used to ensure knowledge transfer and team alignment.
Data Engineer
Gathering business requirements and translating them into technical specifications
Designing and developing data models and data visualizations using Power BI
Building and managing data pipelines using Azure Data Factory
Azure DevOps for deploying the dashboards
Executing Azure VM as workspace to build the projects and installing all the tools
Using Confluence, Jira and Agile methodology for projects management
Big Data Engineer
Built an automated ETL system that generated leads on LinkedIn for efficient lead acquisition, using various tools and languages
Collaborated with data science to build a pattern prediction model, resulting in the generation of Salesforce contact emails and improved communication with potential leads
Built Scrapy/Splash crawling system for automated data scraping from a JavaScript-based website
Big Data Engineer
Playing a key role in the data team for the development of a stock forecasting system using variety of tools such as Spark, Airflow, Hive, and Sqoop
Building a data migration system to migrate data from local into IPFS using Ethereum Blockchain, Solidity and MetaMask
Setting different Power BI dashboards after transforming data in Databricks using Spark and loading it into Azure SQL
Big Data Engineer
Implemented multiple system architectures
Built an automated proposal search using Selenium, resulting in improved efficiency and increased win rates for new business opportunities
Developed an automated ETL system to extract, transform, and load data from massive databases with low data quality, resulting in better data visualization using Looker Studio
Built various event streaming pipelines using different GCP services to understand user behavior, depending on data sources and client budget and goals
Designed and requirements outlined in client request for proposals
Building and deploying WhatsAPP bot system powered with ChatGPT
Building a crawling system to extract contents from several Linkedin Pages in order to train ChatGPT to obtain better contents
Developed a Python-based migration system to migrate data from multiple EC2 into a centralized server
Developed strong relationships with stakeholders throughout the entire product development process, ensuring that projects were delivered on time and on budget
Documented several data team projects in Confluence, outlining best practices and technologies used to ensure knowledge transfer and team alignment
Big Data Engineer
Built an automated ETL system that generated leads on LinkedIn for efficient lead acquisition, using various tools and languages.
Collaborated with data science to build a pattern prediction model, resulting in the generation of Salesforce contact emails and improved communication with potential leads.
Built Scrapy/Splash crawling system for automated data scraping from a JavaScript-based website
Big Data Engineer
Playing a key role in the data team for the development of a stock forecasting system using variety of tools such as Spark, Airflow, Hive, and Sqoop
Building a data migration system to migrate data from local into IPFS using Ethereum Blockchain, Solidity and MetaMask
Setting different Power BI dashboards after transforming data in Databricks using Spark and loading it into Azure SQL