Mohammed Anas

Mohammed Anas

Overall 5 years of experience and 2 years in Machine Learning and Data Engineer Projects
India
Kannada, Malayalam, Hindi, English

نبذة عني

Overall 5 years of experience and 2 years in Machine Learning and Data Engineer Projects. Currently working with Makonis Software Solutions as Data Engineer. Good understanding of Data Analysis fundamentals and experienc…

الخبرة

Data Engineer

Makonis
Feb 2020 - حتى الآن · 6 سنوات 5 أشهر

* Design and develop ETL integration patterns using Python on Spark.
* Data acquisition from internal/external data sources
* Migration of data warehouse from SQL Server to Hadoop and Hive.
* Designed and built Data Quality frameworks for covering Data Quality aspects like
Completeness, Accuracy, coverage using Python and Spark and Kafka.
* Optimization of Hive queries using best practices and right parameters and using
technologies like Hadoop, YARN, Python, PySpark.
* Developed spark applications in python(PySpark) on distributed environment to load
huge number of CSV files with different schema in to Hive ORC tables.
* Worked on reading and writing multiple data formats like JSON, ORC, Parquet on HDFS
using PySpark.
* Involved in converting Hive Queries into various Spark Actions and Transformations by
Creating RDD and Dataframe from the required files in HDFS.
* Responsible for data ingestion into Bigdata using Spark Streaming and Kafka.

Machine Learning

Makonis
Feb 2020 - حتى الآن · 6 سنوات 5 أشهر

Web Scraping, Data Visualization & Regression Modeling.
Compiled pricing data for competitive analysis by performing web scraping in python.
Created charts in Jupyter Notebook to perform preliminary analysis & visualize data using Matplotlib.
Clustering , Classification & Creating FastAPI Framework
Conceptualized & implemented a sentiment analysis tool to rate the financial competence of companies
Deploy Machine Learning models as a Microservice using FastAPI

Machine Learning

Makonis, Kerala, India
Feb 2020 - حتى الآن · 6 سنوات 5 أشهر

Web Scraping, Data Visualization & Regression Modeling.
Compiled pricing data for competitive analysis by performing web scraping in python.
Created charts in Jupyter Notebook to perform preliminary analysis & visualize data using Matplotlib.
Clustering , Classification & Creating FastAPI Framework
Conceptualized & implemented a sentiment analysis tool to rate the financial competence of companies
Deploy Machine Learning models as a Microservice using FastAPI

SQL Developer and Data Analysis

Accenture
Jun 2016 - Jun 2019 · 3 سنوات

Plan, design, and implement application database code objects, such as stored procedures and views.
Build and maintain SQL scripts, indexes, and complex queries for data analysis and extraction.
Analyzing product, market, and share trends to build data.
Design, build and deploy BI solutions.
Designing, developing and maintaining business intelligence solutions.
Presenting information through reports and visualization.
Create visualizations and reports for requested projects.
Develop and execute database queries and conduct analysis.
Create data objects (DDL).
Prepare documentations for database applications.
Memory management for database systems.
Develop database schemas, tables and dictionaries.
Ensure the data quality and integrity in databases.
Create complex functions, scripts, stored procedures and triggers to support application development.
Take regular database backup.

SQL Developer and Data Analysis

Accenture, Kerala, India
Jun 2016 - Jun 2019 · 3 سنوات

Plan, design, and implement application database code objects, such as stored procedures and views.
Build and maintain SQL scripts, indexes, and complex queries for data analysis and extraction.
Analyzing product, market, and share trends to build data.
Design, build and deploy BI solutions.
Designing, developing and maintaining business intelligence solutions.
Presenting information through reports and visualization.
Create visualizations and reports for requested projects.
Develop and execute database queries and conduct analysis.
Create data objects (DDL).
Prepare documentations for database applications.
Memory management for database systems.
Develop database schemas, tables and dictionaries.
Ensure the data quality and integrity in databases.
Create complex functions, scripts, stored procedures and triggers to support application development.
Take regular database backup.

Data Engineer

Makonis
Feb 2020

Design and develop ETL integration patterns using Python on Spark.
Data acquisition from internal/external data sources
Migration of data warehouse from SQL Server to Hadoop and Hive.
Designed and built Data Quality frameworks for covering Data Quality aspects like Completeness, Accuracy, coverage using Python and Spark and Kafka.
Optimization of Hive queries using best practices and right parameters and using technologies like Hadoop, YARN, Python, PySpark.
Developed spark applications in python(PySpark) on distributed environment to load huge number of CSV files with different schema in to Hive ORC tables.
Worked on reading and writing multiple data formats like JSON,ORC,Parquet on HDFS using PySpark.
Involved in converting Hive Queries into various Spark Actions and Transformations by Creating RDD and Dataframe from the required files in HDFS.
Responsible for data ingestion into Bigdata using Spark Streaming and Kafka

Data Engineer

Makonis, Kerala, India
Feb 2020

Design and develop ETL integration patterns using Python on Spark.
Data acquisition from internal/external data sources
Migration of data warehouse from SQL Server to Hadoop and Hive.
Designed and built Data Quality frameworks for covering Data Quality aspects like Completeness, Accuracy, coverage using Python and Spark and Kafka.
Optimization of Hive queries using best practices and right parameters and using technologies like Hadoop, YARN, Python, PySpark.
Developed spark applications in python(PySpark) on distributed environment to load huge number of CSV files with different schema in to Hive ORC tables.
Worked on reading and writing multiple data formats like JSON,ORC,Parquet on HDFS using PySpark.
Involved in converting Hive Queries into various Spark Actions and Transformations by Creating RDD and Dataframe from the required files in HDFS.
Responsible for data ingestion into Bigdata using Spark Streaming and Kafka

المهارات

SQL Python Spark FastAPI UIPath GitHub Pyspark Microsoft Azure Kafka Hadoop Scikit-Learn Numpy Scipy Pandas NLTK BeautifulSoup Matplotlib Statsmodels Jupyter Notebook Azure Data Factory Azure Data Lake Storage Databricks Statistics/Machine Learning Statistical Analysis Linear/Logistic Regression Clustering Graph Theory Regularisations Strong skills in SQL development SQL reporting analytics business intelligence database structures principles theories practices problem solving analytical skills simulation static visualizations pandas Series and DataFrames Enterprise RPA UI Path Object Recorder Windows controls Business process diagrams process flow charts Microsoft Excel Oracle UiPath PySpark NumPy SciPy Linear Regression Logistic Regression SQL development Simulation Static Visualizations pandas Series DataFrames RPA
الإبلاغ عن هذا الملف الشخصي؟