About Me
Around 6+ years of experience as a Python Developer, proficient in multiple languages and environments including Python, JavaScript, Node.JS, SQL, Bash, REST Api, AWS, Google Cloud, C, C++ and more. Proficient in Fronten…
Around 6+ years of experience as a Python Developer, proficient in multiple languages and environments including Python, JavaScript, Node.JS, SQL, Bash, REST Api, AWS, Google Cloud, C, C++ and more. Proficient in Frontend web technologies: HTML, CSS, SCSS, JavaScript (ES6, ES7), TypeScript, Bootstrap, React, Vue JS. Proficient in backend python web frameworks: Django, Flask, FastAPI. Proficient in data analysis and visualization tools in python: Pandas, NumPy, SciPy, matplotlib, seaborn, statistics. Used for scientific research while at university. Experience in Big data and data engineering tools such as Hadoop, PySpark, Kafka in Java and Python. Experience on automating Excel with Python. Experience on making data visualization dashboard tool within a webpage. And exporting the visualization in different formats (e.g., PDF, an image, MS Excel, or a word document.). Also experience on making final report automatically from the web interface. Good understanding of mathematics, statistics, and its uses on real business problems. Used modern Python type-hinting features to make the code error free, more readable, understandable and for the debug purpose. Used Pyright for type-hinting and error catching based on data type. Used TypeScript for datatype-based error catching on JavaScript. Used Virtual environment-based containerization for python code and libraries. Experience with both, product-driven and test-driven development. Used Pytest and Pyunit for testing automated testing in python. Used Selenium and Playwright for automated testing of web apps and collect data from web. Experienced with advance queries and table join in different variations of SQL, (SQLite, MySQL, MS SQL server, PostgreSQL) and their interaction with Python and JavaScript. Experience with NoSQL, MongoDB and its interaction in Python and JavaScript (Node.JS). Experience with manipulating JSON, XML, XSL, Yaml, CSV formatted files or text from Python or JavaScript. And exporting data on any format. Used ajax to communicate from frontend and backend asynchronously. Experience with application development pattern like Model-View-Controller and simple request response pattern. Expert in both Functional Programming and Object-Oriented Programming in python, Java, C++, and JavaScript. Worked with Browser-less Web scraping using http request libraries (python request, bash CURL, or JavaScript axios). Used Python Pandas library to filter, clean and analyze data in python. Used matplotlib and seaborn to plot the visualization. Used Jupyter notebook to develop and interact with data. Used Python libraries NumPy and Scikit-learn to develop mathematical model to predict the future outcomes from the existing data. Experience with AWS services and Google Cloud platform. Good understanding of Pricing and performance between various AWS services and can choose the best option for the application development and deployment. Experience with server management and file transfer to and from the server using SSH (Secure Shell), SCP (Secure copy), rsync, git, curl, wget, using key-based and password-based authentication. Good understanding of git version control, and git hosting platforms such as GitHub, GitLab, bitbucket. Solid experience in containerized development in Docker and deployment of the containers. Developed multiple microservices and constructed a full-fledged app combining the microservices and interacting between them. Used Kubernetes to scale up the deployment process. Used Terraform to quickly configure cloud platform, used Ansible to quickly configure the host, and used Jenkins to automate CI/CD process. Experience with Python GUI tools such as tkinter, Kivy. Deep understanding of Linux operating system. Created command line utilities in Linux bash and Python. Used C and Go programming language to make Linux binaries where performance is very important. Used Cron Jobs to automatically run the task in background on timely manner. Experience setting up general purpose web servers (Nginx, Apache2) and Python web server (gunicorn, uvicorn). And interaction from one server to another server using reverse proxy or Unix socket. Experience with python socket and web socket to make a real time chat app. Experience in concurrency programming using python multi-threading and multi-processing. Excellent Debugging, Problem Solving, Optimization and Testing Skills in python, JavaScript, and other programming languages. Experience of using SQL query inside a terminal emulator, from a python program, and bash script, and Gui tools like MySQL Workbench, pgAdmin. Experience with MS Excel, Tableau, Power BI, SPSS, JASP.
Experience
Data Engineer
• Utilized Python programming language to design and develop scalable ETL processes for ingesting large volumes of telecommunications data from various sources, including call records, network logs, and customer interactions.
• Wrote a python program to efficiently process and transform raw data into a structured and usable format.
• Designed and implemented data models to ensure optimal storage and retrieval of telecom data. Optimized database performance for quick access to critical information.
• Implemented real-time data streaming solutions using technologies such as Apache Kafka to process and analyze data as it arrives, enabling timely insights for operational decision-making.
• Developed and implemented data quality checks and validation procedures to ensure the accuracy and integrity of telecom data.
Python Data Engineer
Utilized Python programming language to design and develop scalable ETL processes for ingesting large volumes of telecommunications data from various sources, including call records, network logs, and customer interactions.
Wrote a python program to efficiently process and transform raw data into a structured and usable format.
Designed and implemented data models to ensure optimal storage and retrieval of telecom data.
Optimized database performance for quick access to critical information.
Implemented real-time data streaming solutions using technologies such as Apache Kafka to process and analyze data as it arrives, enabling timely insights for operational decision-making.
Developed and implemented data quality checks and validation procedures to ensure the accuracy and integrity of telecom data.
Collaborated with cross-functional teams to resolve data quality issues and discrepancies.
Implemented automation scripts (bash and python) to schedule and orchestrate data workflows, reducing manual intervention and improving overall efficiency.
Integrated workflow orchestration tools like Apache Airflow to streamline and automate data processing tasks.
Engineered a scalable ETL pipeline that reduced data processing time significantly, enhancing the speed at which actionable insights could be derived.
Made web-based dashboard for data visualization.
Used cloud computing to train machine learning models forecasting the network demand.
Implemented a real-time data processing solution, resulting in a 20% improvement in the company's ability to respond to network anomalies and customer issues promptly.
Received recognition for designing and implementing a data quality framework, leading to a 25% reduction in data-related errors and discrepancies.
Python Data Engineer / QA
Integrated data sets to create a comprehensive and accurate representation of companies registered under FINRA.
Wrote script to merge data from multiple sources.
Also wrote a script to test the validation of data.
Tested if the correct data is imported from the correct sources or not.
Introduced an automated data validation process, reducing errors by 20% and significantly improving data accuracy and saving manual time by 50%.
Wrote ETL pipeline to collect data from various sources (including databases, spreadsheets, external APIs), filter the relevant information, conducted thorough data cleaning processes, and save it on relational database server.
Wrote python script and SQL queries for extracting meaningful insights from vast financial datasets to support informed decision-making.
Developed a python program to assure data quality protocols are being followed and to identify and rectify anomalies and detect fraud.
Generated fake testing data to validate this system.
Utilized statistical techniques to analyze financial trends and performance indicators.
Created user friendly interactive dashboards and reports using seaborn to present complex financial information in a comprehensible manner.
Research Assistant
Used Python Pandas library to analyze the experimental data obtained by experimental physicists.
Used scikit-learn library (Python) to model the data and verify (or reject) the hypothesis.
Used pingouin library for hypothesis testing and statistical analysis.
Converted the dynamical problem with higher order differential equations to linear algebra problems.
Used Python NumPy to solve the problem.
Used NumPy, SciPy, Matplotlib, Scikit-learn to implement a machine learning model on a biophysical theory.
Wrote test cases on PyTest to test if the data supports the theoretical prediction or it deviates from the theoretical prediction.
Wrote an optimization logic in C program to run from Linux command line, which helps to analyze and filter out the necessary data from raw data of millions of rows.
Studied the effect of discretization on natural continuous systems.
Did planetary simulation to verify discretization will lead to violation of the law of conservation of energy.
Python Web Developer
This is an All-in-one solution web app for a drug testing facility based in United States.
Integrated CI/CD pipeline with git version control to develop, test and deploy the web app.
Used Linux CRON to automatically send notification reminders for patients/clients.
Added 2 step verification using text message or email for security reasons.
To make sure a user can only access information and features related to their role, a user is divided based on their role and each role has separate dashboard layout.
Various AWS services were used and integrated for making cost effective and reliable hosting.
This was a full featured web app made for US healthcare company.
I Modified SQL Alchemy for making a true ORM (object relational mapping) to connect MySQL.
Created encrypted RESTful API endpoints for sending classified user data.
implemented token-based authentication API.
Used Containerized development (inside docker) and Containerized Hosting
I Made a dashboard where user can see the summary of their business and analysis and charts.
Export the report to various formats including CSV, PDF, Excel, Word, HTML
Wrote test cases to verify web app is working correctly.
Which helped developers to know adding other features did not break the previously working feature.
And made development faster.
Used faker library to generate fake data for testing.