Choudhury Durga Prasad

Choudhury Durga Prasad

Highly skilled and detail-oriented Data Engineer with 23 months of professional experience seeking...
India
Telugu, Hindi, English

About Me

Highly skilled and detail-oriented Data Engineer with 23 months of professional experience seeking a challenging position to leverage my expertise in data engineering and analytics. I am dedicated to designing, developin…

Experience

Data Engineer

KPI Partners
Jul 2022 - Present · 4 years

Created data pipeline using Apache Airflow, Python, and AWS to store weekly raw data.  Designed multi-user, multi-database app for processing thousands of records.  Managed SQL and NoSQL using DbSchema for data collection and modeling.  Collaborated with cross-functional teams for pipeline design and business needs.  Developed scalable data ingestion processes and optimized ETL workflows.  Implemented data quality checks and monitoring mechanisms for data integrity.  Documented technical specifications and data dictionaries for knowledge sharing.

Data Engineer

KPI Partners
Jul 2022 - Jul 2023 · 1 year

Created data pipeline using Apache Airflow, Python, and AWS to store weekly raw data.
Designed multi-user, multi-database app for processing thousands of records.
Managed SQL and NoSQL using DbSchema for data collection and modeling.
Collaborated with cross-functional teams for pipeline design and business needs.
Developed scalable data ingestion processes and optimized ETL workflows.
Implemented data quality checks and monitoring mechanisms for data integrity.
Documented technical specifications and data dictionaries for knowledge sharing.

Data Analyst Intern

KPMG
Aug 2022 - Aug 2022

Analyzed and identified data quality issues and strategies to mitigate these issues in the given data.
Prepared a PowerPoint presentation outlining the approach to be taken.
Worked within a 3-week scope with phases including Data Exploration and Model Development.

Associate Professional Software Engineer

DXC Technology
Aug 2021 - Jun 2022 · 10 months

Provided training for data maintenance and issue resolution in data cleaning.
Fixed bugs in existing pipelines and maintained systems documentation.
Designed dimensional data models and worked with data analysts and scientists.
Conducted performance tuning and optimization of database queries.

Cyber Security Intern

Cyber Crime Cell, Gurugram Police
Jun 2021 - Jul 2021 · 1 month

Provided first level compliance monitoring and investigations.
Assisted with forensics analysis and fact gathering.
Assisted with vulnerability assessments and penetration testing for specific applications, services, networks and servers as required.

Google Cloud Ready Facilitator

Google
Apr 2021 - Jun 2021 · 2 months

Participated in the Google Cloud Ready Facilitator program covering Computing, Application Development, Big Data and Machine Learning using Google Cloud's training platform called Qwiklabs.
Learned these topics using self-paced labs with temporary credentials to Google Cloud Platform.

Data Analyst Intern

KPMG
Aug 2022 - Aug 2022

The Aim of the project is to analyze and identify the data quality issues and strategies to mitigate these Issues in the given data. We need to start with a PowerPoint presentation which outlines the approach which we will be taking.
The client has agreed on a 3 week scope with the following 3 phases as follows - Data Exploration; Model Development

Associate Professional Software Engineer

DXC Technology
Aug 2021 - Jun 2022 · 10 months

Provided training for data maintenance and issue resolution in data cleaning.
Fixed bugs in existing pipelines and maintained systems documentation.
Designed dimensional data models and worked with data analysts and scientists.
Conducted performance tuning and optimization of database queries.

Cyber Security Intern

Cyber Crime Cell, Gurugram Police
Jun 2021 - Jul 2021 · 1 month

Provide first level compliance monitoring and investigations. Assist with forensics analysis and fact gathering. Assist with vulnerability assessments and penetration testing for specific applications, services, networks and servers as required.

Google Cloud Ready Facilitator

Google
Apr 2021 - Jun 2021 · 2 months

The Google Cloud Ready Facilitator program will introduce you to Computing, Application Development, Big Data & Machine Learning using Google Cloud's training platform called Qwiklabs.
I learned each of these topic using self-paced labs that provides you temporary credentials to Google Cloud Platform, so you can learn the cloud using the Real thing – no simulations

Skills

Big Data Data Repository Hadoop Scala Spark Apache Hive Apache Pig Amazon Web Services (AWS) Kafka NoSQL Redshift S3 Python SQL PySpark UNIX Powershell scripting Amazon Redshift Google BigQuery Snowflake Apache Airflow Hive MySQL Oracle Dimensional Modeling Star Schema Snowflake Schema Extract Transform Load (ETL) processes Tableau Power BI Azure Google Cloud Platform Git MS Office 365 Active Directory MS Excel MS Applications Strong problem-solving and analytical skills Excellent communication and collaboration abilities PowerShell ETL Microsoft Office 365 Problem-solving Analytical skills Communication Collaboration
Report this Profile?