DONGRE SAINATH

DONGRE SAINATH

Gcp Cloud Data Engineer
India

نبذة عني

Having 3 Years of IT experience in design and development using GCP Components like Dataflow, Big Query, Cloud SQL, Pub/Sub, Cloud Composer, Cloud storage and Compute Engine. Experience working with Big Query to load dat…

الخبرة

gcp data engineer

power soft global solutions pvt ltd
Aug 2021 - حتى الآن · 4 سنوات 10 أشهر

 Developed BQ DDL and DML scripts to Load data into BigQuery from GCS buckets.
 Analyze and organize the raw data as per the business requirements.
 Creation of BigQuery Data sets, tables and pipelines to store the processed results.
 Used cloud shell in GCP to configure the services Storage, BigQuery.
 Experience in handling CSV, Avro, Parquet file formats.
 Preparation of data for prescriptive and predictive modeling.
 Developed Audit tables for reconciliation and metadata tracking purposes.
 Create authorized views in BigQuery to provide required data to downstream applications

POWERSOFT GLOBAL SOLUTIONS PVT LTD, Bangalore
Aug 2021 - حتى الآن · 4 سنوات 11 أشهر

Developed BQ DDL and DML scripts to load data into BigQuery from GCS buckets.
Analyze and organize the raw data as per the business requirements.
Creation of BigQuery data sets, tables and pipelines to store the processed results.
Used Cloud Shell in GCP to configure the services Storage and BigQuery.
Experience in handling CSV, Avro and Parquet file formats.
Preparation of data for prescriptive and predictive modeling.
Developed audit tables for reconciliation and metadata tracking purposes.
Create authorized views in BigQuery to provide required data to downstream applications.
Using source code management as a GitHub tool.
Responsible for Unit Testing and SIT (System integration Testing) and capturing the evidence.
Responsible for SIT walk through to Business to get sign-off.

Hexion
Dec 2021 - Apr 2024 · 2 سنوات 4 أشهر

Chemical Inventory Management System
SQL, Big Query, Dataproc, Pub/Sub, Airflow/Composer

المهارات

دمج وتحويل البيانات باستخدام ETL (ETL) بايثون (لغة برمجة) قاعدة بيانات SQL منصة Google Cloud منصة جوجل السحابية (GCP) GCS BigQuery Pub/Sub Composer/Airflow Dataproc Dataflow Python (Scripting) Hadoop (HDFS) Notebook++ Jupyter Notebook Agile (Sprint Scrum) CSV Parquet Avro Composer Airflow SQL Spark Hadoop HDFS Agile Sprint Scrum Jira GitHub JSON XML Windows Cloud Shell Cloud SQL Compute Engine PySpark GIT SDLC Unit Testing SIT
الإبلاغ عن هذا الملف الشخصي؟