Rajeev Gottapu

Rajeev Gottapu

Snowflake developer
United States of America

نبذة عني

Experienced Snowflake developer seeking to utilize expertise in designing, implementing, and optimizing data solutions to contribute effectively to the success of a dynamic organization.

الخبرة

Snowflake developer

SMK SOFT INC
Apr 2023 - حتى الآن · 3 سنوات 3 أشهر

Migrated tables from Oracle db, my sql, sql server to snowflake.
● Validated the data when migrating from my sql, sql server, oracle to snowflake to make sure it has an
apple to apple match.
● Created snowpipe for continuous data load.
● Defined virtual warehouse re-sizing for snowflake for different types of workloads.
● Designed new databases to meet business needs and designed mapping documents, which is a guideline
for ETL coding.
● Defined roles, privileges required to access different database objects.
● Have in depth knowledge of snowflake databases, schema, and table structures.
● Used copy command to bulk load the data from the external stage(built on AWS) to snowflake.
1
● Created multiple internal and external stages and have transformed the data during load.
● Redesigned the existing views in snowflake to improve the performance.
● Created Materialized views for time sensitive data for business users.
● Implemented Near real time process in snowflake with a cadence of 30 min. Implemented a process to
read kafka topics & copy the data to s3, then load the data to snowflake.
● Consumed semi-structured json data from kafka & used lateral flatten and table flatten functions to
flatten the data & load into the snowflake tables.
● Worked with multiple file formats like csv and parquet.
● Created external tables in snowflake to read data directly from external stage S3 buckets in AWS.
● Created both javascript and sql/scripting procedures for data transformations & data loading from AWS
S3 to snowflake and also for data unloading from Snowflake tables to S3 buckets.
● Created snowflake data sharing between two snowflake accounts.
● Have created efficient stored procedures for near real time processes to loop through all the production
tables & purge the data which is older than 30 days.
● migrated 2 business critical tables from teradata to snowflake using TPTs (teradata parallel transport).
● Implemented CDC process (change data capture) using snowflake streams.
● Created User defined functions (UDFs) for specific use cases.
● Have extensively used Snowflake zero copy cloning & time travel.
● Created multiple temporary & transient tables during the implementation of ETL process.
● Created multiple documents such as source to target data mapping documents and unit test cases
documents.
● performed multiple unit test cases & tuned the procedures for better performance.
● Created multiple reusable workflows & jobs in One automation/ Automic scheduler fo

Snowflake developer

SMK Soft Inc, Reston VA
Apr 2023 - حتى الآن · 3 سنوات 3 أشهر

Migrated tables from Oracle db, my sql, sql server to snowflake.
Validated the data when migrating from my sql, sql server, oracle to snowflake to make sure it has an apple to apple match.
Created snowpipe for continuous data load.
Defined virtual warehouse re-sizing for snowflake for different types of workloads.
Designed new databases to meet business needs and designed mapping documents, which is a guideline for ETL coding.
Defined roles, privileges required to access different database objects.
Have in depth knowledge of snowflake databases, schema, and table structures.
Used copy command to bulk load the data from the external stage(built on AWS) to snowflake.
Created multiple internal and external stages and have transformed the data during load.
Redesigned the existing views in snowflake to improve the performance.
Created Materialized views for time sensitive data for business users.
Implemented Near real time process in snowflake with a cadence of 30 min.
Implemented a process to read kafka topics & copy the data to s3, then load the data to snowflake.
Consumed semi-structured json data from kafka & used lateral flatten and table flatten functions to flatten the data & load into the snowflake tables.
Worked with multiple file formats like csv and parquet.
Created external tables in snowflake to read data directly from external stage S3 buckets in AWS.
Created both javascript and sql/scripting procedures for data transformations & data loading from AWS S3 to snowflake and also for data unloading from Snowflake tables to S3 buckets.
Created snowflake data sharing between two snowflake accounts.
Have created efficient stored procedures for near real time processes to loop through all the production tables & purge the data which is older than 30 days.
migrated 2 business critical tables from teradata to snowflake using TPTs (teradata parallel transport).
Implemented CDC process (change data capture) using snowflake streams.
Created User defined functions (UDFs) for specific use cases.
Have extensively used Snowflake zero copy cloning & time travel.
Created multiple temporary & transient tables during the implementation of ETL process.
Created multiple documents such as source to target data mapping documents and unit test cases documents.
performed multiple unit test cases & tuned the procedures for better performance.
Created multiple reusable workflows & jobs in One automation/ Automic scheduler for data orchestration.
Worked closely with the production support team during UAT/Production deployments and fixing production failures.

Snowflake developer

Global Intellectual Technologies Inc, Fremont CA
Jul 2022 - Apr 2023 · 9 أشهر

Responsible for migration of 700+ objects with 6TB size from Teradata to Snowflake.
Design and develop various data integration and data warehousing objects in snowflake.
Identify all the different kinds of tables in the source databases and create permanent, temporary, and transient tables in the snowflake schemas.
Identified & implemented the appropriate time travel and fail-safe periods for the permanent tables and created Data definition language for the tables and views.
Establish Connections between amazon s3 bucket and snowflake (using integration objects) to load and unload data between s3 and snowflake.
Install copy utilities in the on-premises servers to copy data to AWS s3 buckets.
Develop User defined functions to handle date logics, timestamp differences, and substring logics.
Developed JavaScript stored procedures to handle update and insert incremental data into the tables.
Convert On-premises ETL scripts to snowsql ETL scripts using python by modifying the SQL logics compatible to snowflake user interface.
Design virtual warehouse sizes in snowflake for different types of workloads.
Validate the data types, nullability, and data type lengths between the source and the snowflake target tables.
Create scripts to validate the data between postgre SQL schemas and snowflake schemas.
Perform unit testing on stored procedures with different ranges of parameters.
Redesign views in snowflake to improve performance.
Create data sharing out of snowflake with consumers.
Create a snow pipe and automate continuous data loading from various sources S3 buckets into snowflake.
Work to minimize performance issues on ETL scripts & stored procedures.
Integrated snowflake with Power BI for data processing and reporting.

Snowflake developer

Kensoft Inc, Edison, NJ
Oct 2021 - Jul 2022 · 9 أشهر

worked on Teradata to Snowflake migration (Migrating the business data warehouse, which also interfaces transactional systems) in Microsoft Azure cloud.
Migrated 6TB of data from teradata to snowflake.
Created multiple containers inside the azure and separated the data files based on type delimited (bell or pipe) files.
Bulk loading from external stage, internal stage to snowflake cloud using the copy command.
Created Materialized Views & Non-Materialized Views.
Created both JavaScript and SQL Stored Procedures.
Cloned production data for code modification and testing in dev environment.
Converted all the Teradata Macros to JavaScript Stored procedures.
Used snowpipe for continuous data ingestion from external buckets to snowflake.
Created Data Definition Language for all the tables in snowflake.
Copied all the data from Teradata tables to Snowflake using Linux box and Azure as an intermediate platform.
Extensively involved in troubleshooting post migration issues.
Performed troubleshooting analysis and resolution of critical issues.
Experience with AWS cloud services: EC2, S3

Systems Analyst

Master minds consulting services LLC, Schaumburg, IL
Apr 2017 - Jun 2018 · 1 سنة 2 أشهر

Ensured batch structure and flow is efficient and effective
Prepared ETL standards, naming conventions and wrote ETL flow documentation for stage, mart.
Involved in design, analysis, implementation, testing and support of ETL processes.
Designed batch solutions for complex technical and business requests
Ensured new standards and best practices are adhered to.
Tested the new development, Functional Testing and Flow/Negative testing on all the changes made.
Followed SDLC for the development process.
Upgraded Autosys and WCC tool to a new release which includes Agent upgrades, SAP Adapter configuration, testing of Autosys jobs in new release.
Maintained users in WCC using WCC EEM.
Moved transports from QA to Production for Change requests
Created Incidents in Service now for failures

Systems Administrator Intern

Nemo IT Solution, Dallas, TX
Oct 2015 - Apr 2017 · 1 سنة 6 أشهر

Identifying user requirements and performing research and analysis to determine conception/ logical design for solving business problems.
Analyze user requirements, prepare detailed technical specifications for development and testing environments.
Design, develop, and debug unit test programs for commercial release of development applications.
Responsible for analysis of hardware/ software requirements, system maintenance, maintaining overall security primarily in a client server environment.
Developing applications using embedded systems software, testing, and verifying the applications developed using embedded systems software, working on time series algorithms for quantitative analysis.

المهارات

توحيد النظام Snowflake Data Warehouse Data Loading Data Transformation Data Querying SQL Snowflake SQL Data Modeling Schema Design Snowflake Security Data Protection Python Kafka Tableau Problem Solving Troubleshooting Communication Collaboration Cross-functional Teamwork Oracle MySQL SQL Server Snowpipe Virtual Warehouse AWS Copy Command Internal Stages External Stages Materialized Views JavaScript SQL Scripting Data Sharing Stored Procedures Change Data Capture Streams User Defined Functions Zero Copy Cloning Time Travel Temporary Tables Transient Tables ETL Automic Scheduler Teradata Parallel Transport Power BI Amazon S3 PostgreSQL Snowsql Azure Linux Autosys WCC
الإبلاغ عن هذا الملف الشخصي؟