Vishnuvardhan NJ

Vishnuvardhan NJ

Data Engineer | Etl Developer
India

About Me

Highly skilled and motivated Digital Engineering Analyst with 2 years of experience in ETL development and data engineering. Possessing a Bachelor of Science in Computer Science, I am well-versed in designing, developing…

Experience

Digital Engineering Analyst

NTT Data
Aug 2021 - Present · 4 years 11 months

As a highly skilled and motivated Digital Engineering Analyst with 2 years of experience in ETL development and data engineering, I have a strong foundation in data management and analysis. I have worked extensively with a wide range of ETL tools, including Snowflake, Microsoft SQL Server, Matillion, Fivetran, DBT, Databricks, and Microsoft SSIS. My notable achievement includes implementing the CDC framework in Matillion and Snowflake for a waste management project, leading to improved data quality and significant cost savings. I excel in collaborating with cross-functional teams, working closely with business analysts, data architects, and database administrators to achieve data-driven solutions. Passionate about continuous learning, I actively seek out opportunities to stay up-to-date with the latest developments in data integration.

Digital analyst Engineer

NTT Data, Pune
Present

Transformed SSIS package scripts into SnowSQL scripts for seamless migration to Snowflake platform.
Developed efficient stored procedures in Snowflake based on existing SQL Server stored procedures.
Implemented Change Data Capture (CDC) framework for over 60 data integration packages in Matillion.
Enabled efficient data transformation from source to target while capturing changed data.
Conducted thorough comparisons between SQL Server and Snowflake databases to ensure data accuracy and consistency.
Utilized Matillion's Github deployments and component handling for code versioning and management.
Conducted Metadata validation and DDL validation for both SQL Server and Snowflake.
Leveraged Python for data extraction to efficiently retrieve and process data for integration tasks.
Utilized Snowflake's time travel and cloning features for data recovery and creating copies of databases for testing and analysis.
Conducted data transformations, data cleansing, data enrichment, and data aggregation using Matillion components.
Demonstrated proficiency in error handling, debugging, and troubleshooting data integration issues in Matillion workflows.
Successfully connected Matillion to various data sources and target systems.

Junior Cloud engineer

Hashmat INC an NTT Data company, Pune

Utilized Snowflake's SQL capabilities to query and analyze large datasets, generating actionable insights and reports for stakeholders.
Designed and implemented data warehousing concepts, including star schemas and data modeling, to optimize data storage and improve query performance in Snowflake.
Implemented robust security measures in Snowflake, managing user access, roles, and privileges to ensure data protection and compliance with industry regulations.
Led data integration efforts, developing ETL pipelines to extract, transform, and load data from different sources into Snowflake.
Worked with semi-structured data formats like JSON and Avro, processing and analyzing complex data structures in Snowflake for advanced analytics.
Managed Snowflake's virtual warehouses, provisioning and scaling compute resources to meet fluctuating data processing demands efficiently.
Developed and managed data pipelines from multiple sources using Fivetran, automating the extraction and loading of data into the data warehouse.
Leveraged AWS to deploy and manage Matillion in the cloud environment, enabling scalable and cost-effective data integration.

Skills

Python MSSQL SQL JavaScript ETL ETL architecture Snowflake Microsoft SQL Server Matillion Fivetran dbt Databricks Microsoft SSIS Data warehousing Data integration Data pipelines Stored procedures Change Data Capture (CDC) Data analysis Data validation GitHub Metadata validation DDL Data extraction Time Travel Cloning Data transformation Data cleansing Data enrichment Data aggregation Error handling Debugging Troubleshooting AWS Star schema Data modeling Security management User access management Roles and privileges Semi-structured data JSON Avro Virtual warehouses Cloud deployment Cross-functional collaboration
Report this Profile?