Sapharish Natarajan

Sapharish Natarajan

Data Engineer
India

نبذة عني

Data Engineer with over 9 months of experience in optimum infosystems pvt ltd. Excellent reputation for developing new functionalities. Ability in resolving problems and improving customer satisfaction.

الخبرة

Data Engineer

Optimum infosystem pvt ltd
Feb 2022 - حتى الآن · 4 سنوات 5 أشهر

Data engineer (Feb 2022 -till date)
 Involved in interacting with Design Leads, Business Admins to understand various project
requirements and implement (transformation of raw data) using PySpark.  Worked on a highly agile environment where multiple features are developed and merged
into the existing framework.  Prepared written summaries to accompany results and maintain documentation in
confluence.  Contributed to internal activities for overall process improvements, efficiencies and
innovation.  Actively participated in code reviews, prod deployments, debugging and fixing issues.  Implemented ETL using AWS Services such as S3, Lambda, SSM, CloudWatch, and SNS.  Analyzed SQL scripts and designed the solution to implement using PySpark.  Worked on Mongo DB as part of Ad hoc activity by client to manipulate historical data.  Archiving data from production server as a part of data cleaning activity through AWS Glue.  Good exposure in Version Controlling system GitHub .  Experience with Pandas, PyMongo, Requests, boto3, Python libraries during development
lifecycle.

Data engineer

optimum infosystems pvt ltd
Feb 2022 - حتى الآن · 4 سنوات 5 أشهر

Involved in interacting with Design Leads and Business Admins to understand various project requirements and implement transformation of raw data using PySpark.
Worked on a highly agile environment where multiple features are developed and merged into the existing framework.
Prepared written summaries to accompany results and maintain documentation in Confluence.
Contributed to internal activities for overall process improvements, efficiencies and innovation.
Actively participated in code reviews, prod deployments, debugging and fixing issues.
Implemented ETL using AWS Services such as S3, Lambda, SSM, CloudWatch, and SNS.
Analyzed SQL scripts and designed the solution to implement using PySpark.
Worked on Mongo DB as part of ad hoc activity by client to manipulate historical data.
Archiving data from production server as a part of data cleaning activity through AWS Glue.
Good exposure in version controlling system GitHub.
Experience with Pandas, PyMongo, Requests, boto3, Python libraries during development lifecycle.

المهارات

البيانات الضخمة مستودع البيانات هادوب (Hadoop) سبارك خدمات أمازون ويب (AWS) نوسكيو إل إس 3 (خدمة تخزين البيانات على الإنترنت) Python PySpark Java Oracle MongoDB AWS Lambda AWS Glue Amazon S3 Amazon SNS AWS SSM AWS Crawler Amazon Athena AWS CloudWatch GitHub Pandas PyMongo Requests boto3 MapReduce Big Data Analytics Apache Spark PL/SQL
الإبلاغ عن هذا الملف الشخصي؟