About Me
Detail-oriented Data Engineer having hands-on experience specializing in ETL (Extract, Transform, Load) processes. Proven track record of designing, developing, and optimizing data pipelines to efficiently extract, trans…
Detail-oriented Data Engineer having hands-on experience specializing in ETL (Extract, Transform, Load) processes. Proven track record of designing, developing, and optimizing data pipelines to efficiently extract, transform, and load large volumes of data. Proficient in utilizing ETL tools and technologies like SQL, Python, Pyspark, DBT, Snowflake, Databricks. Excellent communicator with strong analytical and problem-solving abilities, committed to delivering high-quality solutions that drive business insights and operational efficiency.
Experience
Data Engineer
Worked extensively on DBT Tool for creating DBT models for ETL operations.
Worked on Snowflake as a data warehousing tool.
Created DBT models using SQL and yml files.
Worked on CI/CD operations integrated on DBT tool.
Debugging and modifying existing DBT models for optimization which increased performance by 50%.
Data Engineer
gineer
Competent in writing SQL Queries.
Experience in using Jira and working in an Scrum environment.
Proficient in Python programming language
Good with BigData concepts like Hive and Spark.
Worked on AWS services like AWS S3, EMR, EC2, Glue , Redshift, IAM, MWAA, Appflow, etc.,
Good with handling CSV, JSON, TXT etc., files in Python.
Knowledge of Tableau Software
Good Knowledge of Data Warehouse concepts.
Trained in ETL Data Processes.
Well versed with Big Data concepts Hadoop and Spark.
Worked on CI/CD pipelines and Scheduling tool Airflow.
Data Engineer
Worked on ETL project creating SQL scripts for full and incremental loads.
Extracted data from Salesforce using AWS AppFlow.
Worked on AWS Redshift, AWS Glue and AWS Athena for creating warehouse, crawlers and querying data on Athena.
Provided support in developing Airflow pipelines in AWS MWAA.
Data Engineer
Worked on DBT creating models for ETL operations.
Worked on Airflow creating tasks and scheduling jobs.
Extensively monitored EMR jobs and EC2 instances on AWS cloud.
Assisted in designing and development of end-to-end pipeline.
Conducted performance tuning and optimization of SQL queries which decreased query performance by substantial time.
Loyalty Executive - Business Analyst
Executed system configurations based on business requirements.
Delivered projects by adherence through the project life-cycle.
Involved in projects from phase of functional specification to deployment to live environment.
Worked on customer loyalty, POS integrations, CRM tool creation, e-commerce and food delivery projects with FnB Loyalty.
Created business requirements and achievement on technical grounds.
Created customer friendly based processes and analyzed customer behavior to improve the product.
Created reports for the management assessments.
Reviewed files, records and other documents to obtain business information and key data in order to respond to development requests.
Co-ordination with vendors on developments, tests and deployments in pre-production and production environments.
Assisted in planning of software and system testing efforts.
Performed UAT testing with creating customer use cases and detailed test cases.
Tested APIs with requests and responses for specific transactions.
Used SQL for extracting data and perform analytics.
Co-ordination with designers and forwarding to development team and tested the functionality as per requirements.
Managed projects and served as primary liaison between vendors and multiple internal groups to provide clarity of goals and quality and adherence to deadlines.
Worked on loyalty system requirements phase, development phase, testing phase and deployment phase.
Integration with e-commerce websites during tests and deployments.