Ranjith

Attending requirement calls and worked with Business Analyst and Solution Architects to understand the requirements from clients.
Analyzing the data flow from different sources to target and provide the corresponding design Architecture in Azure environment.
Creating DA specs and Mapping Data flow and provided the details to developer along with HLDs.
Creating Application Interface Document for the downstream to create new interface to transfer and receive the files through Azure Data Share.
Creating pipelines, data flows and complex data transformations and manipulations using ADF and PySpark with Databricks.
All the functionality is implemented using Spring Boot and Hibernate ORM.
Implemented Java EE components using Spring MVC, Spring IOC, Spring transactions and Spring security modules.
Ingested data in mini-batches and performs RDD transformations on those mini-batches of data by using Spark Streaming to perform streaming analytics in Data bricks.
Creating Source to Target Mapping for the SSIS Package Development.
Design ETL/SSIS packages to process data from various sources to target databases.
Create SQL Server Configurations, Performance Tuning of stored procedures, SSIS Packages.
Worked on cloud deployments using Maven, Docker and Jenkins.
Developed Docker container based micro services using Spring Boot/Cloud and deployment on Kubernetes cluster.
Created, provisioned different Databricks clusters needed for batch and continuous streaming data processing and installed the required libraries for the clusters.
Involved in Docker container orchestration using ECS, ALB and Lambda.
Experience with ETL workflow Management tools like Apache Airflow and have significant experience in writing the Python scripts to implement the workflow.
Perform ongoing monitoring, automation and refinement of data engineering solutions prepare complex SQL views, stored procs in Azure SQL DW and Hyperscale.
Spring Controllers were used with Angular JS to route the control to desired Java services.
Loaded different files from ADLS by using U-SQL scripts into target Azure Data warehouse.
Working on complex U-SQL for the data transformation and loading table and report generation.
Designed and developed a new solution to process the NRT data by using Azure stream analytics, Azure Event Hub and Service Bus Queue.
Creating Linked service to land the data from Caesars SFTP location to Azure Datalake.
Creating numerous pipelines in Azure using Azure Data Factory v2 to get the data from different source databases Informix, Sybase etc by using different Azure Activities like Move &Transform, Copy, filter, for each, Databricks etc.
Extensively used SQL Server Import and Export Data tool.

Responsibilities:
o Attending requirement calls and worked with Business Analyst and Solution Architects to understand the
requirements from clients.
o Analyzing the data flow from different sources to target and provide the corresponding design Architecture in
Azure environment.
o Creating DA specs and Mapping Data flow and provided the details to developer along with HLDs.
o Creating Application Interface Document for the downstream to create new interface to transfer and receive
the files through Azure Data Share. Creating pipelines, data flows and complex data transformations and
manipulations using ADF and PySpark with Databricks.
o All the functionality is implemented using Spring Boot and Hibernate ORM. Implemented Java EE
components using Spring MVC, Spring IOC, Spring transactions and Spring security modules.
o Ingested data in mini-batches and performs RDD transformations on those mini-batches of data by using Spark
Streaming to perform streaming analytics in Data bricks.
o Creating Source to Target Mapping for the SSIS Package Development. Design ETL/SSIS packages to process
data from various sources to target databases. Create SQL Server Configurations, Performance Tuning of stored
procedures, SSIS Packages. Worked on cloud deployments using Maven, Docker and Jenkins.
o Developed Docker container based micro services using Spring Boot/Cloud and deployment on Kubernetes
cluster.
o Created, provisioned different Databricks clusters needed for batch and continuous streaming data processing
and installed the required libraries for the clusters.
o Involved in Docker container orchestration using ECS, ALB and Lambda.
o Experience with ETL workflow Management tools like Apache Airflow and have significant experience in
writing the Python scripts to implement the workflow.
o Perform ongoing monitoring, automation and refinement of data engineering solutions prepare complex SQL
views, stored procs in Azure SQL DW and Hyperscale.
o Spring Controllers were used with Angular JS to route the control to desired Java services.
o Loaded different files from ADLS by using U-SQL scripts into target Azure Data warehouse.
o Working on complex U-SQL for the data transformation and loading table and report generation.
o Designed and developed a new solution to process the NRT data by using Azure stream analytics, Azure Event
Hub and Service Bus Queue.
o Creating Linked service to land the data from Caesars SFTP location to Azure Datalake.
o Creating numero

Involved in using AWS for the Tableau server scaling and secured Tableau server on AWS to protect the Tableau environment using Amazon VPC, security group, AWS IAM and AWS Direct Connect.
Configured EC2 instances and configured IAM users and roles and created S3 data pipe using Boto API to load data from internal data sources.
Involved in Java, Python, RDBMS, PL/SQL, TOAD, Oracle EBS Apps Technical, ETL (SQL Loader), Workflow Builder, BI Publisher, Tableau, DENODO - Data Virtualization.
Performed Data transformations in HIVE and used partitions, buckets for performance improvements.
Ingestion of data into Hadoop using Sqoop and apply data transformations and using Pig and HIVE.
Used Python and Django creating graphics, XML processing, data exchange and business logic implementation.
Used Git, GitHub, and Amazon EC2 and deployment using Heroku and Used extracted data for analysis and carried out various mathematical operations for calculation purpose using Python library - NumPy, SciPy.
Developed server-based web traffic using RESTful API's statistical analysis tool using Flask, Pandas.
Used Pandas API to put the data as time series and tabular format for east timestamp data manipulation and retrieval.
Added support for Amazon AWS S3 and RDS to host static/media files and the database into Amazon Cloud.
Participate in the design, build and deployment of NoSQL implementations like MongoDB.
Wrote and executed various MYSQL database queries from Python using Python-MySQL connector and MySQL dB package.
Responsible for developing the full stack (from the Markup, JavaScript, Application Services, Database, and Build Scripts).
Designing library for emailing executive reports from Tableau REST API using Python, Kubernetes, Git, AWS CodeBuild, and Airflow.
Developed various Python scripts to find vulnerabilities with SQL Queries by doing SQL injection, permission checks and performance analysis and developed scripts to migrate data from proprietary database to PostgreSQL.
Involved in development of Web Services using SOAP for sending and getting data from the external interface in the XML format.
Designed and implemented ETL pipelines between from various Relational Data Bases to the Data Warehouse using Apache Airflow.
Evaluated Information Management System Database to improve Data Quality issues using DQ Analyzer and other Data preprocessing tools.
Executed Data Analysis and Data Visualization on survey data using Tableau Desktop as well as Compared respondent’s demographics data with Univariate Analysis using Python (Pandas, NumPy, Seaborn, Sklearn, and Matplotlib).
Used Alteryx for Data Preparation in such way that is it useful for developing reports and visualizations.
Reviewed basic SQL queries and edited inner, left, & right joins in Tableau Desktop by connecting live/dynamic and static datasets.
Reported and created dashboards for Global Services & Technical Services using SSRS, Oracle BI, and Excel.
Deployed Excel VLOOKUP, PivotTable, and Access Query functionalities to research data issues.

Used Sqoop to extract data from Oracle SQL server and MySQL databases to HDFS.
Developed workflows in Oozie for business requirements to extract the data using Sqoop.
Developed MapReduce(YARN) jobs for cleaning, accessing and validating the data.
Wrote MapReduce jobs using Pig Latin, Optimized the existing Hive and Pig Scripts.
Hive scripts were written in Hive QL to de-normalize and aggregate the data.
Automated the work flows using Java to export data from databases into Hadoop.
Used JUnit framework to test the Unit testing of the application.
Hive queries for data were written to meet the business requirements.
Designed workflows by scheduling Hive processes for Log file data, which is streamed into HDFS using Flume.
Developed schemas to handle reporting requirements using Tableau.
Have deep and thorough understanding of ETL tools and how they can be applied in a Big Data environment.
Involved in moving all log files generated from various sources to HDFS for further processing through Flume.