About Me
Highly motivated IT professional with 5+ years of experience in the field, including expertise in Hadoop administration (4+ years) and as Linux admin (1.2 yrs). Currently thriving as a Senior Analyst focused on automatin…
Highly motivated IT professional with 5+ years of experience in the field, including expertise in Hadoop administration (4+ years) and as Linux admin (1.2 yrs). Currently thriving as a Senior Analyst focused on automating, deploying, and optimizing Hadoop environments. Additionally, I hold an AWS Solution Architect certification and possess a deep understanding of containerization technologies, including Docker and Kubernetes.
Experience
Sr Hadoop Admin
Demonstrated expertise in Cloudera platform deployments, including HDP, CDH, and CDP versions. Proven ability to configure and manage Hadoop clusters efficiently.
Proactively monitor and maintain Hadoop cluster infrastructure performance and health, leveraging expertise in troubleshooting and resolving issues/bottlenecks for optimal operation.
Expertise in implementing and managing security protocols (Kerberos, Ranger, Ranger KMS, TLS, SSL) for user access, authentication, and authorization within Hadoop environments.
Develop and implement comprehensive backup and disaster recovery plans, including regular DR drills, to guarantee data availability and integrity.
Troubleshoot and debug any Hadoop-related problems, such as spark/Hive job failures, cluster connectivity issues, or performance degradation.
Conduct regular capacity planning to ensure sufficient resources are available to meet current and future data processing demands.
Experience in minor and Major upgrades of Hadoop and Hadoop eco system. Expertise in Data Ingestion tools like Sqoop
Root Cause Analysis for all the failures (Systems, Ingestions, Jobs, Sync & Subscriptions) in production cluster, Verifying log files whenever requires Experienced in using Airflow and Oozie to schedule Spark/Hive jobs
Proficient in Docker and Kubernetes for containerized applications
Senior Big Data Analyst
Demonstrated expertise in Cloudera platform deployments, including HDP, CDH, and CDP versions.
Proven ability to configure and manage Hadoop clusters efficiently.
Proactively monitor and maintain Hadoop cluster infrastructure performance and health.
Troubleshoot and resolve issues and bottlenecks for optimal operation.
Implement and manage security protocols including Kerberos, Ranger, Ranger KMS, TLS, and SSL for user access, authentication, and authorization within Hadoop environments.
Develop and implement comprehensive backup and disaster recovery plans, including regular DR drills, to guarantee data availability and integrity.
Troubleshoot and debug Hadoop-related problems such as Spark/Hive job failures, cluster connectivity issues, and performance degradation.
Conduct regular capacity planning to ensure sufficient resources are available to meet current and future data processing demands.
Perform minor and major upgrades of Hadoop and Hadoop ecosystem components.
Use Sqoop for data ingestion.
Perform root cause analysis for failures in systems, ingestions, jobs, sync, and subscriptions in the production cluster, verifying log files when required.
Use Airflow and Oozie to schedule Spark/Hive jobs.
Use Docker and Kubernetes for containerized applications.
Hadoop Administrator
Worked with Hadoop ecosystem components like Hive, HBase, Spark, Kafka, Oozie, and Sqoop.
Worked with the ITIL framework.
Performed Linux administration and networking.
Configured and managed network services such as DNS, DHCP, Web Server, FTP, and NFS.
Optimized Hadoop cluster performance by analyzing bottlenecks and implementing efficiency improvements.
Worked with systems engineers to design and implement new and expanded Hadoop environments, including hardware and software.
Commissioned and decommissioned nodes.
Managed and reviewed Hadoop log files.
Worked with data delivery teams to set up new Hadoop users.
Set up users and tested HBase, Hive, Spark, and Kafka access for new users.