Kafka Spark Administrator

Job Description

Role/Skill : Kafka/Spark Admin (L3- Support Engineer) + Cloud Knowledge.Primary Skill: Kafka ( Apache / Confluent Kafka) , Secondary Skill: Cloud knowledge like - AWS, Azure , CICD, etc. + Scripting programming in Unix or Python.Responsbility:---------------------Product SME for Confluent Kafka, Apache Spark, TalendConfluent Kafka cluster buildsPROD Issues engagement and follow up with Vendor for product issuesCOB DR Planning and CoordinationCapacity managementConduct PoCs for new featuresVendor and CTI Engineering InterfacingProduct Bugs/ Issues tracking and resolutionEOVS and Vulnerability Assessment resolutions.Request for Enhancements - identification and elaborationInfrastructureSTE Solution architecting - Cloud / HardwareCTI SA interfacing for server/VM buildsServer VTM patching coordination> Expert in Installing and maintaining the Confluent Platform components including: Apache Kafka, Confluent Control Center, Confluent Schema Registry, Confluent Replicator, and Confluent Security Plugins> Strong admin experience and versions used for Confluence/Kafka, details on the projects and environment they supported along with the tools used. Size of the environments, how many nodes/clusters, how many messages processed.> Experience administering the following Event Driven Architecture Components: Apache Kafka, Kafka Brokers, Zookeeper, Confluent Control Center, Confluent Schema Registry, Connect cluster etc.> Understanding of Data access, Data Retention and archiving> Experience working with browse events across federated brokers> Experience performing Confluent Platform installation, upgrades, and maintenance> Experience working with Confluent Security Plugins> The Confluent Kafka Administrator will be responsible for Design, architecture, implementation, and on-going support of Kafka clusters on an Event Streaming Architecture Pilot project.> Manage large scale multi-nodes Kafka cluster environments.> Handle all Kafka environment builds, including design, capacity planning, cluster setup, performance tuning and ongoing monitoring.> Kafka security authentication, authorization and encryption.> Perform high-level, day-to-day operational maintenance, support, and upgrades for the Kafka Cluster.> Good to have knowledge on messaging system like AMQ, Kafka etc.> experience with Cloud Operations (On Premise, Internal or External Cloud) -> experience with either of the scripting technologies Ansible (preferred) however exposure to either, Jenkins, Kubernetes/Docker Orchestration is good> Taking initiatives and designing the solutions as per projects need.> Having experience on OpenShift cluster administration is added advantage.> Knowledge on Java-based applications and Docker and Kubernetes (OpenShift)Qualifications:-> Demonstrate excellent communication skills including the ability to effectively communicate with internal and external customers.> Ability to use strong industry knowledge to relate to customer needs and dissolve customer concerns and high level of focus and attention to detail.> Strong work ethics with good time management with ability to work with diverse teams and lead meetings.

Keyskills :
Apache