DevOps Engineer Job at Zenith services, San Antonio, TX

ZC9RaldWdklnWUcyNFN6S0dnREk2T2VmZXc9PQ==
  • Zenith services
  • San Antonio, TX

Job Description

DevOps Engineer - IBM/USAA
Location: San Antonio, TX

Tools & Technologies:

• Apache Kafka (Self-managed or MSK)

• AWS Managed Apache Flink

• Amazon EC2, S3, RDS, and VPC

• Terraform/CloudFormation

• Docker, Kubernetes (EKS)

• ELK Stack, CloudWatch

• Python, Bash

Skills & Expertise:

1.   AWS Managed Services:

◦ Proficiency in AWS services like Amazon MSK, Kinesis, Lambda, S3, EC2, RDS, VPC, and IAM.

◦ Experience with infrastructure management using Terraform or AWS CloudFormation.

2.   Apache Flink:

◦ Understanding of real-time stream and batch data processing with Apache Flink.

◦ Familiarity with Flink's integration with Kafka and managing Flink clusters on AWS.

3.   Kafka Broker (Apache Kafka):

◦ Strong knowledge of Kafka architecture, brokers, topics, partitions, producers, and consumers.

◦ Experience with Kafka management, monitoring, scaling, and optimization, particularly with Amazon MSK or self-managed Kafka clusters.

4.   DevOps & Automation:

◦ Expertise in automating deployments and infrastructure provisioning.

◦ Familiarity with CI/CD pipelines using tools like Jenkins, GitLab, GitHub Actions, CircleCI.

◦ Experience with Docker and Kubernetes for containerizing and orchestrating applications in the cloud.

5.   Programming & Scripting:

◦ Strong scripting skills in Python, Bash, or Go for automation tasks and data pipeline integrations.

6.   Monitoring & Performance Tuning:

◦ Proficiency with monitoring tools like CloudWatch, Prometheus, Grafana.

◦ Expertise in optimizing data pipelines for scalability, fault tolerance, and performance.

Responsibilities:

1.   Infrastructure Design & Implementation:

◦ Design and deploy scalable, fault-tolerant real-time data processing pipelines using Apache Flink and Kafka on AWS.

2.   Platform Management:

◦ Manage and optimize Kafka clusters (MSK or self-managed) and Flink jobs on AWS infrastructure for low-latency, high-throughput processing.

3.   Automation & CI/CD:

◦ Automate infrastructure provisioning and deployment using Terraform, CloudFormation, or other tools.

◦ Integrate new applications into CI/CD pipelines for real-time data processing.

4.   Collaboration with Data Engineering Teams:

◦ Work with Data Engineers, Data Scientists, and DevOps teams to ensure smooth integration and high performance of real-time data systems.

5.   Security and Compliance:

◦ Implement security for Kafka and Flink clusters, ensuring compliance with regulatory standards (e.g., GDPR, HIPAA).

6.   Optimization & Troubleshooting:

◦ Optimize Kafka and Flink performance, troubleshoot issues related to message delivery, job failures, or AWS service outages.

Job Tags

Similar Jobs

Ace Auto Tint

Window Tint Installer Job at Ace Auto Tint

Looking for a well versed, friendly, and team oriented window film installer to join the Ace Auto Tint family. We are a fast paced tint shop looking to expand our team. As a Window Tint Installer, you will be responsible for applying window tint films to various types... 

School of Spanish Italian Portuguese

Teacher of Portuguese/Norwegian/Swedish Job at School of Spanish Italian Portuguese

Teaching Portuguese (or Norwegian/Swedish) to undergraduate students.

Ginas Tech Jobs

C++ Software Developer Job at Ginas Tech Jobs

 ...C++ Software Developer, Fairfield, NJ We are seeking a C++ Software Developer to join the staff on a full-time basis. As a key member...  ...and IT staffing companies today!Phone (***) ***-**** ext. 12 or email us at ****@*****.*** . Click here to submit your resume... 

R J Donovan Correctional Facility

FIRE CAPTAIN CORRECTION INSTITUTION Job at R J Donovan Correctional Facility

 ...Job Description and Duties This advertisement is for a Fire Captain, Correctional Institutionposition atRichard J. Donovan Correctional Facility in San Diego County. Please indicate the position number on your application: 030-217-9001-001. Note: Main communication... 

Sartor Sales - Evolve To Prosper

Executive Talent Recruitment & Leadership Specialist - Remote Opportunity Job at Sartor Sales - Evolve To Prosper

Executive Talent Recruitment & Leadership Specialist Remote Opportunity Use your expertise in talent recruitment and leadership to guide professionals, drive growth, and build a people-centric cultureall from a flexible remote role. Are you an experienced leader...