DevOps Engineer - IBM/USAA
Location: San Antonio, TX
Tools & Technologies:
• Apache Kafka (Self-managed or MSK)
• AWS Managed Apache Flink
• Amazon EC2, S3, RDS, and VPC
• Terraform/CloudFormation
• Docker, Kubernetes (EKS)
• ELK Stack, CloudWatch
• Python, Bash
Skills & Expertise:
1. AWS Managed Services:
◦ Proficiency in AWS services like Amazon MSK, Kinesis, Lambda, S3, EC2, RDS, VPC, and IAM.
◦ Experience with infrastructure management using Terraform or AWS CloudFormation.
2. Apache Flink:
◦ Understanding of real-time stream and batch data processing with Apache Flink.
◦ Familiarity with Flink's integration with Kafka and managing Flink clusters on AWS.
3. Kafka Broker (Apache Kafka):
◦ Strong knowledge of Kafka architecture, brokers, topics, partitions, producers, and consumers.
◦ Experience with Kafka management, monitoring, scaling, and optimization, particularly with Amazon MSK or self-managed Kafka clusters.
4. DevOps & Automation:
◦ Expertise in automating deployments and infrastructure provisioning.
◦ Familiarity with CI/CD pipelines using tools like Jenkins, GitLab, GitHub Actions, CircleCI.
◦ Experience with Docker and Kubernetes for containerizing and orchestrating applications in the cloud.
5. Programming & Scripting:
◦ Strong scripting skills in Python, Bash, or Go for automation tasks and data pipeline integrations.
6. Monitoring & Performance Tuning:
◦ Proficiency with monitoring tools like CloudWatch, Prometheus, Grafana.
◦ Expertise in optimizing data pipelines for scalability, fault tolerance, and performance.
Responsibilities:
1. Infrastructure Design & Implementation:
◦ Design and deploy scalable, fault-tolerant real-time data processing pipelines using Apache Flink and Kafka on AWS.
2. Platform Management:
◦ Manage and optimize Kafka clusters (MSK or self-managed) and Flink jobs on AWS infrastructure for low-latency, high-throughput processing.
3. Automation & CI/CD:
◦ Automate infrastructure provisioning and deployment using Terraform, CloudFormation, or other tools.
◦ Integrate new applications into CI/CD pipelines for real-time data processing.
4. Collaboration with Data Engineering Teams:
◦ Work with Data Engineers, Data Scientists, and DevOps teams to ensure smooth integration and high performance of real-time data systems.
5. Security and Compliance:
◦ Implement security for Kafka and Flink clusters, ensuring compliance with regulatory standards (e.g., GDPR, HIPAA).
6. Optimization & Troubleshooting:
◦ Optimize Kafka and Flink performance, troubleshoot issues related to message delivery, job failures, or AWS service outages.
...entry Agent, administrative assistant or customer service Rep seeking a legit solution to supplement your earnings from home? This is a work from home position for a Data Entry/CSR-... ...PayPal, direct check, or on-line virtual gift card codes - Possibility to win rewards...
Collision Center Office Manager - Capital Ford of CharlotteAre you a people-person with a knack for organization and a passion for delivering... ...is looking for a Collision Center Office Manager to keep our shop running smoothly while ensuring an exceptional experience for...
...fixtures. Emptying trash cans. Washing and drying windows. Liaising with the line manager to ensure that you have sufficient cleaning products at all times. Reporting any breakages that occur during the cleaning process. Informing the line manager of repairs...
Commercial Litigation Attorney - High-Level Work, Real Growth Potential Are you a sharp, driven Commercial Litigation Attorney looking... ...and business litigation matters Expertise: Strong grasp of contract disputes, business torts, shareholder disputes, real estate litigation...
...home.****Position Summary:**Arizona Care Network (ACN) is a clinically integrated physician network and is a Dignity Health and Abrazo... ...(Tenet) physician collaboration. The Clinical Performance Liaison (CPL) is an employee of Arizona Care Network, doing business as...