Senior Site Reliability Engineer, AI Security (Federal)

Job Description

Job Description

About the job

Every AI request at a federal civilian agency passes through our AI runtime security platform, so its availability and latency directly affect mission systems. As the resident reliability engineer, you'll keep this self-managed, distributed platform on AWS EKS healthy, fast, and compliant.

You'll work alongside the agency's DevOps and security teams to operate, scale, and upgrade the platform, and you'll partner with our engineering team to make it more reliable over time.

Responsibilities

• Operate, monitor, and troubleshoot a distributed, high-throughput platform on Amazon EKS, from pod and node issues to networking, storage, and performance bottlenecks.
• Plan and execute upgrades of the platform, Kubernetes versions, and add-ons with minimal downtime, working within agency change management.
• Manage infrastructure as code with Terraform and Helm, and keep environments consistent from development through production.
• Design and tune autoscaling, capacity, and load testing to meet latency and throughput targets as demand grows.
• Build and maintain observability (metrics, logs, traces, alerting), define SLOs, and lead incident response and post-incident reviews.
• Implement customer security requirements, including secrets management with AWS Secrets Manager and KMS, least-privilege IAM, network controls, image hardening, patching, and evidence for ATO and continuous monitoring.

Minimum qualifications

• Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
• 5 years of experience in site reliability, DevOps, or cloud infrastructure engineering.
• Experience operating production Kubernetes clusters, including monitoring, scaling, and troubleshooting containerized workloads.
• Experience with core AWS services (IAM, VPC, EC2, load balancing, KMS, Secrets Manager, CloudWatch).
• Experience managing infrastructure as code with Terraform.
• Experience with scripting or programming in Python, Go, or Bash.
• Ability to obtain and maintain a DHS Public Trust determination.

Preferred qualifications

• Experience running Amazon EKS specifically, including managed node groups, Karpenter or Cluster Autoscaler, IRSA or EKS Pod Identity, and the AWS Load Balancer Controller.
• Experience operating latency-sensitive, high-throughput services, including load testing and performance tuning.
• Experience with observability tools such as Prometheus, Grafana, OpenTelemetry, and forwarding logs to a SIEM (e.g., Splunk).
• Experience with Helm and GitOps or CI/CD for Kubernetes (Argo CD, Flux, GitHub Actions, GitLab CI).
• Experience in federal environments, including ATO, NIST SP 800-53, AWS GovCloud, FIPS endpoints, and STIG-hardened container images.
• Experience with GPU node pools or serving ML models on Kubernetes.
• Familiarity with AI and LLM applications and their traffic patterns, such as streaming responses and large payloads.
• Certifications such as CKA, CKS, AWS Solutions Architect or SysOps Administrator, or HashiCorp Terraform Associate.

Swish is a customer-centric, specialized integrator with an engineering first culture. Our core solutions are focused on IT modernization, performance engineering, and cybersecurity. Swish believes good people empowered to innovate, coupled with a continuous improvement culture and supportive leadership equals superior outcomes. To this end, Swish believes in hiring, rewarding, and retaining the most talented engineers and technologies in the industry.

Our people make Swish great. We work together on interesting projects and achieve exceptional results. We act as trusted advisors to our customers and are committed to client and industry innovation. We offer our people the chance to grow professionally with teammates they like and respect while tackling challenges that stretch their minds and expand their skill sets. We’re connected by our desire to innovate and continuously improve.

Swish’s high energy, challenging, and fast-paced work environment will keep you engaged and motivated. Work-life balance is a core priority at Swish.

EEO & OFCCP Statement
Swish is an Equal Opportunity Employer and a proud U.S. Federal Government contractor. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity or expression, national origin, age, disability, genetic information, marital status, veteran status, or any other protected characteristic under applicable federal, state, or local laws.

We are committed to providing reasonable accommodations to individuals with disabilities throughout the application and employment process. If you need assistance or an accommodation due to a disability, please contact us.

U.S. Citizenship is required for all positions with a government clearance and certain other restricted positions.

Company Description

Swish is a customer-centric, specialized integrator with an engineering first culture. Our core solutions are focused on IT modernization, performance engineering, and cybersecurity. Swish believes good people empowered to innovate, coupled with a continuous improvement culture and supportive leadership equals superior outcomes. To this end, Swish believes in hiring, rewarding, and retaining the most talented engineers and technologies in the industry.\r\n\r\nOur people make Swish great. We work together on interesting projects and achieve exceptional results. We act as trusted advisors to our customers and are committed to client and industry innovation. We offer our people the chance to grow professionally with teammates they like and respect while tackling challenges that stretch their minds and expand their skill sets. We’re connected by our desire to innovate and continuously improve.\r\n\r\nSwish’s high energy, challenging, and fast-paced work environment will keep you engaged and motivated. Work-life balance is a core priority at Swish. \r\n\r\nEEO & OFCCP Statement\r\nSwish is an Equal Opportunity Employer and a proud U.S. Federal Government contractor. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity or expression, national origin, age, disability, genetic information, marital status, veteran status, or any other protected characteristic under applicable federal, state, or local laws.\r\n\r\nWe are committed to providing reasonable accommodations to individuals with disabilities throughout the application and employment process. If you need assistance or an accommodation due to a disability, please contact us.\r\n\r\nU.S. Citizenship is required for all positions with a government clearance and certain other restricted positions.