Senior MLOps Platform Engineer

Salary: $93,000 - 133,000 per year Requirements:

• We require a BS in computer science or a related engineering discipline.
• We look for 5+ years of experience building and operating production-grade software infrastructure, ideally in a hybrid on-premises and cloud setting.
• We need deep expertise in Kubernetes, including cluster provisioning, Helm, operators, and custom resources, along with container runtimes such as Docker and OCI.
• We expect hands-on experience with AWS services such as EKS, SageMaker, S3, IAM, CloudWatch, and Step Functions, plus the ability to connect on-premises resources to AWS through VPN or Direct Connect.
• We require strong software engineering skills in Python and at least one compiled language, such as Go, Rust, or Java, for developing platform components and SDKs.
• We need proficiency with CI/CD and GitOps tools such as Argo CD, Flux, GitLab, GitHub Actions, or similar platforms.
• We expect a solid understanding of distributed systems, including consensus, fault tolerance, and load balancing, as well as experience tuning high-throughput, low-latency inference pipelines.
• We look for experience with data engineering frameworks such as Airflow, Prefect, Kafka, Spark, or Flink, and with building reliable, versioned data pipelines.
• We require familiarity with observability tools such as Prometheus, Grafana, OpenTelemetry, and ELK, plus the ability to define meaningful SLIs and SLOs for AI services.
• We want a proven record of partnering with research or product teams to move prototypes into production and turn experimental code into maintainable services.
• We need strong problem-solving ability, excellent written and verbal communication, and a passion for building scalable AI platforms.
• We prefer working knowledge of Scrum and Agile software development methodologies.
• This role requires the ability to access export-controlled information, and no visa sponsorship is available.
• Employment is contingent on successful completion of pre-employment screening, including credit, background, and drug checks.

• We design, implement, and operate a unified MLOps platform that supports both on-premises Kubernetes clusters and AWS.
• We enable rapid onboarding of new Agentic AI services while maintaining consistent governance across environments.
• We develop reusable CI/CD pipelines in GitLab CI for model packaging, containerization, automated testing, canary releases, and rollbacks.
• We build observability, monitoring, and alerting systems with Prometheus, Grafana, OpenTelemetry, and CloudWatch to track latency, throughput, resource usage, and data drift.
• We create self-service tools such as CLIs, SDKs, and dashboard interfaces that let data science and product teams register models, manage inference endpoints, and handle versioning without heavy DevOps support.
• We architect and maintain data pipelines that move training data, model artifacts, and inference logs into a governed data lake on S3 and on-premises object storage.
• We collaborate with research and product engineers to convert experimental Agentic AI prototypes into production-ready services with reproducibility, security, and compliance in mind.
• We optimize inference performance through GPU and CPU scaling, model quantization, and batching strategies.
• We promote best practices for security, cost efficiency, and disaster recovery across our hybrid infrastructure.
• We mentor junior engineers and contribute to internal documentation, upskilling efforts, and review processes.

• Agentic AI
• AI
• Airflow
• AWS
• Architect
• CI/CD
• Cloud
• CloudWatch
• DevOps
• Docker
• ELK
• Flink
• GitHub
• GitLab
• GitOps
• Grafana
• Helm
• IAM
• Support
• Java
• Kafka
• Kubernetes
• Load Balancing
• MLOps
• OpenTelemetry
• Prometheus
• Python
• Rust
• Security
• Spark
• VPN
• Model Training
• Network
• UX UI Design

More:

We are ARKA Group L.P., an advanced technologies company serving the U.S. military, intelligence community, and commercial space sector with next-generation solutions that support the national security space enterprise. Built on more than six decades of excellence, we bring modern approaches and a strong culture of innovation to todays challenges. This is a remote role supporting our Aurora, Colorado and King of Prussia, Pennsylvania locations, and the position must be performed from a remote location within the United States. We offer a comprehensive benefits package that includes medical, vision, and dental coverage, HSA contributions, a 401(k) with strong company support, paid vacation and holidays, tuition assistance, annual bonuses, company-paid life and disability insurance, parental leave, and an employee assistance program. We also support work-life balance through flexible scheduling for many positions.

last updated 33 week of 2026