Senior Software Engineer - Inference Jobs

Senior Software EngineerWe're seeking a senior software engineer to support our AI infrastructure team, helping build and maintain the foundation for advanced AI capabilities while supporting an ecosystem of AI-enabled applications. Responsibilities:Lead the evaluation, configuration, and deployment of inference models for users.Mentor engineers and grow development best practices and standards for the team.Develop in-house services to guarantee high-quality inference service.Collaborate with other teams to establish solid infrastructure and integrate LLM-powered tools.Support surge efforts to meet short-term, high-priority inference needs from stakeholders.Required Skills:Experience with Python and/or modern programming languages.Experience with Argo CD and/or other CI/CD frameworks.Knowledge of Kubernetes/Helm.Experience with AWS or another cloud service provider.Strong communication skills and ability to mentor engineers.Excellent leadership and stakeholder management skills.Nice to Have:Experience with vLLM, LiteLLM, or similar inference-serving frameworks.Familiarity with other LLM hosting frameworks and practices.Experience supporting production software using SRE best practices.Knowledge of observability frameworks like Elastic, Grafana/Prometheus.Experience with Docker and containerization.Experience Required: 12 years with Bachelor's degree in a technical discipline or 16 years without degree Location: Columbia, MD Clearance: TS/SCI with Polygraph required Salary Range: $204,000 - $247,000