Senior Software Engineer - Inference

Senior Software Engineer Join us in building the next generation of AI infrastructure that will power innovation across our organization. We’re seeking a senior software engineer to support our AI infrastructure team. Your focus will be ensuring access to the highest available quality LLMs to users throughout the inference software stack. Responsibilities: Lead the evaluation, configuration, and deployment of inference models for our users. Mentor engineers and grow development best practices and standards for the team. Develop in-house services and techniques to guarantee continual high-quality inference service for our customer. Engage with other teams within our organization to establish solid infrastructure for our services and integrate LLM-powered tools for user needs. Collaborate with teammates on surge efforts to support short-term, high-priority inference needs from our customer. Required Skills: Experience with Python and/or other modern programming languages. Experience with Argo CD and/or other CI/CD frameworks. Experience with Kubernetes/Helm. Experience with AWS or other cloud service providers. Strong communication skills and ability to mentor other engineers. Excellent leadership and stakeholder management skills. Nice to Have: Experience with vLLM, LiteLLM, or similar inference-serving frameworks. Experience supporting production software using Site Reliability Engineering (SRE) best practices. Knowledge of and interest in hosting AI capabilities. Experience Required: 12 years with Bachelor's degree in a technical discipline or 16 years without degree Location: Columbia, MD Clearance: TS/SCI with Polygraph required Salary Range: $204,000 - $247,000 #J-18808-Ljbffr Neuralsolutions