Software Engineer -- AI Inference

Job Description

Job Description

Job Description

Software Engineer — AI Inference

Columbia, MD | Full Time | TS/SCI with Polygraph Required

Position: Software Engineer — AI Inference (Software Engineer, Level 1) — 2 positions

Location: Columbia, MD (on-site)

Category: Software Engineering / AI Infrastructure / LLM Inference

Clearance Requirement: Active TS/SCI with Polygraph

Compensation: $130,000 – $160,000 (annualized USD)

Experience Requirement:

• 3+ years with a Bachelor's degree, OR

• 4 additional years of relevant experience in lieu of a degree

Description

Join us in building the next generation of AI infrastructure that will power innovation across the customer organization. We're seeking software engineers to support our AI infrastructure team — helping build and maintain the foundation for customer AI capabilities while supporting a broader ecosystem of AI-enabled applications.

Your focus will be ensuring access to the highest-quality LLMs for users throughout the inference software stack. Requirements shift quickly as needs evolve and new technologies emerge, so you'll keep sharpening your skills and learning to turn loosely defined problems into working solutions.

Responsibilities

• Procure, configure, and test new inference models, preparing them for release to the user base.

• Develop in-house services and techniques to guarantee continual high-quality inference service for customers.

• Work with model vendor teams and representatives to create reliable pipelines for closed-source model usage.

• Collaborate with teammates on surge efforts to support short-term, high-priority inference needs.

• Engage with other teams in the organization to establish solid infrastructure for services and integrate LLM-powered tools for user needs.

Skills Requirements

• Experience with Python and/or other modern programming languages.

• Familiarity with Argo CD and/or other CI/CD frameworks.

• Experience with Kubernetes/Helm.

• Familiarity with AWS or other cloud service providers.

• Ability to learn new technologies quickly.

• Strong communication skills and willingness to ask questions.

Nice to Haves

• Experience with vLLM, LiteLLM, or similar inference-serving frameworks.

• Experience with other LLM hosting frameworks and practices.

• Experience supporting production software using Site Reliability Engineering (SRE) best practices.

• Experience with Elastic, Grafana/Prometheus, or other observability frameworks and practices.

• Experience with Docker and containerization.

Compensation Employment Policy

Salary is determined by multiple factors, including location, education, experience, skills, and organizational requirements. The projected compensation range for this position is $130,000 – $160,000 (annualized USD).

Benefits Overview

At Intezra, Inc., we offer a comprehensive benefits package designed to support long-term career growth and work-life balance:

• Three CareFirst medical plans available; Intezra pays up to 100% of healthcare premiums and up to 100% of deductibles (based on plan selection) for employees and dependents

• Intezra pays 100% for CareFirst Dental and Vision plans for employees and dependents

• 401(k): 15% company contribution (no match required)

• PTO: 160 hours, increasing with seniority

• 12 Floating Holidays

• 4 Code Red Days

EEO Statement

Intezra, Inc. provides equal employment opportunities to all employees and applicants and prohibits discrimination and harassment of any kind without regard to race, color, religion, age, sex, national origin, disability status, genetics, pregnancy, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.

About Us

Intezra Inc. is a small business prime contractor for all realms of cyber and AI/ML development, from tactical-level tools and capabilities to enterprise-level infrastructure and operations. Our leadership team and staff have helped solve the most complex challenges for the intelligence community for over 15 years.

Intezra Inc. is a small business prime contractor for all realms of cyber and AI/ML development, from tactical-level tools and capabilities to enterprise-level infrastructure and operations. Our leadership team and staff have helped solve the most complex challenges for the intelligence community for over 15 years.