Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AI Infrastructure Engineer, Inference at Scale

BigBear Inc

BigBear.ai is seeking a Software Engineer to support our AI infrastructure team, focusing on inference services and scalable AI platform components. You will help design, implement, and operate critical infrastructure and production systems across the AI stack.

8+ years of experience or a technical degree with 4+ years, plus TS/SCI w/Poly clearance, are valued. You will collaborate with multiple teams, improve observability, and guide junior engineers in a fast-evolving environment.

#J-18808-Ljbffr
Vacancy posted 15 hours ago
Similar jobs that could be interesting for youBased on the Senior AI Infrastructure Engineer, Inference at Scale in Columbia, MD vacancy
  • $86.8k - $198k

     ...Job Number: R0234072 AI Platform Engineer, Senior The Opportunity: As an AI Platform Engineer...  ...designing, building, and operating large-scale production systems Experience in...  ...If You Have: Experience with AI inference technologies, including vLLM or LiteLLM... 
    Senior
    Full time
    Contract work
    Part time
    Work at office
    Local area
    Remote work

    Booz Allen Hamilton

    Laurel, MD
    4 days ago
  • Intelliforce-IT Solutions Group is seeking a Senior Full Stack Software Engineer, AI Platform, to lead the design and delivery of scalable AI infrastructure. You will help shape platform components powering inference, AI services, and the broader AI ecosystem, guiding a... 
    Senior

    Intelliforce-IT Solutions Group, LLC.

    Columbia, MD
    2 days ago
  •  ...Bitwise in Laurel, MD is seeking a Senior Software Engineer – Inference to lead evaluation, configuration, and deployment of inference models, ensuring access to high-quality LLMs within our AI infrastructure. You will mentor engineers, shape best practices, and collaborate... 
    Senior

    Jobleads-US

    Laurel, MD
    3 days ago
  •  ...Kryptauri, Inc. seeks a Senior Software Engineer to architect and operate the platform that delivers AI and machine‑learning capabilities to mission users. You will focus on infrastructure automation, deployment, and service reliability across on‑premises Kubernetes... 
    Senior

    KRYPTAURI, INC

    Columbia, MD
    2 days ago
  • Neural Solutions in Columbia, MD seeks a Senior Software Engineer - Tools and Applications to build and maintain AI infrastructure tooling. You will lead AI tools initiatives, work with cross-functional teams, and shape scalable solutions for the workforce. Expect to drive... 
    Senior

    Neural Solutions

    Columbia, MD
    3 days ago
  •  ...Peraton in Laurel, MD seeks a Software Engineer Level 3 to own the full SDLC for large-scale cloud applications. You will design, develop, and deploy robust software systems, collaborating with data scientists, engineers, and product managers to deliver mission-critical... 
    Senior

    Peraton

    Laurel, MD
    4 days ago
  • $179k - $213k

     ...Neural Solutions in Columbia, MD is seeking an Infrastructure Cognizance Specialist to drive end-to-end feature delivery from concept to production. The role focuses on aggregating data sources to create a clear picture of requested and deployed infrastructure, proactively... 
    Senior

    Neural Solutions

    Columbia, MD
    2 days ago
  • $200k - $290k

     ...Blend360 is a premier AI services provider, committed...  ...for AI training and inference, and architecting...  ...to the pilot and full-scale implementation of complex...  ...implications of AI solutions to senior client stakeholders....  ..., machine learning engineers, and other specialists... 
    Senior

    BLEND360

    Columbia, MD
    8 days ago
  • $120.8k - $265.8k

    Job Title: Senior Network EngineerJob Category: Information TechnologyTime Type: Full timeMinimum...  ...* * *The Opportunity:- The Sr. Network Engineer will work within the Network Security...  ...efforts of dynamic requirements and scale.• Works with Systems Engineers and cross-... 
    Senior
    Contract work
    Work experience placement
    Flexible hours

    CACI International

    Columbia, MD
    4 days ago
  • $126k - $345k

     ...world.Our mission-first software and data engineering platform modernizes data operations,...  ...an elite team developing the critical infrastructure for a next-generation, distributed cyber...  ...Our mission is to design, deploy, and scale offensive capabilities that fundamentally... 
    Senior
    Contract work
    Flexible hours

    Clarity

    Columbia, MD
    6 days ago
  • $204k - $247k

    Senior Software Engineer Join us in building the next generation of AI infrastructure that will power innovation across our organization. We’re seeking a senior software engineer...  ...quality LLMs to users throughout the inference software stack. Responsibilities: Lead the... 
    Senior
    Temporary work

    Neural Solutions

    Columbia, MD
    4 days ago
  • $200k

    X8 in Columbia, MD seeks a Senior AI/ML Engineer to transition AI prototypes into secure, enterprise-scale services for USCYBERCOM. The role focuses on Python development, LLM/agent orchestration, model evaluation, and enterprise integration to deliver measurable mission... 
    Senior

    X8

    Columbia, MD
    2 days ago
  • $204k - $247k

     ...Senior Software Engineer Join us in building the next generation of AI infrastructure that will power innovation across our organization. We're seeking a senior software...  ...governance frameworks. Familiarity with AI inference serving technologies (vLLM, LiteLLM, etc.)... 
    Senior

    Neural Solutions

    Columbia, MD
    3 days ago
  •  ...SIXGEN is seeking a Senior Platform/DevOps Engineer in Columbia, MD to build and run the AI-enabled infrastructure and guardrails that enable secure enterprise-scale AI. You will own CI/CD pipelines, containerization, and RMF/ATO readiness, with significant impact on US... 
    Senior

    SIXGEN

    Columbia, MD
    2 days ago
  •  ...BigBear.ai is seeking a Software Engineer to design and maintain large-scale distributed web applications using Node.js, TypeScript and Python. You will build scalable microservices, deploy via IaC, and create CI/CD pipelines in cloud environments. The role involves... 
    Senior

    BigBear Inc

    Columbia, MD
    18 hours ago
  • $200k

    X8 is seeking a Senior AI/ML Engineer to support the U.S. Cyber Command (USCYBERCOM) AI Enterprise capability. Help mission teams transition AI prototypes into secure, governed, enterprise-scale services by engineering production-ready models, agents, and workflows. Columbia... 
    Senior

    X8

    Columbia, MD
    2 days ago
  • QualificationsEdmonton specificallySummaryType: Full-timeFunction: MarketingExperience level: Mid-Senior LevelIndustry: Marketing And Advertising
    Senior

    BLEND360

    Columbia, MD
    7 days ago
  •  ...government and critical infrastructure organizations to stay ahead...  ...standing up USCYBERCOM's AI Enterprise capability -...  ...secure, governed, enterprise-scale service. As a AI/ML Engineer on this team, you will...  ...Experience with model inference/serving platforms (NVIDIA... 
    Full time
    Temporary work
    Remote work
    Flexible hours

    SixGen, Inc.

    Columbia, MD
    13 hours ago
  • $180k - $240k

     ...DescriptionBlend is a premier AI services provider,...  ...Director of AI Engineering to join our team. In this senior, client facing role...  ...design, causal inference, A/B testing, and...  ...pipelines for large-scale structured and...  ...engineering practice.MLOps, Infrastructure &... 

    BLEND360

    Columbia, MD
    5 days ago
  • $176k - $282k

    ResponsibilitiesPeraton is hiring a Senior AI/ML Software Engineer to join our Cyber Solutions business unit in Jessup, MD. As a Software Engineeron our team, you will support one of the largest enterprise-wide engineering contracts within the Intelligence Community. This... 
    Senior
    Full time
    Contract work
    Shift work

    Peraton Corporation

    Columbia, MD
    4 days ago
  • $204k - $247k

     ...involves utilizing expertise in large language models (LLMs) and AI-integrated Python pipelines to drive mission-critical...  ...LLMs to solve complex problems, including expertise in prompt engineering and model optimization. Proven ability to integrate AI into... 
    Senior

    Neural Solutions

    Columbia, MD
    4 days ago
  • $150k - $250k

     ...A cybersecurity and IT services provider in Columbia, Maryland, seeks a Senior DevOps Engineer to deploy and maintain infrastructure for enterprise AI applications. The ideal candidate will leverage extensive experience in DevOps principles, containerization technologies... 
    Senior
    Flexible hours

    Synergy ECP

    Columbia, MD
    4 days ago
  • $282k - $332k

     ...Senior Software Engineer – AI Infrastructure ~ Laurel, MD ** An active TS//SCI clearance with polygraph...  ...autonomous agents, and scalable model inference — while also owning the...  ...designing, building, and operating large-scale production systems ~ Deep expertise... 
    Senior
    Extra income
    Contract work
    Flexible hours
    Night shift

    Bitwise

    Laurel, MD
    13 hours ago
  • $282k - $332k

     ...For Bitwise hires talented engineers who are driven by purpose...  ...building the next generation of AI infrastructure to power innovation across...  ...organization, and we need a senior software engineer to help...  ...language models across our inference software stack. As a Senior... 
    Senior
    Extra income
    Contract work
    Temporary work
    Flexible hours
    Shift work
    Night shift

    Bitwise

    Laurel, MD
    4 days ago
  • $150k - $200k

     ...federal space.We’re looking for an Applied AI / Machine Learning Engineer to design, build, and deploy...  ...workflows to support model training and inference- Evaluate model performance, bias, drift...  ...platforms and managing inference at scale- Familiarity with MLOps practices... 
    Contract work
    For contractors
    Work at office
    Remote work
    Flexible hours

    Devconnectplatform

    Columbia, MD
    2 days ago
  •  ...SIXGEN is seeking an AI/ML Engineer in Columbia, MD to join a team supporting US Cyber Command. You will design and integrate models, agents, and AI workflows on a secure enterprise platform, delivering production-ready capabilities with governance and security in mind... 
    Senior
    Remote work

    SIXGEN

    Columbia, MD
    17 hours ago
  •  ...Power3 Solutions in Columbia, MD is seeking a Sr. Software Engineer (AI/ML) to design, develop, test, and maintain scalable software solutions and prototypes. You'll work in a full-stack environment, using Linux and basic networking, and integrate with LLM-based customer... 
    Senior

    Power3 Solutions

    Columbia, MD
    19 hours ago
  •  ...Peraton is hiring a Senior AI/ML Software Engineer to join our Cyber Solutions unit in Jessup, MD. As a Software Engineer on our team, you will support one of the largest enterprise-wide engineering contracts within the Intelligence Community. This is a full-time position... 
    Senior
    Full time

    Peraton

    Columbia, MD
    13 hours ago
  •  ...technical architecture and implementation decisions for the team's AI applications, documenting key decisions and tradeoffs....  ...technical work, reviewing code, and guiding their growth. Establish engineering standards for code review, testing, CI/CD, security, and... 
    Senior

    Rohde & Schwarz

    Columbia, MD
    2 days ago
  • $116.35k - $210.33k

    Leidos has a new and exciting opportunity for a Senior Network Engineer in our Intelligence Sector, Cyber & Analytics Business Area (CABA)...  ...deploy, test, maintain, and enhance network devices and infrastructure across LAN, CAN, WAN, and telecommunications systems.Implement... 
    Senior
    Full time
    Immediate start
    Remote work
    Flexible hours

    Leidos

    Columbia, MD
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AI Infrastructure Engineer, Inference at Scale. Be the first to apply!