Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Systems Engineer - LLM Infra & GPU

$82.3k - $220k

Draper

Draper in Boston, MA is seeking an AI Systems Administrator, responsible for overseeing a closed GPT environment and ensuring system health. Candidates must have strong Linux administration skills, knowledge of automation, and a Bachelor's degree in Computer Science. This hybrid position requires an Active Secret Clearance. Responsibilities include installing and configuring servers, maintaining observability for GPU workloads, and implementing automation solutions. The salary range for this full-time position is between $82,300 and $220,000, reflecting Draper's commitment to employee growth and innovation. #J-18808-Ljbffr Draper

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the AI Systems Engineer - LLM Infra & GPU in Boston, MA vacancy
  • $197.3k - $225.1k

     ...Lead AI Engineer (AI Foundations, LLM Customization and Finetuning) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real... 
    Suggested
    Full time
    Part time
    Local area

    Capital One Financial Corp

    Cambridge, MA
    2 days ago
  •  ...Job Title: Generative AI Engineer (LLM Expert - AWS Focus) Location: Remote Employment Type: Ongoing Contract About BigRio...  ..., integrating them into cloud-native, production-ready systems. This is a senior technical role , not a research... 
    Suggested
    Ongoing contract
    Remote work

    Saviance

    Boston, MA
    4 days ago
  •  ...Job Title: Gen AI Engineer (LLM Expert) Location: Remote Employment Type: Ongoing Contract About BigRio...  ...Vision Models Build retrieval-augmented generation (RAG) systems using Langchain and ChromaDB . Develop interactive AI... 
    Suggested
    Ongoing contract
    Remote work

    Saviance

    Boston, MA
    12 hours ago
  •  ...leading tech firm in Boston is seeking a Senior AI Engineer to design and integrate an AI platform based on top LLM providers. This role emphasizes delivering secure...  ...scalable APIs, integrating AI with enterprise systems, and supporting adoption through implementations... 
    Suggested

    Franklin Fitch

    Boston, MA
    4 days ago
  •  ...Job Title: AI Engineer - NLP/LLM Data Product Engineer Location: Chennai, India- Hybrid Duration: 6 months with a Contract...  ...pipelines to seamlessly connect LLMs with internal and external systems, ensuring secure and scalable data exchange. Solution... 
    Suggested
    Contract work

    Saviance

    Boston, MA
    2 days ago
  •  ...Multimodal AI Systems Architect (AI Engineering) Boston, USA We are seeking a talented Multimodal AI Systems Architect to develop and optimize AI...  ...Qualifications: Experience with Whisper, CLIP, and multimodal LLM integration. Knowledge of streaming architectures and... 

    Hyphen Connect

    Boston, MA
    12 hours ago
  • $180k - $250k

     ...Senior AI Engineer — Voice & Agentic Systems Location: Remote (US) / Hybrid (Boston or San Francisco) Company Stage of Funding: Seed ($2.5M raised)...  ...RLHF / reward modeling experience Built eval-driven LLM systems Production reinforcement learning systems Real... 
    H1b
    Work at office
    Remote work

    Recruiting from Scratch

    Boston, MA
    3 days ago
  • Capital One National Association seeks a Lead AI Engineer in Cambridge, MA to drive AI initiatives by collaborating with multidisciplinary teams. You will design, develop, and maintain AI software components using cutting-edge technologies. Candidates should possess a Bachelor... 

    Capital One National Association

    Cambridge, MA
    1 day ago
  •  ...Agentic Systems Architect (AI Engineering) Boston, USA Key Responsibilities Architect multi-agent orchestration frameworks. Build robust tool-calling pipelines and reasoning loops. Optimize latency and token usage for real-time agentic workflows.... 

    Hyphen Connect

    Boston, MA
    12 hours ago
  • $140k - $170k

     ...Image & Computer Vision Ai Engineer Hatch I.T. is partnering with Babel...  ...applications. You will build systems that extract, analyze, and...  ...including integration with multimodal LLM systems that allow users to...  ..., and cost efficiency (GPU usage, batching, model selection... 
    Work at office

    Hatchit Co

    Somerville, MA
    12 hours ago
  • $152k - $222k

     ...AI Engineer Join Suffolk's project teams across the U.S. as the on-site catalyst who turns...  ...Opensearch and other data stores; automate infra with GitHub Actions; monitor latency,...  ..., including 2+ years building production LLM/RAG/Agentic solutions. ~ Bachelor's in... 
    Work at office

    Suffolk Construction

    Boston, MA
    2 days ago
  • $106k - $176.6k

     ...combine cutting-edge software engineering with artificial intelligence to...  ...at the forefront of applied AI, collaborating closely with Medicinal...  ..., and deploy intelligent systems that enhance productivity and...  ...technologies with Large Language Model (LLM) capabilities, creating... 
    Permanent employment
    H1b
    Local area
    Visa sponsorship
    Work visa
    Relocation package
    2 days per week

    Pfizer

    Cambridge, MA
    3 days ago
  • $187k - $240k

     ...Datadog to developers within AI-focused IDE experiences such as...  ...re looking for product-minded engineers who are excited about developer...  ...to productionize these systems and integrate them within our...  ...Follow the latest research on LLM prompt optimization, agents, and... 
    Work at office

    Datadog

    Boston, MA
    more than 2 months ago
  • $96.8k - $306.4k

     ...Description The Senior Principal AI Agent / ML Software Engineer is a Senior Staff-level,...  ...next-generation AI systems on Oracle Cloud Infrastructure...  ...latency, high throughput, GPU efficiency, reliability, cost...  ...~ Deep understanding of LLM application patterns, including... 
    Temporary work
    Flexible hours

    Oracle

    Boston, MA
    1 day ago
  •  ...Senior Infra Support Manager /System Engineer Rootshell Enterprise Technologies Inc. is a recognized provider of professional IT Consulting services in the US. We are actively seeking a Senior Infra Support Manager /System Engineer for one of our clients. Location... 

    Rootshell Inc

    Boston, MA
    12 hours ago
  • $229.9k - $262.4k

     ...Overview Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to... 
    Full time
    Part time
    Local area

    Capital One

    Cambridge, MA
    19 days ago
  •  ...technology company building an AI-enabled nursing platform...  ...directly into EHR systems such as Epic and Athena...  ...roadmap for STT/TTS/Speech LLM model training: from...  ...failover strategies Mentor engineers on data curation, fine‑...  ...Server, Kubernetes, and GPU scaling Hands‑on with... 
    Remote work

    OutcomesAI

    Boston, MA
    2 days ago
  • A leading global professional services firm is seeking a Manager in Application Design and Development to manage and deliver quality software solutions. In this role, you will develop user interfaces across platforms and lead projects, engaging with clients regularly. The...

    Ernst & Young Oman

    Boston, MA
    12 hours ago
  • $200k - $220k

     ...Senior AI Engineer Cambridge, MA - 4 days onsite $200,000 - $220,000 + bonus + equity...  ...longitudinal monitoring, and decision-support systems for screening and survivorship. ML Infrastructure...  ...| EHR | Electronic Health Records | GPU | TPU | Startup | Engineering | End-to-... 

    Harnham

    Cambridge, MA
    12 hours ago
  •  ...Full-time opportunity for a Senior AI Engineer based in Boston, MA. Join a fast-growing,...  ...combining large language models, agentic AI systems, and advanced automation, the company helps...  ...Doing Tech Breakdown • 50% AI, LLM & Agentic Systems Development • 25% Backend... 
    Full time

    Motion Recruitment

    Cambridge, MA
    3 days ago
  •  ...Senior AI Engineer| AI-Native Orchestration Platform About NetSpeek NetSpeek is building...  ...pressure Customers depended on the system What You Will Own Design and...  ...systems ~2+ years building and shipping LLM-powered systems in a growth-phase AI SaaS... 

    Talent Retriever

    Newton, MA
    4 days ago
  •  ...high-value tasks to intelligent AI agents that help reshape the...  ...bleeding edge of AI, blending deep engineering with practical product impact....  ...what's next in AI-powered systems. This role builds on, but...  ...Do Architect and build LLM-powered systems - design retrieval... 
    Shift work

    SevenAI

    Boston, MA
    4 days ago
  • $30 per hour

     ...Description We are seeking an Agentic AI Engineer to support the development of a customized...  ...agentic approach, and shipping working systems. This is not a research role. You'll be in...  ...Mandatory skills: Agentic AI, Claude, LLM Building production-grade agentic systems... 
    Full time
    Work at office
    Remote work
    Shift work

    FocusKPI Inc.

    Boston, MA
    7 days ago
  •  ...Senior AI Engineer Full-time opportunity for a Senior AI Engineer, based in Boston (hybrid...  ...offers the chance to build cutting-edge AI systems at a rapidly growing company transforming...  ...AI/ML, NLP, statistical learning, and LLM-based applications • Hands-on experience... 
    Full time

    Motion Recruitment

    Boston, MA
    12 hours ago
  • $144.5k - $230k

     ...Senior AI Engineer We are the better way to work in finance. As private equity's value creation...  ...group builds and operationalizes the AI systems that power Accordion's consulting...  ...ML systems, agent development, or applied LLM engineering ~ Hands-on experience building... 
    Work at office
    Local area
    Remote work
    2 days per week

    Accordion USA

    Boston, MA
    5 days ago
  • $144k - $181k

     ...the company operates by embedding AI into workflows across every function - product, engineering, revenue, finance, support. It's...  ...judgment lives, and build the systems that make it real. Some of that...  ...Hands-on experience building with LLM APIs, agent frameworks, or AI-... 
    Flexible hours
    Shift work

    CarGurus

    Boston, MA
    2 days ago
  • $124.9k - $228.9k

     ...massive datasets in real time to building systems that operate reliably on a global...  ...do You'll join a software engineering team building internal AI solutions that support teams across...  ...knowledge of or hands-on experience with LLM orchestration frameworks (e.g.,... 
    Full time
    Temporary work
    Local area
    Worldwide

    The Trade Desk

    Boston, MA
    4 days ago
  •  ...gap. We're building the first AI-powered platform built for hardware...  ...early role for a hands-on AI engineer to design and build the agents...  .... You'll own the AI systems that set our product apart: agents...  ...production software. You've shipped LLM-powered agent systems to real... 
    Permanent employment
    Contract work
    Remote work
    Shift work

    Re:Build Manufacturing

    Boston, MA
    1 day ago
  • $269.1k - $307.2k

     ...Distinguished AI Engineer Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry...  ...Invent and introduce state-of-the-art LLM optimization techniques to improve the performance... 
    Full time
    Part time
    Local area

    Capital One Financial Corp

    Cambridge, MA
    12 hours ago
  • $217k - $307k

     ...Gpu Performance Software Engineer Zoox is building the world's most advanced self-driving hardware and software solution. The efficiency demands of such a system require an expert fine tuning of both the compute hardware architecture as well as the algorithms and middleware... 
    Temporary work
    Relocation package

    Zoox

    Boston, MA
    12 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Systems Engineer - LLM Infra & GPU. Be the first to apply!