AI Systems Engineer - LLM Infra & GPU
$82.3k - $220kDraper
Draper in Boston, MA is seeking an AI Systems Administrator, responsible for overseeing a closed GPT environment and ensuring system health. Candidates must have strong Linux administration skills, knowledge of automation, and a Bachelor's degree in Computer Science. This hybrid position requires an Active Secret Clearance. Responsibilities include installing and configuring servers, maintaining observability for GPU workloads, and implementing automation solutions. The salary range for this full-time position is between $82,300 and $220,000, reflecting Draper's commitment to employee growth and innovation. #J-18808-Ljbffr Draper
$197.3k - $225.1k
...Lead AI Engineer (AI Foundations, LLM Customization and Finetuning) Overview At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to create real...SuggestedFull timePart timeLocal area- ...Job Title: Generative AI Engineer (LLM Expert - AWS Focus) Location: Remote Employment Type: Ongoing Contract About BigRio... ..., integrating them into cloud-native, production-ready systems. This is a senior technical role , not a research...SuggestedOngoing contractRemote work
- ...Job Title: Gen AI Engineer (LLM Expert) Location: Remote Employment Type: Ongoing Contract About BigRio... ...Vision Models Build retrieval-augmented generation (RAG) systems using Langchain and ChromaDB . Develop interactive AI...SuggestedOngoing contractRemote work
- ...leading tech firm in Boston is seeking a Senior AI Engineer to design and integrate an AI platform based on top LLM providers. This role emphasizes delivering secure... ...scalable APIs, integrating AI with enterprise systems, and supporting adoption through implementations...Suggested
- ...Job Title: AI Engineer - NLP/LLM Data Product Engineer Location: Chennai, India- Hybrid Duration: 6 months with a Contract... ...pipelines to seamlessly connect LLMs with internal and external systems, ensuring secure and scalable data exchange. Solution...SuggestedContract work
- ...Multimodal AI Systems Architect (AI Engineering) Boston, USA We are seeking a talented Multimodal AI Systems Architect to develop and optimize AI... ...Qualifications: Experience with Whisper, CLIP, and multimodal LLM integration. Knowledge of streaming architectures and...
$180k - $250k
...Senior AI Engineer — Voice & Agentic Systems Location: Remote (US) / Hybrid (Boston or San Francisco) Company Stage of Funding: Seed ($2.5M raised)... ...RLHF / reward modeling experience Built eval-driven LLM systems Production reinforcement learning systems Real...H1bWork at officeRemote work- Capital One National Association seeks a Lead AI Engineer in Cambridge, MA to drive AI initiatives by collaborating with multidisciplinary teams. You will design, develop, and maintain AI software components using cutting-edge technologies. Candidates should possess a Bachelor...
- ...Agentic Systems Architect (AI Engineering) Boston, USA Key Responsibilities Architect multi-agent orchestration frameworks. Build robust tool-calling pipelines and reasoning loops. Optimize latency and token usage for real-time agentic workflows....
$140k - $170k
...Image & Computer Vision Ai Engineer Hatch I.T. is partnering with Babel... ...applications. You will build systems that extract, analyze, and... ...including integration with multimodal LLM systems that allow users to... ..., and cost efficiency (GPU usage, batching, model selection...Work at office$152k - $222k
...AI Engineer Join Suffolk's project teams across the U.S. as the on-site catalyst who turns... ...Opensearch and other data stores; automate infra with GitHub Actions; monitor latency,... ..., including 2+ years building production LLM/RAG/Agentic solutions. ~ Bachelor's in...Work at office$106k - $176.6k
...combine cutting-edge software engineering with artificial intelligence to... ...at the forefront of applied AI, collaborating closely with Medicinal... ..., and deploy intelligent systems that enhance productivity and... ...technologies with Large Language Model (LLM) capabilities, creating...Permanent employmentH1bLocal areaVisa sponsorshipWork visaRelocation package2 days per week$187k - $240k
...Datadog to developers within AI-focused IDE experiences such as... ...re looking for product-minded engineers who are excited about developer... ...to productionize these systems and integrate them within our... ...Follow the latest research on LLM prompt optimization, agents, and...Work at office$96.8k - $306.4k
...Description The Senior Principal AI Agent / ML Software Engineer is a Senior Staff-level,... ...next-generation AI systems on Oracle Cloud Infrastructure... ...latency, high throughput, GPU efficiency, reliability, cost... ...~ Deep understanding of LLM application patterns, including...Temporary workFlexible hours- ...Senior Infra Support Manager /System Engineer Rootshell Enterprise Technologies Inc. is a recognized provider of professional IT Consulting services in the US. We are actively seeking a Senior Infra Support Manager /System Engineer for one of our clients. Location...
$229.9k - $262.4k
...Overview Senior Lead AI Engineer (AI Foundations, LLM Core and Agentic AI) Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry leader in using machine learning to...Full timePart timeLocal area- ...technology company building an AI-enabled nursing platform... ...directly into EHR systems such as Epic and Athena... ...roadmap for STT/TTS/Speech LLM model training: from... ...failover strategies Mentor engineers on data curation, fine‑... ...Server, Kubernetes, and GPU scaling Hands‑on with...Remote work
- A leading global professional services firm is seeking a Manager in Application Design and Development to manage and deliver quality software solutions. In this role, you will develop user interfaces across platforms and lead projects, engaging with clients regularly. The...
$200k - $220k
...Senior AI Engineer Cambridge, MA - 4 days onsite $200,000 - $220,000 + bonus + equity... ...longitudinal monitoring, and decision-support systems for screening and survivorship. ML Infrastructure... ...| EHR | Electronic Health Records | GPU | TPU | Startup | Engineering | End-to-...- ...Full-time opportunity for a Senior AI Engineer based in Boston, MA. Join a fast-growing,... ...combining large language models, agentic AI systems, and advanced automation, the company helps... ...Doing Tech Breakdown • 50% AI, LLM & Agentic Systems Development • 25% Backend...Full time
- ...Senior AI Engineer| AI-Native Orchestration Platform About NetSpeek NetSpeek is building... ...pressure Customers depended on the system What You Will Own Design and... ...systems ~2+ years building and shipping LLM-powered systems in a growth-phase AI SaaS...
- ...high-value tasks to intelligent AI agents that help reshape the... ...bleeding edge of AI, blending deep engineering with practical product impact.... ...what's next in AI-powered systems. This role builds on, but... ...Do Architect and build LLM-powered systems - design retrieval...Shift work
$30 per hour
...Description We are seeking an Agentic AI Engineer to support the development of a customized... ...agentic approach, and shipping working systems. This is not a research role. You'll be in... ...Mandatory skills: Agentic AI, Claude, LLM Building production-grade agentic systems...Full timeWork at officeRemote workShift work- ...Senior AI Engineer Full-time opportunity for a Senior AI Engineer, based in Boston (hybrid... ...offers the chance to build cutting-edge AI systems at a rapidly growing company transforming... ...AI/ML, NLP, statistical learning, and LLM-based applications • Hands-on experience...Full time
$144.5k - $230k
...Senior AI Engineer We are the better way to work in finance. As private equity's value creation... ...group builds and operationalizes the AI systems that power Accordion's consulting... ...ML systems, agent development, or applied LLM engineering ~ Hands-on experience building...Work at officeLocal areaRemote work2 days per week$144k - $181k
...the company operates by embedding AI into workflows across every function - product, engineering, revenue, finance, support. It's... ...judgment lives, and build the systems that make it real. Some of that... ...Hands-on experience building with LLM APIs, agent frameworks, or AI-...Flexible hoursShift work$124.9k - $228.9k
...massive datasets in real time to building systems that operate reliably on a global... ...do You'll join a software engineering team building internal AI solutions that support teams across... ...knowledge of or hands-on experience with LLM orchestration frameworks (e.g.,...Full timeTemporary workLocal areaWorldwide- ...gap. We're building the first AI-powered platform built for hardware... ...early role for a hands-on AI engineer to design and build the agents... .... You'll own the AI systems that set our product apart: agents... ...production software. You've shipped LLM-powered agent systems to real...Permanent employmentContract workRemote workShift work
$269.1k - $307.2k
...Distinguished AI Engineer Overview: At Capital One, we are creating responsible and reliable AI systems, changing banking for good. For years, Capital One has been an industry... ...Invent and introduce state-of-the-art LLM optimization techniques to improve the performance...Full timePart timeLocal area$217k - $307k
...Gpu Performance Software Engineer Zoox is building the world's most advanced self-driving hardware and software solution. The efficiency demands of such a system require an expert fine tuning of both the compute hardware architecture as well as the algorithms and middleware...Temporary workRelocation package
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Systems Engineer - LLM Infra & GPU. Be the first to apply!
- senior ai engineer Boston, MA
- ai ml engineer Boston, MA
- ai engineer remote Boston, MA
- ai engineer Boston, MA
- ai prompt engineer Boston, MA
- ai developer Boston, MA
- machine learning ai engineer Boston, MA
- healthcare systems engineer Boston, MA
- application system engineer Boston, MA
- operating system engineer Boston, MA



