Senior AI Inference Engineer - Scalable LLM Production
Jobleads-US
Thomson Reuters is seeking a Senior Inference Engineer, AI to productionize, optimize, and scale AI/LLM workloads powering TR’s AI-driven products.
The role focuses on deploying across multi-cloud environments (AWS, Azure, GCP) and on‑prem Kubernetes clusters, reducing latency and ensuring enterprise reliability, with collaboration across Platform Engineering, Data Science, and Product teams.
Strong CUDA, TensorRT/ONNX Runtime, PyTorch or TensorFlow experience is required.
#J-18808-Ljbffr Jobleads-USVacancy posted 21 hours ago
Similar jobs that could be interesting for youBased on the Senior AI Inference Engineer - Scalable LLM Production in Eagan, MN vacancy
- ...Thomson Reuters is seeking a Senior Inference Engineer, AI to collaborate with platform teams to productionize and scale AI and LLM workloads across AWS, Azure, GCP and internal Kubernetes... ..., and work with data science and product teams to onboard new research models...Senior
- ...Thomson Reuters is seeking a Senior Software Engineer – AI to architect and optimize backend platforms powering... ...professionals. You will design scalable services, integrate LLM providers, and ensure high availability in production. You will collaborate with ML engineers...SeniorFlexible hours
- ...Reuters is seeking a Senior Software Engineer – AI to join the CoCounsel International team... ...backend services for AI agents and LLM orchestration for international products. You will collaborate with... ...engineers and shaping scalable platform architecture. #J-188...SeniorWorldwide
- .... is seeking a Lead Software Engineer, AI to drive architecture across... ...infrastructure, tooling, and production reliability. You will lead a senior team, work with AI-native practices, and deliver scalable agent systems built on modern LLM APIs and SDKs. The role emphasizes...Suggested
- ...Metal Blank Metal is an AI-native engineering company that partners... ...to deliver production AI fast. We blend strategic... ...powered projects Design scalable, production‑grade... ...Expert knowledge of LLM APIs, vector databases... ...systems Understanding of inference optimization and...Senior
- ...Thomson Reuters is seeking a Lead AI Engineer to set technical direction for AI agent platforms, building scalable agent infrastructure and tooling... ...and safety. You will guide a senior team, architect production AI systems atop modern LLM APIs, and drive architecture...
$110k - $204.2k
## Senior Inference Engineer - AIApplyremote type: Hybridlocations: United States... ...Senior Inference Engineer, AI. This person will collaborate... ...AI workloads and work with Product, Data Science, Architecture,... ...optimizing, and scaling AI and LLM workloads that power TR’s AI...SeniorWork at officeLocal areaFlexible hours2 days per week3 days per week$110k - $235k
...Job Description As a Senior Machine Learning Engineer , you will build and deploy production machine learning and large language model (LLM) systems that extract actionable... ...and summarization, AI agents, search, and... ...analysis . Build scalable and reliable machine learning...SeniorFull timeWork at officeLocal areaRemote workFlexible hours- ...Thomson Reuters in the United States is seeking a Senior Software Engineer, AI, to build AI-driven software for professionals through CLEAR. You... ...pipelines, RAG architectures, and autonomous agents as part of scalable backend and frontend features. The role requires 5+...Senior
$109k - $203k
Software Engineer - AI - CoCounsel Forward Deployed EngineeringAre... ..., Architects, and senior technical teammates to... ...to ensure solutions are scalable, maintainable, and secure.Help evaluate LLM outputs for legal... ...applications or integrations in production environments.Hands-on...Full timeContract workWork at officeLocal areaFlexible hoursThomson Reuters
Eagan, MN1 day ago$146.8k - $272.6k
Job DescriptionThomson Reuters products power the professionals... ...certainty.As a Staff Software Engineer - AI on the Confirmation Product Engineering... ...large language model (LLM)-powered applications, AI agents... ..., and build reliable and scalable AI infrastructure.Key ResponsibilitiesArchitect...Full timeWork at officeLocal areaFlexible hoursThomson Reuters
Eagan, MN1 day ago$146.8k - $272.6k
## Staff Software Engineer – AIApply: Hybrid: United States... ...**Thomson Reuters products power the professionals... ...Staff Software Engineer – AI** on the Confirmation... ...large language model (LLM)-powered applications,... ...and build reliable and scalable AI infrastructure. **Key...Full timeWork at officeLocal areaFlexible hoursReuters
Eagan, MN8 hours ago$183.1k - $340k
Thomson Reuters products power the professionals... ...Principal Software Engineer for Cloud Audit... ...an engineering-led, AI-native organization... ...experimentation, and stand up scalable solutions. Your... .... Mentor staff and senior engineers, raising... ...integrating LLM APIs (e.g., OpenAI,...Full timeWork at officeLocal areaFlexible hoursShift workThomson Reuters
Eagan, MN3 days ago- ...Reuters - Noetica in the United States is seeking a Senior Software Engineer, Full Stack to build scalable backend services and APIs powering our document analysis... ...to frontend features as needed, collaborating with AI/ML PhDs and domain experts to deliver reliable, high‑...Senior
$124.36k - $146.3k
Senior Engineer (Generative AI) At U.S. Bank, we're on a journey to do our best. Helping... ...developing, and deploying scalable Generative AI (GenAI)... ...strong hands-on expertise in LLM-based applications, GenAI... ...functional teams to build production-ready AI systems that meet...SeniorTemporary workWork experience placement3 days per week- ...Reuters is seeking a Senior Software Engineer, AI, to build AI-driven software for professionals. You will implement AI orchestration, RAG pipelines, and AI agents, while shipping robust backend APIs and modern UIs. The role emphasizes collaboration with AI researchers...Senior
$94.9k - $176.3k
...Thomson Reuters is hiring a Senior Software Engineer I to help build the... ...processing platform powering AI products across the company. The service... ...-class concerns. Build scalable cloud services that process... ...document processing, NLP, and/or LLM-based applications (RAG,...SeniorWork at officeLocal areaFlexible hours$127k - $235k
...government, and media. Our products combine highly specialized... ...Thomson Reuters can be found on**Senior Software Engineer - AI (Materia AI)**We’re... ...the systems that orchestrate LLM interactions, serve high‑traffic... ...requirements into scalable solutions.* Turn conceptual...SeniorWork at officeLocal areaFlexible hours2 days per week3 days per week$127k - $235k
We're looking for a Senior Software Engineer - AI to join the CoCounsel International... ...them for our international products and features. In this role,... ...early Labs concepts into scalable, production-ready features... ...such as agentic workflows, LLM orchestration, and content...SeniorWork at officeLocal areaWorldwideFlexible hours- Senior Data Engineer Travelers Data Engineering team constructs pipelines that... ...educate end users on data products/analytic environment. Perform... ...Expertise designing and building scalable, self-healing, cloud-native... ...-grade, multi-agent AI applications using agent orchestration...SeniorWork experience placementLocal area
- ...Thomson Reuters Corp. is seeking a Lead Software Engineer (Staff Engineer) to own the backend and AI orchestration powering CoCounsel for Audit. You will... ...patterns and roadmaps across teams. You will work at production scale with millions of documents and thousands of...
- ...Experience Team. You will contribute to architecture and develop scalable digital platforms for e-commerce and cloud initiatives,... ...tools. You will work with Front End, Back End, and Full Stack engineers to build customer-facing experiences using React Native, React...Senior
$127.4k - $236.6k
## Lead Software Engineer, AIApplyremote type: Hybridlocations... ...Software Engineer, AI**What if the AI agents... ...that let a small, senior group move at a pace well... ...and operate agents in production, pushing quality and safety... ...on top of modern LLM APIs, agent SDKs, and orchestration...Work at officeLocal areaFlexible hoursShift work2 days per week3 days per week$127.4k - $236.6k
## Lead Software Engineer, AIApplyremote type: Hybridlocations... ...Software Engineer, AI**What if the AI agents... ...that let a small, senior group move at a pace well... ...and operate agents in production, pushing quality and safety... ...on top of modern LLM APIs, agent SDKs, and orchestration...Work at officeLocal areaFlexible hoursShift work2 days per week3 days per week- Senior Software Engineer Location: St. Paul, MN or Juno Beach, FL are... ...organizations move technology and AI initiatives from... ...expertise with product thinking, business acumen... ...problems into scalable, production-ready systems... ...2 years of applied AI/LLM production experience...SeniorContract workTemporary workFlexible hours
- ...Are Collaboration.Ai is a mission-... ...transformative change. Our Products NetworkOS —... ...layer that keeps LLM quality measurable;... ...cost, and latency Engineer data pipelines —... ...background — robust, scalable pipelines for AI/ML... ...trust. Small, senior team. Early-stage impact...SeniorRemote work
Collaboration.Ai
Minneapolis, MNa month ago - ...Senior Life Sciences Knowledge Engineer Company: Norstella Location: Remote, United States Date Posted... ...scientific domain expertise and applied AI development. This role will be... ...with downstream evaluation metrics and production requirements across NPD. Train and...SeniorFull timeTemporary workWork at officeLocal areaRemote workFlexible hoursShift work
Norstella
Saint Paul, MN5 days ago - ...client is seeking a Lead AI Engineer to help design, build,... ...will serve as a senior technical contributor... ...responsible for developing production-grade AI applications,... ...powered applications, LLM solutions,... ...data sources. • Build scalable APIs and services supporting...
- ...Blank Metal Inc. is seeking a senior full-stack engineer to design and ship production-ready applications across frontend and backend stacks. You’ll work with... ...ll collaborate with product and ML teams to deliver scalable, secure, observable systems and mentor junior engineers...Senior
- IDR is seeking a Senior Software Engineer (Java) to join one of our top clients for an opportunity remotely. This role focuses on designing,... ...platform, and solutions teams to ensure resilience, uptime, and scalability. Work on custom Java applications using Java 17+ with...SeniorFull timeRemote work
IDR, Inc.
Eagan, MN3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Inference Engineer - Scalable LLM Production. Be the first to apply!
Related searches