Production AI/ML Engineer - Reliability & Evaluation (SF)
Jobleads-US
Wwshemi is seeking an on-site AI/ML Engineer to enhance the reliability of production agents by detecting failures, evaluating fixes, and guiding teams in building trustworthy systems. You will own the intelligence behind flagging decisions and the confidence of identifications.
The role emphasizes hands-on work with LLMs in production, evaluating approaches, and iterating based on real production traces. Salary ranges reflect SF market rates and visa sponsorship is not available.
#J-18808-Ljbffr Jobleads-USVacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Production AI/ML Engineer - Reliability & Evaluation (SF) in San Francisco, CA vacancy
- ...AI/ML Engineer (Computer Vision) A fast-growing applied AI company... ...its engineering team to build production grade computer vision capabilities... ...turning research into reliable software, working close to product... ...pipelines across training, evaluation, inference, and monitoring....Suggested
Blue Signal Search
San Francisco, CA1 day ago - ...Machine Learning Engineer This is the first Machine... ..., to serving them in production and keeping them honest. This is applied ML on messy, high-dimensional... ...have opinions about evaluation, monitoring,... ...smaller, cheaper, more reliable model wins instead....SuggestedWork at officeWork from homeRelocationFlexible hours
Metriport
San Francisco, CA2 days ago $200k - $300k
...focuses on placing the best product managers, software, and hardware... ...to help them hire. AI/ML Engineer Location: San Francisco,... ...production applications. Define evaluation frameworks, metrics, and... ...Optimize model performance, reliability, latency, and operational...SuggestedH1bWork at officeRemote workRelocation package3 days per weekRecruiting from Scratch
San Francisco, CA2 days ago- ...seeking a Senior Full-Stack AI Engineer to lead the design and deployment... ...standards for quality and reliability in a startup-paced environment... ...You bring 5+ years shipping production AI systems, strong React and... ...regulated healthcare. Onsite SF role with base salary and equity...SuggestedVisa sponsorshipRelocation package
- ...Wwshemi is seeking a software engineer to build an AI-powered recruiting marketplace's intelligence layer in San Francisco, CA. You... ..., ranking, and retrieval systems, from design through production. You'll ship ML-powered features, work with PyTorch/TF, and design scalable...Suggested
- ...Niulix seeks a capable, early-career software/ML engineer with 2–8 years of real full-time experience, ideally from a strong startup, ex-CTO, or top school. The candidate should have built production-grade systems and learns quickly, with a clear spike on their CV. On-...Full time
$251k - $278k
...TeamOpenAI’s Applied AI Engineering team helps... ...capabilities into safe, reliable, and high-impact production systems. We work with... ...through prototyping, evaluation, production launch,... ...role is based in our SF or NYC office. We use... ...include applied AI or ML engineering, forward...Work at officeLocal areaRelocation packageFlexible hoursOpenAI
San Francisco, CA22 hours ago- ...About the role Our client is a well-funded AI startup building production-grade ML infrastructure used by enterprise customers. They are looking for a Senior AI/ML Engineer to own model training pipelines, evaluation systems, and inference serving at scale. Full-time...Full time
Clera
San Francisco, CA22 hours ago - ...Artificial Analysis, Inc. in San Francisco, CA is seeking a Senior AI/ML Engineer to lead projects in benchmarking and analysis, building core... ...design robust Python-based solutions for benchmarking, model evaluation, and data visualization, and work with enterprise customers...
$100k - $175k
...Back to jobs Applied AI Engineer Remote (San... ...observability and evaluation platform , empowering... ...high-performing, reliable agents and applications... ...prototype to production scale, Arize AX unifies... ...from traditional ML to generative AI... ...and events in the SF Bay Area The estimated...Full timeWork at officeRemote workShift workAfternoon shiftArizeai
San Francisco, CA15 days ago- ...software company in San Francisco, seeks an Applied AI Engineer to own AI-driven content generation systems in production. You will design agents that convert briefs into interactive assets, build orchestration and reliability tooling, and connect generation to ranking...
- ...Raydar is seeking a Staff AI Engineer in San Francisco to design and ship software systems... .... You will own major parts of the product, focusing on evaluating AI agents, agentic concepts, and... ...production stability. Requires hands-on AI/ML work, Python proficiency, and strong...Full time
$120k - $200k
...AirwallexAirwallex is the AI-native financial... ...financial products of their own.We started... ...: from prompt engineering and in-context learning... ...in applied AI/ML engineering with production... ...of monitoring, evaluation, and iteration in... ...innovation with reliability, scalability, and...Temporary workLocal areaAirwallex
San Francisco, CA1 day ago$242.25k - $285k
...connected platform and AI-native ecosystem for... ...WithYou’ll join Carta’s ML Engineering team, embedded in... ...from post-training and evaluation through model serving... ...engineers building the product and bringing these capabilities... ...to run experiments reliably, using managed or self...Full timeContract workCarta
San Francisco, CA2 days ago- ...portfolio of agentic software products in the industries we... ..., design, and engineering together with the autonomy... ...are an exceptional AI-native software engineer... ..., establish tests and evaluations, and review generated... ...architecture, security, reliability, and quality of the...Permanent employmentFull timeWork experience placementLive inWork at officeLocal area
Accenture
San Francisco, CA4 days ago $240k - $270k
...we’re not just adding AI—we’re building the future... ...you come in. As an AI/ML Engineer, you’ll join a growing... ...You’ll DoPartner with product, design, and engineering... ...in all our offices in SF, NYC, London and Sydney... ...data for the purposes of evaluating your candidacy for employment...Full timeWork at officeSigma Computing
San Francisco, CA1 day ago$129k - $198.4k
Job DescriptionRole: As an AI/ML Engineer on the Metrics Frameworks team... ..., part of the Simulation, Evaluation, and Data organization, you... ...teams to enhance productivity across the organization by... ...accountable for the performance, reliability, and scalability OKRs of the...Full timeLocal areaWork from homeGeneral Motors
San Francisco, CA22 hours ago- ...Thinking Machines is hiring a Software Engineer, Inference to own the reliability, scale, and efficiency of the systems that serve our models to real users. This production-facing role sits at the center of a fast-growing platform, bridging cutting-edge inference techniques...
- ...the RoleAs a Principal AI Engineer at Innovaccer, you... ...pipelines, and the AI/ML-powered features that... ...increasingly define our products — while setting the technical... ...ensuring they perform reliably in production.Own... ...designs you can deliver.Evaluate and select...Full timeTemporary work
Innovaccer
San Francisco, CA2 days ago $150k - $170k
...Cogniify is building production-grade Generative AI applications and is hiring a hands-on engineer to design, build, and... ...agent workflows, and reliable integration with internal... ...selection to evaluation, safety guardrails, deployment... ...Observability/ML tools: MLflow, Weights...Remote workCogniify
San Francisco, CA1 day ago$150k - $210k
...AI Engineer Location: San Francisco, CA, in-office Compensation... ...intersection of AI, product development, and... ...Ensure scalability, reliability, and security of AI systems... ...advancements in AI/ML, especially in agent... ...layers, monitoring, and evaluation frameworks to mitigate...Work at officeLocal areaImmediate startFlexible hoursArgo AI
San Francisco, CA4 days ago- ...B2B SaaS company building AI-native software for complex... ...central part of the company’s product and engineering strategy. Rather than... ...required to make production AI reliable: evaluation, ingestion, observability,... ..., retrieval, and AI/ML infrastructure Own AI systems...Full time
People in AI
San Francisco, CA1 day ago $151.28k - $183.32k
...department. From optimizing a production line to the latest... ...Position Summary: As a Senior AI Engineer on the AI Venture Studio team... ...move fast without giving up reliability, observability, security, or... ...aware AI applications. Build evaluation, testing, and observability...Full timeTalentify.io
Brisbane, CA1 day ago- ...General Employee builds AI employees for service businesses. Our product answers calls, texts,... ...customer workflows where reliability, judgment, and... ...are looking for a senior engineer to own the production systems... ...management workflows. Create evaluations, simulations, scenario...
General Employee
San Francisco, CA4 days ago $180k - $260.9k
...Senior AI Product Engineer | Agentic AI | Bay Area (Hybrid) | $180,000–$260,900 + RSUs Build... ...— prompting, orchestration, evaluation, debugging, iteration, and optimization... ...frameworks and feedback loops to ensure reliability, quality, and measurable business impact...Work at office3 days per weekHarnham
San Francisco, CA1 day ago$140k - $200k
...Work on cutting‑edge AI solutions including LLMs, computer vision... ...intersection of research and production, implementing cutting‑edge AI... ...collaborate with world‑class engineers and researchers to solve complex... ...Build and maintain ML pipelines and model deployment...Remote workFlexible hoursBitWords Inc.
San Francisco, CA4 days ago$240k - $270k
...Senior AI/ML Engineer San Francisco, CA About the Role At Sigma... ...You'll Do Partner with product, design, and engineering teams... ...environment in all our offices in SF, NYC, London and Sydney. All... ...data for the purposes of evaluating your candidacy for employment...Full timeWork at officeFlexible hoursSigma Computing
San Francisco, CA1 day ago- ...Machine Learning Engineer Bucket Robotics is hiring a Machine Learning... .... You'll work on the core ML systems that turn 3D geometry and synthetic data into reliable, production-grade vision models deployed... ...Design, train, and evaluate computer vision and ML models...Shift work
Bucket Robotics
San Francisco, CA22 hours ago - ...Machine Learning Engineer Location: Onsite... ...next generation of AI for industrial... ..., validation, and production. If you're passionate... ...UniversalAGI is hiring an ML Engineer to help... ...training and evaluation. Run training... ...code, debugging, reliability, reproducibility)....Work at officeFlexible hours1 day per week
UniversalAGI
San Francisco, CA2 days ago $73.8k - $218.8k
...Oracle Business Group AI Center of... ...We build real products that close deals and... ...You might come from engineering, consulting, product... ...retrieval pipelines and evaluation frameworks... ...software engineering, AI/ML, or enterprise... ...that makes agents reliable Minimum of 1 year...Work experience placementLive inWork at officeLocal areaAccenture
San Francisco, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Production AI/ML Engineer - Reliability & Evaluation (SF). Be the first to apply!
Related searches
- security operations center engineer San Francisco, CA
- operations engineer San Francisco, CA
- post production engineer San Francisco, CA
- remote operation drilling engineer San Francisco, CA
- network operations center engineer San Francisco, CA
- application operations engineer San Francisco, CA
- senior production engineer San Francisco, CA
- production network engineer San Francisco, CA
- production operations engineer San Francisco, CA
- senior security operations engineer San Francisco, CA