Evaluation-Driven AI Engineer (Python, Production)
$150k - $250kDistyl
Distyl is seeking an AI Evaluation Engineer to design evaluation systems for AI-driven solutions. Located in San Francisco, this position requires strong Python skills and a commitment to utilizing AI tools to enhance evaluation processes. The role offers a competitive salary range of $150K – $250K based on experience, with comprehensive benefits including medical coverage and 401(k) plans. You will be working in a hybrid model with 3+ days per week in the office. #J-18808-Ljbffr Distyl
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Evaluation-Driven AI Engineer (Python, Production) in San Francisco, CA vacancy
$180k - $250k
A leading technology consultancy is seeking an experienced Full Stack Engineer to develop AI-driven web applications. The ideal candidate has 6-10 years of experience, strong skills in Python, TypeScript, and data engineering. This role focuses on designing, deploying,...Suggested- ..., located in San Francisco, is seeking a creative production leader to own high-volume ad creative output. This... ...needs. The ideal candidate will have a performance-driven background with strong hands-on experience in AI creative tools. A passion for managing creative...SuggestedFull timeImmediate start
- ...AI Engineer AI has changed software development. Security... ...is redefining product security for the AI era... ...'s largest companies, driven cybersecurity policy efforts... ...for model evaluation, training, and experimentation... ...production-quality code (Python, ML frameworks,...Suggested
Corridor Security Inc
San Francisco, CA1 day ago - Luma AI is seeking a Research Engineer to design and scale the infrastructure powering model evaluation efforts. You will build pipelines... ...engineering, and product teams. Ideal... ...evaluation, strong Python skills, and experience... ..., and measurement-driven development. #J-1...Suggested
$150k
A leading AI-driven company in San Francisco is seeking a GTM Engineer to bridge go-to-market strategy with AI execution. This senior role focuses on diagnosing GTM operations, making data-driven recommendations, and building systems that enhance revenue effectiveness....SuggestedFlexible hours$260k
...Title : Senior AI Product Engineer Location : San Francisco, CA (Hybrid... ...with a high-growth, mission-driven SaaS company transforming how... ...UI through Node.js/Python backend, with real-time streaming... ...shaping how AI systems are built, evaluated, and deployed in high-trust...Harnham
San Francisco, CA4 days ago$150k - $250k
...Distyl is an applied AI technology company partnering... ...of AI systems, and products that transform mission... ...AI systems using Evaluation‑Driven Development—a process... ...production. AI Evaluation Engineers design and implement... ...who write production Python code, build evaluation...Work at office3 days per week$150k - $210k
...AI Engineer San Francisco, California AI Engineer Location: San... ...and deploying standalone AI-driven applications . This role focuses... ...at the intersection of AI, product development, and infrastructure... ...layers, monitoring, and evaluation frameworks to mitigate hallucination...Work at officeLocal areaImmediate startFlexible hoursCargomatic
San Francisco, CA1 day ago- ...seeking a highly skilled AI Engineer to design, build, and deploy scalable AI‑driven applications that... ...development, model training and evaluation, and deployment of... ...models (LLMs), into production‑ready tools that... ...Advanced experience with Python; ability to write clean...Work experience placement1 day per week
- Ladders seeks a Marketing Engineer to join its data-driven growth team in San Francisco. This role will drive... ...You will collaborate with analytics, product, creative, and RevOps to optimize the... ...automation lifecycle, and apply AI tools to stay ahead in a competitive...
- AI Engineer, Production Agents Guild.ai is looking for a founding engineer focused... ...using autonomous and event-driven AI. Your agents will be... ...Collaborate closely with product and evaluation teams: define agent... .... Proficiency in Python and comfort with TypeScript...Full timeFlexible hours
$215k - $230k
...change our trajectory. The AI Engineering Team is chartered with... ...needed to make AI production-ready. We’re also deeply involved in evaluating and integrating... ...backend or systems work (Python preferred) Hands‑on experience... ...who is both results‑driven and sociable, with...Local areaRemote work$1,500 per month
About Gem Gem is the only AI‑first all‑in‑one... ...customers boost recruiter productivity by up to 5x while... ...senior or staff AI/ML Engineer to design and ship production... ...to create cohesive AI‑driven experiences Share ML... ...model development and evaluation What You'll Need...Full timeWork at officeLocal areaImmediate startRemote workFlexible hours3 days per week- Founding AI Engineer | LLM Systems | $500k+ & Equity | SF... ...AI engineer to build production LLM systems for mission... ...You’ll own retrieval, evaluation, grounding, latency &... ...reliability across LLM‑driven systems tied to real... ...agentic workflows Strong Python, backend & systems...Relocation
- ...looking for a Senior Full-stack Engineer in San Francisco. The successful candidate will lead product development from ideation to implementation, emphasizing AI-powered tools and collaboration with... ...tasks using React/TypeScript and Python/Flask. The ideal applicant has...
Ersilia
San Francisco, CA2 days ago $154.6k - $315k
...building admin dashboards. AI is redefining what it... ...transforms natural language into production-ready code, integrates... ...Retool is evolving how engineering works within Retool. We’... ...autonomous, resilient agents and evaluation frameworks to power an AI-driven software factory Drive...- UCSF Health is seeking a skilled AI Engineer to design, build, and deploy scalable AI‑driven applications that improve... ...data pipelines, model training, evaluation, and cloud deployment to deliver... .... You will translate LLMs into production‑ready solutions, develop APIs,...
- ...leading technology company is seeking an Automation Engineer based in California to create automated scripts for AI training. This role involves building reliable... ...pipelines. The ideal candidate has expertise in Python, R, and C++, as well as familiarity with CI/CD tools...Remote jobFlexible hours
- Notion is seeking an AI Applications Engineer to drive business transformation across GTM, Finance and People teams, delivering AI‑driven solutions that scale and create measurable impact... ...You’ll build reusable components, evaluation patterns, and guardrails to make AI...
- ...Head of Product and AI Engineering (CTO) About the Company Expanding market research technology... ...and engineering aspects of AI-driven platforms, and defining the product vision... ...instrumental in establishing processes for the evaluation, prioritization, and launch of new...
Confidential
San Francisco, CA15 hours ago $150k - $190k
...AI ENGINEER / ML ENGINEER - APPLIED AI & LLM SYSTEMS $150,000 - $19... ...AI is core to the company's product and long-term strategy Engineering... ...scalable AI/ML systems using Python and PySpark Develop LLM... ...of AI services Create evaluation and validation frameworks for...Remote workFlexible hoursHarnham
San Francisco, CA4 days ago$150k
...looking for a motivated Entry‑Level Python / AI Engineer to join our growing engineering team... ...learning, and building real-world AI‑driven products. You’ll work closely with senior engineers... ...Assist in developing, training, and evaluating machine learning models Work with...InternshipStealth Startup
San Francisco, CA3 days ago$200k - $250k
...first company based in San Francisco, is seeking a Senior AI Engineer to lead the evaluation infrastructure for AI agents. This role focuses on... ...The ideal candidate will have experience with TypeScript, Python, and observability systems, working collaboratively to design...Remote jobFlexible hours- ...Goodfin Goodfin is an AI-native wealth platform... ...accredited investors research, evaluate, and act on private... ...As a Staff AI Engineer, you’ll be a technical... ...applied AI—and make it production‑grade. You’ll own end‑to... ...Strong fundamentals in Python and backend system design...
goodfin
San Francisco, CA1 day ago - Jack & Jill is a fast-growing AI edtech startup in San Francisco seeking a Software Engineer, Product to join as an early engineering... ...hire. You will help build AI-driven grading and feedback solutions... ...ship production-ready code using Python, FastAPI, and React/TypeScript...
- ByLabs is seeking a skilled professional to develop AI-driven systems for automating vulnerability discovery and security analysis in large... ...strong programming skills in languages such as Go, Java, or Python, and familiarity with security tools like Semgrep and CodeQL. A...
- ...Smart Bricks is a frontier AI lab building autonomous... ...capital to discover, evaluate, and transact assets... ...Everything we build is live in production, consequential, and... ...The Role As an AI Engineer at Smart Bricks, you will... ...infrastructure Be proficient in Python and comfortable working...Live in
- The Mice Groups, Inc. seeks an experienced ML Engineer to design and deploy high-performance Python-based ML models. The role focuses on data-intensive applications... ...ll collaborate with cross-functional teams and own production models, ensuring robust alerting and clean, modular...
- ...record of turning ambitious AI ideas into products people actually use; move... ...effortlessly between research and engineering; have shipped something... ...work by regularly running evaluations and tests. Analyze... ...agentic harnesses. Fluent in Python and common agentic frameworks...Relocation package
$130k - $220k
...leading independent AI benchmarking and... ...company. They help engineers, enterprises,... ...described as an AI Evaluation Engineer / Technical... ...benchmarking, technical product work, strategic... ...suited to highly driven technical... ...**Tech Stack** * Python **Why Join** This...Full timeWorldwideAurora Jobs ApS
San Francisco, CA11 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Evaluation-Driven AI Engineer (Python, Production). Be the first to apply!
Related searches
- ai engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- ai research engineer San Francisco, CA
- senior ai engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- ai developer San Francisco, CA
- ai prompt engineer San Francisco, CA
- ai engineer remote San Francisco, CA
- python engineer San Francisco, CA
- python developer San Francisco, CA