AI Engineer, Agents and Evaluation
Pronoia
Pronoia Energy is a pioneering deep tech startup at the forefront of quantum energy storage innovation. As a lean, mission‑driven team, we thrive on rapid prototyping, cross‑disciplinary collaboration and solving complex engineering challenges to turn quantum physics into practical, scalable products. Our current focus is on developing our groundbreaking room‑temperature macroscopic quantum energy storage technology that promises orders of magnitude greater energy density, faster charging, and higher power delivery as well as being cheaper and safer compared to existing battery technology. This represents a paradigm shift in energy storage with applications spanning consumer electronics, electric vehicles, renewable grids, and beyond. Role Summary: To meet our ambitious goals we are building an internal, grounded, agentic AI system that accelerates our research, and we are hiring an AI Engineer to build two things: the orchestration that plans and routes the work, and the verification layer that stops the system from stating anything it cannot support. It is a founding, high‑leverage role, and you will own the part of the stack that decides what counts as true before the team acts on it. In this role you will build the agent orchestrator that plans a research question into steps and routes each step to the right tool, and the first verification gate and evaluation harness that catch the system before it states anything unsupported. You will enforce our defining rule: factual questions go to retrieval, computational questions go to tools, and nothing is answered from the model's own memory. You will stand up a self‑hosted open‑weights model on our own hardware and build the entire agent loop around it. This is a founding generalist role, and early on you will wear several hats across orchestration, serving, and evaluation. This role is onsite in Torrance, California. Key Responsibilities: Build the agent orchestrator and the tool‑routing logic at the heart of the system. Stand up and serve a self‑hosted open‑weights model on local hardware. Build the first verification gate and evaluation harness, making grounding mechanical rather than hopeful. Enforce strict routing so claims trace to a retrieved source or a deterministic computation. Wear several hats as a founding generalist and later hand specialties to dedicated hires. Required Qualifications: A track record shipping a real agent or tool‑use system in production, not a demo. Genuine experience self‑hosting open‑weights models on your own GPUs, not only calling a hosted API. A habit of treating hallucination and tool‑misuse as engineering problems with mechanical fixes. Builder‑generalist range across orchestration, model serving, and evaluation. A self‑starter who thrives amid ambiguity and rapid iteration. Preferred Qualifications: A scientific or physics background that makes our zero‑fabrication standard second nature. Contributions to open‑source serving or agent tooling such as vLLM, TGI, or agent frameworks. Experience building retrieval‑augmented systems and evaluation suites. Prior work in deep tech R&D alongside interdisciplinary teams. What We Offer: Chance to solve one of the world's biggest engineering challenges and pioneer quantum energy storage. Competitive salary, equity in a transformative startup, and performance‑based incentives. Access to cutting‑edge labs, tools, and resources in a flexible, collaborative work environment. Comprehensive benefits: health insurance, unlimited PTO, professional development stipend, and relocation assistance if needed. A culture of innovation where your work will accelerate our path to market impact. If you're excited to tackle this real‑world quantum problem and build the energy systems of the future, apply with your resume and cover letter detailing relevant projects. #J-18808-Ljbffr Pronoia
$160k - $210k
Overview Model/Z seeks an experienced and dynamic AI Agent Engineer to provide technical expertise and software development skills to further... ...affordable housing development. ESSENTIAL DUTIES Evaluate Large Language Models (LLMs) and select the best one for Model...SuggestedLocal areaImmediate startRemote workRelocation3 days per week- Linktree Pty is seeking an Applied AI Engineer to build end-to-end AI experiences that help... ...data, and platform engineering to ship AI agents and AI-powered experiences at scale. The... ...with strong product judgment, evaluation, observability, and safeguards. This is...Suggested
$240k - $250k
The Role The AI Agents and Experience team focused on turning frontier model capabilities... ..., and their audiences. As an Applied AI Engineer at Linktree, you’ll work across product,... ...real usage, and harden what works with evaluation, observability, safeguards, and strong product...SuggestedCasual workWork at officeRemote workHome office- Pronoia Energy seeks an AI Engineer to build an orchestration layer that plans and routes research steps, plus a verification... ...open-weights model on local GPUs and shaping the agent loop from exploration to evaluation. The candidate will work onsite in Torrance, California...SuggestedLocal area
- Salesforce is looking for experienced Forward Deployed Engineers to design and implement AI solutions directly within enterprise customer environments. The role involves working closely with a Deployment Strategist to deliver impactful projects from day one. Ideal candidates...Suggested
$160k - $210k
A pioneering modular housing company is seeking an experienced AI Agent Engineer to enhance AI capabilities within their software. You will be responsible for optimizing AI agent performance, integrating AI capabilities, and collaborating with teams in a fast-paced environment...Remote work- eCommerce Placement is seeking an AI Engineer who excels at leveraging AI coding tools to rapidly develop software. The successful candidate... ...development, rapid prototyping, and designing autonomous AI agents. A strong problem-solving mindset and a passion for continuous...
- A fast-growing AI company in Los Angeles is seeking a Senior AI Systems Engineer to develop agent execution systems that interact with real infrastructure. The candidate should have strong backend experience, particularly in TypeScript and Python, and experience building...
$200k - $230k
Convoso is seeking a Principal Software Engineer to develop and scale AI agent systems for their enterprise SaaS application. This role involves building frameworks that enable intelligent automation, optimizing data interfaces, and ensuring robust performance across the...Remote job$350k
Tapcart in Santa Monica is seeking an experienced engineer to architect and ship durable, fast, and clean products. You will work on proactive AI agent orchestration layers and collaborate with key stakeholders to deliver immediate value. Qualifications include 5+ years...Immediate startRemote workFlexible hours- Linktree is looking for an Applied AI Engineer in Los Angeles to create AI experiences that enhance creator tools. The role emphasizes building and shipping products from concept to production, collaborating across teams to tackle user problems effectively. The ideal candidate...
$170k - $220k
Senior AI Systems Engineer - Agentic Platforms $170k-$220k + Equity A fast-growing, venture-backed AI company is hiring engineers to build systems... ...across infrastructure . The team is building autonomous agents that operate in production environments, interacting with...- A leading AI security company in Los Angeles is looking for a Software Engineer Intern to help architect and scale their AI Security Agent systems. The role emphasizes backend development and requires strong Python skills, as well as experience with LLMs and AI agents....Internship
- ...Vice President of AI Engineering & Agent Platforms About the Company Industry-shaping healthcare technology (HealthTech) & software provider Industry Internet Type Privately Held, VC-backed Founded 2019 Employees 501-1000 Funding $76-$10...
$190k - $250k
TWG AI, located in Santa Monica, CA, is searching for a Senior or Staff AI Software Engineer in Test to build commercial-grade AI products. This role will focus on designing and building test automation frameworks and infrastructure, ensuring quality in AI-powered applications...- ...System1 is building the next generation of AI Agent–powered consumer products, and we’re looking for a Lead AI Product Engineer to help lead the effort. You’ll design, build... ...layers (planners, supervisors, evaluators) to manage task decomposition, retries, and...Full timeWork at officeLocal area
- Faraday Future in Los Angeles is seeking a Senior AI & Business Operations Engineer to build an enterprise-grade AI platform that integrates AI capabilities into core business processes and decision-making. The ideal candidate will lead system architecture design, collaborate...
- M|R Walls, a leader in architectural solutions, seeks an AI Systems Engineer to streamline operations using AI technologies. The role emphasizes building AI agents, automating workflows, and connecting systems. Ideal candidates will possess software engineering experience...Full timePart time
- ...planning. Job Description The job description for an OleOle AI engineer language intern may vary, but typically, it involves: Assisting... ...models. Annotating and curating data for training and evaluation purposes. Conducting experiments and analysis to enhance AI model...InternshipWorldwideMonday to FridayShift work
- ...extraordinary, together. ABOUT THE ROLE The AI Enablement Engineer plays a critical role in accelerating... ...Build and maintain prompt libraries, agent configurations, workflow playbooks,... ...Provide input on vendor evaluation, tool consolidation, and platform investment...
$141.9k - $190.3k
...Job Summary We’re hiring a Senior AI Engineer to build the AI core capabilities and tooling... ...across Ad Technology. You will create shared agents, initializers, registries, and reusable... ..., governance, observability, and evaluation, so teams can deliver high‑quality AI solutions...$160k - $230k
....com. About the Role We’re looking for a Senior Software Engineer on our Sports AI team to help build the next generation of real‑time AI systems... ...composed, validated, and refined Design and implement evaluation and observability frameworks to measure system quality,...Work at officeWorldwide- A leading AI research accelerator based in San Francisco is seeking an experienced software engineer to evaluate and refine AI-generated code. The ideal candidate will have over 5 years of experience in software engineering, including substantial time at top-tier companies...Remote jobFor contractors10 hours per week
$125.5k - $147.6k
Senior AI Software Engineer - Technology & Experience (TechEx) West Monroe is seeking a Senior AI... ...enabled features including intelligent agents, copilots, workflow automation, and... ...clients, exercising sound judgment in evaluating outputs. Applying AI technologies (e....Local areaFlexible hours- ...development company is looking for a skilled Software Engineer based in the US to enhance AI-driven coding solutions. This role requires over 5 years... ...stack applications and software architecture. You will evaluate AI-generated code, design verification mechanisms, and...Remote jobContract work10 hours per weekFlexible hours
- Description GoodSuite Position Description AI Engineer Woodland Hills, CA | Full-Time | On-Site... ...Build and maintain AI tools, agents, dashboards, and workflows that eliminate... ...getting teams to actually use the tools Evaluate and implement AI-forward platforms including...Full time
$75k - $85k
True Classic is looking for an AI Engineer to design, build, and deploy AI‑powered applications... ...Classic business problems Build AI agents, automation pipelines, and LLM‑powered features... ..., and drive continuous improvement Evaluate and implement AI tools that fit our...Work at officeWorldwideRelocationRelocation package$155k - $235k
...Databricks, to the semantic and AI layers that sit on top. This... ..., and ensuring data works for engineers, analysts, and business users... ...Semantic Layer — connecting AI agents and agentic workflows to governed... ...LLMs are trained, aligned and evaluated (RLHF, fine‑tuning, prompt...Home officeFlexible hours$80k - $100k
About Us UJET leads the way in AI‑powered contact center... .... UJET’s AI solutions empower agents, optimize customer journeys, and... ...operational decisions. AI Data Engineer Own the seam between "customer... ...AWS Bedrock, or equivalent) - evaluation, prompt design, cost and latency...Contract workWork experience placementWork at officeLocal areaRelocationWork visa$83.2k - $124.8k
...Knowledge Management will identify effective use of Generative AI, client facing solutions, and knowledge and information systems... ...user feedback and track logs, usage data, and behavior metrics to evaluate knowledge management platforms for usability and performance Facilitate...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Engineer, Agents and Evaluation. Be the first to apply!
- ai engineer Los Angeles, CA
- ai ml engineer Los Angeles, CA
- senior ai engineer Los Angeles, CA
- machine learning ai engineer Los Angeles, CA
- ai developer Los Angeles, CA
- ai prompt engineer Los Angeles, CA
- ai engineer remote Los Angeles, CA
- operations agent Los Angeles, CA
- import export agent Los Angeles, CA
- remote chat agent Los Angeles, CA

