Senior AI Systems Engineer, Agent Quality & Evaluation
Flodesk
Flodesk is a remote-first company shaping the future of AI-driven marketing tools for small businesses. The role focuses on owning prompts, agent instructions, evaluation criteria, and the continuous-improvement loop across prompts, context, tools and product state, ensuring measurable quality. You will collaborate with product, design, marketing and copy teams to encode Flodesk's perspective while applying your judgment on how the product should behave, balancing quality, latency and cost. #J-18808-Ljbffr Flodesk
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior AI Systems Engineer, Agent Quality & Evaluation in Los Angeles, CA vacancy
$150k - $250k
...marketers to grow. Today, our AI helps members create and... .... We are building a system that can understand a... ...own Flodesk's prompts, agent instructions, quality definitions, evaluation criteria and continuous-... ...systems work at that connects engineering, product and natural...QualitySeniorImmediate startRemote workRelocationFlexible hours- ...Title: Senior Agentic AI Engineer Working Location: Glendale AZ (Hybrid... ...Digital Supply Chain Systems organization. The role... ...-grade single-agent and multi-agent systems... ...Define and automate evaluation methodologies for response quality, reasoning quality, recommendation...QualitySenior
SPECTRAFORCE
Glendale, CA2 days ago $400k
...Agents write most of the code and most of the content here. That only works because a loop layer decides what those agents can reach, and... ...claims belong to a sister seat; the loops belong to you. Product.ai is the verified truth layer for shopping, the intelligence that...SeniorFull timeProduct.ai
Los Angeles, CA2 days ago$110.7k - $372.9k
Position Summary Senior Agentic AI Engineer — Healthcare AI Three... ...rely on a healthcare system whose decision-making... ...build. You will own agent systems end to end —... ...time. Reliability, evaluation & safety • Implement... ...tool calls, retrieval quality, agent traces, failures...QualitySeniorLocal areaVisa sponsorshipDeloitte
Los Angeles, CA4 days ago$122k - $240.5k
...Summary Agentic AI is moving from... ...growing a team of engineers who want to work... ...autonomous, multi-agent systems powered by Anthropic... ...to detail and quality of work productAbility... ...state management, evaluation, guardrails, and... ...level employees to senior leaders, we believe...QualitySeniorWork at officeLocal areaVisa sponsorshipShift workDeloitte
Los Angeles, CA3 days ago$143.67k - $215.5k
...building the first AI-powered platform... ...a hands-on AI engineer to design and build the agents at the core of... ...You'll own the AI systems that set our... ...'re comfortable evaluating new frameworks,... ...approaches emerge.This senior engineer will... ..., and automated quality benchmarksDeveloping...QualitySeniorPermanent employmentRemote workShift workRe:Build Manufacturing
Los Angeles, CA4 days ago$125k - $186k
...comes next.Job Title:Senior AI Applied EngineerCompany... ...-driven pilots, evaluating results, and translating... ...and strong software engineering practices.• Communicate... ...production-quality systems.• Expert Python skills... ...memory strategies, multi-agent orchestration) and reliability...QualitySeniorFull timePrologis
Los Angeles, CA3 days ago$103k - $142k
...innovative multi‑disciplinary engineering consulting firm, seeks a Senior Commissioning Agent for our Los Angeles,... ...work on high quality, high-profile, national... ...lighting and specialty systems including fire alarm,... ...and building systems to evaluate and test the performance...QualitySeniorPart timeWork at officeLocal areaFlexible hoursWSP
Los Angeles, CA2 days ago$103k - $142k
...innovative multi‑disciplinary engineering consulting firm, seeks a Senior Commissioning Agent for our Los Angeles,... ...work on high quality, high-profile, national... ...lighting and specialty systems including fire alarm,... ...and building systems to evaluate and test the performance...QualitySeniorPart timeWork at officeLocal areaFlexible hoursWSP
Los Angeles, CA2 days ago$175k - $275k
...is seeking an experienced Senior AI Engineering to design, build, and operationalize... ...for CI/CD, testing, model evaluation, observability, performance... ...architecture, distributed systems, data pipelines, CI/CD,... ...discipline, including data quality, lineage, metadata,...QualitySeniorTalentify.io
Pasadena, CA2 days ago$90k - $180k
...key member of program teams by leading systems engineering tasks defining, developing or... ...Performs technical planning and performance evaluation studies, conducts technology assessment... ...identified by management and in support of Quality Management Systems (QMS),...QualitySeniorFor contractorsWork experience placementAbbott
Los Angeles, CA2 days ago$117k - $195k
...industry. Consumer-driven innovation, high quality products and a promising portfolio, all... ...technical leadership and/or supervises Systems Engineers I, II, and III. Key... ...platforms, and operational services. Evaluate, recommend, and implement infrastructure...QualitySeniorLocal areaWork from homeShift workWeekend workPharmavite LLC
Los Angeles, CA1 day ago$72k - $184.44k
...OpportunityAs part of the AI Engineering team within the... ...algorithms, models, and systems to enable intelligent... ...involving lead testing and evaluation of AI-enabled systems,... ...AI deployment.As a Senior Associate, you will build... ...clients, delivering quality work while embracing...QualitySeniorFull timeH1bPwC
Los Angeles, CA2 days ago$160k - $190k
...Overview We’re looking for a Senior Software Engineer with a passion for AI to join us in our... ...of production-ready AI systems within the ION Factory OS... ...preprocessing, and model evaluation at scale. ~ Familiarity... ...in better hardware quality and delivery. Compensation...QualitySeniorWork experience placementWork at officeFlexible hoursFirst Resonance
Los Angeles, CAa month ago- ...member to serve as the Senior AI Engineer. The selected... ...production-grade LLM agents and RAG pipelines, steer... ...RLHF) → offline/online evaluation → MLflow registry, with... ...automated drift and quality alerts. Data & Storage... ...of RAG or agentic systems in production (e.g....QualitySeniorWork at office
Hop
Los Angeles, CA22 days ago $103k - $142k
...innovative multi‑disciplinary engineering consulting firm, seeks a Senior Commissioning Agent for our Los Angeles,... ...work on high quality, high-profile, national... ...lighting, and specialty systems including fire alarm,... ...and building systems to evaluate and test the...QualitySeniorPart timeWork at officeLocal area$170k - $200k
...are Metropolis is seeking a Senior AI Engineer to join our Applied AI... ...the technical ability to own systems end-to-end, from the LLM prompt... ...AI workflows, ensuring data quality and reliability for your stakeholders... ...value delivery Evaluate and integrate emerging AI tooling...QualitySeniorTemporary workWork at officeLocal areaMetropolis
Los Angeles, CA29 days ago$105.4k - $207.8k
...Deloitte is seeking an AI Cloud Security Engineer, Senior Consultant to design... ...of production-quality solutions that help... ...controls across models, agents, tools, application... ...prompt versioning, evaluation datasets, approval workflows... ..., distributed systems, or cloud applications...QualitySeniorWork experience placementLocal areaVisa sponsorshipDeloitte
Los Angeles, CA5 days ago- ...well as implementing systems and through investment... ...opportunities; strategically evaluates talent for succession... ...support the service, quality, access, and... ...beginning to educate senior leaders to gain buy-in... ...Management Cost Optimization Engineering Failure Analysis IT...QualitySeniorContract workTemporary workWork experience placementFlexible hours
$138.55k - $187.45k
...iteration, we deliver high-speed systems at the pace of the modern... ...About The Role: As an RF systems engineer you will be responsible for... ...engineering, manufacturing, and quality professionals.ResponsibilitiesSimulate... ...use artificial intelligence (AI) tools to support parts of the...QualitySeniorWeekly payPermanent employmentFull timeWork at officeHermeus
Los Angeles, CA2 days ago$135k - $190k
...PROPULSION FLUIDS ANALYST (RAPTOR SYSTEMS ENGINEERING) The Propulsion Fluids Analyst role is responsible for evaluating and improving engine... ...industryDemonstrated ability to execute high quality work in a technical... ...range:Propulsion Engineer/Senior: $135,000 - $190,000.00/per...QualitySeniorPermanent employmentTemporary workWeekend workSpaceX
Hawthorne, CA3 days ago- ...secure and compliant systems to efficient... ...lifecycle.As a Staff AI & Data Engineer, HR Systems, you... ...and delivers AI agents, intelligent... ...role reports to the Senior Manager, HR Tech... ...development and delivery.Evaluate opportunities... ...meaning, quality, lineage, freshness...QualityLocal areaFlexible hours
Riot Games
Los Angeles, CA6 days ago - ...Description Job #220162 Chipton-Ross is seeking a Seniro Systems Engineer for a contract opportunity in Plymouth, MN. BASIC... ...particularly medical devices developed under the rigor of a quality system. Product development experience working in an Agile...QualitySeniorFull timeContract workLocal areaImmediate start
Chipton-Ross
Los Angeles, CA4 days ago - ...Senior Systems Engineer Location: Los Angeles, CA Company: GPL Technologies Work Type: Full-Time, Onsite / Client-Site Required... ...will have a major impact on client satisfaction, operational quality, and GPL's ability to scale its managed services and...QualitySeniorFull time
GPL Technologies
Los Angeles, CA4 days ago $180k - $240k
...here . About the Video Agent team Video Agent turns... ...box sits a multi-step AI agent. It plans a storyboard... ...conversations. Measure quality. Build evals and... ...people use. We mean a system where a model calls tools... ...are a strong full‑stack engineer. You have 2 or more years...QualityFlexible hours$204k - $216k
...Description About Sapience AI Sapience AI is the collective... ...Knowledge lives in silos, in legacy systems, in the heads of a few... ...applied AI, research, and platform engineering, and you make the difference... ...cut waste without hurting quality or speed. Make cost a...QualitySapience AI Corporation
Los Angeles, CA6 days ago- ...transport sector. About the Engineering Services Business Unit... ...specializes in power system software development,... ...Simulation (RTDS) to evaluate and test control,... ...communication systems. The Senior Power System Modelling... ...reports to ensure quality and compliance...QualitySeniorFull timeWork experience placementRemote work
Powertech Labs
Los Angeles, CA22 hours ago $181k - $225k
...Senior Site Reliability Engineer Los Angeles, CA Altruist is transforming... ...by building an AI platform for wealth... ...resilience of robust backend systems across all product... ...to ensure high-quality code. What you... ...review cycles. By evaluating compensation on a regular...QualitySeniorWork at officeImmediate start3 days per weekAltruist
Los Angeles, CA4 days ago$122k - $240.5k
Position Summary Join our AI & Engineering team in transforming... ...Generative AI, Agentic AI or multi-agent systems 2+ years of hands-on... ...(foundation models, model evaluation, and agent orchestration);... ...From entry-level employees to senior leaders, we believe there’s...SeniorLocal areaVisa sponsorshipDeloitte
Los Angeles, CA4 days ago- ...Consulting company, is looking for a Senior AI Engineer for their Woodland Hills, CA... ...applications and agentic systems. This role owns the end-to-... ...multi-step, tool-using agents (planning, execution, memory... ...cloud platforms Establish evaluation, reliability, and...Senior
Talentify.io
Los Angeles, CA2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Systems Engineer, Agent Quality & Evaluation. Be the first to apply!
Related searches
- senior ai engineer Los Angeles, CA
- ai engineer Los Angeles, CA
- ai developer Los Angeles, CA
- ai engineer remote Los Angeles, CA
- ai prompt engineer Los Angeles, CA
- system performance engineer Los Angeles, CA
- active directory systems engineer Los Angeles, CA
- senior linux systems engineer Los Angeles, CA
- software system engineer Los Angeles, CA
- ground systems engineer Los Angeles, CA