Remote AI Engineer, Quality & Evaluation at Enterprise Scale

Fieldguide

Remote job

A pioneering AI technology firm based in San Francisco is seeking an AI Engineer to own the evaluation infrastructure for AI agents. This role requires designing automated pipelines and building observability systems, ensuring agent performance meets enterprise standards. Ideal candidates have experience in production software and familiarity with TypeScript, React, and Python. The firm values collaboration, inclusivity, and personal growth, offering competitive compensation and flexible work arrangements. #J-18808-Ljbffr Fieldguide

Apply

Vacancy posted 4 days ago

Similar jobs that could be interesting for youBased on the Remote AI Engineer, Quality & Evaluation at Enterprise Scale in San Francisco, CA vacancy

Senior Applied AI Engineer, Handshake AI Enterprise
...started Handshake AI and built the... ...to create evaluations, publish benchmarks... ...economy, at global scale, with impact... ...together with engineers, scientists, operators... ...Handshake AI Enterprise, you'll embed... ...sacrificing quality Surface insights... ...development Remote & Office: Internet...
Remote work
Quality
Full time
Work at office
Flexible hours
Handshake
San Francisco, CA
3 days ago
Enterprise AI Research Engineer
$250k
...research partner embedded within enterprise AI systems, focusing on... ...Design high-signal datasets and evaluation protocols to target... ...judgment for research signal quality, including data selection and... ...Terms Full-time position with remote work flexibility. Compensation...
Remote work
Quality
Full time
Local area
SaidGig
United States
7 days ago
AI Evaluation Engineer
$180k
...professionals towards their dream careers AI Evaluation Engineer $180,000 Remote (US-based) Are you passionate... ...deployed safely, reliably, and at scale? This is a rare opportunity to join... ...analysis and validating data quality/performance Bonus: experience with...
Remote work
Quality
Full time
DeepRec.ai
Denver, CO
1 day ago
Remote AI Data Engineer: Petabyte-Scale Pipelines
...Technologies is seeking an experienced AI Data Engineer to build and operate large-scale data systems aimed at optimizing AI training and evaluation workflows. This remote position requires a strong... ...data pipelines, implement data quality assurance and collaborate closely...
Remote job
Quality
Bright Vision Technologies
Norcross, GA
1 day ago
Remote Enterprise AI Solutions Engineer (Germany)
...ElevenLabs is an AI research and product... ...startups to large enterprises like Deutsche... ...and chat agents at scale. ElevenCreative empowers... ...are researchers, engineers, and operators.... ...faster with higher-quality results. We do this... .... This role is remote but the successful...
Remote work
Quality
Immediate start
Neura Market
New Bremen, OH
1 day ago
Sr AI Engineer
$80 per hour
...is preferred, but remote Rate: $8... ...Job Title: Sr AI Engineer Experience... ...are grounded in enterprise data, governed responsibly... ...~ Tune retrieval quality through vector... ...systems. Evaluation & Quality... ...solutions before full-scale deployment....
Remote work
Quality
Futran Tech Solutions Pvt. Ltd.
United States
3 days ago
AI Software Engineer
...Suites is seeking AI Software Engineers to join our... ...to deliver high-quality solutions independently... ...someone who is fully remote regardless of... ...AI services and enterprise systems. Prepare... ...Focus Areas: Evaluate solution performance... ...streamline and scale their IT products...
Remote work
Quality
Work at office
Immediate start
Work from home
Home office
ERP Suites
United States
2 days ago
Senior AI Engineer
...Senior AI Engineer Boston, MA January 27, 2025 Remote Job Description 7AI empowers... ..., optimizing, and scaling AI systems that solve complex enterprise problems. What... ...strategies to meet product quality and reliability... ...Manage real-world evaluation metrics — measure...
Remote work
Quality
Shift work
Venturefizz Product Management Community
United States
3 days ago
Forward Deployed AI Engineer
...experienced Forward Deployed AI Engineer, the full-time remote position will partner with enterprise AI teams to design, implement, and scale production-grade GenAI... ...observability and evaluation programs Lead technical... ..., ensuring high-quality technical execution and...
Remote work
Quality
Full time
Virtual Vocations Inc
United States
3 days ago
Senior AI Engineer
...Senior AI Engineer We're looking for a Senior AI Engineer to build and scale production-grade AI systems that... ...workflows Implement evaluation, monitoring, and... ...Ability to balance speed, quality, cost, and... ...legal, healthcare, or enterprise data models Familiarity...
Remote work
Quality
Flexible hours
Venturefizz Product Management Community
United States
22 hours ago
Senior AI Engineer
...Senior AI Engineer Berlin, Remote in Germany About the Position... ...optimal performance. Evaluate and enhance the... ...challenges concerning data quality, bias mitigation,... ..., with powerful enterprise tools to manage AI brand... ...as the business scales Our Values...
Remote work
Quality
Work at office
Immediate start
Flexible hours
Bluefish AI
United States
2 days ago
AI Engineer
...Founded in 2012, H2O.ai is on a mission... ...AI to help enterprises and public... ...looking for an AI Engineer who builds things... ..., used, and evaluated by real enterprises... ...at scale. Develop ML pipelines... ...cohesive, high‑quality solutions. What... ...Total Rewards Remote‑Friendly Culture...
Remote work
Quality
Worldwide
Flexible hours
H2O.ai
New York, NY
4 days ago
AI Engineer (R&D)
...AI Engineer(R&D) NTT DATA strives to hire exceptional... ...bar for technical quality through strong... ...quality checks Evaluate third-party AI... ...generated code to enterprise standards ~ Extensive... ...in enterprise-scale AI, cloud,... ...many positions offer remote or hybrid work options...
Remote work
Quality
For subcontractor
Work at office
Flexible hours
NTT DATA
Dallas, TX
3 days ago
AI Infra Engineer
...stack portfolio of AI-enabled, AI-ready... ...an AI Infra Engineer, to support the delivery... ...with two days remote.... ...research for large-scale enterprise infrastructure data... ...document parsing, quality validation, and knowledge... ...Define rigorous evaluation metrics for model...
Remote work
Quality
Full time
Work at office
Local area
3 days per week
Lenovo
Morrisville, NC
2 days ago
Senior AI Engineer
...Senior AI Engineer 1 Your Journey at Crowe... ...helping clients scale smarter, transform... ...PTO, a flexible remote work policy, and... ...for producing high-quality, well-architected... ...architectures for enterprise workloads Lead... ...training and model evaluation workflows that...
Remote work
Quality
Flexible hours
Crowe
Villa Park, IL
2 days ago
Senior AI Engineer
...Senior AI Engineer Remote RegScale is a continuous controls... ...automate and scale their security, risk,... ...execution to a disciplined, enterprise ready engineering organization... ...fine tuning and evaluation, agent design and... ...depend on, ensuring quality and traceability from...
Remote work
Quality
RegScale
United States
3 days ago
AI Engineer
$150k - $165k
...us to provide top-quality services on an unprecedented scale. WHAT WE’RE ABOUT:... ...ADDITIONAL REQUIREMENT FOR REMOTE POSITIONS: For... ...a highly hands‑on AI Engineer who thrives in... ..., tools, and enterprise workflows Design orchestration... ...engineering and evaluation workflows (...
Remote work
Quality
Temporary work
Live out
Work at office
Local area
Flexible hours
Beyondsoft Consulting
New York, NY
4 days ago
Agentic AI Engineer
$176k - $265k
...Location Remote, US Employment Type... ...Remote Department Engineering Compensation... ...biotech for the AI era. When a breakthrough... ...and enterprise‑grade agentic systems... ...management, evaluation, and observability... ...bar for code quality, testing and... ...from scratch and scaled. Experience operating...
Remote work
Quality
Full time
Local area
Albert Invent
Washington DC
22 hours ago
Senior AI Engineer I - Agentic AI
$123k - $215.25k
...Senior AI Engineer I - Agentic AI New York, NY,... ...FL, United States (Remote) Job Description... ...uninterrupted, high-quality customer experience.... ...responsibly and at scale across the enterprise. Our focus is on... ...orchestration frameworks, and evaluation and monitoring...
Remote work
Quality
Full time
Work at office
Local area
Visa sponsorship
Flexible hours
Shift work
American Express
Charlotte, NC
4 days ago
Senior AI Engineer
...Senior AI Engineer We're looking for a Senior... ...capabilities for our enterprise solutions. This... ...engineering execution, code quality, and operational... ...and quality. Evaluate and implement... ...and enterprise-scale AI solutions built... ...purchase plan ~ Remote work flexibility...
Remote work
Quality
For contractors
PRIM
United States
22 hours ago
AI Engineer
$75 - $80 per hour
...currently seeking a AI Engineer to join our team... ...ground LLM outputs in enterprise knowledge bases.... ...and systematic evaluation pipelines to ensure LLM output quality, consistency, and... ...Delta Lake for large-scale data processing... ...hourly range for this remote role is ($75 - 80/...
Remote work
Quality
Hourly pay
Contract work
Temporary work
Flexible hours
Creative Solutions Services, LLC
Hackettstown, NJ
2 days ago
Remote AI Training Engineer - Coding & Evaluation
$60 per hour
A leading AI development firm is seeking proficient programmers to contribute... ...systems. Enjoy the flexibility of remote work and choose projects that... ...designing coding problems for AI, evaluating AI-generated code, and writing high-quality code. Ideal candidates have...
Remote job
Quality
DataAnnotation
California, MO
4 days ago
Senior Applied AI Engineer
$250k - $400k
...Our team is 100% remote and we work with... ...Senior Applied AI Engineer Location: San... ...client is building enterprise-grade AI agent systems... ...data at massive scale. Backed by top... ...systems Build evaluation frameworks for... ...Experience at high-quality engineering orgs...
Remote work
Quality
H1b
Work at office
Visa sponsorship
Recruiting from Scratch
San Francisco, CA
3 days ago
Remote AI Training Engineer - Code, Evaluate & Shape AI
$60 per hour
A leading AI development company seeks proficient programmers to contribute to... ...-edge AI systems while enjoying fully remote work and a flexible schedule. Responsibilities... ...solving coding problems, writing high-quality code, and evaluating AI-generated code. Ideal candidates...
Remote job
Quality
Hourly pay
Flexible hours
DataAnnotation
New York, NY
4 days ago
AI Engineer, Forward Deployed
...Mission Join the Engineering team as a Forward Deployed AI Engineer - a hybrid... ..., accuracy, and scale. Hybrid engineer... ...optimization: Improve prompt quality, reduce token usage... ...features for enterprise data applications,... ...test cases, prompt evaluation, failure analysis,...
Remote work
Quality
Work at office
Visa sponsorship
Flexible hours
Shift work
IntegriChain
United States
22 hours ago
Staff AI Software Engineer
...Staff AI Software Engineer Bishop Fox is the leading authority... ...about reliability, evaluation, and scale—not just whether... ...Integrate with Enterprise-Grade Infrastructure... ...Francisco Bay Area; remote-first with occasional... ...deliver the highest quality of work for our clients...
Remote work
Quality
Work at office
Local area
Work from home
Bishop Fox
United States
3 days ago
Senior AI Solutions Engineer
..., and leveraging AI to deliver faster... ...Senior AI Solutions Engineer is responsible... ...repeatable frameworks for evaluating and scaling new AI use cases... ...experience with enterprise AI platforms such... ..., including quality thresholds, risk... ...working in a remote environment Bachelor...
Remote work
Quality
Worklane GmbH
Peachtree Corners, GA
22 hours ago
Lead AI Software Engineer - Remote
$112.7k - $193.2k
...optimization on a global scale. Join us to... ...to work remotely * from anywhere... ...production grade AI/ML and... ...automation, and engineering productivity... ...healthcare and quality related datasets... ...code aligned to enterprise standards Build... ...vector indexing, evaluation frameworks, and...
Remote work
Quality
Minimum wage
Full time
Work experience placement
Work at office
Local area
Optum
Raleigh, NC
4 days ago
Principal AI Engineer
...driven solutions, and AI-enabled enterprise architectures.... ...Principal AI Engineer provides strategic... ...lifecycle management, evaluation, deployment... ...Address data quality, completeness, and... ...agencies or large-scale enterprises. Familiarity... ...flexibility for remote work as per...
Remote work
Quality
REI Systems
Sterling, VA
2 days ago
Remote Evaluation Team Lead - SCALE Program
...consulting agency is seeking a part-time Evaluation Team Lead to oversee the SCALE Evaluation. You will lead a team,... ...workforce programs. This remote role allows you to contribute to nationwide... ...initiatives while ensuring high-quality deliverables that inform U.S. national...
Remote job
Quality
Part time
Social Impact
Arlington, VA
4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Remote AI Engineer, Quality & Evaluation at Enterprise Scale. Be the first to apply!