Senior AI Engineer, Evaluation & Reliability (Remote)
$200k - $250kFieldguide
San Francisco, CA
- Remote job
Fieldguide, a remote-first company based in San Francisco, is seeking a Senior AI Engineer to lead the evaluation infrastructure for AI agents. This role focuses on enhancing the reliability and performance of AI systems to support top accounting and consulting firms. The ideal candidate will have experience with TypeScript, Python, and observability systems, working collaboratively to design and build robust evaluation platforms. Fieldguide offers competitive compensation ranging from $200K to $250K, flexible PTO, and wellness benefits. #J-18808-Ljbffr Fieldguide
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior AI Engineer, Evaluation & Reliability (Remote) in San Francisco, CA vacancy
$70 - $80 per hour
A leading AI solutions firm in Redwood City seeks a Senior Engineer specializing in AI Evaluation & Reliability. The role focuses on designing evaluation metrics, ensuring operational excellence for AI features, and requires substantial experience in machine learning systems...SeniorContract work3 days per week- ...located in Raleigh, North Carolina, is seeking an AI & Machine Learning Engineer specialized in training and evaluating large language models. The ideal candidate will... .... Benefits feature competitive pay, flexible hours, and remote work options. #J-18808-Ljbffr ProlificRemote jobSeniorFlexible hours
$80 per hour
Prolific is seeking an AI & Machine Learning Engineer in San Francisco to evaluate and refine AI models. The role involves auditing ML code, providing human feedback on AI frameworks, and analyzing model reasoning. Candidates should have a relevant degree and experience...Remote jobSeniorHourly payWork from homeFlexible hours$150k - $250k
Slingshot Aerospace is seeking a Senior AI Engineer to join our AI and Data Science team. This role involves developing evaluation frameworks for intelligent systems in mission-critical space operations. Responsibilities include maintaining our validation SDK, designing...Remote jobSenior$80 per hour
Prolific is looking for an AI & Machine Learning Engineer to evaluate AI architectures, audit code, and refine frameworks. Ideal candidates will hold a BS... ...role offers up to $80 per hour, flexible hours, and remote work options. Join Prolific to contribute to cutting-edge...Remote jobSeniorHourly payFlexible hours$80 per hour
Prolific is seeking an AI & Machine Learning Engineer to evaluate and refine AI models. This role involves auditing complex machine learning components and... ...You will be paid up to $80 per hour, with flexible hours and remote work options available. #J-18808-Ljbffr ProlificRemote jobSeniorHourly payFlexible hours$80 per hour
Prolific is hiring an AI & Machine Learning Engineer in San Diego, CA to evaluate LLM architectures and audit machine learning code. The role requires a BS/MS/PhD... ...of up to $80 per hour with flexible hours and remote working options. Join Prolific to help train and evaluate...Remote jobSeniorHourly payFlexible hours- TechInsights in Denver, Colorado, is seeking a Senior Site Reliability Engineer to own strategic reliability initiatives for its AI-first platform. Responsibilities include... ...improving observability for AI workloads. This remote role requires 6-8 years of experience in SRE...Remote jobSenior
$170k - $200k
...Role The Senior AI Engineer builds and deploys production-grade AI agents... ..., with a focus on reliability, speed, and practical value... ...reliability and performance Evaluate, test, and improve agent behavior... ...Location Full-time, remote (US-based) Quarterly on-sites...Remote workSeniorFull timeLocal areaFlexible hoursGrabJobs
Scottsdale, AZ2 days ago- ...infrastructure for reinsurance. A Senior engineer on the Platform team you own the agent runtime and the evaluation system around it. Paid in USD. Remote, with in person hackathons and offsites... ...across models and ensuring reliable production deployments. Strong engineering...Remote jobSenior
- ...service, and leveraging AI to deliver faster,... ...outcomes. The Senior AI Solutions Engineer is responsible for implementing... ...solutions to ensure reliability and effectiveness in... ...frameworks for evaluating and scaling new AI... ...Experience working in a remote environment....Remote workSenior
ResMed
Peachtree Corners, GA2 days ago - ...operational support of AI platforms, tools, and... ..., cloud, and platform engineering teams. Operationalize... ...performance, scalability, reliability, and cost efficiency.... ...business objectives. Evaluate emerging AI tools,... ...equivalent experience. REMOTE WORK NOTICE: This position...Remote workSeniorWork at office
ARA Brand
Santa Fe, NM3 days ago $98.81k - $148.16k
...increasing availability, and improving reliability. By radically lowering launch costs... ...iterate, build, and test efficiently. As a Senior AI Engineer on theBoltlineteam, you will design,... ...knowledge.You'llarchitect evaluation frameworks to ensure AI reliability, build...Remote workSeniorPermanent employmentFull timeGrabJobs
Portland, OR1 day ago- ...a distributed team with remote employees across every US... ...Who You Are You are a Senior Software Engineer who is both AI-native and product-minded... ...hallucinations, safety, and evaluation, and you design data flows... ...from prototype to reliable, scalable production. Create...Remote workSeniorFull time
GrabJobs
Chandler, AZ3 days ago $40 per hour
A cybersecurity company is seeking experienced professionals to evaluate AI-generated security content and contribute to building reliable AI tools. This remote role offers flexibility to choose projects and work hours, with pay starting at $40+ per hour. Ideal candidates...Remote workHourly payDataAnnotation
Helena, MT4 days ago$240k - $280k
Sentry, located in San Francisco, is searching for a Senior Software Engineer to enhance its AI/ML team. In this role, you'll build the evaluation infrastructure for AI systems, ensuring they perform accurately and reliably. Responsibilities include designing datasets,...Senior$150k - $250k
Role Description As a Senior AI Engineer focused on Agentic Evaluation and Verification and Validation (V&V), you will join the AI and Data Science team within... ...into production environments Benefits ~Remote work opportunity ~Salary range: $150,000-$250,000...Remote workSeniorFull timeSlingshot Aerospace
Remote7 days ago$40 per hour
...our team to help train AI models. In this role, you will evaluate AI-generated security content... ...to building more reliable tools for the cybersecurity... ...full-time or part-time REMOTE position You’ll be able... ...response, detection engineering, DFIR, malware analysis,...Remote workHourly payFull timePart timeDataAnnotation
Hartford, CT3 days ago$175k - $215k
...option to work 100% remotely within the United States... ...to have a very reliable, high-speed internet... ...are proud to take an "AI-Enabled" approach in... ...are looking for a Senior AI Platform Engineer to join our AI Platform... ..., and regression evaluations Experience extending...Remote workSeniorSummer workWork at officeFlexible hoursGrabJobs
North Las Vegas, NV1 day ago$240k - $280k
...leading software monitoring company is seeking a Senior Software Engineer on its AI/ML team to build evaluation infrastructure for measuring the performance of AI... ...benchmarks, and ensuring AI features behave reliably. Candidates should have 5+ years of experience, proficiency...Senior- ...on user feedback. As a fully remote company (even before COVID!)... .... The Role: At Monarch, AI is the engine powering intelligent, personalized... ...AI architecture to how we evaluate and ship AI features with... ...to ship features that work reliably at scale. Ship with Confidence...Remote jobSeniorWork at officeWork from homeWeekend work
$228k - $342k
...company and a leading AI platform for... ...re forming small, senior, cross‑functional... ...machine learning engineers, and full‑stack builders... ...orchestration, evaluation, and feedback loops... ...systems that are reliable, explainable, and... ...in‑person time and remote. Our approach enables...Remote workSeniorWork at officeHome officeFlexible hours- ...research accelerator for frontier AI labs and a trusted partner... ...who specialize in software engineering, logical reasoning, STEM, multilinguality... ...with systems that perform reliably, deliver measurable impact,... ...a Typical Day Look Like? Evaluate and refine AI-generated code...Remote jobSeniorFor contractorsFlexible hours
- ...of integrating modern AI and LLMs into the... ...systems, and robust evaluation — not as “chatbots with... ...months and years. As a Senior AI Engineer, you will design,... ...workflows that meet reliability and performance expectations... ..., especially for remote roles. Official offers...Remote workSeniorTemporary workWork at officeLocal areaFlexible hours
$70k - $200k
1.12 Senior AI Software Engineer — Edge Model Optimization & Deployment 1.12 Senior... ...are building risk-aware, reliable, and field-ready AI systems... ...open to exploring a hybrid or remote option. Why Join Field AI?... ...and employees are always evaluated based on merit, qualifications...Remote workSeniorFull time- ...can be considered Remote if the successful... ...area. About Us The AI Cloud and... ...tools and services engineers here at GM use every... ...are looking for a Senior Engineer with an extensive... ...a robust, reliable, and cohesive inner... ...technical roadmap Evaluate new tools and technologies...Remote workSeniorWork experience placementWork at office3 days per week
$200k - $250k
...are building the AI Search Infrastructure... ...AI systems more reliable, transparent, and... ...Our team includes engineers, researchers, product... ..., vertical feeds, evaluation tooling, and new... ...credibility with senior engineers and commercial... ...of our hybrid/remote team’s cell phone...Remote workSeniorFull timeImmediate startWork from homeFlexible hoursEarly shift- YO IT Consulting is seeking a Senior Data Engineer to work remotely on advanced AI data engineering challenges. The successful candidate... ...and Snowflake. This role focuses on evaluating AI outputs for accuracy and designing reliable data pipelines that support analytics...Remote jobSenior
- ...team in New York/Dallas/Remote, New York (US-NY),... ...Duties Build agentic AI systems: Design and implement... ...MCP protocol. Engineer robust guardrails for... ...Productionize LLMs: Build evaluation framework for open‑source... ...functions linked to reliability, risk reduction, and...Remote workSeniorHourly pay
$155k
...offer a unique blend of AI support and teams of... .... About the Role The Senior Data Engineer sits on Scorpion's AI... ...teams with a single, reliable, and secure source of... ...Success Will Look Like Evaluate and improve data quality... ...phone and service Remote office allowance Professional...Remote workSeniorWork at officeLocal areaFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Engineer, Evaluation & Reliability (Remote). Be the first to apply!
Related searches
- ai engineer San Francisco, CA
- ai ml engineer San Francisco, CA
- ai research engineer San Francisco, CA
- senior ai engineer San Francisco, CA
- machine learning ai engineer San Francisco, CA
- ai developer San Francisco, CA
- ai prompt engineer San Francisco, CA
- ai engineer remote San Francisco, CA
- senior trade analyst San Francisco, CA
- senior app developer San Francisco, CA