Senior AI Code Evaluation Engineer (Remote)
Temporary
YO AI Labs
YO AI Labs is seeking a Senior Software Engineer (Contractor) to design reinforcement learning environments for software tasks, using MCP tools to evaluate AI models remotely. You will create reproducible environments, deterministic verification, and reference solutions for bug fixing, feature development, refactoring, and performance tuning, with a focus on high-quality software engineering outcomes.
Strong proficiency in multiple languages and algorithms, plus experience with large codebases
#J-18808-LjbffrVacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior AI Code Evaluation Engineer (Remote) in Wisconsin vacancy
$144.7k - $261.3k
...DescriptionAbout the TeamThe Evaluation Foundations team, part of Embodied AI's Scaling... ...vehicle development. We engineer high-performance... ...About the RoleAs a Senior Engineer in the... ...Participate in design and code reviews and work... ...This role is based remotely, but if the...Remote workSeniorFull timeLocal areaWork from homeRelocation packageFlexible hours$80 - $110 per hour
...seeking experienced Structural Engineers to help train and evaluate next-generation AI systems. This opportunity is part... ...analysis, design, simulation, and code compliance. Develop reference... ...Work independently in a fully remote, flexible environment. Qualifications...Remote workSeniorHourly payContract work10 hours per weekFlexible hoursLifted, an Upwork Company™
Chicago, IL12 days ago$60 per hour
...seeking experienced Lua Developers to support AI model training through technical evaluations, scripting tasks, and code quality reviews. This opportunity is ideal for... ...evaluation projects. Additional Information Fully remote, project-based opportunity. Up to $60/hour,...Remote workSeniorWeekly payContract workFreelance10 hours per weekLifted, an Upwork Company™
Chicago, IL14 hours ago- ...Role Overview Shape evaluation tasks for AI systems used in enterprise electrical... ...Create electrical engineering scenarios covering complex... ...and rubrics that distinguish senior enterprise engineering judgment... ...documentation. Work Terms ~ Remote, hourly engagement....Remote workSeniorHourly pay
SaidGig
United States13 days ago $70 - $80 per hour
...Overview Shape high-stakes AI evaluation tasks grounded in enterprise... ...create realistic mechanical engineering scenarios, reference outputs... ...reflect the judgment expected of senior engineering leaders working... ...preferred. Work Terms Remote, hourly engagement....Remote workSeniorHourly paySaidGig
United States13 days ago$184k - $287.5k
...unlimited potential of AI to define the next era... ...seeking an AI Compiler Engineer with deep expertise in... ...into compiler passes, code generation flows, and optimization... ....Lead experimentation, evaluation, and deployment with... ..., TX, Austin; US, TX, Remote; US, CA, Remote; US, WA...Remote workSeniorFull time$224k - $356.5k
...unlimited potential of AI to define the next... ...is hiring a Senior Software Architect... ...Harness & Runtime Engineering team to build foundational... ..., inference, evaluation, and large-scale... ...quality production code, and provide... ..., Austin; US, CA, Remote; US, CA, Santa ClaraType...Remote workSeniorFull time$127k - $170k
What You'll DoAs a Senior Infrastructure Engineer II (Senior Kubernetes EKS... ...infrastructure-as-code toolsMonitor, troubleshoot... .... Candidates will be evaluated to determine the... ...typical workweek), and remote work arrangements (... ...and comparisons. These AI tools support our...Remote workSeniorHourly payTemporary workWork experience placementWork at office$200k - $322k
Physical AI and Artificial Intelligence (AI... ...week-long—intensive coding sessions where experienced... ...are looking for a Senior Developer Advocate Engineer to own technical... ...synthetic data generation, evaluation, benchmarking,... ...Clara; US, DC, Remote; US, FL, Remote; US,...Remote workSeniorFull time- ...1-$92 / hourSummary:Work Mode: Remote, EST requiredDuration: 12/31/20... ...a zero-defect delivery posture.Evaluate automation requests and emerging AI capabilities to determine the optimal... ...to junior and mid-level engineers, establishing code quality standards and AI integration...Remote workSenior
- ...developing a new-generation, AI-first web application... ...scratch, and quality engineering is a core founding-team focus. We seek a Senior Software Quality... ...-friendly. Stand up evaluation harnesses for automated... ...or similar) and strong coding skills in TypeScript/JavaScript...Remote workSeniorShift work
Adobe
United States4 days ago - ...scaling rapidly and investing in AI-powered service, deeper... ...We are hiring a Senior Software Test Engineer to help us deliver quickly... ...production. We're investing in the evaluation layer to match: eval suites... ...wrong role. If moving between code, product, and people in the...Remote workSeniorFull timeFlexible hours
Curative HR LLC
United States2 days ago - ...Senior Software Engineer — AI Coding Evaluator is a remote engineering review track for evaluating production code, debugging traces, and developer-facing AI outputs against real-world correctness standards. Reviewers reproduce failures, write the unit test the model...Remote jobSeniorHourly payFor contractors10 hours per week
- ...operational support of AI platforms, tools, and services... ..., cloud, and platform engineering teams.Operationalize... ..., Infrastructure as Code, and configuration management... ...business objectives.Evaluate emerging AI tools,... ...may be performed fully remote, hybrid, or onsite at an...Remote workSeniorFull timeWork at office
$175k - $190k
...Platform unites agentic AI solutions with the... ...exposures across code, cloud, and AI... ...and accountability.Senior GTM Systems & Process... ...architecting the revenue engine, building an AI-... ..., this is a remote role targeted for candidates... ...and scalability.Evaluate the GTM technology...Remote workSeniorContract workApprenticeshipLocal areaFlexible hoursShift work- ...development challenge. Write code that is readable, easy to... ...Proficient in working with Unreal Engine or Custom C++ engines. Fair... ...engine Components (Rendering, AI, Networking, Navigation,... ...future projects. Transparent and fair evaluation of your work....Remote workSeniorImmediate start
Amber Studio
United States3 days ago $86.9k - $198k
Cyber Operations Engineer, SeniorThe Opportunity... ...highly experienced senior Cyber Operations... ...writing production code, to configuring lab... ...technologies and rapidly evaluate their operational... ...using generative AI and large language... ...on during meetings.Remote: If this position is...Remote workSeniorFull timeContract workPart timeWork at officeLocal area$150 - $175 per hour
...expert consultants with 30 Senior Software Engineering Experts for part‑time, fully‑remote work supporting frontier AI research. Projects start... ...Designing expert‑level coding problems that today's leading... ...AI models can't solve. Evaluating and pressure‑testing AI models...Remote workSeniorPart timeFreelanceAligned Labs
San Francisco, CA1 day ago- As a Senior Software Engineer, Quality Engineering, you are a product-minded, full-stack engineer who ships faster and smarter with AI coding agents as core development tools — and who owns the harder... ...code, you build the test and evaluation infrastructure other engineers...Remote workSeniorFull timeWorldwide
$173k - $251k
Everlaw is looking for a Senior Software Engineer, Database Systems to... ...and writing the code that ensures data is... ...the next generation of AI-driven features.In this... ...with the industry, evaluating when to adopt emerging... ...explicitly stated), remote interviews or live interviews...Remote workSeniorFull timeWork at officeLocal areaVisa sponsorshipWork visa3 days per week$115.4k - $173k
...content into other game engines and 3D environments —... ...orchestration by future AI-driven tools and systems... ...low-level C++ runtime code to high-level C# APIs across... ..., data collection, evaluation loops, agents, tool use... ....com.SummaryLocation: Remote, Washington, USA; Bellevue...Remote workSeniorFull timeWork at officeWorldwide$173k - $251k
As a Software Engineer, Automation & Developer... ...illuminating truth.In this Senior Software Engineer... ...thoughtful code reviews, you will ensure... ...the use of AI - to stay ahead of... ...explicitly stated), remote interviews or live... ...processes. As part of the evaluation process, we provide...Remote workSeniorLocal areaWork from homeVisa sponsorshipWork visa$200k - $322k
...unlimited potential of AI to define the next... ...a highly skilled Senior Staff SRE to join... ..., senior engineers, program managers,... ...InfrastructureProven experience evaluating existing... ...infrastructure as code (IaC) and configuration... ...: US, Remote; US, CA, Santa ClaraType...Remote workSeniorFull time$121k - $206k
...matter to you. About the TeamThe AI Engineering and Application Development... ...products and services while evaluating new technologies to evolve... ...Experience with infrastructure as code and automation tools such as... ..., Colorado, Washington and remote workers$133,000.00 - $227,000...Remote workSeniorFull timeWork experience placementLocal area3 days per week- ...we are hiring for a Senior QA Engineer at M3 Global Research... ...verbal and written AI and Automation... ...CircleCI Ability to evaluate and adopt emerging AI... ...alongside AI-generated code and validating its correctness... ...needs of the organization #LI-JM1 #LI-Remote...Remote workSeniorFull timeWork experience placementWorldwide
M3 Global Research (US)
Delaware, OH19 days ago $125.6k - $157k
...partner is looking for a Senior DBA Engineer - Fuze Care Services... ...and infrastructure-as-code practices. Maintain... ...requirements. Evaluate future modernization opportunities... ...–$157,000 . ~ Fully remote work opportunity, with... ...works: We use an AI-powered matching...Remote workSeniorFull timeTemporary workFlexible hoursjobgether
United States3 days ago- ...Senior Automation Engineer The Senior Automation Engineer is a pivotal, foundational hire for our AI program — the engineer who will design, ship, and own production... ...Analyst) and Claude (Cowork, Code, Skills, MCP), and build the evaluation, observability, and governance...Remote workSeniorTemporary workFlexible hours
Planet
United States2 days ago - ...for the way people and AI agents work today. As one... ...Sr Enterprise Systems Engineer, AI Productivity, you’... ...engineers using AI-assisted coding tools to accelerate... ...point, and rigorous evaluation before anything ships to customers. This is a remote opportunity within the...Remote workSeniorFull timeImmediate start
1password
Remote4 days ago - ...AI Senior SRE MOZN is a leading Enterprise AI company enabling organizations... ...: read and debug service code, understand business logic... ...earned trust. Own agent evaluation — define what "correct" and "... ...positive/negative rates, and engineer-hours of toil removed....Remote workSenior
Mozn
United States14 hours ago $169.5k - $233k
...location. We are seeking a Senior Fire Protection Engineer / Subject Matter... ..., operational, and code requirements. You will... ...projects. Conduct code evaluations and interpretations... ...strategies for hyperscale and AI-focused data center... ...offices/projects and remote locations enabling...Remote workSeniorFull timeFor contractorsWork at officeLocal area
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior AI Code Evaluation Engineer (Remote). Be the first to apply!
Related searches
- ai engineer Wisconsin
- ai engineer remote Wisconsin
- ai developer Wisconsin
- senior director product management Wisconsin
- senior grant accountant Wisconsin
- senior tax Wisconsin
- senior data management analyst Wisconsin
- senior consulting engineer Wisconsin
- senior dynamics crm developer Wisconsin
- senior brand strategist Wisconsin