Remote Senior Ruby Engineer — LLM Evaluation & Validation
Turing
- Remote job
Turing is seeking a Senior Software Engineer to work on LLM evaluation and repository validation. You will perform hands-on software engineering, automate environments, triage issues, and assess test coverage in real-world codebases. The role offers a fully remote setup with the possibility to work across international teams on cutting-edge AI projects. Strong Ruby experience and familiarity with Git/Docker are essential. #J-18808-Ljbffr Turing
- ...Analyze GitHub issues and evaluate LLM performance on real code. Job Title: Senior Software Engineer – LLM Evaluation & Repository Validation About the projects... ..., Rust, C/C++, C#, or Ruby. Proficiency with... ...Work in a fully remote environment. Opportunity...Remote workSeniorContract workPart timeFor contractorsFreelance
$296.3k
...portfolio. Autonomy Evaluation helps the AV... ...into findings for engineering and release reviews. The RoleAs Senior Manager of Eval Applications... ...with the Software Validation and Safety teams,... ...VLM- and LLM-based classification... ...is categorized as Remote/hybrid. Remote: This...Remote workSeniorFull timeLocal areaWork from homeFlexible hoursShift work- A Sylision busca um Engenheiro(a) de IA Sênior para liderar a avaliação de modelos de linguagem aplicados ao mercado imobiliário. Você vai construir rubricas, conjuntos de avaliação e pipelines de calibração, garantindo que as mudanças sejam seguras e justificadas por evid...Remote jobSenior
$201.3k - $352.3k
...all started when engineer Fred Luddy wrote code... ..., data-driven Senior Engineering Manager... ...Benchmarking and Evaluations to establish and... ...infrastructure, rigorous validation frameworks, and... ..., BLEU, G-Eval, LLM-as-a-judge patterns... ...(flexible, remote, or required in office...Remote workSeniorFull timeWork experience placementWork at officeImmediate startFlexible hoursShift work$115.4k - $155k
...GILLIG Engineering is responsible for the development,... ...range of technical areas. Validation Engineering is... ...testing, simulation, and evaluation of systems, components... ...We are looking for a Senior Product Validation Engineer... ...(on site and at remote locations) Ability to...Remote workSenior- ...Remote/Hybrid Remote - United States Full time JR-202611035... ...About the Organization The Evaluation team builds and evolves the evaluation... ...results into clear feedback for engineering and leadership, and help accelerate validated AV deployment at scale. What...Remote workSeniorFull timeLocal areaWork from home
$204k - $259k
...Waymo Planner Evaluation Team Role Waymo is an autonomous driving... ...data-minded software engineers and data scientists to help... ...Experience building and validating metrics to measure quality in... ...if the role can be performed remote, the specific salary range for...Remote workSeniorFull time- ...is a team of researchers, engineers, designers, and more, who... ...the future! Why this role?Evaluation is critical to making progress... ...infrastructure to measure LLM progress. As a Senior Research Scientist, Model... ...improvement ~? Remote-flexible, offices in Toronto...Remote workSeniorFull timeWork at officeFlexible hours
$184.7k - $324.8k
...Intelligence Platform Experience Validation team builds the tooling... .... We are looking for a Senior SDET to lead the design... ...implementation of automated model evaluation: standing up LLM-as-a-judge in existing and... ...quickly.Strong software engineering fundamentals — able to...SeniorRelocation$120k - $140k
...Overview We are seeking a CQV Engineer with 7-11 years of experience... ..., qualification, and validation activities for GMP-regulated... ...rewards as compensation, benefits, remote work/flexibility, development... ...availability, promotion, compensation, evaluation, disciplinary actions, and...Remote workSeniorWork at officeWork visaFlexible hours$115k - $145k
...Position Overview We are seeking a Sr. Validation Engineer with 7–11 years of experience to lead... ...total rewards as compensation, benefits, remote work/flexibility, development,... ...availability, promotion, compensation, evaluation, disciplinary actions, and termination...Remote workSeniorWork at officeWork visaFlexible hours- ...Synopsys is the leader in engineering solutions from silicon to systems... ...direction for UCIe validation, mentor engineers who want to... ...through on-site lab visits and remote correlation sessions Develop... ...tools used for customer evaluations, marketing demonstrations, and...Remote workSenior
$148k - $235.75k
...looking for an ambitious Senior Solutions Architect to drive validation of NVIDIA AI factories from... ...running and debugging AI/LLM workloads and benchmarks... ...digs in, partners with engineering, and drives resolution. You... ...CA, Santa Clara; US, TX, Remote; US, VA, Remote; US, WA,...Remote workSeniorFull time$84k - $167k
...clinical research. Make an Impact as a Senior Business Analyst, AI Evaluation & Value Realization at Worldwide... ...Where You'll Work This is a remote role open to candidates based in... ...Security, Legal, Records Management, and validation specialists on regulated or...Remote workSeniorHourly payFull timeContract workWorldwide$295k
...Cohere is a team of researchers, engineers, designers, and more, who are... ...Seoul. Join us!Role Overview:Evaluation is critical to making... ...and infrastructure to measure LLM progress.Key Responsibilities... ...Location:This role can be based remotely or from one of our office locations...Remote workSeniorFull timeWork at officeLocal areaHome office$90 - $105 per hour
...solve complex systems engineering and integration challenges... ...Systems Test & Validation/ SE&I Engineer (MTS Casual... ...is a CASUAL part time/remote role but will require... ...products. ~ Offer senior-level integration systems... ...instructions, and evaluating waivers, deviations, and...Remote workSeniorHourly payPart timeCasual workWork at officeImmediate startRelocation packageFlexible hours- ...Synopsys is the leader in engineering solutions from silicon... ...manage a team of validation and characterization engineers... ..., delivered through remote and sometimes on-site... ...to set direction and evaluate technical tradeoffs... ...communicator who can brief senior management on risk...Remote workSenior
- The Monitoring and Evaluation Senior Officer is responsible for implementing the monitoring and... ...achievements. Implement procedures to clean and validate data received from implementing... ...requirements is required. Experience in remote monitoring and supervising third-party...Remote workSenior
- ...DecisionPoint seeks a Test & Evaluation Lead to own the test... ...ENLIST program. This senior role establishes the... ...developers, QA engineers, cybersecurity personnel... .... This position is remote, with Chicago-area candidates... ...personnel to validate approved security remediation...Remote workSeniorContract workTemporary workFor contractorsLocal area
$149k - $198.5k
...system design, for verifying and validating the autonomy stack, and for... ...The AV Behavior Design and Evaluation Team is responsible for... ...are looking for passionate Engineers to help build a robust framework... ..., or this role can be fully remote. The salary range for...Remote workSeniorWork at office$400 per month
...backgrounds to support an advanced AI evaluation project. You'll design... ...relevance. This is a remote, project-based contractor opportunity... ...outcomes , accounting for valid alternative financial approaches... ...and recommendations to senior management or executive stakeholders...Remote workSeniorHourly payPart timeFor contractorsFlexible hours$218.4k - $365.2k
...applied scientists, and engineers, uses coding agents... ...strategy for AI quality and evaluation, establish how we... ...to test a change and validate its customer impact.Build... ...to customers and senior stakeholders.Minimum RequirementsA... ...San Francisco Metro - Remote; Washington -...Remote workSeniorFull timeFlexible hours- Monitoring and Evaluation Senior Officer Job Category Duty Station(s) Home based Seniority Level... .... Implement procedures to clean and validate data received from implementing... ...requirements is required. Experience in remote monitoring and supervising third-party...Remote workSeniorContract workWork at officeWork from homeFlexible hours
- The American Heart Association is seeking a Senior Program Evaluation Analyst in Dallas, TX for a full-time, grant-funded role with potential extension. The position can be home-based and includes a comprehensive benefits package and professional development opportunities...Remote jobSeniorFull timeWork from home
- ...can you make a difference? The UNICEF Evaluation Office (EO) is commissioning a global... ...effectively in the future. The EO is seeking a Senior Expert in Organizational Decision-making... ...e., application stage, interview stage, validation stage, or appointment and training)....Remote workSeniorWork experience placementWork at office
- ...to own Evals & Annotations. You’ll shape evaluation workflows end-to-end—from creation to... ...iteration—while collaborating with Design and Engineering to ship polished experiences. Work with... ...and cross-functional peers in a remote‑first environment, with optional offices...Remote workSenior
- ...Risk Management Model Validator Are you ready to make an impact at DTCC? Do you want... ...hybrid model of 3 days onsite and 2 days remote (onsite Tuesdays, Wednesdays and a third... ...Validation team is also responsible for evaluating the Model Performance Monitoring Plan for...Remote workSeniorFlexible hours
- ...this position will report into Senior Manager - Product Quality... ...the GxP Computerized Systems Validation efforts globally across Intuitive... ...application. Ability to evaluate risks, define and execute action... ...of the time Workplace Type: Remote - This job will be remote and...Remote workSeniorFull timeWork experience placementWork at officeLocal areaShift work
- Wugen, Inc. in St. Louis, MO, is seeking a Senior Process Validation Engineer/Scientist to support late-stage CMC activities for a BLA program in cell therapy. You will execute PPQ campaigns, CPV, and author regulatory deliverables. The role requires 7-10 years biopharmaceutical...Remote jobSenior
- ...funding, the government validation, and the sites under construction... ...:We are seeking a Senior Optical Systems Validation Engineer to lead the validation... ..., optical transceivers, evaluation platforms, and relevant... ...Phoenix/Tempe and many remote locations This position...Remote workSeniorFull timeShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Remote Senior Ruby Engineer — LLM Evaluation & Validation. Be the first to apply!
- remote data architect New York, NY
- remote data manager New York, NY
- remote property manager New York, NY
- office manager remote New York, NY
- it manager remote New York, NY
- claims specialist remote New York, NY
- project manager remote europe New York, NY
- remote video game New York, NY
- remote office assistant New York, NY
- node js remote New York, NY




