Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Code Quality Engineer, LLM Training and Evaluation

Temporary

Turing

About Turing:

Turing is one of the world's leading AGI infrastructure companies, working with frontier AI labs to accelerate model development through high-quality training data, evaluations, and engineering talent.

About the Role

We are looking for senior software engineers with 7+ years of industry experience to support the training and evaluation of large language models. In this role, you will review, analyze, and improve AI-generated code, ensuring that it is correct, secure, maintainable, scalable, and aligned with production engineering standards.

This is a code quality and engineering evaluation role, not a traditional software testing or manual QA position. You will apply your software engineering judgment to assess implementation quality, identify root causes, and recommend or implement robust solutions.

What Does Day-to-Day Look Like?

  • Review and evaluate AI-generated code across different programming languages and software engineering scenarios.

  • Assess code for correctness, reliability, security, scalability, readability, and maintainability.

  • Identify bugs, logical errors, incomplete implementations, edge-case failures, and architectural weaknesses.

  • Analyze unfamiliar codebases and understand the impact of proposed changes.

  • Review bug fixes, feature implementations, refactoring, API integrations, configuration changes, and database operations.

  • Compare alternative implementations and determine which solution best satisfies the requirements.

  • Rewrite or improve code to create high-quality reference solutions.

  • Provide clear technical explanations for identified issues and recommended improvements.

  • Develop evaluation criteria, technical annotations, and rubrics for code-quality assessment.

  • Collaborate with researchers and engineering teams to design coding benchmarks and improve LLM evaluation methodologies.

Required Qualifications:

  • 7+ years of professional software engineering experience.

  • Strong proficiency in at least one programming language, such as Python, JavaScript/TypeScript, Java, C++, Go, C#, Ruby, PHP, or Rust.

  • Significant experience building, maintaining, debugging, and reviewing production-grade software.

  • Strong understanding of software design principles, clean code, modular architecture, abstraction, error handling, and maintainability.

  • Proven ability to identify functional, performance, security, and design issues in complex codebases.

  • Experience with code reviews and collaborative software development workflows.

  • Familiarity with Git and modern engineering practices.

  • Strong written English and the ability to communicate technical feedback clearly.

  • Good understanding of data structures, algorithms, APIs, databases, and application architecture.

Offer Details:

  • Commitments Required: 8 hours per day with at least 4 hour overlap with PST.
  • Employment Type: Contractor position (no medical/paid leave).
  • Duration of Contract: 3 months [expected start date is next week].

Evaluation Process :

  • AI interview (~20 mins)
  • Delivery interview (~45 mins)
Vacancy posted 22 days ago
Similar jobs that could be interesting for youBased on the Senior Code Quality Engineer, LLM Training and Evaluation in Remote vacancy
  •  ...Analyze GitHub issues and evaluate LLM performance on real code. Job Title: Senior Software Engineer – LLM Evaluation & Repository Validation...  ...building LLM evaluation and training datasets to train LLM to work...  ...) who are familiar with high-quality public GitHub repositories... 
    Senior
    Training
    Contract work
    Part time
    For contractors
    Freelance
    Remote work

    Turing

    San Francisco, CA
    a month ago
  • $60 per hour

     ...Company Description An enterprise client is seeking experienced Lua Developers to support AI model training through technical evaluations, scripting tasks, and code quality reviews. This opportunity is ideal for developers who have strong Lua programming skills and... 
    Senior
    Training
    Weekly pay
    Contract work
    Freelance
    Remote work
    10 hours per week

    Lifted, an Upwork Company™

    Chicago, IL
    4 days ago
  •  ...Analyze GitHub issues and evaluate LLM performance on real-world code. Job Title: Senior Software Engineer – LLM Evaluation & Repository...  ...building LLM evaluation and training datasets to train LLM to work...  ...who are familiar with high-quality public GitHub repositories and... 
    Senior
    Training
    Part time
    For contractors
    Freelance
    Remote work

    Turing

    San Francisco, CA
    a month ago
  •  ...cloud, data, software engineering, and artificial...  ...We are looking for a Senior AI Quality & Evaluation Engineer to own the...  ...evaluation runbook and train client stewards and platform...  ...with infrastructure code. ~ Clear written...  ...evaluation libraries and LLM-as-judge scoring with... 
    Senior
    Full time

    Solvd

    Remote
    2 days ago
  • $100 - $150 per hour

     ...accelerate model development through high-quality training data, evaluations, and engineering talent. Engagement Details...  ...to help evaluate and improve AI coding models . Rather than primarily...  ...tools Experience with LLM evaluation, coding agents, RLHF, preference... 
    Senior
    Training
    Hourly pay
    Contract work
    For contractors
    Freelance
    Immediate start
    Remote work

    Turing

    Remote
    6 days ago
  •  ...things every day. Each code, each voice, each...  ...development standards, engineering best practices, and technical...  ...while maintaining quality, security, and performance...  ...including candidate evaluation and technical...  ...webinars, and in-house training sessions. Together... 
    Senior
    Training
    Full time
    Remote work
    Worldwide

    VeriPark

    Remote
    13 days ago
  • $105k - $140k

     ...Description   JOB SUMMARY The Senior Supplier Quality Engineer (SSQE) provides technical...  .... The role independently evaluates supplier capability and...  ..., participating in training, development, and mentorship...  ...order flowdown, procurement codes, and ERP system... 
    Senior
    Training
    Work at office
    Remote work

    Advanced Ground Systems Engineering LLC

    Santa Fe Springs, CA
    2 days ago
  •  ...a global scale.Senior Software Test Engineer - Retail DataHybrid...  ...end-to-end data quality and performance...  ...and training content (bench setup...  ...and tooling glue code. What Will Give...  ...and performance evaluation. Experience applying...  ...applying AI agents and LLM-based tools to... 
    Senior
    Training
    Full time
    Local area
    Work from home
    Relocation package

    General Motors

    Milford, MI
    3 days ago
  •  ...professional services and engineering talent solutions....  ...AI security evaluation project. In this...  ...applications, particularly LLM agents and...  ...You will analyze code paths, identify security...  ...evaluation and AI training TECHNICAL FOCUS:...  ...peer reviews, and quality assurance... 
    Senior
    Training
    Contract work
    Remote work

    Gramian Consulting Group

    Remote
    7 days ago
  • $101.6k - $152.4k

    Join us as a Senior Supplier Quality Engineer and become the technical expert who ensures...  ...- intermediate level; evaluating supplier processes and quality...  ...and relevant education or training.Schneider Electric is...  ...Our Trust Charter is our Code of Conduct and demonstrates... 
    Senior
    Training
    Permanent employment
    Full time
    Temporary work
    Immediate start
    Flexible hours

    Schneider Electric

    Foxboro, MA
    2 days ago
  • $114.6k - $157.6k

     ...Twitter) and Facebook. The Senior Quality Engineer plays an integral role in supporting...  ...such as document control, training, CAPAs, nonconforming event...  ...the ability to critically evaluate and responsibly leverage AI...  ...the Fair Chance Act (Gov. Code Section 12952).Guardant... 
    Senior
    Training
    Full time
    Work at office
    Work from home

    Guardant Health

    Redwood City, CA
    1 day ago
  •  ...Job Description# Senior QA Automation EngineerApply...  ...QA Automation Engineer**Location:**...  ...seeking a Senior Quality Assurance Automation...  ...various applications.* Evaluate the technology...  ...Review and enhance code quality in...  ...career resources, training, certifications, development... 
    Senior
    Training
    Hourly pay
    Contract work
    Immediate start
    Remote work

    Apex Systems

    Richmond, VA
    3 days ago
  • $140k - $160k

     ...About the Role We are looking for a Senior Quality Engineer at Credo AI is a senior software...  ...quality gates, writing production-quality code, and documenting the patterns and playbooks...  ...experience, and relevant education or training. Location & Remote Culture While... 
    Senior
    Training
    Full time
    Work at office
    Remote work

    Credo.AI

    Remote
    5 days ago
  •  ...Senior Air Quality EngineerThe Bay Area Air Quality Management District...  ...position of Senior Air Quality Engineer in the Refineries Section...  ...such as permit application evaluation, air pollutant emissions, toxic...  ...direction, coordination, training and work review to staff on... 
    Senior
    Training
    Full time
    For contractors
    Work at office

    Bay Area Air District

    San Francisco, CA
    5 days ago
  •  ...frontier research with high-quality data, advanced training pipelines, plus top AI...  ...who specialize in software engineering, logical reasoning, STEM,...  ...As a Software Engineering evaluator, you will create cutting-edge...  .... This includes curating code examples, providing precise... 
    Senior
    Training
    Contract work
    For contractors
    Flexible hours

    Turing

    Remote
    6 days ago
  • $140k - $190k

    Ready to shape quality strategy across a platform...  ...AI driven quality engineering capabilities. You...  ...directly with senior engineering and product...  ...Playwright test, evaluate an automation...  ...on experience with LLM evaluation frameworks...  ..., compensation, training, development,... 
    Senior
    Training
    Full time
    For contractors
    Remote work
    Flexible hours

    CFA Institute

    Charlottesville, VA
    13 hours ago
  •  ...frontier research with high-quality data, advanced training pipelines, plus top AI...  ...who specialize in software engineering, logical reasoning, STEM,...  ...As a Software Engineering evaluator, you will create cutting-edge...  .... This includes curating code examples, providing precise... 
    Senior
    Training
    Contract work
    For contractors
    Flexible hours

    Turing

    Remote
    6 days ago
  •  ...the globe. About This Role As a Senior Quality Engineer, you will work with an elite team of developers...  ...best test practices. Review the code of peers in a team. Mentoring more...  ...Keep Learning: Access world-class training resources to power your success. Perks... 
    Senior
    Training
    Permanent employment
    Full time
    Remote work
    Flexible hours
    Night shift

    Takeaway.com

    United States
    5 days ago
  • $178k - $213.6k

     ...relevant education or training. Schneider Electric...  ...highly experienced Senior Certification Engineer to lead regulatory compliance...  ..., and safety evaluation activities for our...  ...requirements.Documentation & Quality SystemsPrepare...  ...Charter is our Code of Conduct and demonstrates... 
    Senior
    Training
    Ongoing contract
    Full time
    Temporary work
    Immediate start
    Flexible hours

    Schneider Electric

    Lake Forest, CA
    13 hours ago
  •  ...Quality Engineer, Senior At Zebra, we are a community of innovators who come together to create...  ...years work experience ~ Education and training in quality disciplines would be an...  ...Technologies leverages AI technology to evaluate job applications using objective, job... 
    Senior
    Training
    Work experience placement
    Summer work
    Local area
    Remote work
    Flexible hours

    Zebra

    United States
    5 days ago
  • $104k - $143k

     ...Senior Quality Engineer StackAdapt is the leading technology company that empowers marketers to...  ...Participate in technical planning, code review and architectural decision-making...  ...hubs in London and Toronto Robust training and onboarding program Coverage and... 
    Senior
    Training
    Local area
    Remote work
    Work from home
    Home office

    StackAdapt

    United States
    5 days ago
  • $70 - $73 per hour

     ...remote day available after completion of training) Position Overview We are seeking an experienced Senior Quality Assurance Engineer to support manufacturing operations and supplier...  ...functional assessments and approvals. Evaluate supplier changes and oversee Production... 
    Senior
    Training
    Contract work
    Remote work
    Day shift
    1 day per week

    Comrise

    Redmond, WA
    11 days ago
  • $150k - $205k

     ...collaboration, responsiveness, and quality results in client...  ...We are seeking a senior-level Environmental, Civil, or Chemical Engineer to support our...  ...selection  Leading technical evaluation of data and developing...  ...required Supervising and training junior and mid-level... 
    Senior
    Training
    Work at office
    Flexible hours

    Landau Associates Inc.

    Seattle, WA
    16 days ago
  • $174k - $252k

     ...such as streaming evaluation, autorater pipelines...  ...experience with coding in Python.3 years...  ...model evaluation, or LLM and GenAI...  ...Google's software engineers develop the next-generation...  ...leadership qualities and be enthusiastic...  ...relevant education or training. US: $174000 - $25... 
    Senior
    Training

    Google

    New York, NY
    3 days ago
  • prolificacademicltd is seeking a talented engineer to contribute JS/TS expertise for AI model training and evaluation. You will review generated code and explanations, run scripts in Node.js or browsers, and provide structured technical feedback. A brief skills assessment... 
    Senior
    Training
    Remote job

    prolificacademicltd

    New York, NY
    1 day ago
  • $97.9k - $133.5k

     ...Become a part of our caring community Senior Software Quality Engineer will be responsible for server-side...  ...pipeline automation and pipeline-as-code concepts for test execution within...  ...occasional travel to Humana's offices for training or meetings may be required.... 
    Senior
    Training
    Full time
    Temporary work
    Apprenticeship
    Work at office
    Remote work
    Work from home
    Home office

    Humana

    Kentucky
    4 days ago
  •  ...Senior Design Quality Engineer We're a rapidly growing startup on a mission to make healthcare proactive...  ...or the data. You can read the code, the logs, and the test evidence to find...  ...quality procedures, document control, training records, and compliance evidence as the... 
    Senior
    Training
    For subcontractor
    Live in
    Remote work

    Bayesian Health

    United States
    3 days ago
  • $68.7k - $123.7k

     ...Senior Clinical Coding Auditor & Trainer-Remote New York, New York, United States About the...  ...Fiscal care and assist in development of training and audit tools. Location: The...  ...recommendations for improvement to management Evaluate effectiveness of training programs... 
    Senior
    Training
    Remote job
    Full time
    Part time
    Work at office
    Flexible hours

    Fox Point Recruitment

    New York, NY
    4 days ago
  •  ...Our partner is looking for a Coding Suspends Senior Specialist based in the...  ...operations while supporting high-quality patient care. \n...  ...practices and providing guidance, training, and support to improve...  ...process your personal data to evaluate your candidacy and share... 
    Senior
    Training
    Full time

    Jobgether

    Remote
    3 days ago
  • $102.8k - $128.5k

     ...We are seeking a Senior Quality Engineer to join CMT’s IoT Operations team and lead supplier and...  ...vendor qualification and onboarding, evaluating supplier quality plans, compliance requirements...  ...Experience mentoring or training junior engineers or technicians Compensation... 
    Senior
    Training
    Contract work
    Temporary work
    Summer work
    Work from home
    Worldwide
    Flexible hours

    Cambridge Mobile Telematics

    Cambridge, MA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Code Quality Engineer, LLM Training and Evaluation. Be the first to apply!