Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Evaluation Engineer (Contract) — Python QA & Testing

$80 per hour

Mindrift

A leading AI project company in the United States is seeking experienced software developers for project-based opportunities. Candidates must have a degree in Computer Science or Software Engineering, at least 5 years of experience in Python, and Full-Stack development capabilities. Responsibilities include reviewing coding tasks, writing functional tests, and analyzing AI model failures. The role offers competitive pay rates up to $80/hour based on skills and project requirements, with flexible working hours. #J-18808-Ljbffr Mindrift

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the AI Evaluation Engineer (Contract) — Python QA & Testing in Brooklyn, NY vacancy
  •  ...Join to apply for the AI QA Trainer - LLM Evaluation role at Invisible...  ...robustness. Design and run test plans, regression...  ...to prompt engineering, guardrails, and evaluation...  ...teaming, automation (Python/SQL), and...  ...apply. Employment type: Contract Workplace type: Remote... 
    Contract work
    Hourly pay
    For contractors
    Freelance
    Remote work

    Invisible Expert Marketplace

    New York, NY
    2 days ago
  • $30 per hour

     ...is looking for a Quality Assurance Engineer to train AI models by evaluating their responses and improving quality...  ...in programming languages like Python or JavaScript, and are expected to...  ...chatbots. This is a flexible, independent contract position that offers hourly... 
    Contract work
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    12 hours ago
  •  ...Responsibilities Review and refine AI-generated prompts, responses,...  ...benchmarking efforts to evaluate and compare model...  ...Strong experience in software engineering, technical research, or educational...  ...Strong experience with debugging, testing, and validating code Ability... 
    Suggested
    Remote job
    Part time

    Crossing Hurdles

    New York, NY
    2 days ago
  • $30 per hour

    A tech company specializing in AI is seeking a Quality Assurance Engineer to evaluate and improve AI models. The ideal candidate will be proficient in programming languages like Python or JavaScript, and will assess coding challenges and outputs produced by AI chatbots.... 
    Suggested
    Remote job
    Hourly pay
    For contractors
    Flexible hours

    DataAnnotation

    New York, NY
    12 hours ago
  •  ...AI Engineer | IntePros IntePros is partnering with...  ...the team on a 6-month contract-to-hire basis. This is...  ...technical solutions, pressure test feasibility, and...  ...solutions Evaluate and refine AI concepts...  ...experience with strong Python fundamentals ~ Hands... 
    Contract work

    IntePros

    New York, NY
    1 day ago
  • $30 - $40 per hour

    A technology company is seeking a Quality Assurance Engineer to join the team evaluating AI models. You will assess AI chatbots based on coding challenges...  ...proficiency in a programming language such as Python or JavaScript. Successful candidates will be detail-oriented... 
    Remote job
    Hourly pay
    Flexible hours

    DataAnnotation

    New York, NY
    12 hours ago
  • $150k - $160k

     ...productionization of AI capabilities...  ...As a Senior AI Engineer (Full-Stack / Applications...  ...systems: from evaluating and optimizing models...  ..., AWS, Firebase, Python, Typescript, Django...  .... Solid testing discipline across...  ...integration, and contract tests for both deterministic... 
    Contract work
    Temporary work
    Work at office
    Local area
    Remote work

    Macmillan Learning

    New York, NY
    4 days ago
  • Anju Software AI Engineering Manager The AI Engineering Manager leads a cross...  ...team (Development & QA) and owns technical architecture...  ...RAG) Prompt engineering and evaluation AI output validation and guardrails...  ...Drive experimentation, A/B testing, and telemetry‑based decision... 

    Valsoft Corp

    New York, NY
    2 days ago
  •  ...searching for an Applied AI Engineer for a CONTRACT assignment with one of our...  ...understand failure modes, evaluation, and governance as first...  ...platforms and workflows (Python or Java). ~ Proven experience...  ...management, regression testing, observability, and... 
    Contract work

    SGA

    New York, NY
    1 day ago
  • $60 per hour

    A leading AI development company is looking for proficient programmers to join their...  ...problems, writing high-quality code, and evaluating AI-generated code. Ideal candidates have...  ...programming languages such as JavaScript or Python. The role offers flexibility in projects... 
    Remote job

    DataAnnotation

    Brooklyn, NY
    2 days ago
  • $60 per hour

    A leading AI development company is seeking proficient programmers to contribute to the...  ...include solving coding problems, evaluating AI-generated code, and improving AI models...  ...languages including Kotlin, JavaScript, and Python. Ideal for those who seek impactful work... 
    Remote job
    Hourly pay

    DataAnnotation

    New York, NY
    4 days ago
  • $60 per hour

    A leading AI development firm is seeking proficient programmers to join its remote team. This role...  ...in frameworks like Kotlin, JavaScript, or Python. Responsibilities include designing coding challenges for AI and evaluating generated code. Competitive pay of up to $60 USD... 
    Remote job

    DataAnnotation

    New York, NY
    2 days ago
  • $150k - $180k

    Ironclad is the leading AI contracting platform that...  ...company events. AI Engineering @ Ironclad Ironclad is...  ...lead efforts in model evaluation, iteration, and deployment...  ...‑on experience with Python, backend service development...  ...to code quality, testing, and maintainability... 
    Contract work
    Full time
    Work at office

    Ironclad

    New York, NY
    2 days ago
  • $20 - $28 per hour

     ...freelancers, or independent contractors for a flexible remote role that involves training AI chatbots. Responsibilities include developing prompts, writing responses, and evaluating model outputs. Candidates should be fluent in English and have strong writing and... 
    Remote job
    Hourly pay
    For contractors
    Freelance
    Flexible hours

    DataAnnotation

    Brooklyn, NY
    1 day ago
  •  ...join their team and contribute to advancing AI development. This role allows for fully...  ...development, write clear code, and evaluate AI-generated solutions. Candidates should...  ...languages such as Kotlin, JavaScript, or Python. A competitive pay rate is offered, with... 
    Remote job

    DataAnnotation

    Brooklyn, NY
    12 hours ago
  • A leading AI development company is looking for proficient programmers to join their...  ...problems, writing high-quality code, and evaluating AI-generated work. Fluency in English and...  ...programming languages like Kotlin, JavaScript, and Python are preferred. Competitive pay and... 
    Remote job

    DataAnnotation

    New York, NY
    12 hours ago
  •  ...feedback company is seeking a Remote QA Review Assistant to test mobile apps and games. In this entry-...  ...role, you'll install applications and evaluate their performance while providing...  ...offers flexible hours with no fixed contract term, making it suitable for newcomers... 
    Contract work
    Remote job
    Fixed term contract
    Flexible hours

    Review Pays

    New York, NY
    2 days ago
  •  ...air disagreements, test each other's logic...  ...firm adopts AI securely. This...  ...security copilots for engineering teams that perform...  ...Security AI Stack: Evaluate, select, and implement...  .... ~ Expert in Python and/or TypeScript...  ...is not a contract and confers no contractual... 
    Contract work
    Full time

    Bridgewater Associates

    New York, NY
    3 days ago
  • $35 per hour

     ...games you enjoy? As a Remote QA Review Assistant, you’ll dive into the exciting world of testing and analyzing apps and games,...  ...areas where it could be improved. Contract length: No fixed term —...  ...relaxed way to get involved in app evaluation. You’ll play a role in improving... 
    Contract work
    Remote job
    Hourly pay
    Fixed term contract
    Worldwide

    Review Pays

    New York, NY
    2 days ago
  • $60 per hour

     ...company is looking for proficient programmers to develop cutting-edge AI systems. This fully remote role allows you to choose your...  ...designing coding problems for AI training, crafting quality code, and evaluating AI-generated content. Excellent English fluency and programming... 
    Remote job

    DataAnnotation

    New York, NY
    2 days ago
  •  ...seeking highly skilled Image Generation Experts & Prompt Engineers to support a leading AI research lab's model training and data quality efforts....  ...generative media while maintaining high standards in quality evaluation. Full-time and part-time roles are available. #J-18808-... 
    Full time
    Part time

    Obsidian

    New York, NY
    2 days ago
  • A leading AI development company is seeking proficient programmers to join their remote team. As part of the coding team, you'll design...  ...problems, primarily focused on Android development. You'll also evaluate AI-generated code and provide feedback to shape AI models. Ideal... 
    Remote job
    Flexible hours

    DataAnnotation

    New York, NY
    2 days ago
  • $35 per hour

     ...interactions? As an Entry Level QA Analyst, you'll embark on an exciting journey testing innovative mobile apps and games...  ...Dive into a realm where you'll evaluate user experiences, ensuring seamless...  ...to support future improvements. Contract length: No fixed term — take... 
    Contract work
    Hourly pay
    Fixed term contract
    Start working today
    Remote work

    Review Pays

    New York, NY
    2 days ago
  • $35 per hour

     ...flawlessly? As an Entry Level QA Tester, you'll embark on an...  ...exciting journey of exploring, testing, and analyzing mobile apps...  ...where it could be improved. Contract length: No fixed term — continue...  ...relaxed way to get involved in app evaluation. You’ll play a role in... 
    Contract work
    Hourly pay
    Fixed term contract
    Remote work
    Work from home
    Worldwide

    Review Pays

    New York, NY
    2 days ago
  • $35 per hour

     ...so seamlessly? As a Freelance QA Analyst, you’ll dive into the...  ...captivating world of apps and games, testing and exploring each pixel and...  ...: In this role, you’ll help evaluate mobile apps by downloading...  ...issues discovered during testing. Contract length: No fixed term — work... 
    Contract work
    Hourly pay
    Fixed term contract
    Freelance
    Remote work
    Work from home

    Review Pays

    New York, NY
    2 days ago
  • $35 per hour

     ...comfort of your own home? As a Remote Software QA Tester, embark on an exciting journey...  ...any areas where it could be improved. Contract Length No fixed term — continue at your own...  ...a relaxed way to get involved in app evaluation. You’ll play a role in improving everyday... 
    Contract work
    Remote job
    Hourly pay
    Fixed term contract
    Work from home
    Worldwide

    Review Pays

    New York, NY
    2 days ago
  • $35 per hour

     ...of app discovery as a Beginner QA Review Assistant. Picture...  ...in enhancing user experiences, testing interfaces, and offering insights...  ...Roles: In this role, you’ll help evaluate mobile apps by downloading...  ...issues discovered during testing. Contract length: No fixed term — work... 
    Contract work
    Hourly pay
    Fixed term contract
    Immediate start
    Remote work
    Work from home

    Review Pays

    New York, NY
    2 days ago
  •  ...seeks proficient programmers to contribute to developing cutting-edge AI systems with a flexible remote work schedule. You will engage in diverse coding tasks, including Android development and evaluate AI-generated code. Candidates should have experience in Kotlin and... 
    Remote job
    Flexible hours

    DataAnnotation

    New York, NY
    2 days ago
  •  ...Corporate Contractor - AI Engineer International...  ...Remote • Engineering Contract Description ***All Applicants...  ...Mandarin or English, Python or Ruby. Languages...  ...Model Benchmarking & Evaluation: Develop model evals to...  ...language services industry. Testing, Optimization, and... 
    Contract work
    For contractors
    Remote work

    Helloglobo

    New York, NY
    2 days ago
  • A leading AI development company is seeking proficient programmers to contribute to innovative AI systems. This role offers the flexibility...  ...strong writing skills. You will design coding tasks for AI, evaluate AI-generated output, and help refine intelligent systems.... 
    Remote job

    DataAnnotation

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Evaluation Engineer (Contract) — Python QA & Testing. Be the first to apply!