AI Evaluation Engineer: Code & Test Automation
$80 per hourMindrift
A tech consulting firm is seeking experienced freelance contributors to develop coding test cases for AI systems, allowing for flexible part-time work. Ideal candidates should have a degree in computer science or related fields, over 5 years of experience in software development mainly in Python, and a strong background in full-stack development. Compensation may reach up to $80/hour based on project-specific criteria, fostering a stimulating work environment with the freedom to manage task schedules flexibly. #J-18808-Ljbffr Mindrift
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the AI Evaluation Engineer: Code & Test Automation in New York, NY vacancy
- TWG Global AI in New York is seeking a Senior or Staff AI Software Engineer in Test to develop test automation frameworks for AI products. The ideal candidate will have significant experience in Python and Java, along with a strong software engineering background focused...Suggested
$80 per hour
A leading AI project company in the United States is seeking experienced software... ...in Computer Science or Software Engineering, at least 5 years of experience in... ...Responsibilities include reviewing coding tasks, writing functional tests, and analyzing AI model failures. The...SuggestedContract workFlexible hours$60 per hour
A leading AI development company seeks proficient programmers to contribute to cutting-edge AI systems while... ...flexible schedule. Responsibilities include solving coding problems, writing high-quality code, and evaluating AI-generated code. Ideal candidates should have a...SuggestedRemote jobHourly payFlexible hours$60 per hour
A prominent AI technology company seeks proficient programmers to join a remote coding team that drives AI development. Responsibilities include designing coding problems, writing high-quality code, and evaluating AI-generated code. The ideal candidate is fluent in English...SuggestedRemote job- ...Responsibilities Review and refine AI-generated prompts, responses, and code Validate algorithms and... ...benchmarking efforts to evaluate and compare model... ...experience in software engineering, technical research, or... ...with debugging, testing, and validating code Ability...SuggestedRemote jobPart time
$60 per hour
...seeking proficient programmers to contribute to cutting-edge AI development. This fully remote role allows candidates... ...choose projects. Responsibilities include designing coding problems for AI systems and evaluating AI-generated code. Candidates should be fluent in...Remote jobHourly payFlexible hours- ...looking for Senior Python and Test Engineer. New York City Location.... ...package. Senior Python & Test Automation Engineer In this role you will... ..., modular design, and clean code practices. Experience... ...UAT (Planning, Execution and Evaluation) Participate in planning and...Work at officeVisa sponsorship2 days per week3 days per week
$40 per hour
...join our team to help train AI models. In this role, you will evaluate AI-generated security... ...explanations and security-relevant code Provide feedback that... ...(e.g., penetration testing, red teaming, incident response, detection engineering, DFIR, malware analysis, threat...Hourly payFull timePart timeRemote workDataAnnotation
New York, NY6 days ago$72k - $184.44k
...of stakeholders. They evaluate compliance with regulations... ...technology, and automation tools to leverage data... ...guidance), the Firm’s code of conduct, and independence... ...evaluation and assessment of AI solutions, securing... ...in AI/ML model and testing and validation, risk management...H1bLocal areaSwiftCruit
New York, NY3 days ago$100k - $135k
...Job Description: The AI Automation Engineer will develop AI-assisted automation... ...engineering productivity, testing, documentation,... ...enabled workflows that support coding, test generation, documentation... ..., logging, monitoring, evaluation, and production support....Full timeTemporary workFor contractorsWork at officeRemote workHome officeFlexible hoursThe Mutual Group
New York, NY19 hours ago$40 per hour
A technology firm focusing on AI is seeking experienced cybersecurity professionals... ...for a remote role. You will evaluate AI-generated content, solve... ..., including skills in penetration testing and incident response, as well as some coding experience. Strong writing and analytical...Remote jobHourly pay- ...solutions provider is looking for Software Engineering, Data Science, and Systems Design Experts proficient in C programming to evaluate responses generated by large language... ...completeness of LLM outputs, as well as conducting code testing and validation. Candidates should...Remote jobFlexible hours
- An AI Engineer, a strong Software Engineer transitioning... ...AI, or perhaps a Data/Automation Engineerwith some GenAI... ...PoC development to evaluate AI capabilities and feasibility... .... Microsoft Code-Based Development Build... ...documentation. Quality, Testing & Delivery Conduct...
- ...perfect software engineering opportunity for you... ...and high-quality code using the syntax of... ...enterprise‑authorized AI coding assist... ...refactoring, unit test creation, documentation... ...peer review, automated testing, and secure... ...ability to critically evaluate and validate AI‑...
$150k - $250k
...Unit within Core Engineering focused on running... ...through large scale automation, best-in-class... ...classical ML with agentic AI, we deliver... ...Productionize LLMs: Build evaluation framework for open... ..., architecting, testing, and launching... ...), and infra-as-code (Terraform/CloudFormation...Full timeTemporary workPart timeWorldwide- VP AI Innovation & Solutions Engineering New York, NY, United States Job Description... ...the application code, cloud integration patterns... ...standards. Drive automation of deployment, testing, and monitoring processes... ...practices, continuously evaluating and recommending new...
$133k - $185k
...infrastructure, intelligence, and automation that powers our go-to-market engine. As an AI / Data Engineer (P3), you will... ...Redshift). Familiarity with agentic coding tools (Claude Code, Cursor, etc.)... ...tools (version control, CI/CD, testing, code review, Github, etc.) Systems...Summer holidayLive outLocal areaFlexible hoursBetterUp
New York, NY1 day ago$60 per hour
A leading AI development team is seeking proficient programmers to contribute to cutting-edge AI systems. Enjoy... ...projects. Key responsibilities include designing coding problems for AI, providing feedback, and evaluating AI code. Candidates should be fluent in English and...Remote job$118.98k - $195.47k
...to shape the future of intelligent automation? We’re seeking a visionary AI Engineer to join our high‑performing team. In... ...lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operation 5+ years of hands‑on...Remote workFlexible hoursThe Guardian Life Insurance Company of America
New York, NY8 hours ago$60 per hour
A cutting-edge AI development company is looking for proficient programmers to contribute to AI systems... ...-time jobs. Responsibilities include designing coding problems for training AI systems, writing code snippets, and evaluating AI-generated code. Candidates should have...Remote jobFull time- ...proficient programmers to contribute to cutting-edge AI systems with the flexibility of remote work and... ...projects. Responsibilities include designing coding problems for AI training, writing clear code, and evaluating AI-generated outputs. Preferred candidates will possess...Remote jobHourly pay
$80 per hour
A tech consulting platform is seeking experienced developers and test automation specialists for freelance opportunities in AI systems testing. You will create coding challenges, analyze AI failures, and contribute to various projects based on your schedule. Candidates...Freelance- A cutting-edge AI development company is seeking proficient programmers for remote work in the United States. You will design and solve coding problems impacting AI systems, write high-quality code, and evaluate AI-generated code. Fluency in English and experience in various...Remote jobFlexible hours
- .... But more importantly — we are building a company where AI powers ~70% of engineering execution. That means: AI assists with code generation, test scaffolding, refactoring, documentation, and workflow automation Engineers focus on architecture, system design, production...
- A leading AI development firm is seeking proficient programmers to enhance AI development. Enjoy the flexibility of remote... ...working on innovative projects. The role involves designing coding tasks, evaluating code quality, and providing valuable feedback to aid in AI training...Remote job
$60 per hour
...proficient programmers to contribute remotely to AI systems development. Ideal candidates should have... ...JavaScript and Python. Responsibilities include designing coding problems for AI training, writing clear code, and evaluating AI-generated scripts. This role offers...Remote jobHourly pay$60 per hour
A leading AI development company seeks proficient programmers to contribute to cutting-edge AI projects remotely.... ...JavaScript or Python. Responsibilities include designing coding problems for AI systems and evaluating AI-generated code. A bachelor's degree is preferred. #J...Remote job- A technology company is seeking proficient programmers to contribute to AI development in a fully remote role. You will design solutions for coding problems, evaluate AI code, and provide impactful feedback. The ideal candidate will have strong English fluency, proficiency...Remote jobFlexible hours
- ...take your software engineering career to the next... ...deliver agentic AI platforms and large... ...system quality through evaluation and observability.... ...through strong code reviews,... ...through reliable automation and decision support... ...experimentation, regression testing, and observability...
- A leading AI development company is seeking proficient programmers to advance AI systems with the flexibility of remote work. Responsibilities include designing coding problems, evaluating AI-generated code, and writing clear code snippets. The ideal candidate will be...Remote jobFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Evaluation Engineer: Code & Test Automation. Be the first to apply!
Related searches
- ai engineer New York, NY
- machine learning ai engineer New York, NY
- ai research engineer New York, NY
- ai ml engineer New York, NY
- senior ai engineer New York, NY
- ai prompt engineer New York, NY
- ai developer New York, NY
- ai engineer remote New York, NY
- infrastructure automation engineer New York, NY
- junior software test automation engineer New York, NY