AI Evaluation Engineer (Contract) — Python QA & Testing
$80 per hourMindrift
A tech consultancy seeks an AI Specialist to engage with project-based opportunities focused on evaluating and improving AI systems. Responsibilities include reviewing coding tasks, writing functional tests, and analyzing AI failures. Candidates should have a degree in Computer Science, 5+ years in software development primarily using Python, and experience in Full-Stake development. Payment is project-based, offering rates up to $80/hour, with flexible task management. #J-18808-Ljbffr Mindrift
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the AI Evaluation Engineer (Contract) — Python QA & Testing in Denver, CO vacancy
- ...Our client seeks an AI-focused Software Engineer to design, build, and... ...data engineering, and QA workflows. The role centers... ..., analytics tagging, testing, and project... ...React, Node.js, and Python. Develop APIs and... ...position. All AI-assisted evaluations and responses are reviewed...Contract workHourly payLocal areaWork from home
$180k
...Consultant: Guiding GenAI professionals towards their dream careers AI Evaluation Engineer $180,000 Remote (US-based) Are you passionate about... ...is critical. That’s where you come in. You won’t just be testing models, you’ll be creating the frameworks, pipelines, and...SuggestedFull timeRemote work- ...Senior AI/ML Engineer Anywhere Type: Contract-to-Hire Category: Development Industry... ...Runner with automated testing and security scans.... ...engineering. ~ Strong Python skills with TensorFlow and... ...position. All AI-assisted evaluations and responses are...Contract workHourly payPermanent employmentLocal areaRemote work
Eliassen Group
Denver, CO19 hours ago $188.1k - $282.1k
...Warfighter Development Contract (SWDC) is seeking a... ...and motivated Staff AI Software Engineer - SWDC AI/ML Lead to... ...pipelines Identify and evaluate emerging AI/ML technologies... ...through rigorous testing and validation.... ...programming skills in Python, R, or other relevant...Contract workRelocationShift work- A technology training company is seeking experienced cybersecurity professionals to evaluate AI-generated security content and solve technical problems. This fully remote role allows you to choose your projects and work on your schedule. You will contribute to improving...SuggestedRemote job
$200k - $300k
...systems, specialized AI, and data-driven... ...for an AI Engineering Leader who leads... ...expertise in designing, evaluating, and shipping AI based... ...for your team: testing strategy, evaluation... ...~ Proficiency in Python and familiarity... ...create an employment contract, implied or...Contract workWork at officeVertafore
Denver, CO14 days ago$180k - $273k
...Invoca Invoca is an AI-powered revenue... ...culture. About the Engineering Team You'll join... ...primitives, evaluation frameworks, context... ...interfaces, workflow contracts, context-handling... ...enables teams to test AI systems consistently... ...effective in Python and/or TypeScript...Contract workCurrently hiringRemote workFlexible hoursInvoca
Denver, CO25 days ago$100k - $130k
...Owner’s Quality Assurance (QA) and management on... ...in compliance with the contract. Assist in the development... ...Receive subcontractor test and inspection requests... ...members. Personnel evaluation and development. Job... ...in civil or structural engineering, architecture or...Contract workTemporary workFor contractorsFor subcontractorWork at officeFlexible hoursHaselden Construction
Centennial, CO19 hours ago$52 - $56 per hour
Immediate need for a talented AI/LLM Engineers. This is a 12+ Months contract opportunity with long-term potential and... ...Responsibilities: Ability to design thorough test cases and support reliability... ...(TypeScript/JavaScript, Python, or similar). Active AWS certification...Contract workLocal areaImmediate start- ...service delivery. Recent contract awards in... ..., develops, trains, evaluates, and integrates AI/ML models and algorithms... ...pipelines, feature engineering, and model lifecycle... ...pipelines, automated testing, and secure deployment... ...development, such as Python, and supporting...Contract workMinimum wageFull timeTemporary workFor contractorsWork experience placementRemote work
Maximus
Thornton, CO19 hours ago $120k - $250k
...Silicon Valley, Pony.ai has quickly become a global... ...and multi-dimensional evaluation. Design and implement... ...evaluation metrics, testing frameworks, and... ...and optimize downstream engineering workflows for Large Language... ...skills in C/C++, Python, and software design...Temporary work- ...Science Expert - AI Content Specialist... ...inference, and data engineering could directly... ...solutions, and stress-testing AI reasoning at a... ...remote, flexible contract role built for senior... ...including Python/R scripts, SQL queries... ...Generated Code - Evaluate model outputs using...Contract workHourly payOngoing contractFor contractorsFreelanceRemote workFlexible hours
Alignerr
Denver, CO4 days ago - ...Management System. Duties: Participate in the evaluation of subcontractors to verify they have adequate QA/QC capabilities. Prepare, submit for approval,... ...meetings as necessary. Create Inspection and Testing Plans (ITP’s) and Audit Plans for each Definable Feature...Full timeFor contractorsFor subcontractor
Moore Industries
Denver, CO19 days ago - ...& Content Subject Matter Expert for a remote, part-time contract role. You will evaluate AI-generated content and create high-quality copy, enhancing... ...AI training content and optimizing AI performance by testing outputs for accuracy. This position provides flexible remote...Contract workRemote jobPart timeFlexible hours
$80 per hour
...Description Job Description AI & Machine Learning Engineer - AI Training About... ...Network to help train and evaluate the next generation of LLMs... ...you a quick 10- to 15-minute test to assess your skills and suitability... ...& Data: advanced Python (NumPy, Pandas, Scikit-...Hourly payWork from homeFlexible hoursProlific Academic Ltd
Denver, CO22 days ago$60 per hour
A leading AI development firm is seeking proficient programmers to join their remote... ...create applications, and provide critical evaluations of AI-generated code. Successful candidates... ...in languages like Kotlin, JavaScript, or Python. This position offers flexibility in...Remote jobFlexible hours$150k - $184k
...Opportunity The Generative AI Innovation Team is... ...advantage. As a Senior AI Engineer, you will play a... ...direction across engineering. Evaluate, prototype, and... ...production. Proficiency in Python, with working experience... ...). Solid background in testing practices—including unit...Work experience placement3 days per week$128.75k - $160.68k
...Health has a great opportunity for an AI Developer/Engineer. Connect for Health Colorado is a... ...organizational standards. Collaborate with the QA department to select AI-related testing tools and frameworks (prompt/model evaluation, regression testing) to enhance testing...Full timeTemporary workWork at officeRemote workWeekend workAfternoon shiftConnect for Health Colorado
Denver, CO2 days ago$116k - $175k
...development. The Prompt + Skills Engineer is the hands-on builder in Cherry Bekaert's AI Center of Excellence - the... ...Engineer, you will: Writes, tests and refines prompts across Tax,... ...Participates in use case intake, evaluating submitted ideas from across the...Work experience placementLocal areaCherry Bekaert
Denver, CO4 days ago- AI/ML Engineer III page is loaded## AI/ML Engineer IIIremote type: Hybrid... ...Our charter is to identify, test, develop and deploy new products... ..., model deployment, and evaluation.* Work with Project Engineer/... ...programming languages such as Python, C++, C# or Java, with experience...
$108.5k - $149.18k
## AI/ML Engineer IIApplyremote type: In officelocations: Lone Tree, COtime... ...design, integration, test, certification, ground/flight... ...AI/ML models using rigorous evaluation metrics. Optimize models for... ...programming languages such as Python, C++, C# or Java.* Strong understanding...Work experience placement$200k
...assignments (including - Ancillary Testing Coordinator - Education... ...following: Foreign transcripts are evaluated by an acceptable evaluation... ...action Co-Chairs Laboratory QA committee and prepares... ...applies to quality management of contracts for supplies and services in...Contract workFor contractorsWork at officeImmediate startRemote workMonday to Friday- ..., develop, and deploy AI agents that automate,... ...management, versioning, and testing strategies Ensure AI... ...or misuse Establish evaluation metrics for AI agents... ...in software engineering, platform integration,... ...programming languages: Python, JavaScript/TypeScript...Local area
$99.6k - $234.6k
...Description The Principal AI Agent / ML Software Engineer is a Senior Staff-level,... ...APIs, memory, retrieval, evaluation, guardrails, and cloud services... ..., eval suites, regression testing, experimentation, safety... ...programming skills in Python and ability to contribute...Temporary workFlexible hoursOracle
Denver, CO2 days ago- ...Cloud Security Analyst (AI Training) About the Role We... ...AI research teams to build and evaluate cutting-edge AI models. Right... ...Alignerr Type : Hourly Contract Location : Remote Commitment... ...architecture, penetration testing, or incident response...Contract workHourly payOngoing contractFreelanceRemote workFlexible hours
Alignerr
Denver, CO4 days ago $55 per hour
Freelance AI Trainer - Civil Engineering & Python 1 day ago Be among the first 25 applicants This opportunity is only for candidates currently residing... ...Civil Engineers with Python skills to train and evaluate AI models on realistic civil engineering problems. This...Part timeFreelanceRemote workFlexible hours$101k - $167k
...Quality related activities to contract quality requirements for... ...Review inspection, compliance testing and remediation. Participate... ...Qualifications Bachelor’s degree in engineering, construction management,... ...sizes and types. Formal QA/QC training and certification...Contract workFor contractorsFor subcontractorWork at officeFlexible hours$40 per hour
...cybersecurity innovation firm is seeking experienced professionals to evaluate AI-generated content and solve technical problems in a remote... ...experience in cybersecurity, including areas like penetration testing and incident response. Strong communication and analytical...Remote jobHourly payFull timePart timeFlexible hours- ...Teradata's next generation of AI-driven analytics —... ...agent harness, build evaluation frameworks to measure agent... ...a focused team of AI engineers within Teradata's AI... ...equivalent). Proficiency in Python; Go experience is a... ...and automated regression testing for agent behaviors....Permanent employmentFlexible hours
$127k - $187k
...looking for a Senior Applied AI Engineer to be part of... ...of-material generation. ~ Evaluate and refine model accuracy, reasoning... ...through Evals, zero/few-shot tests, Chain-of-Thought reasoning analysis... .... ~ Highly skilled in Python and at least one major ML framework...Paradigm
Denver, COa month ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to AI Evaluation Engineer (Contract) — Python QA & Testing. Be the first to apply!
Related searches