Senior Machine Learning Engineer / Model Evaluations Expert

Requirements

Must be eligible to work in Remote
Fluent proficiency in English (Written & Verbal)
Reliable high-speed internet connection
Bachelor's degree or equivalent professional experience
Demonstrated expertise in Software Engineering
How long hiring takes
Across the platforms we work with, people typically hear back about a hire within

about

30 days
of being referred.
Some are quicker, some take longer.
Within 2 weeks
~25%
Within 6 weeks
~60%
Within 3 months
~80%
Why this role
$125/hr for Senior Machine Learning Engineer / Model Evaluations Expert work puts your Software Engineering expertise on the same footing as an AI lab's own research staff, without the overhead of running a consulting practice around it.
Skills and categories
Explore other opportunities in related specializations:
Software Engineering
High-Pay ($100+/hr)
No Degree Required
Software Engineering & Coding
Machine Learning
Engineering & Robotics
Expert
Related jobs
Data Science Consultant Expert
ethos • Software Engineering
$100
/hr
AI Engineer (LLMs & Agents) Expert
ethos • Software Engineering
$100
/hr
Software / AI / IT & Data Generalist Expert
ethos • Software Engineering
$80
/hr
Machine Learning Engineer Expert
ethos • Software Engineering
$80
/hr
Browse All Jobs from Ethos
Discover more opportunities on Ethos that match your skills and interests.
View All Ethos Jobs →
Verified Reviews
Loading reviews…
Community Reviews
Loading reviews…
💬
Share your experience with Ethos
Help other candidates make better decisions by leaving a review.
Sign in to leave a review
Common questions
Do I need to keep applying for projects on Ethos?
No. Once your profile is live, Ethos's algorithm matches you to inbound opportunities based on your career history, so companies find you instead of you hunting for listings. Your Expert Score rises with each completed engagement and unlocks higher-value work over time. Ethos already works with 25+ private equity firms, hedge funds, and consultancies, so the deal flow behind this is real.
How and when does Ethos pay experts?
Within 30 days of invoice submission after a project closes. That net-30 schedule is standard for enterprise expert networks, but it's slower than the weekly payouts some AI training platforms offer, so plan your cash flow around it.
What does the day-to-day workload look like for elite-expert AI training roles?
Slow and deep, not fast and repetitive. A single task can take 45-60 minutes of researching citations or verifying complex calculations. Quality is what's being measured here, not throughput.
Is AI training work the same as traditional consulting?
No. Instead of client deliverables, you're given complex scenarios to evaluate: grading the AI's logic, correcting its hallucinations, and supplying expert-level reasoning it doesn't have on its own. The job is closer to teaching than consulting.
What does Software Engineering work look like for a Senior Machine Learning Engineer / Model Evaluations Expert?
Tasks here are scoped to Software Engineering, not generic labeling. As a Senior Machine Learning Engineer / Model Evaluations Expert, expect to draw on real domain judgment (evaluating outputs, correcting errors, or providing expert reasoning specific to Software Engineering) rather than following a one-size-fits-all rubric. If you don't have hands-on Software Engineering background, this is likely not the right listing to start with.
What specific skills does this listing call for?
Expert is named directly in the listing. If you don't have hands-on experience with this, expect the screening process to test for it directly rather than accepting adjacent experience as a substitute.
How much does this specific role pay?
This listing is posted at $125/hr, an hourly rate. Pay can change between when we last checked the listing and when you apply, so confirm the current number on the platform's own application page before committing time.
What happens when I click Apply on this listing?
You'll be taken to Ethos's external site to complete your application there. This listing links through a referral, but the process is identical to applying directly; the link just routes you correctly. Create an account on their site and follow their onboarding steps.
Who built Ethos and is it legitimate?
Yes, it's legitimate and well-funded: Ethos raised $3.5M from General Catalyst and was co-founded by Daniel Mankowitz (Google DeepMind research scientist and lead author of AlphaDev) and James Lo (McKinsey, SoftBank Vision Fund). Over 17,000 experts have signed up, and it's actively working with 25+ PE firms, hedge funds, and consultancies. The referral link on this page is an affiliate link; it doesn't affect your pay or opportunities.