Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

AI Model Benchmarking Intern (Remote, Iowa-Based)

$22 - $28 per hour
Temporary

Braintrust

  • Rate: $22 – $28/hr
  • Hours: 20 hours / week
  • Experience: 1 - 3 years
  • Location: United States | Canada + 23 more

AI Model Benchmarking Intern (Remote, Iowa-Based)

Part-time, 15–20 hours/week · Remote, Iowa-based · 6-month internship · $22–$28/hour

About SureHost

SureHost is an early-stage hospitality technology company based in Des Moines, Iowa. We help growing short-term rental operators confirm each property is guest-ready after a cleaning turn, using documented property standards, photo and video evidence, AI-assisted review, and human review where it matters.

We are working with an initial paying customer and preparing for broader growth in the U.S. market. Our customer and product work happens in Des Moines, and our technical team is based in Pune, India. Our stack is Python and Flutter, deployed on GCP.

The role

SureHost uses AI narrowly, where it can be measured and trusted. Language and vision models change quickly, and a model that looks strong in a demo can still fail on real property footage, cost too much to run, or make decisions an operator cannot follow.

In this role, you will help us tell the difference. You will build repeatable benchmarks that compare LLMs and VLMs on SureHost use cases, and your findings will inform model choices and the product roadmap. You will work with our AI Chief Architect.

What you will do

  • Research and compare evolving LLM and VLM models that may support SureHost's product use cases.
  • Create representative evaluation datasets, test cases, scoring criteria, and repeatable benchmark workflows.
  • Measure model quality across accuracy, reliability, latency, cost, and other product-relevant factors.
  • Analyze failure patterns and trade-offs, including false positives and false negatives on issues operators care about.
  • Present clear findings and recommendations to inform model strategy and the product roadmap.
  • Maintain benchmark results and documentation as models, APIs, and requirements change.

What you bring

  • Interest in applied AI and familiarity with LLMs, VLMs, generative AI tools, or model APIs through coursework or projects.
  • Logical, evidence-based thinking and comfort working with structured data and evaluation criteria.
  • Basic Python or data-analysis skills.
  • The ability to document methods and results clearly.
  • Patience to run repeatable experiments, investigate edge cases, and separate a compelling demo from dependable performance.
  • Clear communication, willingness to ask questions early, and responsible handling of customer, property, and company information.

Required

  • Based in Iowa.

Details

  • Pay: $22–$28/hour, based on experience and how independently you can work.
  • Hours: 15–20 hours per week, with flexible scheduling.
  • Location: Remote, for Iowa-based candidates.
  • Term: 6-month internship.
  • Start date: Flexible. We are onboarding now and can work around school schedules, finals, and the holidays.
  • Works with: AI Chief Architect.
  • Team time: A monthly in-person check-in over coffee in Des Moines.

What you get

  • Real responsibility on a live hospitality technology product, with few layers between customer needs and product decisions.
  • Direct mentorship from the AI Chief Architect on applied model evaluation.
  • Work you can point to: benchmark methods, results, and recommendations to reference in future roles.

Company: SureHost

Vacancy posted 8 days ago
Similar jobs that could be interesting for youBased on the AI Model Benchmarking Intern (Remote, Iowa-Based) in San Francisco, CA vacancy
  •  ...Your Future at DTCC As a Model Risk Management Intern, you will gain exposure to...  ...that combines team-based project work, training, feedback...  ...model validation testing, benchmarking exercises, and related...  ...days in office and 2 days remote, based on team schedule.... 
    Internship
    Remote work
    Hourly pay
    Full time
    Summer work
    Summer internship
    Work at office

    DTCC

    Jersey City, NJ
    4 days ago
  • $22 - $30 per hour

     ...Argentina | Bolivia | Brazil + 15 more Mobile Development Intern, Internship-to-Hire (Remote, Iowa-Based) Part-time, 15-20 hours/week · Remote, Iowa-based · 3-6...  ...property standards, photo and video evidence, AI-assisted review, and human review where it matters. We... 
    Internship
    Remote job
    Full time
    Temporary work
    Part time
    Flexible hours

    Braintrust

    New York, NY
    1 day ago
  • $70 per hour

     ...to meet you. Waymo interns partner with leaders in...  ...Develop temporal graph modeling techniques to capture...  ...dashboards (e.g., Jupyter/Colab-based explorers) to help...  ...distribution Benchmark retrieval precision, recall...  ...papers in top-tier AI/ML, data mining, or computer... 
    Internship
    Hourly pay
    Full time
    Summer internship
    Relocation package

    Waymo

    Mountain View, CA
    2 days ago
  • $15 - $35 per hour

    Remote | United States | Project-Based Independent Contractor Compensation : $15-$35 USD/hour...  ...Help Shape the Future of AI in Healthcare What if the...  ...Artificial Intelligence (AI) models. We're seeking...  ...Practice, Family Medicine, Internal Medicine, Nurse Practitioner... 
    Internship
    Remote work
    Hourly pay
    For contractors
    Traineeship
    Freelance
    Weekday work

    Volga Partners

    New York, NY
    2 days ago
  •  ...the future of physical AI. Founded in 2017 and now...  ...may include occasional remote work, starting the day with...  ...passionate Research Interns to join the Research Group...  ...world-action foundation model with various world modalities...  ...qualified individuals based on their status as... 
    Internship
    Remote work
    For contractors
    For subcontractor
    Casual work
    Work at office
    Immediate start
    Day shift

    Applied Intution

    Sunnyvale, CA
    5 days ago
  •  ...are exploring the next generation of AI technologies that will transform how...  ...manage the power grid. As a Power System Intern focused on foundational models, you will contribute to research and...  ...For candidates applying to a U.S. based position only: This posting is expected... 
    Internship
    Permanent employment
    Summer work
    Relocation package

    GE Vernova

    Bellevue, WA
    4 days ago
  • $60 - $90 per hour

     ...technical talent with leading AI research labs....  ...our investors include Benchmark , General Catalyst ,...  ...Machine Learning Engineer — Model Evaluation &...  ...0/hour Location: Remote Commitment: 35 hours...  ...resume AI interview based on your resume Submit... 
    Remote work
    Contract work
    Summer work

    Mercor

    New York, NY
    2 days ago
  • $219k - $351k

     ...bandwidth business. As models scale past what...  ...core product of AI inference, not an...  ...Flexible Work policy; remote/hybrid option...  ...hybrids) and publish internal reference...  ...bandwidth. Define benchmarking and characterization...  ...reward employees based on individual and... 
    Remote work
    Work at office
    Flexible hours

    Samsung Semiconductor

    San Jose, CA
    5 days ago
  •  ...Research Interns at Applied IntuitionApplied Intuition,...  ...the future of physical AI. Founded in 2017 and now...  ...may include occasional remote work, starting the day with...  ...world-action foundation model with various world modalities...  ...qualified individuals based on their status as... 
    Internship
    Remote work
    Full time
    For contractors
    For subcontractor
    Casual work
    Work at office
    Immediate start
    Day shift

    Applied Intuition

    Sunnyvale, CA
    5 days ago
  • $70 - $100 per hour

     ...technical talent with leading AI research labs....  ...our investors include Benchmark , General Catalyst ,...  ...0/hour Location: Remote Role Responsibilities...  ...knowledge gaps and improve AI model performance in...  ...analysis , and cell-based assays . Design challenging... 
    Remote work
    Contract work
    Summer work
    Weekday work

    Mercor

    San Francisco, CA
    27 days ago
  • $152k - $241.5k

     ...’re building the perception-based world model stack that makes this possible...  ...on Orin and Thor.Develop benchmarks and performance regression tests...  ...vacancy. NVIDIA uses AI tools in its recruiting processes...  ..., CA, Santa Clara; US, WA, Remote; US, LA, Remote; US, CA, Remote... 
    Remote work
    Full time

    Nvidia

    Seattle, WA
    1 day ago
  • $85 per hour

     ...technical talent with leading AI research labs....  ...our investors include Benchmark , General Catalyst ,...  ...5/hour Location: Remote Role Responsibilities...  ...engineering tasks. Review model-generated...  ...resume AI interview based on your resume Submit... 
    Remote work
    Contract work
    Summer work

    Mercor

    San Francisco, CA
    5 days ago
  •  ...supercomputers or AI systems will never...  ...architecture and approach is based on silicon...  ...C of its Quantum Benchmarking Initiative,...  ...seeking a Photonic Model Integrator to develop...  ...business needs, and internal equity. Your...  ...Phoenix/Tempe and many remote locations This position... 
    Remote work
    Full time
    Shift work

    PsiQuantum

    Palo Alto, CA
    3 days ago
  •  ...participants join a cohort of 11 interns across multiple...  ...3 days in office/2 days remote each week. What You'll Experience Our Model Risk team plays a key role...  ...-on experience with AI use cases is desired....  ...appropriate work attire based on what your day looks like... 
    Internship
    Remote work
    Hourly pay
    Summer internship
    Work at office
    Flexible hours
    2 days per week
    3 days per week

    Federal Home Loan Bank of Indianapolis

    Indianapolis, IN
    5 days ago
  • SureHost is hiring an AI Software Development Intern to implement LLM- and VLM-based features in Python and build the supporting services...  ...Architect and Pune team on a remote, Iowa-based internship-to-hire path. The role focuses on model-driven workflows, API development,... 
    Internship
    Remote job
    Full time

    Braintrust

    New York, NY
    1 day ago
  •  ...aircraft, including the Helix family, using model-based design in MATLAB and Simulink. We are...  ...meaningful tests for them. This is a fully remote contract position. Responsibilities...  ...Jira and Confluence. Experience using AI-assisted development tools, such as Claude... 
    Remote work
    Contract work
    Work at office

    Pivotal

    Remote
    7 days ago
  • $145.2k - $187.69k

     ...Responsibilities STC is seeking a Model-Based Mission Engineering Subject Matter Expert to develop innovative, model-centric solutions...  ...that align to the specified role, geographic location (For Remote Opportunities), education and certifications as well as Federal... 
    Remote work
    Hourly pay
    Full time
    Contract work
    Temporary work
    For contractors
    Work experience placement

    Arcfield

    Remote
    21 days ago
  • $52.9k - $108k

     ...Administrator - Summer Intern Job Description The Opportunity...  ...fraud. Candidate AI Usage Policy AI is a...  ...fair candidate process based on your own skills and...  ...provided . Work Model Our people-first culture...  ...on during meetings. Remote : If this position is listed... 
    Internship
    Remote work
    Full time
    Contract work
    Part time
    Summer internship
    Local area

    Booz Allen

    Annapolis Junction, MD
    1 day ago
  • $15 - $40 per hour

     ...United States (US) - Iowa - Urbandale...  ...IA - 124769 Onsite/Remote: Onsite Position...  ...robotics, perception, and AI technologies that enable...  ...multi-modal AI models using camera...  ...Highly competitive base pay Savings & Retirement...  ...Science, Engineer, Intern, Electrical,... 
    Internship
    Remote work
    Hourly pay
    Full time
    Part time
    Summer work
    Local area
    Relocation package
    Flexible hours

    John Deere

    Urbandale, IA
    3 days ago
  • $58.96 per hour

     ...work. Today, ServiceNow is the AI control tower for business...  ...ServiceNow? Here’s what our former interns have to say about working at...  ...in this location, we offer a base pay of $58.96/hr , plus...  ...trust. Work personas (flexible, remote, or required in office) are categories... 
    Internship
    Remote work
    Summer internship
    Work at office
    Immediate start
    Flexible hours

    ServiceNow

    Kirkland, WA
    3 days ago
  • $61.9k - $141k

     ...Summer Games Data Scientist Intern - Royal Oak, MI The...  ...products and unique engagement models, and leverage the power...  ...fraud. Candidate AI Usage Policy AI is a...  ...fair candidate process based on your own skills and...  ...on during meetings. Remote : If this position is listed... 
    Internship
    Remote work
    Full time
    Contract work
    Part time
    Summer work
    Summer internship
    Local area
    Worldwide

    Booz Allen

    Royal Oak, MI
    5 days ago
  • $61.9k - $141k

     ...Summer Games Data Scientist Intern The Opportunity: The...  ...and unique engagement models, and leverage the power...  ...prevent fraud. Candidate AI Usage Policy AI is a...  ...fair candidate process based on your own skills and...  ...on during meetings. Remote : If this position is listed... 
    Internship
    Remote work
    Full time
    Contract work
    Part time
    Summer work
    Summer internship
    Work at office
    Local area
    Worldwide

    Booz Allen

    Colorado Springs, CO
    2 days ago
  • $38 - $94 per hour

     ...NVIDIA is searching for several interns to join the Learning and Perception research team for...  ...in the areas of embodied and agentic AI, such as perception, agentic reasoning, multi...  ...internship hourly rates are a standard pay based on the position, your location, year in school... 
    Internship
    Remote job
    Hourly pay

    NVIDIA

    Santa Clara, CA
    3 days ago
  • $104k - $166k

     ...About the role At Zillow, interns do meaningful work that contributes...  .... Our 2027 internships are based in Seattle and follow a hybrid...  ...has been categorized as a Remote position. "Remote" employees do...  ...Hands-on experience using AI tools to build software, with... 
    Internship
    Remote work
    Permanent employment
    Summer work
    Summer internship
    Live in
    Work at office
    Local area
    Relocation

    Zillow

    Seattle, WA
    2 days ago
  • $147k - $220k

     ...a Senior Research Engineer on the model scaling team, reporting to a Director of AI Research. The work covers model training...  ...— 30 minutes. # Offer. Base salary: $147,000–$220,000 + strong...  ...-site presence is required. Fully remote is not available. Visa... 
    Remote work
    Visa sponsorship

    Intelix.AI

    Seattle, WA
    4 days ago
  • $29 - $34 per hour

     ...through connected insights, AI-powered technology, and intelligent...  ...Machine Learning Engineering Intern who is currently enrolled in...  ...: This position is remotely based within the United States....  ...label, and prepare datasets for model training. Train, fine-tune... 
    Internship
    Remote work
    Hourly pay
    Full time
    Contract work
    Part time
    Summer work
    Summer internship
    Local area

    Siemens

    Raleigh, NC
    2 days ago
  • $55.2k - $126k

     ...Transformation Analyst - Summer Intern Job Description The...  ...fraud. Candidate AI Usage Policy AI is a...  ...fair candidate process based on your own skills and...  ...explicitly provided . Work Model Our people-first...  ...on during meetings. Remote : If this position is listed... 
    Internship
    Remote work
    Full time
    Contract work
    Part time
    Summer work
    Summer internship
    Work at office
    Local area

    Booz Allen

    Arlington, VA
    1 day ago
  • $40 - $125 per hour

     ...Drug Discovery Scientist, AI Trainer (Remote, Flexible Hours)100% Remote | Work When You Want |...  ...trainers and evaluate how frontier AI models handle real discovery and preclinical work...  ...from target toward IND. This is project-based, 100% remote work you do from home on... 
    Remote work
    Hourly pay
    Full time
    Contract work
    Temporary work
    Part time
    Freelance
    Work from home
    10 hours per week
    Flexible hours
    Afternoon shift

    Crucial Recruiting

    New York, NY
    a month ago
  • $160k - $200k

     ...TS.SCI Clearance Level Must Be Able to Obtain: TS/SCI with Poly Potential for Remote Work: ORA_ON_SITE Description SAIC is seeking an experienced Model Based Systems Engineer (MBSE) to join our Technical Engineering and Design Department in... 
    Remote work
    Full time
    Shift work

    SAIC

    San Diego, CA
    2 days ago
  • $120k - $160k

     ...Clearance Level Must Be Able to Obtain: None Potential for Remote Work: ORA_ON_SITE Description SAIC's...  ...Security customers and their systems. This role focuses on advancing model-based systems engineering (MBSE), digital engineering (DE), and... 
    Remote work
    Full time
    Shift work

    SAIC

    San Diego, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to AI Model Benchmarking Intern (Remote, Iowa-Based). Be the first to apply!