Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Model Evaluators

ClifyX

Model Evaluators (2 Positions)

Candidate will be familiar with RAG and agentic systems, including end-to-end query-to-response workflows, and have experience in fine-tuning language models, tracing, analysis, and debugging. Strong proficiency in Python and Jupyter Notebooks is required, along with the ability to create LLM evaluators (LLM judges) and expertise in prompt engineering

ClifyX
Vacancy posted 6 days ago
Similar jobs that could be interesting for youBased on the Model Evaluators in Austin, TX vacancy
  • $231.44k - $282.88k

     ...responsible for guiding the performance team to develop benchmarks for evaluating CPU / accelerator performance. The candidate will also be...  ...ISA to SoC / system simulators; from analytical to cycle-based models; from bare-metal environment to virtual machines. 5+ years... 
    Suggested
    Full time
    Work experience placement

    SiFive

    Austin, TX
    5 days ago
  • $272k - $431.25k

     ...FlashDreams are the foundation for a new generation of interactive world-model systems. With this release, NVIDIA has set the standard for...  ...workflows.Hands-on experience building, adapting, or deeply evaluating world models, video generation systems, neural rendering... 
    Suggested
    Full time

    Nvidia

    Austin, TX
    1 day ago
  •  ...Visit us at accenture.com.We Are:Accenture's Enterprise Operating Model practice. We partner with Boards, CEOs, and other C-Suite...  ...Engage with senior clients on their biggest business challenges.Evaluate actionable solutions to these challenges, the value of these solutions... 
    Suggested
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Austin, TX
    2 days ago
  •  ...Visit us at accenture.com.We Are:Accenture's Enterprise Operating Model practice. We partner with Boards, CEOs, and other C-Suite...  ...Engage with senior clients on their biggest business challenges.Evaluate actionable solutions to these challenges, the value of these solutions... 
    Suggested
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Austin, TX
    6 days ago
  •  ...driven, deeply technical Product Manager to own AI inference and model serving for k0rdent AI, our control plane for GPU...  ...reasoning across the full stack, identifying performance bottlenecks, evaluating system design trade-offs, and translating technical insight into... 
    Suggested

    Mirantis

    Austin, TX
    4 days ago
  • A global leader in customer experience is seeking a Freelance Luxury Brand Evaluator in Austin, TX. In this role, you will assess customer experiences with high-end brands by visiting stores or evaluating online. Enjoy flexible assignments and compensation based on your... 
    Freelance
    Flexible hours

    CXG

    Austin, TX
    6 hours ago
  • $130.7k - $205.2k

    [Agentic AI] AI Runtime / ML Model Systems EngineerDescription -This role is responsible for developing runtime abstraction layers and intelligent model placement systems across heterogeneous compute resources.. In this role, you will ensure the technical design, development... 
    Full time
    Temporary work
    Work experience placement
    Work at office
    Local area
    Relocation
    Flexible hours
    Shift work

    Juniper Networks

    Austin, TX
    2 days ago
  •  ...use. Inference is where that happens: every product built on a model is bounded by what it costs to run, so the economics of serving...  ...own optimizations where they fall short. You will also build the evaluation discipline that makes a claim like “lossless at 2× throughput”... 
    Full time
    Internship

    Bitdeer Technologies Group

    Austin, TX
    10 days ago
  • $20 per hour

     ...A leading AI technology firm is seeking a Graphic Design Expert to evaluate graphic design elements for AI model training. This part-time contract role offers remote work flexibility and requires expertise in design principles. Ideal candidates should have formal training... 
    Contract work
    Part time
    Remote work

    HumanSignal

    Austin, TX
    6 hours ago
  •  ...physical examinationsProvide verbal or written feedback to students in a constructive and professional mannerAccurately recall and evaluate student performance using checklists or formsMaintain confidentiality regarding case content and student performanceAttend... 

    University of Texas at Austin

    Austin, TX
    9 hours ago
  • $25 per hour

     ...examinations Provide verbal or written feedback to students in a constructive and professional manner Accurately recall and evaluate student performance using checklists or forms Maintain confidentiality regarding case content and student performance Attend... 
    Hourly pay
    Work at office
    Flexible hours
    Shift work
    Afternoon shift

    UT Medicine

    Austin, TX
    1 day ago
  •  ...WHAT YOU WILL BE DOING: We are seeking highly motivated AI Model Optimization & Software Engineer Interns/Co-op to join our teams...  ...TensorFlow, JAX, ONNX Runtime, vLLM, or SGLang. Develop or evaluate parallel and distributed computing methods, including collective... 
    Full time
    Summer work
    Internship
    Summer internship
    Worldwide

    AMD

    Austin, TX
    6 hours ago
  • $180k

     ...humanity understand the universe. Our teams are building the full Super Intelligence stack: from our Colossus supercomputers, to Grok models, to our suite of applications, including Grok Bot, Grok Build, Grok Imagine, Grok Voice, and X. We're creating a powerful flywheel... 
    Temporary work

    SpaceXSI

    Austin, TX
    28 days ago
  •  ...provide during the hiring process (interviews, assessments, background checks, as permitted by law) We use this information to: Evaluate your candidacy and qualifications Conduct interviews and background checks Manage our recruitment and hiring processes... 
    Permanent employment
    Flexible hours

    ESS

    Manor, TX
    4 days ago
  •  ...campus routines and regulations Other Demonstrates behavior that is professional, ethical and responsible Serves as a role model for all district staff Participates in approved professional development opportunities Performs other duties as assigned Knowledge... 
    Temporary work
    Local area

    Lake Travis Independent School District

    Austin, TX
    2 days ago
  • Part Time Food Service Substitute Work under moderate supervision to prepare and serve appropriate quantities of food to meet menu requirements. Maintain high standards of quality in food production, sanitation, and safety practices. Incumbent prepares menu items, as...
    Part time
    Local area
    Immediate start

    Austin Independent School District

    Austin, TX
    2 days ago
  •  ...use. Inference is where that happens: every product built on a model is bounded by what it costs to run, so the economics of serving...  ...own optimizations where they fall short. You will also build the evaluation discipline that makes a claim like “lossless at 2× throughput”... 
    Full time

    Bitdeer Technologies Group

    Austin, TX
    22 days ago
  •  ...Generalists with strong analytical and critical-thinking skills to support AI and data-focused projects. The role involves reviewing, evaluating, and annotating information across different topics while maintaining high accuracy and quality. Key Responsibilities... 
    Remote job
    For contractors

    YO AI Labs

    Austin, TX
    9 days ago
  •  ...use. Inference is where that happens: every product built on a model is bounded by what it costs to run, so the economics of serving...  ...What you will be responsible for: ~ This role builds the evaluation and decision systems that make agentic inference measurable, reliable... 
    Full time

    Bitdeer Technologies Group

    Austin, TX
    22 days ago
  •  ...provide during the hiring process (interviews, assessments, background checks, as permitted by law) We use this information to: Evaluate your candidacy and qualifications Conduct interviews and background checks Manage our recruitment and hiring processes... 
    Permanent employment
    Flexible hours

    ESS

    Manor, TX
    4 days ago
  •  ...utilizing professional assessment skills, the nursing process, and establish school health protocols. Supervise, monitor, and evaluate Health Room Assistant(s). Delegate nursing responsibilities to other unlicensed assistive personnel according to district policy... 
    Work at office
    Local area

    Austin ISD

    Austin, TX
    1 day ago
  • $56.29k - $65k

    Senior Administrative Program Coordinator, Standardized Patient Programs Hiring Department: Department of Medical Education Position Open To: All Applicants Weekly Scheduled Hours: 40 FLSA Status: Exempt from FLSA Earliest Start Date: Oct 05, 2026 Position...
    Work at office

    UT Medicine

    Austin, TX
    2 days ago
  •  ...partner to our Sales and Business Development teams for every Model Studio deal requiring custom solutioning. In this role, you will...  ...Technical Discovery: Partner with Sales and BD on calls to evaluate client model needs, latency tolerances, throughput requirements... 
    Full time
    Local area

    Bitdeer Technologies Group

    Austin, TX
    22 days ago
  • $80 - $120 per hour

     ...and Jack Dorsey . Position: Public health communications Evaluator Type: Contract Compensation: $80–$120/hour Location...  .... Provide clear, structured written feedback to improve AI model outputs . Apply deep subject-matter expertise in Public... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Austin, TX
    9 days ago
  • $80 - $120 per hour

     .... Position: Nonprofit / philanthropy / community programs Evaluator Type: Contract Compensation: $80–$120/hour Location...  ...and asynchronously to meet deadlines while improving AI model performance . Qualifications Must-Have ~5+ years of relevant... 
    Contract work
    Summer work
    Work at office
    Remote work

    Mercor

    Austin, TX
    9 days ago
  • $16 - $18 per hour

    Job Description Job Description Openwork is currently engaged in a search to find a lumber grader in South Austin. The lumber grader will be responsible for the safe and efficient movement of materials and products within the warehouse. The primary function will involve...
    Monday to Friday

    Openwork, LLC

    Austin, TX
    10 days ago
  • Job Description Job Description CatFace is a YouTube entertainment company, home to a family of channels with over 25 million combined subscribers and an average of 300 million views per month. Our goal is to entertain our audience with fun, light-hearted narratives...
    Work at office
    Relocation package
    Flexible hours
    Weekend work

    Catface

    Austin, TX
    15 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Model Evaluators. Be the first to apply!