Model Evaluator @ Austin, TX/Sunnyvale, CA- Hybrid -1+yr
Maintec Technologies
REQUIREMENT
Model Evaluator Project Duration: 1 year, with possible extension based on performance Location - Austin, TX/Sunnyvale, CA Work Type - Hybrid ( 3 days office must) Type of Visa - GC/Citizen - Independent Candidates only Technical Skills Strong understanding of LLMs, generative AI, and transformer-based architectures. Experience with Python, data analysis, and model evaluation frameworks. Familiarity with prompt engineering, embeddings, RLHF/RLAIF, and LLM-based scoring methods. Experience building evaluation datasets and working with annotation platforms. Understanding of safety alignment, bias detection, and adversarial testing. Tools & Platforms ML/AI frameworks: PyTorch, TensorFlow, HuggingFace, LangChain. Evaluation/annotation tools: Scale AI, GroundTruth, Labelbox, Prodigy. Prompt testing tools: Weights & Biases, MLflow, OpenAI evals, LLM-as-a-judge pipelines. Thanks & Regards, John Stanley - Sr. BDM / Delivery Manager Maintec Technologies Inc 8801 Fast Park Drive, Ste. 301, Raleigh, NC 27617 Mobile: View phone number on click.appcast.io / View phone number on click.appcast.io Email: View email address on click.appcast.io; | LinkedIn : Bangalore | Chennai | Hyderabad | Pune | Noida | USA Maintec TechnologiesVacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Model Evaluator @ Austin, TX/Sunnyvale, CA- Hybrid -1+yr in Austin, TX vacancy
- ...Practitioners (AANP) is seeking a Multimedia Communications Specialist to join our Communications and Marketing team in a hybrid role at our Austin, Texas HQ. You will create engaging multimedia and digital content spanning video, audio, graphics, and campaigns to advance...Suggested
$272k - $431.25k
...new generation of interactive world-model systems. With this release, NVIDIA has... ...building, adapting, or deeply evaluating world models, video generation systems... ...characteristic protected by law.SummaryLocation: US, CA, Santa Clara; US, TX, Austin; US, WA, SeattleType: Full timeSuggestedFull time$90 per day
Substitute Teaching Pool - Premier Austin Wells Branch Responsive Education Solutions 128 - Premier High School of Austin North, TX - Austin, Texas Open in Google Maps This job is also posted in Responsive Education Solutions Job Details Job ID: 5339469 Application...SuggestedTemporary workImmediate start- Community Impact in Pflugerville, TX is seeking a Multi-Platform Journalist to produce about 10 sponsored content pieces weekly across Austin, Houston, and Dallas-Fort Worth. The role blends storytelling, marketing, and technology, and focuses on relationships with business...SuggestedLocal area
- ...production tasks. Ideal candidates should have over 3 years of experience, excellent writing skills, and a bachelor's degree in a relevant field. This position is based in Austin, TX, offering an opportunity to work collaboratively in a dynamic environment. #J-18808-Ljbffr...Suggested
Insight Global
Austin, TX3 days ago - Now Hiring: Substitute Educators - Austin Austin, TX, US 3 days ago Requisition ID: 1659 Teachers Now is seeking dependable and passionate Substitute Teachers to support local K-12 schools throughout the Austin area. Whether you're gaining classroom experience, returning...Local areaImmediate startMonday to FridayFlexible hours
- Health & Human Services Commission in Austin, TX, seeks a Senior Substance Use Program Evaluator to lead evaluations and performance improvement initiatives within the Behavioral Health Services department. This role partners with executives and external stakeholders to...Remote work
- CXG is seeking luxury brand evaluators to discreetly assess customer experiences across premium brands. You may visit stores or evaluate online from home, providing honest feedback that helps brands refine services. Each assignment is designed for flexibility and busy...WorldwideFlexible hours
- CXG invites you to become a luxury brand evaluator, joining a global network that assesses customer experiences for premium brands. You will discreetly evaluate interactions across boutiques, online channels, or product returns, providing essential feedback to help brands...Flexible hours
- A global leader in customer experience is seeking a Freelance Luxury Brand Evaluator in Austin, TX. In this role, you will assess customer experiences with high-end brands by visiting stores or evaluating online. Enjoy flexible assignments and compensation based on your...FreelanceFlexible hours
- ...achievements through compelling narratives aligned with award criteria. The role focuses on storytelling, editing, and managing timelines, with a hybrid schedule across US offices. A passion for awards submissions and strong writing are essential. #J-18808-Ljbffr DLA Piper
$231.44k - $282.88k
...performance team to develop benchmarks for evaluating CPU / accelerator performance. The... ...simulators; from analytical to cycle-based models; from bare-metal environment to virtual... ...California, United States; Hsinchu, Taiwan; Austin, Texas, United States; Berkeley,...Full timeWork experience placement- ...JOB DETAILS: Location: San Jose, CA or Santa Clara,CA Onsite/Hybrid: This role requires the student to work... ...We are seeking highly motivated AI Model Optimization & Software Engineer Interns... ..., vLLM, or SGLang. Develop or evaluate parallel and distributed computing methods...Full timeSummer workInternshipSummer internshipWorldwide
$25 per hour
...constructive and professional manner Accurately recall and evaluate student performance using checklists or forms Maintain... ...School, Health Learning Building located at 1501 Red River St. Austin, TX 78712. Virtual work will also be available as needed to meet students...Hourly payFor contractorsWork at officeFlexible hoursShift workAfternoon shiftThe University of Texas at Austin
Austin, TX1 day ago- ...and writes with equal confidence and ships content fast without sacrificing quality. This is a full-time, on-site role based in Austin, TX, and embedded on the marketing team. You will travel to EnergyX project sites, partner facilities, and events to capture the...Full time
Energy Exploration Technologies
Austin, TX2 days ago - Spectrum News, part of Charter Communications, is hiring a Multimedia Journalist in Austin, TX, to tell local stories with impact across TV, connected TV, and the Spectrum News app. You’ll produce accurate, engaging reports, shoot video, edit, and distribute content quickly...Local areaShift workWeekend work
- ...driven, deeply technical Product Manager to own AI inference and model serving for k0rdent AI, our control plane for GPU... ...reasoning across the full stack, identifying performance bottlenecks, evaluating system design trade-offs, and translating technical insight into...
- ...AI Labs is seeking an Investment & Finance Expert to work remotely as a contractor. The role focuses on evaluating AI outputs related to valuation, financial modeling, markets, and investments, and crafting expert prompts plus reference answers to improve model...Remote jobFor contractors
- ...nurse, click here . Qualifications TX Nurse Certification - Varies by District... ...law) We use this information to: Evaluate your candidacy and qualifications Conduct... ...here if you are a California resident: CA Privacy Policy Click here if you...Permanent employmentFlexible hours
ESS
Manor, TX14 hours ago - YO AI Labs seeks a Hebrew Bilingual Expert to evaluate Hebrew audio content for AI training in a remote contractor role. You will assess... ...linguistic quality, providing clear feedback to help improve model performance. No prior AI experience is required; strong Hebrew...Remote jobFor contractors
- YO AI Labs is seeking Polish Bilingual Experts to contribute to an AI training project by evaluating Polish audio content and providing feedback on nativeness, fluency, and linguistic quality. You will document assessments in English, follow guidelines, and collaborate...Remote job
$158.4k - $237.6k
...platforms enabling efficient inference of large-scale foundation models. We are seeking a Staff Engineer - AI Model Optimization... ...numerical methods, performance/accuracy trade-off analysis, or evaluation frameworks. PhD in a relevant field. Minimum Qualifications Bachelor...Work experience placement- ...use. Inference is where that happens: every product built on a model is bounded by what it costs to run, so the economics of serving... ...own optimizations where they fall short. You will also build the evaluation discipline that makes a claim like “lossless at 2× throughput”...Full time
Bitdeer Technologies Group
Austin, TXa month ago - Apptronik in Austin, TX is seeking a master visual storyteller—a lead Writer/Producer who translates hardware and robotics into sharp, cinematic narratives, guiding projects from pitch to final delivery. You will direct on-set talent, oversee production, and collaborate...
$10k
Do you have enormous energy, big dreams, and tons of personality? Could you light up social media if just given the chance? Here’s your shot. Orca Communications wants fresh, bold talent to train as the next digital superstar. Don’t sweat your resume. We want ambition,...Remote workORCA Communications
Austin, TX1 day ago- ...dependable, and possess a high school diploma or equivalent. Experience in acting or healthcare education is preferred. The position requires onsite work at the Dell Medical School in Austin, with variable weekly hours based on business needs. #J-18808-Ljbffr Phase2 TechnologyFlexible hours
- ...Generalists with strong analytical and critical-thinking skills to support AI and data-focused projects. The role involves reviewing, evaluating, and annotating information across different topics while maintaining high accuracy and quality. Key Responsibilities...Remote jobFor contractors
YO AI Labs
Austin, TX14 days ago $25 per hour
The University of Texas at Austin is seeking a Standardized Patient to portray patient scenarios and assist students in developing their clinical skills. This role requires excellent communication skills and the ability to accurately recreate medical scenarios. The position...Hourly pay- Newmark Group seeks a Senior Appraiser to independently appraise complex commercial real estate for disputes, financing, acquisitions, and portfolio analysis. You will prepare comprehensive reports, inspect properties, and engage directly with clients. You will apply valuation...
Newmark Group
Austin, TX4 days ago - ...checks, as permitted by law) We use this information to: Evaluate your candidacy and qualifications Conduct interviews and background... ...below. Click here if you are a California resident: CA Privacy Policy Click here if you reside in all other...Permanent employmentFlexible hours
ESS
Manor, TX14 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Model Evaluator @ Austin, TX/Sunnyvale, CA- Hybrid -1+yr. Be the first to apply!
