LLM Evaluation & Verification Lead
DeepRec.ai
A leading AI technology firm in Redwood City is seeking an LLM Evaluations Engineering Lead. In this full-time position, you will be responsible for building evaluation systems for agentic LLMs, ensuring improved performance and reliability. Ideal candidates have strong software engineering skills and deep understanding of evaluation methodologies for machine learning. Join to work on impactful AI systems with the autonomy to shape their development. #J-18808-Ljbffr DeepRec.ai
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the LLM Evaluation & Verification Lead in Redwood City, CA vacancy
- Gordon and Betty Moore Foundation seeks an Adaptive Management and Evaluation Officer (Science) and Manager, External Evaluations to lead design, planning, and day-to-day management of external evaluations within the AME department. Based in Palo Alto, CA, this hybrid...Suggested
$110k - $150k
...of climate change. We're hiring a Growth Lead to own go-to-market execution for our flagship... ...and talk directly to customers to evaluate satisfaction Design viral features and implement... ...prototypes. Bonus if you've built with LLM APIs. Experience running pricing experiments...SuggestedWork at office3 days per week- Sanas is building a full Speech AI suite and seeks an Evaluations Lead who designs evaluation frameworks and benchmarking systems. This role sits at the intersection of research, product, and infrastructure to build metrics and studies that hold models accountable. You...Suggested
$21 - $24 per hour
...assigned cash register, including records of scanning errors, price verifications, items not on file, price modifications, and voids. Assists... ...package). Assists manager or assistant store manager in evaluating and developing displays, including promotional, seasonal,...SuggestedHourly payWork experience placementSeasonal workLocal areaShift work- ...looking for a Founding Member of the Technical Staff for the Design Verification team. This role involves owning the verification strategy... ...processes, solid coding skills in verification tools, and a desire to lead the validation function as the team grows. #J-18808-Ljbffr...Suggested
- ...Science. This facility provides world-leading scientific capabilities to a global user... ...level. Appointment at this level requires evaluation of the candidate's scientific... ...and maintain a HSPD-12 Personal Identify Verification (PIV) Credential. To obtain this credential...Work at officeLocal area
- ...Ambassador embodying Coach values and increasing brand awareness. Leads implementation of Company initiatives and support full... ...Supports the store with recruiting, interviewing, performance evaluation, high-level training as needed. Provides necessary feedback and...Minimum wageShift work
$173k - $203k
...people participate in the growth of private companies. As a Deal Lead for Robinhood Ventures, you will be at the forefront of... ...You will manage the full investment lifecycle—from sourcing and evaluation through investment committee materials, negotiation support, and...Work at officeFlexible hoursShift work3 days per week- NeoCognition Inc. is seeking a Member of Technical Staff for research on LLM agents in Palo Alto, California. You will lead research projects and collaborate with engineers to create impactful AI systems. Essential qualifications include a solid foundation in machine learning...
$244k - $305k
...The Opportunity:The Senior Director, Molecule Global Regulatory Lead will develop and execute global regulatory strategy for assigned... ...opportunities for expedited pathways.Anticipate regulatory risks, evaluate potential impact, and develop proactive mitigation strategies....Full timeLocal area$215k - $260k
...Connectivity Systems Integration and Test Lead on the Embedded Software team, you will... ...proactively design, facilitate, and evaluate advanced testing campaigns—utilizing industry... ...potential inconsistencies or verification signals in application materials based on...Full timeTemporary workRelocation package- ...and humility.Your Role:We’re looking for a Lead Product Manager to define and drive the... ...area.Stay ahead of AI trends: Continuously evaluate emerging LLMs, multimodal capabilities, and... ...externally.Demonstrated experience using AI/LLM-based tools (such as analytics/product...Contract workTemporary workWork at officeFlexible hoursNight shift
$26.75 - $29.25 per hour
...performance, including conducting regular check‑ins and mid‑season evaluations Ensure adherence to state and camp policies Report and record... ...and able to calm those around you? Are you comfortable leading groups of kids on your own while still collaborating with a team...Hourly paySummer workShift workSteve and Kate's Camps
Menlo Park, CA4 days ago$144k - $180k
...product portfolio of cutting-edge molecular diagnostic tests. As a Lead Biostatistician, you will leverage your strong applied... ...knowledge of probability theory and statistics including the ability to evaluate and produce novel methods and applicationsFamiliarity with...Immediate startWorldwide- About PoshmarkPoshmark is the leading fashion marketplace where style comes alive through discovery, self-expression, and human connection... ..., execute, and analyze A/B tests and quasi-experiments to evaluate the impact of new features, algorithms, and merchandising campaigns...
$95.8k - $118.25k
...examination, 2-step PPD test for tuberculosis, acceptable criminal background clearances, excluded party sanctions, and degree or license verification. If the position requires driving, valid driver’s license, a motor vehicle clearance and proof of auto insurance is required at...Hourly payFull timePart timeLocal areaRelocation packageMonday to FridayShift workNight shiftWeekend workDay shiftTelecare Corporation
San Carlos, CA2 days ago- ...purpose here. Job Description Primary Function: As a Lead Cytopathologist, you will serve as a medical and scientific expert... ...for dataset curation, annotation strategy, and algorithm evaluation, ensuring that our products are clinically robust and aligned with...Full timeWork at officeLocal areaWorldwideFlexible hoursShift work
Intuitive
San Carlos, CA2 days ago $196k - $242k
...design progression schedules, and requirement compliance and verification Lead with geometry - Engage daily in the vehicle CAD and drive... ...tools, preferably CATIA V5/V6 or 3DX, and lightweight geometry evaluation software (e.g., Vis-Mockup) and establishing digital mockup...Full timeRemote workWaymo
Mountain View, CA3 days ago- ...department, drive profitability, control expenses, and ensure compliance with health and safety standards. You will hire, develop, and evaluate team members, and collaborate with store leadership to deliver exceptional customer service and premium product quality. You will...
$140.4k - $175.5k
...rapidly scaling global organization. You’ll lead process mapping and redesign across our... ...workflow automation, case deflection, or LLM‑assisted tools can eliminate manual lift -... ...engineering teams to define requirements, evaluate options, and prioritise work across platforms...Hourly payFull timeContract workTemporary workPart timeLocal areaImmediate startShift workDay shift- ...directly with the CEO and our outbound SDR. First 2 weeks: audit our current outbound, pick 3 experiments, and run them. We evaluate based on experiments launched, quality of execution, and pipeline generated. To Apply Skip the generic cover letter. Instead...Full timeContract work
- ...operations of the Prepared Foods department, ensuring top-notch displays, cleanliness, and customer service. You will train, mentor, and evaluate Team Members, delegate tasks, manage inventory, and help maintain regulatory compliance while promoting the store's core values...
$111k - $167k
.... Description The Regulatory Compliance Lead is a technically grounded individual contributor... ...decision-making, including performance evaluation, clinical equivalence assessments, and... ...and vigilance activities for LLM or AI/ML-enabled products, including real...Full time$200k - $247k
...code and prompts, guiding system design decisions, and defining evaluation methodologies and performance benchmarks. Partner with... ...technical stakeholders We prefer: Deep expertise integrating AI and LLM solutions securely with major enterprise SaaS platforms (e.g.,...Full timeRemote work$141k - $205k
Google’s Education unit aims to democratize learning, leveraging artificial intelligence to empower people with knowledge and skills. The Learning Science team collaborates with Gemini, Search, YouTube, and Classroom to build high-quality educational products grounded in...$63.37 - $79.18 per hour
...performance to supervisorProvides feedback during performance evaluations for team membersMeets regularly with the SupervisorKeeps team morale... ...health and enable earlier and more targeted interventions that lead to longer, healthier lives.The Natera team consists of highly...Immediate startWorldwide$144k - $180k
...Lead Biostatistician (IVD Clinical)San Carlos, CAThis is an exciting opportunity to advance Natera's regulated product portfolio of... ...knowledge of probability theory and statistics including the ability to evaluate and produce novel methods and applicationsFamiliarity with...Natera
San Carlos, CA5 days ago- About PoshmarkPoshmark is the leading fashion marketplace where style comes alive through discovery, self-expression, and human connection... ...platforms, shipping solutions, and analytics providers. Evaluate new integration opportunities, define partner standards, and ensure...Work experience placement
$1,000 per month
As Lead Recruiter, you will own full-cycle recruiting for complex and high-impact roles across assigned functions or business areas.... ...throughout the hiring process Leverage recruiting data and metrics to evaluate pipeline health, sourcing effectiveness, and process efficiency;...Permanent employmentFull timeTemporary workWork at officeWork from homeFlexible hours- ...preparing for and performing procedures consistently following sterile technique, infection control guidelines and department standards. Evaluates personal and departmental work volume and flow to ensure efficient departmental patient care. Prioritizes work according to...Relocation package
Sequoia Hospital
Redwood City, CA4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to LLM Evaluation & Verification Lead. Be the first to apply!
