Data Scientist - LLM Evaluation & Survey Design
$141.8k - $258.6kApple Inc.
Apple Inc. in Cupertino, California is seeking a Data Scientist to join the Special Projects team. The role involves developing user-facing features leveraging multimodal capabilities. You will design and manage data annotation processes, work with ML Engineers, and develop LLM auto-judges for AI model evaluation. The ideal candidate has a BA/Master’s in a relevant field and at least 2 years of experience in survey design and data annotation. Compensation ranges from $141,800 to $258,600 depending on qualifications. #J-18808-Ljbffr Apple Inc.
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Data Scientist - LLM Evaluation & Survey Design in Cupertino, CA vacancy
$141.8k - $258.6k
Data Scientist - Survey Design, Data Annotation, and Machine Learning Evaluation Cupertino, California, United States Machine Learning and AI Apple is where individual imaginations... ...processes, and to develop, test, and refine LLM judges for generative AI model evaluation. A...SurveysRelocation$188k - $275k
...programming languages used for data manipulation and computational... ...methods like logs analysis, survey research, and regression. We value... ...blend of behavioral research design, statistical proficiency, and... .... Lead teams to define and evaluate product, service, and ecosystem...Surveys$171.23k - $205.6k
...Employer: Amazon Web Services, Inc. Position: Data Engineer II Location: Cupertino, CA Multiple Positions Available: Design, develop, implement, test, document, and... ..., usable dataset documentation and metadata. Evaluate and make decisions around dataset implementations...SuggestedLocal areaRelocation packageAmazon
Cupertino, CA3 days ago$188k - $275k
...programming languages used for data manipulation and computational... ...methods like log analysis, survey research, and regression. We value... ...blend of behavioral research design, statistical proficiency, and... ...recommendations. Lead teams to define and evaluate product, service, ecosystem...Surveys$188k - $275k
...programming languages used for data manipulation and computational... ...methods like logs analysis, survey research, and regression. We value... ...blend of behavioral research design, statistical proficiency, and... .... Lead teams to define and evaluate product, service, ecosystem impact...Surveys$181.1k - $318.4k
...you could accomplish. The AIML Evaluation org works with teams across... ...maintain the highest standards for data quality and user privacy... .... Description As a Data Scientist on the AIML Evaluation team,... ...- consulting on new feature design, flagging privacy considerations...Relocation$141.8k - $258.6k
...Apple Maps is changing, and data is in the driver’s seat. Our... ...focused environment where Data Scientists are given runway to own big projects... ...team, focusing on the deep evaluation of Apple Maps search services... ...closely with Product, Design, Engineering, and Marketing to...Work experience placementRelocation$224k
...everyone, everywhere. We design cutting-edge tech... ...across Product, Data Science, AI/ML,... ...a well-designed survey as in a well-tuned... ...experience metrics, and AI evaluation rubrics — that... ...challenges like LLM output quality,... ...Researchers, AI/ML scientists, Data Science, Product...SurveysLocal areaFlexible hours$194k - $262.5k
...Intuit Customer Success (ICS) Data Science team as a Staff Data Scientist. This role will be... ...business segments. You will Design, build, and ship GenAI... ...intersection of data science, LLM engineering and... ...online evals. Implement evaluation & observability with ground...Work experience placementLocal areaIntuit
Mountain View, CA4 days ago- Rhoda AI in Mountain View is seeking a candidate to design scalable curation pipelines for web-scale video pretraining data, focusing on ingestion, deduplication, and content classification across internet-scale video corpora. The ideal candidate will have a strong understanding...
$2,000 per month
...hardware for frontier intelligence. We co-design chips, racks, software, and manufacturing... ...-class physical infrastructure. As a Data Center Engineer at Etched, you will own the... ...co-location vendors and internal teams to evaluate sites, negotiate contracts, and enforce SLAs...Work at officeRelocation packageShift workETCHED LLC
San Jose, CA4 days ago$50 - $70 per hour
...THE OPPORTUNITY FOR YOU • Design & conduct research to guide the... ...experimentation, statistical analysis, and surveys, supplemented by qualitative methods as needed • Evaluate and iterate on audio and... ...complete research, including data collection, data analysis,...SurveysLocal areaRemote workFlexible hoursINSPYR Solutions
Menlo Park, CA2 days ago$72.96k - $115.2k
...What this Job Entails The Data Center Engineer III will be heavily involved in the design of the datacenter collocations, infrastructure hardware, and provide technical consultations. The incumbent will build/create all drawings for datacenter POP’s and develop/write Scopes...Full timeTemporary workWork at officeFlexible hoursDormont Manufacturing Company
Cupertino, CA3 days ago$159k - $231k
...programming languages used for data manipulation and... ...C++, Java, or Go). Experience designing and executing a wide range of... ...methods (e.g., A/B testing, survey, log analysis). Experience with... ...engineers, designers, and data scientists to identify research needs, execute...Surveys- ...helping Toyota Research Institute find a Data Engineer to design and build the data systems that power... ...modeling, scenario analysis, and LLM-enabled workflows. You’ll partner closely... ...researchers, technical leads, research scientists, and Toyota stakeholders to develop...Ongoing contractFull timeContract workTemporary workLocal areaVisa sponsorshipFlexible hoursShift work2 days per week
HireArt
Los Altos, CA5 days ago $141.8k - $258.6k
...Silicon Technologies group, you'll help design and manufacture our next-generation, high... ...design, creation, and enhancement of our data infrastructure, which underpins the productization... ...entail close collaboration with data scientists, analysts, and product teams to establish...RelocationApple
Cupertino, CA1 day ago- Rhoda AI in Palo Alto is seeking Research Scientists and Engineers to develop the foundational data and evaluation methods for video action models. This role involves designing scalable video data curation pipelines and enhancing model performance through rigorous evaluation...
$147.4k - $272.1k
...problems? The Video Engineering Data Analytics and Quality group is seeking an expert in evaluating machine learning and deep... ...methods and modern techniques like LLM-as-a-Judge. The ideal candidate... ..., including ML engineers, data scientists, and ML Infrastructure engineers...Relocation$150k
...Data Engineer Specializing In Natural Language Processing... ...researchers, data scientists, and engineers,... ...including web crawling, LLM-generated content refinement... ...processes. Refine and evaluate outputs from Large... ...Demonstrated proficiency in designing and deploying web...Visa sponsorshipInstitute of Foundation Models
Sunnyvale, CA1 day ago$185k - $200k
...of our platform — an AI-native data foundation that will power... ...of this team, responsible for designing and building the Databricks-first... ...that unifies all research data — surveys, qualitative feedback, CRM,... ...OpenSearch Exposure to AI agent and LLM-serving infrastructure...SurveysWork experience placementWork at officeRemote workFlexible hoursNight shiftGrabJobs
San Jose, CA3 days ago- ...technology company in Cupertino, California, is seeking a Data Software Engineer to design and maintain scalable data infrastructure for its... ...software and data engineering, collaborating with data scientists and optimizing data processing workflows. Applicants should...
- DRISHTICON Inc is seeking a Data Engineer to support our client in Sunnyvale, CA, for a hybrid long-term contract position. The Data Engineer will design, develop, and deploy enterprise-scale big data solutions, primarily using Hadoop ecosystem technologies. The ideal candidate...Long term contract
$159k - $231k
...Experience in programming languages used for data manipulation and computational statistics... ...empirical methods like logs analysis, survey research, and regression. We value... ...and require a blend of behavioral research design, statistical proficiency, and programming...SurveysTemporary work- Sekai is seeking a Founding Analytics Engineer to build the data modeling layer behind its product and company decision-making. You will design trusted datasets for analytics, work closely with product and engineering teams, and support data quality standards in a remote...Remote work
- ...redefining mobility. Through a human‑centered design process, we create vehicles and... ...foundational hire. As a Staff Product Data Scientist , you’ll help define how analytics informs... ...to participate in a company vehicle evaluation program, though which you will be assigned...Immediate startFlexible hours
- Uber is seeking a Senior Data Scientist for the Merchant Optimization team. You will identify optimal merchant selection and pricing models... ...merchant ROI and drive growth in the Delivery business. You will design experiments, collaborate with product and engineering, and...
$181.1k - $318.4k
...Cupertino, California is searching for a Senior Software Engineer to design and implement AI-powered software systems in compliance with... ...in modern engineering practices, AI integration, and data pipeline development. Collaborate closely with domain experts, maintaining...- ...located in Cupertino is seeking an experienced Machine Learning Engineer to develop data generation methodologies and quality assessment systems. This role involves designing automated evaluation systems and collaborating on data requirements. Candidates should have 6+ years...
$181.1k - $318.4k
...Engineer - Regulatory AI & Connected Data Cupertino, California, United... ...on this team, you will design, build, and ship software systems... ...systems with appropriate evaluation, guardrails, and monitoring -... ...for traceability/lineage for AI/LLM based decisions Establish and...Work experience placementImmediate startRelocation$60 per hour
...• Conduct discovery through interviews, surveys, usability tests, and systems deep-dives... ...our customers. Our expertise in strategy, design, execution and operations unlocks... ...process, including sourcing, screening, and evaluating candidates. AI helps assess applications...SurveysContract workTemporary workFor contractorsRemote workTEKsystems
Cupertino, CA9 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Scientist - LLM Evaluation & Survey Design. Be the first to apply!
Related searches
- python data scientist Cupertino, CA
- data scientist (hedge fund) Cupertino, CA
- python data scientist (contract) Cupertino, CA
- healthcare data scientist Cupertino, CA
- energy data scientist Cupertino, CA
- data scientist Cupertino, CA
- data Cupertino, CA
- data collection researcher Cupertino, CA
- provider data management Cupertino, CA
- clinical data Cupertino, CA