Assessment Design Lead - Shape Scalable Language Testing
Socket.dev
Speak is hiring an Assessment Design Lead to define measurement constructs, rubrics, and item specs for its language assessments. You will own content validity, develop scoring rubrics, and guide calibration with ML engineers, ensuring fairness and alignment to CEFR and external standards. You’ll work closely with Product and ML teams on automated scoring, validation studies, and test development. This role reports to the Head of Learning Design and Curriculum and is located in San Francisco. #J-18808-Ljbffr Socket.dev
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Assessment Design Lead - Shape Scalable Language Testing in San Francisco, CA vacancy
- ...learn, starting with language. Learning a... ...through carefully designed lessons. The result... ...one of the world’s leading AI companies, with... ...standalone proficiency tests to onboarding... ...re looking for an Assessment Design Lead: the person... ...want to directly shape Speak's efficacy...LanguageLive inImmediate startRemote work
$242.8k - $357k
...Engineer, you will lead the technical... ...and shape how ads are selected... ...verticals. You will design and build next-... ..., and large language models (LLMs).... ...and online A/B testing, and continuous... ...innovation by assessing emerging research... ...into scalable, production-ready...LanguageHourly payWork at officeLocal areaRemote workFlexible hoursDoordash Usa
San Francisco, CA1 day ago$82.7k - $129.8k
...processes, and launch execution across 29 languages. You'll join a lean team of senior... ...quality processes: coordinate testing, build LQA workflows and propose improvements... ...or Japanese preferredExperience designing and implementing scalable localization processes and technical...LanguageFlexible hours$113.5k - $259.5k
...’re all in to shape your future with... .... Our market-leading approach... ...for shaping, designing, and delivering... ...solutions are scalable, compliant, integrated... ..., data flows, testing approach,... ..., feasibility assessments, and vendor evaluations... ...or Portuguese language capability is...SuggestedSummer holidayLocal areaFlexible hours- ...addresses.About the roleThe Rippling Design System team is responsible for... ...positions at Rippling. As a Lead Designer on the Design Systems... ...and manage our global design language and library of components.... ...through sketches, prototypes, and testing.Work with Engineering to...LanguageWork at office3 days per week
- ...Rippling.com addresses.About the roleAs a design lead for Data Cloud, you'll own how customers... ...are involved through iteration, testing, and launch. They own the outcome of their... ....Design how customers move from a plain-language question ("show me attrition by team since...LanguageWork at office3 days per week
- ...understand, trust, and use. As a Lead Product Designer on the AI Platform team, you... ...’s product suite and shape the patterns, systems, and interaction... ...and codifying patterns into scalable guidance.Stay close to... ...you should be fluent in the language, trade-offs, and constraints...LanguageWork at office3 days per week
- ...evolve the app's visual language across illustration, photography... ...with product design, brand, and marketing to maintain a cohesive, scalable, and distinctly ŌURA aesthetic. You will lead by example, advocating for... ...freelance‑first mindset while shaping the next chapter of #J-...LanguageFreelance
- ...ourCitywhat it is today, but also in shaping the future of San Francisco.... ..., interview findings, assessments recommendations for the treatment... ...appropriate psychological tests of intelligence, personality,... ...fluency in a variety of languages, depending upon the department...LanguagePermanent employmentFull timeTraineeshipWork experience placementInternshipLocal areaTrial periodMonday to Friday
- ...resistance to oppression have shaped the city's historical... ...Creative: You will design and maintain... ...position requires bilingual language skills, only those candidates... ...a language proficiency test if selected for hire.... ...invited to participate in an assessment process (or testing) to...LanguagePermanent employmentFull timePart timeLocal area
City of Oakland
Oakland, CA1 day ago - ...Data to be a technical lead and help architect... ...the reliability and scalability of our Ingestion,... ...lifecycle, including designing, generating code, testing, monitoring and releasing... ...in programming languages such as Python/Kotlin... ...empower local economies shapes how our team members...LanguageHourly payWork at officeLocal areaRemote workFlexible hours
- ...routinesImprove the reliability and scalability of our ETL... ...development lifecycle, including designing, generating code, testing, monitoring and releasing... ...in programming languages such as Python/Java3+ years... ...empower local economies shapes how our team members move...LanguageHourly payWork at officeLocal areaRemote workFlexible hours
- ...individual's freedom. OKX is a leading crypto exchange, and the... ...shared values drive our culture, shape our processes, and foster a... ...process evaluations, and control assessments to identify operational... ...preparing process flowcharts and testing procedures for key controls....Remote work
OKX
San Francisco, CA1 day ago $38.21 per hour
...expansive network, industry-leading pay, and we are growing faster... ...Additional compensation for language skills, lead positions, and international... ...to pass a functional reach assessment with a combined 76-inch... ..., and vision/hearing tests. Must be able to pass DOT/...LanguageHourly payFull timeTemporary workTraineeshipRelocationTrial periodFlexible hoursNight shiftWeekday workUnited Airlines
San Francisco, CA4 days ago- ...heart of everything the Design org builds. Our... ...each content designer shaping the experience and bringing... ...through clear, thoughtful language that makes our three-... ...tools into A/B testing platforms so teams can... ...translate workflows into scalable products.Systems thinking...LanguageHourly payWork at officeLocal areaRemote workFlexible hours
$68k - $102k
...of care.Backed by leading healthcare venture... ...process—you'll help shape the future of how... ..., or other languages commonly spoken by... ...medicine, biomarker testing, or molecular diagnostics... ...insurance options designed to support your... ...include a technical assessment, case study,...Temporary workWork at officeLocal areaRemote workHome officeFlexible hours3 days per week$180k - $400k
...applications across simulation, design, and play. Our first... ...Instrument automated testing and feedback systems... ...ensuring reliability, scalability, and developer usability. Quickly assess and refine Roam's... ...finetuning diffusion and language models Work in research...LanguageFull timeVisa sponsorshipRelocation packageROAM
San Francisco, CA2 days ago- ...illnesses, and disordersOrders, performs, and interprets diagnostic tests and explains the results to patientsMay hospitalize NEMS... ...fellowship.Current documentation of Basic Life Support is required.LANGUAGE:Must be able to fluently speak, read and write English.Fluent...LanguageFull timeLocal area
- ...resistance to oppression have shaped the city's historical... ...more of the following languages: Cantonese, Mandarin,... ...skills will be tested prior to a final offer... ...Psychological and Medical Assessment: Final candidates... .... CritiCall 3D is designed to measure applicant's...LanguagePermanent employmentFull timeContract workWork experience placementLocal areaImmediate startMonday to FridayFlexible hoursShift workWeekend work
City of Oakland
Oakland, CA4 days ago $210k - $245k
...companies impact and change the world.Design at a16zMost design orgs are... ...'re hiring a Design Systems Lead to own and evolve that... ...intuitive command of the a16z visual language, half thinking in components,... ...a16z brand systems into scalable templates, components, and modular...Language$159k - $259.7k
...organizations across seven languages and 190 countries... ...closely with designers, product managers... ...will directly shape the future of... ...ensuring performance, scalability, and reliability.... ...through rigorous testing, debugging, and... ...and assessed on a case-by-case...LanguageFull timeLocal areaFlexible hoursCalm
San Francisco, CA1 day ago$100k - $150k
...the Founding Product Designer role at Nowadays (YC S... ...play a pivotal role in shaping our tech, product, and... ...identity, from visual language to tone and voice Design... ...and usability testing to validate designs before... ...polished, trustworthy, and scalable Help us avoid design...LanguageFull time$230k - $385k
...engineering, product, research, and design to build the foundational... ..., and Safety partners to shape Android architecture that supports... ...sessions.Establish and evolve testing and quality systems, including... ...systems maintainable, testable, and scalable.Care deeply about performance,...Work at officeLocal areaRelocation packageFlexible hours$130k - $175k
...productivity platform designed to empower users with... ...are passionate about shaping the future of AI and technology... ...regular reviews and testing to optimize website... ...: Write clean, scalable, and maintainable code... ...determined by multiple factors assessed during the interview...Full timeImmediate startWork from homeFlexible hoursYou.com
San Francisco, CA1 day ago$148.5k - $223.9k
...at the company leading workforce transformation... ...traditional testing to using AI in... ...& Adoption: Design, build, and maintain scalable, AI-first testing... ...evaluating Large Language Models (LLMs) for... ...today to not only shape the future — but... ...our recruiters assess and evaluate...LanguageFull time- ...ecosystem of libraries for scalable machine learning.... ...distributed scheduler, language runtime integration, I/... ...distributed libraries, test infra improvements, debugging... ...role, you will: Leading cross-team projects while... ...structures, system design Knowledge of distributed...LanguageFull timeWork experience placement
Anyscale
San Francisco, CA1 day ago - ~ LANGUAGE : Spanish Interpreter As a remote interpreter, you play a significant role in facilitating communication between Spanish... ...payments ~ Per minute rate ~*Based on your location, language testing, background check and/or drug screen may be required*...LanguageFull timeRemote workWork from homeHome officeShift work
One World Global Services LLC
San Francisco, CA5 days ago $134.16k - $213.6k
...Contracts workstream scalable — so the team... ...deal cycle times.Shape the Security Contract... ...Review Strategy: Design and own the end-to... ...identified gaps, assess feasibility and propose... ..., and penetration testing provisions.Ability... ...security contract language looks like in...LanguageContract workWork experience placementWork at officeLocal area$172.5k - $260.1k
...at the company leading workforce transformation... ...outcomes, and shape GTM strategy... ...and execution.Design measurement... ...productivity.Build scalable analytical... ...one programming language for data science... ...design, A/B testing, causal inference... ...our recruiters assess and evaluate candidates...LanguageFull time$180k - $215k
...-invasive cardiac test supported by the ACC... ...RoadMapAnalysis), assess coronary blood... ...Staff level to help shape technical strategy... ...canvas opportunity to design production-grade... ..., secure, and scalable Agentic AI platform... ...applications with Large Language Models (LLMs) and...LanguageLocal areaWorldwideRelocation
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Assessment Design Lead - Shape Scalable Language Testing. Be the first to apply!
Related searches
- interior design coordinator San Francisco, CA
- product design lead San Francisco, CA
- design coordinator San Francisco, CA
- ux design lead San Francisco, CA
- language arts San Francisco, CA
- natural language processing San Francisco, CA
- language internship San Francisco, CA
- language subtitle San Francisco, CA
- dual language San Francisco, CA
- language San Francisco, CA