Staff Engineer - LLM Benchmark Platform
Vals AI, Inc.
Vals AI, Inc. is seeking exceptional engineers to own and scale our benchmarking platform. You’ll work across the stack—Python/Django backend, React/TypeScript frontend, and distributed cloud infrastructure—building reliable, high-performance systems for evaluating LLMs at scale. You will drive architecture decisions, mentor teammates, and collaborate with research to ensure infrastructure meets rigorous requirements. #J-18808-Ljbffr Vals AI, Inc.
Vacancy posted 13 hours ago
Similar jobs that could be interesting for youBased on the Staff Engineer - LLM Benchmark Platform in San Francisco, CA vacancy
$298k - $368k
...can also be applied to a range of vehicle platforms and product use cases. The Waymo Driver... ...from a diverse set of sensors, enabling engineers like you to (1) develop methods for efficiently... ...hardware. You will: Design VLM/LLM model architecture and drive strong...PlatformFull timeRemote workWaymo
San Francisco, CA13 hours ago$150k - $300k
Prime Intellect is looking for a skilled ML Systems Engineer to build and optimize LLM serving infrastructure and inference systems. This hybrid role... ...ML services, strong knowledge of Python and cloud platforms, and a desire to work on cutting-edge AI infrastructure....PlatformRelocation package- .... You will train frontier models, evaluate quality, and build benchmarks while shaping the public research narrative. You will publish findings, contribute to platform tooling, and help grow the engineering team. Expect startup speed, strong product ownership, and direct...Platform
- ...made significant strides in LLM quality for these products. These... ...are seeking multiple GenAI Engineers from junior levels to more... ...products, and strengthening our platform architecture to enable... ...training datasets, and evaluation benchmarks. ~ Proficiency in Python, TensorFlow...PlatformFull timeWork at office
Databricks
San Francisco, CA13 hours ago $252k - $315k
...remains one of the hardest engineering challenges.As a Staff Frontier Agent Engineer (... ...designing a customer intelligence platform, a healthcare copilot, or... ...frameworks using offline benchmarks, online A/B experiments,... ..., regression suites, LLM-as-a-Judge, and human evaluation...PlatformFull time$220k - $280k
...applications. Our Voice AI platform powers production-grade, real... ...reliability. We're looking for a Staff ML Engineer to drive the model serving... ...inference engines like TRT-LLM and SGLang to optimize how... ...TTS; establish the internal benchmark methodology that informs...PlatformFull timeTogether Ai
San Francisco, CA13 hours ago$190k - $285k
...made significant strides in LLM quality for these products. These... ...are seeking multiple GenAI Engineers from junior levels to more... ...products, and strengthening our platform architecture to enable... ...training datasets, and evaluation benchmarks.Proficiency in Python, TensorFlow...PlatformWork at officeLocal areaWorldwide$180k - $247k
...Identity belongs to you.The Staff Product Security Engineer OpportunityThe Security... ...can do for security, from benchmarking SOTA frontier models and fine... ...and secure internal AI platforms, agentic execution runtimes... ...orchestration layers, and LLM-integrated services.Deliver...PlatformLocal areaWorldwideFlexible hours$231k - $318k
...a technology wholesale platform built on the belief that... ...less like a search engine and more like a trusted... ...and what will sell.As a Staff Engineer on the Search... ...AI frontier: Integrate LLM-powered capabilities, such... ...strict industry latency benchmarks.You’ll drive cross-...PlatformWork experience placementWork at officeLocal areaRemote workMonday to FridayFlexible hours3 days per week$238k - $297k
...create evaluations, publish benchmarks, and push the boundary... ...Work alongside engineers, scientists, operators,... ...Handshake is hiring a Staff Machine Learning Engineer... ...notifications across the Handshake platform. You'll operate as a... ...Retrieval and LLM Post Training recipes is...PlatformFull timeWork at officeRemote workFlexible hoursHandshake
San Francisco, CA12 days ago- ...physical product creation platform, where imagination becomes... ...Role We're looking for a Staff Applied AI Engineer to architect the ML systems... ...measurement systems (not one-off benchmarks) that real engineering... .../ text-to-image models and LLM-based applications, including...PlatformFull time
Arcade
San Francisco, CA13 hours ago - ...Role We are seeking a Staff Machine Learning Engineer with deep expertise in... ...frameworks — automated testing, benchmarking, regression testing,... ...performance in production. Drive LLM and ML model development —... ...(or advanced analytics platforms) — designing, optimizing,...PlatformFull time
Medeloop
San Francisco, CA13 hours ago $170.6k - $234.2k
....Job Responsibilities:As a Senior or Staff Software Staff Engineer in Dolby’s Cinema Technology Groups,... ...real-time secure software on embedded platforms for imaging and audio products.Responsibilities... ...organization.Fluency in current LLM coding techniques, including the...PlatformFull timeLocal areaWorldwideFlexible hours$173.5k - $331.05k
...these products. We are looking for a senior, hands-on engineer to own and evolve the cross-platform GPU rendering platform at the heart of that mission... ...) within a render pipeline Experience building GPU benchmarking / performance frameworks Web & mobile graphics experience...PlatformFull timeTemporary workLocal areaWorldwide- ...financial world.The roleWe are seeking a Staff Vulnerability Management Engineer to lead the most complex technical... ...directly with development and platform teams to define practical remediation... ...Evaluate and responsibly apply AI/ML and LLM-assisted techniques to security...PlatformRemote work
$300 per month
...ambitious team run by scientists and engineers from leading institutions... ...teams, and shape how our platform evolves. You'll spend some time... ...skills, tool-use pipelines, benchmarks – that improves every agent... ...depend on. Experience building LLM-powered tools or applications...PlatformFull timeWork at officeEdison Scientific Inc.
San Francisco, CA13 hours ago- ...multimodal computer vision platform turn complex, constantly... ...looking for a Principal or Staff Robotics Perception Engineer to serve as a critical bridge... ..., not only offline benchmarks. Your work will improve autonomy... ...record of adoption of LLM assisted and agentic programming...Platform
$207k - $290k
...seeking an experienced AI Engineer with deep expertise in... ...our team as a Senior Staff Architect. In this... ...generation enterprise AGI platform. You will lead the... ...Define frameworks for benchmarking, continuous evaluation... ...large language model (LLM) training and fine-...PlatformWorldwideFlexible hoursJazzX AI
San Francisco, CAmore than 2 months ago- ...Millions of people around the world come to our platform to find creative ideas, dream about new... ...scientists, and machine learning engineers. You'll conduct research that can be applied... ...cutting-edge research in machine learning and LLM that can be applied to Pinterest problems...PlatformFull timeWork at officeRemote workRelocationRelocation package
Pinterest
San Francisco, CA13 hours ago - ...around the world come to our platform to find creative ideas, dream... ...here . We are looking for a Staff MLE to lead the technical vision... .... Coach and mentor engineers while collaborating with product... ...refactoring. ~ Familiarity with LLM-powered productivity tools for...PlatformFull timeWork at officeRemote workRelocationRelocation package
Pinterest
San Francisco, CA13 hours ago - ...financial world.The role: We’re seeking a Staff Security Detection Engineer to build and mature SoFi’s machine... ...documentation for the ML detection platform, data lake, and pipelines across the... ...Experience applying deep learning or LLM-based approaches to security, log, or...PlatformRemote work
- ...of people around the world come to our platform to find creative ideas, dream about new... ...demand and supply. We’re looking for a Staff ML engineer to develop core bidding and ranking systems... ..., and refactoring. Familiarity with LLM-powered productivity tools for...PlatformFull timeWork at officeRelocationRelocation package
Pinterest
San Francisco, CA13 hours ago $204k - $280.5k
...FaireFaire is a technology wholesale platform built on the belief that the future is... ...compliance training, and AI governance. As our Staff Security Engineer focusing on Enterprise AI, you will... ...or deeply integrating with AI/LLM platforms. Not just using them, but managing...PlatformWork experience placementWork at officeLocal areaRemote workMonday to FridayFlexible hours3 days per week- ...Staff Software Engineer, Product Quality LiteLLM is the world's most popular AI Gateway, trusted... ...like Adobe, Netflix, and NASA. Our platform empowers developers with secure, reliable... ...enabling seamless calls to 100+ LLM APIs in the OpenAI format, trusted by...PlatformPermanent employmentWorldwide
LiteLLM AI Gateway
San Francisco, CA1 day ago $137.1k - $201.6k
...learning, optimization, and systems engineering to the core decisions behind... ...We’re looking for a Staff Machine Learning Engineer to... ...Data Science, Engineering, and Platform teams to improve delivery quality... ...AI vision for logistics: an LLM-inspired foundation model for...PlatformHourly payWork at officeLocal areaRemote workFlexible hoursDoordash
San Francisco, CA13 hours ago$242.8k - $357k
...and discovery experiences. As a Senior Staff Engineer, you will lead the technical direction for... ...AI, including sequential models and LLM-powered decisioning, reshapes ads relevance... ...future: We're one of the fastest growing Ads platforms in the world and we're looking to take...PlatformHourly payWork at officeLocal areaRemote workFlexible hoursDoordash Usa
San Francisco, CA13 hours ago$161k - $215k
...experience here. ----Guild is hiring a Staff Engineer to join our Grow Talent Experience team,... ...deployment (CI/CD). Expertise with a cloud platform (AWS, GCP, Azure, DigitalOcean),... ...Copilot, or similar; Experience integrating LLM APIs (e.g., OpenAI) and building AI-powered...PlatformFull timeTemporary workWork at officeShift workGrabJobs
San Francisco, CA13 hours ago$268.08k
...people around the world come to our platform to find creative ideas, dream about new... ...here.We are looking for a Sr. Staff Machine Learning Engineer to be the Technical Lead for the Content... ...testing, and refactoring.Familiarity with LLM-powered productivity tools for...PlatformWork at officeLocal areaRelocationRelocation package$159.2k - $301.6k
...opportunityAdobe Design is looking for a Staff Design Engineer to join our Insights design team. This... ...-fidelity, functional prototypes in LLM-powered applications that allow our design... ...& collaborationMulti-surface/platform thinking, particularly at enterprise scaleWhy...PlatformFull timeTemporary workLocal areaImmediate startRemote workWorldwide- ...of work through an AGI platform purpose‑built for the enterprise... ...industries and set new benchmarks for innovation and... ...an experienced AI Engineer with deep expertise in... ...join our team as a Senior Staff Architect. In this role... ...large language model (LLM) training and fine‑tuning...PlatformFlexible hours
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Engineer - LLM Benchmark Platform. Be the first to apply!
Related searches
- software engineer staff San Francisco, CA
- assistant engineer San Francisco, CA
- engineering aide San Francisco, CA
- staff engineer San Francisco, CA
- staff security engineer San Francisco, CA
- assistant mechanical engineer San Francisco, CA
- assistant engineering manager San Francisco, CA
- senior staff systems engineer San Francisco, CA
- technology administrator San Francisco, CA
- project engineer assistant project manager San Francisco, CA