Senior Inference Benchmarking Engineer - Frontiers in AI
Artificial Analysis, Inc.
Artificial Analysis, Inc. is seeking a Member of Technical Staff to own and advance our serverless inference benchmarks. You will cover endpoints across providers, extend our methodology to pricing and accuracy, and work directly with neoclouds to measure performance. You will analyze throughput, time-to-first-token, and cost-per-token while shaping the roadmap with engineers and the pillar lead. This role offers front-row exposure to frontier AI and equity compensation. #J-18808-Ljbffr Artificial Analysis, Inc.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior Inference Benchmarking Engineer - Frontiers in AI in San Francisco, CA vacancy
$216k - $270k
About Scale AIScale AI is the data foundation for AI, helping... ...AI transformation through frontier AI systems that solve real... ...one of the hardest engineering challenges.As a Senior Frontier Agent Engineer (Applied... ...frameworks using offline benchmarks, online A/B experiments,...SeniorFull timeScale AI
San Francisco, CA2 days ago- ...Atlassian, we are seeking an ML System Engineer to join the AI & ML Platform Inference team. You will design and optimize... ...workloads. You will collaborate with senior ML engineers to fine-tune and deploy open-source LLMs, benchmark performance, and ensure robust CI/CD...Senior
- Cloudflare is seeking a Senior Systems Engineer for its AI inference platform. You will design and build core infrastructure powering AI inference across a global network, working with AI/ML engineers, hardware partners, and product teams to solve distributed systems challenges...Senior
- Baseten powers mission-critical AI inference at scale. We seek distributed systems engineers to own the runtimes and APIs that run large-scale LLM inference and hosted endpoints. You’ll work across the stack from developer tooling to orchestration on Kubernetes, driving...Senior
- A leading AI consultancy is expanding by hiring 25 Senior Electrical Engineering Experts for part-time, fully-remote roles. This position focuses on designing complex... ...can set their own rates and will work on high-impact frontier AI projects. #J-18808-Ljbffr Aligned LabsSeniorRemote jobPart time
- OpenAI in San Francisco is seeking an experienced systems generalist to build an automated inference optimization platform across hardware, compiler, and runtime contexts. You will design the OpenAI-hosted control plane and partner-side software, focusing on reliable long...Senior
- Baseten is hiring a Software Engineer focused on testing within the Platform team. You will own the end-to-end testing strategy, building... ..., and performance testing frameworks for a mission-critical AI inference platform. You will design end-to-end test infrastructure,...Senior
- Obsidian seeks a senior mechanical engineering expert to craft challenging industry-grounded problems, author... ...validate difficulty across leading AI models. Candidates should hold a PhD in... ...creation and validation against frontier language models to ensure substantial...Senior
$170k - $200k
...communities around the globe. Our AI-powered labor marketplace... ...companies to push the frontiers of robotics and AI. Backed... ...world-class investors like Benchmark, Spark Capital, Craft Ventures... ...works.We are seeking a Senior Software Engineer - Instawork Robotics to contribute...SeniorHourly payTemporary workLocal areaShift workInstawork
San Francisco, CA2 days ago- DigitalOcean is seeking a Senior Engineer 2 to drive AI Inference Optimization. You will lead benchmarking and optimizations at the inference engine and GPU kernel levels, and guide the technical roadmap for high-performance inference fleets. Bring 5+ years of HPC or AI...SeniorRemote job
$161.3k - $241.9k
...professional services operate. By combining frontier agentic AI, an enterprise-grade platform, and deep... ...every customer interaction, every model inference, and every production workload. We’re looking for a Production Engineer to help build and operate Harvey’s core compute...SeniorHarvey
San Francisco, CA1 day ago- Obsidian is seeking a candid evaluator to assess the quality, correctness, and reproducibility of software-engineering benchmark tasks used to train frontier AI labs. You will review repository-level tasks, reference patches, test harnesses, and grading integrity, and provide...
$250k - $320k
(Staff / Senior Staff) AI Infra Engineer, Inference Infrastructure About The Role We're looking for a software engineer, reliability-minded but still... ..., fine-tuning and reinforcement learning for creating frontier-level specialized models, and pre-training at massive...SeniorPermanent employmentFull timeTogether Computer Inc
San Francisco, CA11 hours ago- ...powering the next generation of AI products. We build the... ...platform where high-performance inference, orchestration, and observability... ...usage, cost, and access. Engineer for correctness and... ...Interesting, challenging work at the frontier of generative media ·...SeniorVisa sponsorshipRelocation package
The Consensus
San Francisco, CA1 day ago $225k - $290k
...Senior Growth Engineer – AI Developer Tools Location: San Francisco / Bay Area, CA Employment... ...place for people who want to work at the frontier: an AI company building... ...including prompt engineering, tool use, or inference pipelines. Experience with LLM APIs...SeniorFull timeContract workH1bLive inRelocationMorgan Pinnacle Group
San Francisco, CA1 day ago$200k - $275k
...San Francisco-based applied AI and data company, seeks a lead... ...training and research efforts for frontier models used in finance... ...models, publish findings, drive benchmarks, contribute to platform... ...help build a high-performance engineering culture from the ground up, with...Relocation- CoreWeave is hiring an Applied AI Engineer to understand, measure, and improve the real-world performance of our inference platform. In the near term, you will build and run rigorous benchmarks, profile model and system behavior, identify bottlenecks, and drive targeted...
- HUD is seeking a Lead Research Engineer, Data Quality to own how HUD measures, improves,... ...scales the quality of training data for frontier agents. You’ll lead the data quality team... ...across RL environments, synthetic data, benchmarks, and domain-specific workflows. You will...
$190.9k - $334.1k
...DescriptionIt all started when engineer Fred Luddy wrote code that... ...work. Today, ServiceNow is the AI control tower for business... ...make decisions with context no frontier model has on its own.Trust, safety... ...to LLM fine-tuning or inference optimization in production.Why...SeniorWork experience placementWork at officeImmediate startRemote workFlexible hoursServiceNow
San Francisco, CA1 day ago- Databricks is seeking high-agency engineers to power model inference at enterprise scale. You will build and... ...enables serving, scaling, and optimizing frontier models with enterprise reliability.... ...scientists and developers building AI applications on Databricks. This role...Senior
$250k - $350k
...Francisco, Turing works with frontier AI labs to generate high-quality... ...environments, and frontier research benchmarks that improve model capabilities in software engineering, enterprise knowledge work,... ...We are seeking Senior Research Engineers to advance...SeniorTuring Enterprises, Inc.
San Francisco, CA1 day ago$150k - $300k
...(RF-DETR). We build our own benchmarks grounded in real enterprise use... ...100-VL). And we partner with frontier labs to deliver the training... ...business that is exploding as AI traverses the physical... ...shoulder with researchers and engineers at leading AI labs who depend...Work at officeRoboflow, Inc.
San Francisco, CA1 day ago- ...security-first enterprise AI company. We build... ...training and deploying frontier models for enterprises... ...a team of researchers, engineers, designers, and more, who... ...Model Vault is Cohere’s inference platform for deploying... ...enterprise workloads. As a Senior/Staff Software Engineer...SeniorFull timeWork at officeLocal areaRemote workHome office
$184k - $259.44k
Scale AI is seeking a highly skilled and motivated Software Engineer, Frontier AI Infrastructure to join our dynamic Public Sector... ...team, you will own the model inference layer - enabling state of the... ....g, Cloud SRG, FedRAMP, STIG Benchmarks, etc). Experience developing...Full timeWork at office3 days per weekEarly shiftScale AI
San Francisco, CA5 days ago- Mercor is hiring PhD and Master's scientists to author AI evaluation tasks for a new benchmark in scientific computing. You will design executable research problems that frontier models currently cannot solve and author prompts based on your sourced material. Responsibilities...
- ...Member of Technical Staff to define how frontier coding agents are benchmarked and improved. You will partner with top researchers and engineers to develop benchmarks, verifier systems,... ...and data-quality techniques for coding AI. Early team members influence technical...
- ...emerging trillion-dollar Voice AI economy, providing real-... ...Deepgram is looking for a Senior Software Engineer - Model Evaluation & AI Systems... ...grounded in Research benchmarks, and build the monitoring that... ...Research, model training, inference, and product teams to provide...Senior
$250k - $350k
...is to develop reliable AI systems for the world’s... ...focused on pushing the frontier of what agentic applications... ...Learning Research Engineer, you will operate across... ...training/fine-tuning, inference, memory and retrieval,... ...technical direction, mentor senior and staff-track...SeniorFull timeScale AI
San Francisco, CA5 days ago$160k - $250k
Together AI is building the Inference Platform that brings the most advanced generative AI models to the... ...with research teams to bring frontier models into production, making breakthroughs... ...balancing across data centers and model engine pods. Develop auto‑scaling systems...SeniorFull timeLocal area$172.55k - $203k
...office. We are seeking a highly skilled Senior Software Test Engineer to join our team. In this role, you... ...ExplorationExplore the use of AI-driven testing approaches and tools,... ...verify that products meet performance benchmarks.This is a Hybrid role out of our San...SeniorWork at officeLocal areaRemote workFlexible hoursOura
San Francisco, CA5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Inference Benchmarking Engineer - Frontiers in AI. Be the first to apply!
Related searches
- senior living San Francisco, CA
- senior associate vice president San Francisco, CA
- senior php developer remote San Francisco, CA
- senior app developer San Francisco, CA
- senior manufacturing engineer San Francisco, CA
- senior ml engineer San Francisco, CA
- senior data analyst San Francisco, CA
- senior manager strategic partnerships San Francisco, CA
- senior executive director San Francisco, CA
- senior application support engineer San Francisco, CA