Tech Lead, Distributed AI Evaluation Systems
Anthropic
Anthropic is at the forefront of AI research, building safe, ethical, and powerful AI systems. We are seeking an experienced tech lead to join our Evals Infrastructure team, owning the infrastructure that measures model capabilities at scale. You will work at the intersection of inference, research, and engineering to orchestrate evals for frontier models. You will manage a distributed team, focus on throughput, cost, and reliability, and collaborate with researchers to translate requirements #J-18808-Ljbffr Anthropic
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Tech Lead, Distributed AI Evaluation Systems in California, MO vacancy
- ...interpretable, and steerable AI systems. We want AI to be safe and... ...looking for an experienced tech lead to join our Evals Infrastructure... ...our models can actually do. Evaluation is how we know whether a... ...engineering: managing the large scale distributed systems that orchestrate...SuggestedWork at officeVisa sponsorshipFlexible hours
- AI Systems Engineer - Codex Core Agents About The Team The Codex Core... ...of how models are trained and evaluated, making this one of the... ...operated production systems in distributed systems, infrastructure, developer... ...strong ownership, and can lead scoped or multi‑team AI systems...Suggested
- YO AI Labs invites a Senior Software Engineer to help build reinforcement learning environments that test AI models on complex... ...include creating environments, building verification systems, and evaluating agents on real-world codebases. #J-18808-Ljbffr YO AI LabsSuggestedRemote job
$199k
...members, shaping the product, the systems, and the roadmap from scratch. We’re hiring a Tech Lead Manager (TLM) to lead this team... ..., not just manage Fluency with AI-assisted development tools such... ...on Rails, React Native, AWS, distributed systems) is a plus Strong cross...SuggestedFull timeWork at officeLocal areaRemote work$50.24 - $55.82 per hour
...next‑generation memory for datacenter and AI workloads. In this internship you will... ...and simulation platform — a multi‑agent system that turns large volumes of external and... ...Key Responsibilities Design, build, and evaluate AI agents that automate multi‑stage research...SuggestedFull timeInternshipLocal areaImmediate start- ...transformer models, caching, and low-latency serving. You\'ll collaborate across Rust, Python, CUDA, CuTe DSL, and deploy production distributed systems under real load with a focus on performance and reliability. You will contribute to a stack built around PyTorch, CUDA...
$140k - $180k
...Software Engineer specializing in AI and Machine Learning to join an... ...for building, training, evaluating, and deploying AI/ML models and agentic systems that power intelligent products... ...evening meetings to collaborate with distributed teams or international partners....Remote workAfternoon shiftEarly shiftProsum
California, MO1 day ago- ...You will design, build, and own systems across product and platform... ...frontier technology. You will lead features end-to-end, collaborate... ...diverse teams and tackle hard AI-driven problems, building... ...that leverage agents, context, evaluation and personalization to empower...
- ...and product managers to deliver AI-powered products Oversee... ...similarity search, guardrails, model evaluation, experimentation, governance,... ...throughput of production AI systems Contribute to the technical... ...years of experience managing and leading an engineering team (preferred...
$221.2k - $387.1k
...Today, ServiceNow is the AI control tower for... ...Engineering, you will lead the teams that architect... ...will span large-scale distributed systems, data ingestion, context... ...develop engineers, tech leads, and managers. Build... ...workflow correctness, evaluation, observability, safety...Work at officeImmediate startRemote workFlexible hours$224k - $356.5k
...driving car powered by AI can meander through a... ...looking for a Manager of System Software Engineering -... ...for features, evaluating quality and proposing... ...+ years of experience leading a team. Excellent C and... ...debugging multi-threaded/distributed applications like multimedia...Night shift$220k - $240k
A well-funded deeptech startup in California is looking for a Tech Lead, Perception with a focus on Robotics and Autonomy. The position... ...extensive experience in designing and implementing perception systems for autonomous vehicles, along with project management skills....$143.2k - $243.4k
...meaningful work. Today, ServiceNow is the AI control tower for business reinvention.... ...in data structures, algorithms, and distributed systems with a Bachelor's degree; or 3 years and... ..., structured outputs, and model evaluation in production settings. Familiarity with...Work experience placementWork at officeImmediate startRemote workFlexible hoursServiceNow
California, MO4 days ago$184k - $287.5k
...the Senior High Performance AI Engineer role at NVIDIA NVIDIA... ...and optimize agentic AI systems for the CUDA ecosystem. Co‑design... ...reproducible, high‑fidelity evaluation frameworks covering performance... .../libraries, frameworks, distributed training, and inference/serving...$155k - $241k
...manufacturing facilities, and distribution centers—tackling... ...work. With industry-leading safety standards and years... ..., training policies, evaluating failures, and... ...MS or PhD in Robotics, AI, Computer Science, Machine... ...hands-on with robotic systems in a lab environment...Full timeTemporary workRelocation packageFlexible hours- ...products that advance how people learn with AI. The team works across higher education... ...the Role We’re looking for a hands‑on Tech Lead Manager to lead and manage a team of senior... ...the boundaries of the capabilities of AI systems and seek to safely deploy them to the world...
$123.24k - $180k
...Role As a Sr./Principal AI Engineer within TSMC's... ...building foundational systems from the ground up and... ...office. Responsibilities Lead System Architecture: Own... ...-of-concepts, create evaluation harnesses to measure accuracy... ...engineering and distributed systems. Mastery of Python...Work at office- ...Role DoorDash is building an AI Research org from the ground up... ...founding team and leadership Lead high-impact research projects... ...training runs, and large-scale evaluation sweeps Full research infrastructure... ...built on real operational systems, training and evaluation...Hourly payWork at officeLocal areaRemote workFlexible hours
- ...the new era of agentic AI. Millions of people now... ...are often the first to evaluate emerging model capabilities... ...AI research, agent systems, platform engineering,... ...and product innovation. Tech Stack: Python | Go | PostgreSQL... ...services, and scalable distributed systems that serve high...
- Cohere is seeking engineers to design and develop cutting-edge multimodal AI systems across text, speech, and vision. You will push the boundaries of model capabilities and work with leading compute infrastructure to explore novel ideas. Join a team that values rapid experimentation...Remote job
$184k - $287.5k
A leading tech company is seeking a Senior Performance Engineer in California to enhance AI system performance and datacenter applications. The role requires extensive experience in accelerated computing, deep learning frameworks, and cloud/container architecture. Applicants...- California State University, Dominguez Hills seeks an Associate Director of Financial Aid Systems to lead the CMS Financial Aid module and fiscal operations, supervise staff, and guide deployment of new technologies. The role drives process improvements, oversees funds...
- ...features end-to-end across our tech stack. You will expand our authenticated... ...high-throughput data processing systems, and build intuitive interfaces that present AI-driven financial insights... ...you enjoy functional programming, distributed cloud infrastructure, modern web...
Canary Data
California, MO1 day ago $140k - $175k
...growing health technology company using AI, advanced imaging, cloud software, and data... ...: Scalable backend services and APIs Distributed systems and microservices Cloud-native applications... ...Automation and platform tooling Tech stack includes: Node.js, Java/Kotlin, GraphQL...Kismet Search
California, MO2 days ago$193.93k - $291.15k
...and profound opportunity for AI to drive positive change in the... ..., T. Rowe Price, and other leading investors. About the Role The... ...Driver’s prediction and planning systems to enable safe, driverless... ...for safety-critical systems, distributed training, or inference...Immediate startFlexible hoursNuro
California, MO4 days ago$180k - $200k
...What we do: Zefr is the leader in AI-powered content classifications for brands and... ...role you will build and run the production systems that power Zefr's platform at scale, and... ...Code, Copilot, Cursor) Strong foundation in distributed systems, API design, data structures,...Summer workWork at officeRemote workFlexible hoursZEFR
California, MO1 day ago$166k - $225k
...ingestion to ETL, BI, and all the way up to ML/AI with a unified platform. To achieve this... ...) query engine and structured storage system that can outperform specialized data... ...-art: Query compilation and optimization Distributed query execution and scheduling Vectorized...Local areaWorldwideDatabricks
California, MO4 days ago- ...is changing that. Pax is the AI control tower for global trade... ...we’re building the operating system for how enterprises manage trade... ...problems into product decisions, and lead delivery from discovery... ...limitations, and thinks carefully about evaluation, reliability, and human...H1bWork at office
PAX
California, MO3 days ago $160k - $225k
...running the world's best data and AI infrastructure platform so our... ...in building and scaling the systems that make large-scale training... ...scheduling and capacity, distributed training performance, fault tolerance... ...production training jobs. Lead end-to-end engineering efforts...Local areaWorldwideDatabricks
California, MO4 days ago$193.4k - $290k
...services operate. By combining frontier agentic AI, an enterprise-grade platform, and deep... ...Engineer, Agents, you'll build the systems that make our AI agents indispensable to... ..., and are experienced in using practical evaluations to drive task completion quality and customer...Harvey
California, MO4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Tech Lead, Distributed AI Evaluation Systems. Be the first to apply!
Related searches
- technical leader California, MO
- technical lead California, MO
- tower tech California, MO
- technology instructor California, MO
- administrative office technology California, MO
- deloitte business technology analyst California, MO
- gi tech California, MO
- precision technology California, MO
- distribution tech California, MO
- care tech California, MO