Platform Engineer for LLM Benchmarking & Tools (SF)

Vibehackers

Vals AI is seeking a Senior Platform Engineer in San Francisco to own and build the scalable infrastructure for large‑scale LLM evaluation benchmarks. You will work across distributed systems, cloud infra, and full‑stack features (Python/Django backend and React/TypeScript frontend) on an in‑person team. Responsibilities include designing, deploying, and improving the platform, collaborating with research, and maintaining libraries. #J-18808-Ljbffr Vibehackers

Apply

Vacancy posted 4 days ago

Similar jobs that could be interesting for youBased on the Platform Engineer for LLM Benchmarking & Tools (SF) in Eastern, KY vacancy

Senior Platform Engineer
$148.75k - $201.25k
...seeking a senior AI Agentic Engineer to embed with a government... ...enterprise data, APIs, developer tooling, and platform services to turn AI... ...agent workflows using modern LLM and agentic technologies.... ...established using national benchmarking data and apply across all geographic...
Suggested
Full time
Local area
Remote work
Home office
Flexible hours
Defense Unicorns
Eastern, KY
15 hours ago
Principal AI Platform Engineer
$139.7k - $232.9k
...Principal AI Platform Engineer page is loaded## Principal AI Platform Engineerremote... ..., and approve agent-based and tool-integrated AI architectures, including multi-step LLM workflows using approved... ...performance.* Drive model testing, benchmarking, evaluation, and performance...
Suggested
Work experience placement
Remote work
M&T Bank
Eastern, KY
4 days ago
SRE I - Platform Engineering
...build and maintain AI platform services: Design, build... ...Protocol (MCP), tool orchestration frameworks... ...accelerate AI adoption across engineering teams. You ensure... ...model evaluation, benchmarking, experimentation, and... ...Strong understanding of LLM operations including prompt...
Suggested
National Black MBA Association
Eastern, KY
4 days ago
Senior Platform Engineer Product & Engineering Tools
Socure is seeking a Senior Business Systems Engineer - Product & Engineering Platforms to own and evolve the systems that support product planning, engineering... ...such as Jira, Aha!, and related product management tools, partnering with Product, Engineering, TPM, Finance,...
Suggested
Socure Inc
Eastern, KY
4 days ago
AI Platform Engineer, Enablement and Governance Operations
...Payward Services and CF Benchmarks - has spent the last 1... ...infrastructure platforms in the industry, built... ...internal AI platform. AI tooling is deployed at scale across... ...gateway as an engineering surface. You'll handle... ...ideally including an AI or LLM platform. Demonstrated...
Suggested
Work at office
Local area
Kraken International
Eastern, KY
4 days ago
Senior Platform & MLOps Engineer Internal AI Tools
Serko is hiring a Senior Full Stack Engineer to own the end‑to‑end development of next‑gen AI products. The role focuses on building an internal platform, dashboards, and tooling that empower our AI engineers. You will work from Washington or California, partnering with...
Aimlroles
Eastern, KY
1 day ago
Principal AI Platform Engineer for Creative Tools
Pika is hiring a Principal Product Engineer to steer the technical vision, architecture, and roadmap for user-facing systems. You will... ...serving millions of creators—from intuitive UIs and collaboration tools to real-time interactions and advanced generative AI. You’ll...
Sarah Smith Fund
Eastern, KY
5 days ago
Senior Software Engineer, Product Platform
...looking for a Senior Software Engineer to join our Product Platform org - the group that... ...architecture libraries, code quality tooling, and test frameworks.... ...members who report to the SF and NYC office ~ Family... ..., and country location, benchmarked against similar-stage...
Work experience placement
Work at office
Immediate start
Remote work
Flexible hours
Apply
Eastern, KY
1 day ago
Platform Engineer
...We're looking for a Platform Engineer to own the infrastructure that puts long-horizon AI Agents... ...workflow. You've tried a bunch of AI developer tools and have strong opinions about what... ...Bonus You've shipped agentic or LLM systems to production and think clearly...
Live in
Flexible hours
Getnexus
Eastern, KY
4 days ago
Senior Platform Engineering
$94.9k - $176.3k
## Senior Platform EngineerApplyremote type: Hybridlocations: United... ...About the team**Our Platform Engineering team builds and operates the... ..., and the internal developer tooling that other engineering teams... ...built on or integrating with LLM/Generative AI infrastructure...
Work at office
Local area
Flexible hours
Shift work
Reuters
Eastern, KY
1 day ago
Platform Engineer
$150k - $200k
...Role Atomic Canyon is looking for a Platform Engineer to join our team. You will design, build... ...engineers actually act on Support GPU and LLM serving infrastructure, including... ...Docker, Helm, and Kubernetes deployment tooling Expertise in Infrastructure as Code using...
Remote work
Flexible hours
Atomic Canyon
Eastern, KY
4 days ago
Platform Engineering (Remote)
...maintenance operations on us. When our platform slows down, our customers... ...we ship. Platform Engineering owns AWS, CI/CD, and the platform... ...record of building internal tooling and Production support.... ...Building or operating AI/LLM backends on AWS, including Bedrock...
Remote work
S27a
Eastern, KY
4 days ago
Senior Platform Engineer
$140k - $200.8k
...Description We are seeking a Senior Platform Engineer to manage multiple critical enterprise applications... ...internal developer platforms and tools that enhance engineering productivity.... ...and deploying solutions using AI/LLM stacks (Gemini, Vertex AI, ADK). ~5 years...
Full time
Contract work
For contractors
For subcontractor
Work at office
Webpass Inc
Eastern, KY
4 days ago
Senior Platform Engineer
...Summary We are looking for a Senior Platform Engineer to join the Platform Engineering team at... ...pipelines running AI inference, LLM-powered summaries, and real-time patient... ...across engineering. We expect you to use AI tools daily to multiply your output. Responsibilities...
Hda Institute
Eastern, KY
4 days ago
Senior Platform Engineering
$94.9k - $176.3k
## Senior Platform EngineerApplyremote type: Hybridlocations: United... ...About the team**Our Platform Engineering team builds and operates the... ..., and the internal developer tooling that other engineering teams... ...built on or integrating with LLM/Generative AI infrastructure...
Work at office
Local area
Flexible hours
Shift work
Thomson Reuters
Eastern, KY
1 day ago
Platform Engineer
$150k - $220k
...About the Job: As a Platform Engineer, you will play a crucial role in designing, building, and... ...surfaces early indicators of risk that other tools miss and provides the context needed to... ..., and location. Base salary range (SF Bay Area): $150K-220K #J-18808-Ljbffr
Remote work
Worldwide
Dtex Systems Pty Ltd
Eastern, KY
4 days ago
Head of Platform Engineering
...Reducto is the agentic document platform for leading AI teams who... ...class investors including a16z, Benchmark, and First Round Capital.... ...re hiring a Head of Platform Engineering that will own the reliability... ...person role at our office in SF. We're an early stage company...
Work at office
Local area
Reducto, Inc.
Eastern, KY
1 day ago
AI Platform Engineer
$184k - $215k
...power X-energy's AI-native application platform (APEX). The DevOps Engineer will work with the AI and Application... ...* Leverage Claude Code and AI tools to accelerate infrastructure development... ...Understanding of AI/ML concepts and LLM architectures* Proficiency with Claude...
Full time
Work at office
Monday to Friday
X Energy, LLC
Eastern, KY
15 hours ago
AI Platform Engineer
...Our platforms turn messy source documents into numbers an investment... ...only works if the AI layer is engineered like production software:... ...regression suites and accuracy benchmarks that gate every model or prompt... .... Technical skills LLM engineering: production experience...
Remote work
Megsoft
Eastern, KY
1 day ago
Senior AI Platform Engineer
$150k - $210k
...Build internal AI platforms, applied LLM workflows, model-service integrations, and AI-enabled tooling. CodeVertex works across data-heavy and process-heavy business environments... ...clarity matter. The Senior AI Platform Engineer role helps turn business needs into reliable...
Remote work
Codevertex Innovations
Eastern, KY
4 days ago
Principal Data Platform Engineer
$197.3k - $313.7k
...The Developer Experience team builds the tooling, paved paths, and automation that let... ...quickly and safely. As our Principal Data Platform Engineer, based in San Francisco, you’ll design and... ...building and deploying production AI/LLM applications, including RAG pipelines and...
Salesforce
Eastern, KY
1 day ago
Software Engineer - AI Platform (US)
...re looking for software engineers with solid foundations... ...and predictive analytics tools. Operationalize LLMs... ...chaining, and fine-tuning. Benchmark models, develop... ...gRPC. Experience with LLM and AI frameworks such... ...building and scaling backend platforms, APIs, and...
Full time
Remote work
Genios AI, Inc.
Eastern, KY
4 days ago
Software Engineer (Release & Platform Engineering)
Software Engineer (Release & Platform Engineering) Zions Bancorporation's Enterprise Technology and Operations (ETO) team is transforming what it... ...RESTful APIs that power platform capabilities and internal tooling. Automate deployments and manage container orchestration...
Temporary work
Work experience placement
H1b
Work at office
Local area
Flexible hours
Zions Bancorporation
Eastern, KY
3 days ago
GenAI & LLM Platform Engineer Scale Production AI
Teladoc Health seeks an AI Engineer - Data & AI Platform to architect and operationalize scalable generative AI and ML solutions across Snowflake, Databricks, and modern MLOps ecosystems. You will partner with data scientists and platform teams to deploy end-to-end AI/ML...
Aimlroles
Eastern, KY
1 day ago
Principal Agentic Platform Engineer - AI-Driven Services
Elastic is seeking a Principal, Agentic Engineering Platform to design, ship, and refine agentic systems that support our services team... ...projects. You will lead multi-step workflows using LLM orchestration, tool integration, retrieval-augmented generation, and #J-188...
Elasticsearch B.V.
Eastern, KY
1 day ago
Senior Platform Engineer - AI/LLM Model Integration
Apple Inc. in Seattle is seeking a senior Platform Engineer to design and deliver systems that integrate Large Language Models into Apple Intelligence and Private Cloud Compute. You will architect distributed components, ensure reliability, and enable teams to deploy ML...
Apple
Eastern, KY
3 days ago
Senior DevSecOps Engineer
$160k - $250k
...currently looking for a seasoned DevSecOps engineer with significant experience in operating... ...web apps that leverage Machine Learning tools and LLM technologies. In this role you will work... ...candidate (able to be present in the SF office most weeks) is preferred. Responsibilities...
Full time
Work at office
Local area
Flexible hours
Ellipsis Health
Eastern, KY
2 days ago
Senior Design Release Engineer
...as you are. Group Summary: As an engineering and manufacturing partner, Magna’s Complete... ...and external best practices Lead benchmarking studies and contribute to the benchmark... ...level up team skills, qualifications, tools and processes Lead design proposals...
Permanent employment
Work at office
Local area
Flexible hours
Magna International
Eastern, KY
4 days ago
Staff Frontend UX Platform Engineer
...category-defining AI automation platform that healthcare teams rely on... ...workers with world‑class tools that deliver real, measurable... ...a Staff Frontend UX Platform Engineer to shape the foundations of our... ...Commuter Benefits — $100/month for SF and NYC-based employees Parental...
Full time
Work at office
Remote work
Flexible hours
2 days per week
RXinsider
Eastern, KY
5 days ago
Sr. DevOps Engineer II, AI Platforms
$153k - $260k
## Sr. DevOps Engineer II, AI PlatformsApply: Hybrid: NYC Global HQ:... ...agencies, publishers, and digital ad platforms. Since 2008, DV has helped... ...that fronts 30+ internal tool backends, a gateway for model... ...routing/gateway platforms, or LLM observability stacks at organizational...
Full time
Work at office
Remote work
DoubleVerify
Eastern, KY
1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Platform Engineer for LLM Benchmarking & Tools (SF). Be the first to apply!