Inference Platform Engineer for Open-Source ML
Togetherai
Together AI is seeking a Research Engineer for the Model Shaping team to build a platform that lets users tailor open-source models with their data. You will work across training and inference, enhancing Fine-Tuning, RL, and Evaluation services, and ensuring reliable, scalable API integration into our infrastructure. You will collaborate with product, research, and engineering teams to advance open-source AI tooling, supporting developers worldwide in creating high-quality, task-specific models #J-18808-Ljbffr Togetherai
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Inference Platform Engineer for Open-Source ML in San Francisco, CA vacancy
- Together AI in San Francisco is seeking a Research Engineer to help build a platform that lets users customize open-source models, bridging post-training and production inference. You will contribute across Fine-Tuning, RL, and Evaluation services and collaborate with product...SuggestedFull timeWorldwide
$160k - $250k
Together AI is building the Inference Platform that brings the most advanced... ...also works closely with the open source community, contributing to... ...across data centers and model engine pods. Develop auto‑scaling... ...responses. Collaborate with ML researchers to bring new...SuggestedFull timeLocal area- Prime Intellect is building a platform that unifies AI workloads, compute, environments... ...This hybrid role spans platform software engineering and infrastructure, focusing on Python-... ...to ensure reliability and security as we open-source and #J-18808-Ljbffr Prime IntellectSuggested
$300k
...building an AI and cloud platform, powered by thousands... ...model training, or inference. Our client operates... ...and operate inference engines such as vLLM, SGLang,... ...distributed systems (ML inference, HPC, or similar... .... Contributions to open-source ML or inference...SuggestedPermanent employmentWorldwide$200k - $260k
...building the best inference infrastructure for... ...applications. Our Voice AI platform powers production-... ...a Senior Platform Engineer to own the API and... ...with the ML engineering side of... .... We believe open and transparent AI... ...contributed to leading open-source research, models,...SuggestedFull time- ...cutting-edge technology startup in San Francisco is seeking a first engineer to collaborate with founders in building innovative AI... ...will engage with users, ship new features rapidly, and maintain open-source projects as part of a dynamic team culture. #J-18808-Ljbffr TraceRoot...
$200k
Platform Engineer - Inference Optimization We build and operate large-scale LLM inference and training infrastructure... ...-LLM, and NVIDIA Dynamo at the source code level (PyTorch / C++ / CUDA).... ...read, modify, and contribute to large open-source projects (e.g., PyTorch, vLLM,...$200k - $290k
...and research for tailoring open foundation models to... ...language processing, and ML systems. As a Platform Engineer in Model Shaping, you will... ...services for AI training or inference Networking fundamentals,... ...Maintaining or contributing to open‑source projects About Together...Full timeRemote work$183k - $310k
...unexpectedly, or need to be improved, engineers rely on data to understand... ...Role We're looking for a ML Platform Engineer with deep... ...the ML platform itself, from inference serving and pipeline orchestration... ...passionate about open‑source and developer tools. Ownership...Remote work- ...building it. We're looking for a Staff ML Platform Engineer - Large Scale Training (LLMOps/MLOps)... ...enables high-throughput, low-latency inference pipelines for state-of-the-art models... ...to ship. Bonus: Familiarity with open-source LLM training/fine-tuning. Why Join TrueFoundry...Flexible hours
$295k - $405.5k
...Senior Staff Machine Learning Platform Engineer, you will own the technical... ...and evolution of Faire’s ML platform. You will set standards... ...including training, inference, feature management, governance... ...plus Previous contributions to open source ML infrastructure projects or...Work experience placementWork at officeLocal areaRemote workMonday to FridayFlexible hours3 days per week$165k - $330k
...Baseten powers mission‑critical inference for the world’s most dynamic... .... Join us and help build the platform engineers turn to to ship AI products.... ...in operationalizing ML, onboarding them onto our platform... ...experience required, but should be open to learning about it....Flexible hours$165k - $330k
...Baseten powers mission‑critical inference for the world's most dynamic... ...Join us and help build the platform engineers turn to to ship AI products.... ...have personally developed open‑source developer tools. Benefits... .... Exposure to a variety of ML startups, offering unparalleled...Flexible hours$300 per month
...intelligence. We’re crafting the engine that powers a world... ...to define the AI platform roadmap. Influence... ...platform. Contribute to open‑source AI frameworks and... ...projects quickly. AI/ML Expertise: Experience... ...infrastructure (training, inference, ETL pipelines)....Temporary workWork at office- ...commercializing Ray, a popular open-source project that's creating an... ...scientist can scale an ML application from their laptop... ...: As a Forward Deployed Engineer - AI/ML Platforms at Anyscale, you’ll partner... ...that support model training, inference, or large‑scale data processing...
$229.9k - $262.4k
...applications of AI & ML are bringing humanity... ...class applied science and engineering teams to deliver our... ...customers. Our AI models and platforms empower teams across... ...large language model inference, similarity search,... ...a broad stack of Open Source and SaaS AI technologies...Full timePart timeLocal areaCapital One
San Francisco, CA10 hours ago$165k - $330k
...Baseten powers mission‑critical inference for the world's most dynamic... ...Join us and help build the platform engineers turn to to ship AI products.... ...team has contributed to open‑source developer tooling. Strong written... .... Exposure to a variety of ML startups, offering...Flexible hours- ...Nscale is the GPU cloud engineered for AI. We provide... ...ll build trust through openness and transparency while... ...a Staff Observability Platform Engineer, you'll play... ...infrastructure, platform, and AI/ML teams to improve... ...to model training, inference workloads, GPU utilization...
$295k - $345k
...Opportunity at Altana As the Senior Director of Platform Engineering, you will own the foundation that the... ..., including which tools, vendors, and open‑source technologies to adopt across the SDLC.... ...in support of fast‑paced ML/AI‑enabled products and services. Experience...Temporary workLocal areaImmediate startRemote workFlexible hours$150k - $215k
Principal Observability Platform Engineer - Nscale About Nscale Nscale is... ...you’ll build trust through openness and transparency while contributing... ...SRE, infrastructure, and AI/ML teams to embed observability... ..., training job visibility, inference latency. Prior experience...Flexible hours$200k - $300k
...AI research to systems engineering to product design —... ...looking for a Research Platform Engineer to build the... ...and data processing and sourcing pipelines. Productionize... ...and own parts of the inference stack. Build internal... ...in at least one of: ML infrastructure, distributed...Shift work- MeshyAI is seeking a Platform Engineer to enhance our AI inference platform in San Francisco. You will design and develop core capabilities, focusing on resource management and service orchestration. The ideal candidate holds a relevant degree and has experience in backend...Remote jobFlexible hours
- ...of product and portfolio leadership, data engineering, infrastructure and DevOps, data/metadata/knowledge platforms, and AI/ML and analysis platforms, all geared toward:... ...programming languages (e.g. Python, R, bash), open‑source tools (e.g. Spark, Nextflow, k8s), and...Work experience placementLocal area
$175k - $200k
Staff Platform Engineer - Agentic AI Systems, IFS The Loops Staff Platform Engineer - Agentic AI Systems... ...scaling paradigms. Contributions to open-source projects in the distributed systems ecosystem. Experience with AI or ML-driven orchestration or agentic frameworks...Full timeFor contractorsFlexible hours- Lightning AI in San Francisco or Seattle is seeking a Senior Application Security Engineer to secure our AI/ML platforms and inference services. You will work with platform, ML, and infrastructure teams to identify risks and implement secure architectures. The role emphasizes...
- ...D lab building Asimov, an open-source humanoid robot platform, and the full software stack... .... The Role As an DevOps Engineer, you will own and evolve... ...everything at Menlo runs on - from inference serving, to training rigs,... .... Background in AI/ML infrastructure or GPU...Local areaFlexible hours
- ...the role: As a Backend Engineer at Brain Co., you'll own... ...that power our AI platform end-to-end, from architecture... ...teams across Product, ML, and Infrastructure.... ...principles, break down complex, open-ended problems into... ...with AI/ML platforms, inference systems, or data-...
- ...is the incrementality platform leading brands trust to... ...Using frontier causal inference-based econometric... ...managers, economists, and engineers from Google, Netflix,... ...comfortable working with DS, ML, or analytics... ...contributing to or maintaining open‑source data tooling/...Live inWork at officeWork from homeWorldwideFlexible hours
- ...seeking a Member of Technical Staff, ML Product Engineer to develop APIs and systems that support... ...batch systems and ensuring efficient inference for scientific applications. The ideal... ...partners to enhance the developer experience of the Omnii platform. #J-18808-Ljbffr Jobr
- ...Full time Department Engineering Who We Are... ...computing power with our Open-Access AI Cloud.... ...marketplace and AI inference service that... ...intersection of AI and open-source technology, we... ...us in building a platform that empowers innovators... ..., AI/ML platforms, or compute...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Inference Platform Engineer for Open-Source ML. Be the first to apply!
Related searches
- data platform engineer San Francisco, CA
- client platform engineer San Francisco, CA
- platform engineer San Francisco, CA
- platform developer San Francisco, CA
- senior platform engineer San Francisco, CA
- platform engineering manager San Francisco, CA
- director of digital platform San Francisco, CA
- digital platform specialist San Francisco, CA
- power platform San Francisco, CA
- platform manager San Francisco, CA