Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Member of Technical Staff - ML Systems & Inference

Acceler8 Talent

Member of Technical Staff - ML Systems & Inference Bay Area, CA | Onsite Join a well-funded AI infrastructure startup building the orchestration layer for next-generation AI workloads This role sits at the intersection of ML systems, inference, distributed systems, and performance engineering. You'll build production inference systems, optimize scheduling and memory management, improve KV cache efficiency, and work closely with compiler, kernel, and distributed systems engineers to push AI infrastructure forward We're looking for engineers with: Strong software engineering fundamentals Experience with ML inference or model serving Knowledge of distributed systems and performance optimization Python and/or C++ Experience with vLLM, TensorRT-LLM, CUDA, or similar is a plus This is an opportunity to help define how AI work #J-18808-Ljbffr Acceler8 Talent

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Member of Technical Staff - ML Systems & Inference in Brooklyn, NY vacancy
  • $150k - $350k

    Member of Technical Staff | Distributed Systems San Francisco - Onsite $150k-$350k base + equity I'm working with...  ...infrastructure company , building an inference cloud for agentic workloads that...  ...built schedulers, control planes, ML serving infrastructure,... 
    Suggested

    Acceler8 Talent

    Brooklyn, NY
    2 days ago
  •  ...us We are building AI systems that can reason, use tools...  ...training, reliable inference, and products that make...  ...internal documents and technical reviews; contribute to...  ...language models, agents, or ML systems, demonstrated...  ...We currently expect all staff to work from one of our... 
    Suggested
    Work at office
    Visa sponsorship
    Flexible hours
    3 days per week

    Goaly

    Brooklyn, NY
    1 day ago
  •  ...foundation Model (LPM) because physical systems, unlike text or images, are governed by verifiable...  ..., and multi-tenancy across training and inference workloads Build software that abstracts...  ...platforms (GCP, AWS, or Azure) and their ML/AI service offerings Understanding of... 
    Suggested

    Uncover

    Brooklyn, NY
    3 days ago
  •  ...us We are building AI systems that can reason, use tools...  ...training, reliable inference, and products that make...  ...record in a closely related ML research area. Solid...  ...-source contributions, technically ambitious independent...  ...We currently expect all staff to work from one of our... 
    Suggested
    Work at office
    Visa sponsorship
    Flexible hours
    3 days per week

    Goaly

    Brooklyn, NY
    1 day ago
  • $140k - $185k

     ...benchmarks. The role spans distributed systems, cloud infrastructure, backend...  ...person team based in San Francisco. Role Member of Technical Staff - Platform responsible for owning and...  ...run your own company. Interest in AI/ML systems and evaluation. Python, Django... 
    Suggested
    Full time
    Relocation
    Relocation package

    Vibehackers

    Brooklyn, NY
    22 hours ago
  • $200k - $400k

     ...mission is to grow vLLM as the world's AI inference engine and accelerate AI progress by...  ...diagnostics, and incident response across the systems our engineers rely on every day. You'll...  ...systems. Experience with storage for HPC or ML workloads, including NFS, Lustre, Ceph,... 
    Remote work
    Visa sponsorship

    Inferact Inc.

    Brooklyn, NY
    22 hours ago
  •  ...governor that enforces spend ceilings before inference happens rather than after the invoice...  ...for Hands-on production experience with LLM systems beyond prototypes: serving, evaluation, and cost control. Strong applied ML or systems background with rigorous measurement... 

    Dipp AI Technologies

    Brooklyn, NY
    3 days ago
  • $160k - $200k

    Member of Technical Staff, Agent Delivery Full time · Remote · San Francisco or New York Important: if an employer asks you to log into their system via iCloud or Google, send a code, an SMS or Telegram password...  ...in model research or pure ML experimentation. You prefer... 
    Full time
    Work at office
    Local area
    Remote work

    Talanto

    Brooklyn, NY
    22 hours ago
  •  ...accessible to all. About the Role Build and scale distributed training systems that power frontier model pre-training. Work closely with...  ...tuning for distributed workloads. Experience working closely with ML researchers to productionize experimental training workflows.... 
    Work at office
    Visa sponsorship

    Visa Hunt

    Brooklyn, NY
    22 hours ago
  •  ...Solid software engineering capabilities with experience building large-scale systems. Experience with large-scale ETL workflows and training data preparation. Deep understanding of large-scale ML, especially as it relates to language models, distributed training, and... 
    Work at office
    Visa sponsorship

    Visa Hunt

    Brooklyn, NY
    1 day ago
  •  ...About the Role Anthropic is looking for a Member of Technical Staff to join our Applied AI team. In this role, you will work directly with our...  ...Augmented Generation (RAG) paradigms. Experience with distributed systems and cloud infrastructure (AWS or GCP). Benefits Competitive... 
    Remote work
    Flexible hours

    AI Breaking Wire

    Brooklyn, NY
    3 days ago
  •  ...general world models: causal, multimodal systems that learn to predict and interact with the...  ...system, data, architecture, training, inference, evaluation, rather than as six specialties...  ...for weeks. Implement state of the art ML algorithms, define metrics, and relentlessly... 

    Odyssey

    Brooklyn, NY
    22 hours ago
  • # Research Member of Technical Staff, Materials and ManufacturingTurn physical limits in compute into...  ...teach the team, build one useful AI system, manage what runs, and measure what still...  ...repeated limits through software, inference, kernels, memory, hardware, materials... 
    Full time
    Remote work

    Touchdown Labs

    Brooklyn, NY
    3 days ago
  • $227.5k - $401k

     ...your career. We are motivated individuals who tackle unique technical challenges at scale and solve them as a team, delivering...  ...AI research within the financial technology sector. As a Member of Technical Staff , you will operate with a high degree of autonomy and responsibility... 
    Work at office
    Immediate start
    Relocation
    Flexible hours

    Adyen

    Brooklyn, NY
    22 hours ago
  •  ...accessible to all. Role Overview Reflection.AI is looking for a Member of Technical Staff - Infrastructure Security to secure our geographically...  ...cluster services such as GKE Comfort working with CI/CD systems such as ArgoCD Familiarity with Kubernetes orchestration systems... 
    Work at office
    Visa sponsorship

    Visa Hunt

    Brooklyn, NY
    4 days ago
  •  ...the world's most efficient software for inference (processing LLM tokens) and agent hosting...  ...stack to building large scale systems that maximize our efficiency. What you’ll...  ...detail about Sail as you want to hear. A technical interview with one of our Sailbox engineers... 
    Work at office

    Sail Research Inc.

    Brooklyn, NY
    22 hours ago
  •  ...and research settings. This field-facing technical specialist role serves as a key...  ...environments. As a Technical Specialist - KRYPTOR Systems and Assays, you will play a critical role...  ...with laboratory leaders, technical staff and other key personnel in supporting both... 
    Work at office
    Flexible hours

    RXinsider LTD.

    Brooklyn, NY
    1 day ago
  • Member of Technical Staff: DataMonk is an AI-native accounts receivable platform for B2B companies. We automate billing, collections, and payments...  ...'s volume Who you are 4+ years building production data systems at a venture-backed startup. You joined when the data layer... 
    Immediate start

    Uncover

    Brooklyn, NY
    22 hours ago
  • $140k - $185k

     ...publishable evaluations and work with model labs and enterprises to shape how foundation models are measured. Job Description Role Member of Technical Staff - Research responsible for designing and implementing novel, high-impact benchmarks that assess challenging real-world... 
    Full time
    Relocation package

    Vibehackers

    Brooklyn, NY
    22 hours ago
  • Member of Technical Staff - Simulation About Us Veeda AI is building the next generation of multimodal foundation world models for Physical AI....  ...Experience with differentiable simulation or gradient-based system identification. Experience building 3D Gaussian splatting... 

    Veeda Innovation

    Brooklyn, NY
    2 days ago
  • $180k - $280k

     ...fragmented data - and we're building the software to fix it. As a Member of the Technical Staff at Finch, you'll own critical features end-to-end, ship...  ...of the Technical Staff at Finch, you're building the system our team uses every day to run intake, medical records, police... 
    Work at office
    Remote work
    Flexible hours
    1 day per week

    Finchlegal

    Brooklyn, NY
    22 hours ago
  •  ...join our highly driven Agents engineering team. The Agents team consists of backend, full-stack, and AI/ML engineers who collaborate to build harnesses and AI systems powering delightful agentic experiences. These experiences include Perplexity Computer (our platform... 
    Flexible hours

    Neura Market

    Brooklyn, NY
    1 day ago
  •  ...THE ROLE You\'ll build the secure, reliable systems beneath Valkai\'s agents and products. The scope spans compute, storage, deployment, data pipelines, indexing, and retrieval. You will make these systems observable and dependable across cloud and self-hosted environments... 
    Immediate start

    Valkai, Inc.

    Brooklyn, NY
    1 day ago
  •  ...Hanomi is the operating system through which every hardware company in the world will manufacture mechanical parts. Every product is...  ...Competitive salary and meaningful equity participation. A small, technical team with backgrounds from NASA, Formula 1, and top engineering... 
    Full time
    Work at office

    Hanomi Inc.

    Brooklyn, NY
    4 days ago
  •  ...identifying the actions to alter it. To achieve this breakthrough, we are building a Large Physics foundation Model (LPM) because physical systems, unlike text or images, are governed by verifiable cause and effect. We believe that scaling on physics will enable an... 

    Uncover

    Brooklyn, NY
    2 days ago
  • $200k

     ...employment type. We train action policies and world models on the largest corpus of action-labeled gaming data in the world. Member of Technical Staff is the title everyone in our technical team holds. Each MTS is not fit to a single role - we help you find the most... 

    Gamedevsofcolorexpo

    Brooklyn, NY
    3 days ago
  •  ...leaders at design partners to encode real control frameworks correctly. What we look for Experience building rules engines, policy systems, query planners, compilers, or type checkers. Comfort with formal reasoning: decidability, determinism, and the limits of static... 

    Dipp AI Technologies

    Brooklyn, NY
    3 days ago
  •  ...About the Role Conduct critical comparative analysis to advance our understanding of model capabilities Build and refine evaluation systems and processes that create tight feedback loops between data, evals, and model behavior Develop generalizable evaluation frameworks... 
    Work at office
    Visa sponsorship

    Visa Hunt

    Brooklyn, NY
    4 days ago
  •  ...your career. We are motivated individuals who tackle unique technical challenges at scale and solve them as a team, delivering...  ...AI research within the financial technology sector. As a Member of Technical Staff , you will operate with a high degree of autonomy and responsibility... 
    Flexible hours

    EngineersOfAI

    Brooklyn, NY
    2 days ago
  •  ...Thor is hiring an engineer to design and improve the data center systems behind our compute fleet. This is an on-site engineering role...  ...through the software control plane. In this role you will Own the technical direction for data center architecture and operations... 
    Work at office

    Mount Thor, Inc.

    Brooklyn, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Member of Technical Staff - ML Systems & Inference. Be the first to apply!