Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Member of Technical Staff - ML Systems & Inference

Acceler8 Talent

Member of Technical Staff - ML Systems & Inference Bay Area, CA | Onsite Join a well-funded AI infrastructure startup building the orchestration layer for next-generation AI workloads This role sits at the intersection of ML systems, inference, distributed systems, and performance engineering. You'll build production inference systems, optimize scheduling and memory management, improve KV cache efficiency, and work closely with compiler, kernel, and distributed systems engineers to push AI infrastructure forward We're looking for engineers with: Strong software engineering fundamentals Experience with ML inference or model serving Knowledge of distributed systems and performance optimization Python and/or C++ Experience with vLLM, TensorRT-LLM, CUDA, or similar is a plus This is an opportunity to help define how AI work #J-18808-Ljbffr Acceler8 Talent

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Member of Technical Staff - ML Systems & Inference in Brooklyn, NY vacancy
  • $150k - $350k

     ...Member of Technical Staff | Distributed Systems San Francisco - Onsite $150k-$350k base + equity I'm working with a...  ...infrastructure company , building an inference cloud for agentic workloads that...  ...built schedulers, control planes, ML serving infrastructure, distributed... 
    Suggested

    Acceler8 Talent

    Brooklyn, NY
    17 hours ago
  • Member of Technical Staff - Distributed Systems San Francisco, CA Full-time | On-site Join an early-stage AI infrastructure company building the orchestration...  ...beyond simply operating clusters Collaborate across inference, runtimes, compilers, kernels, and hardware What We’... 
    Suggested
    Full time

    Acceler8 Talent

    Brooklyn, NY
    2 days ago
  •  ...is building the trusted agent operating system for the enterprise. Our platform helps companies...  ...ambiguous enterprise problems into clear technical designs, working software, and measurable...  ...another engineering team. It is not an ML research role focused on training... 
    Suggested
    Immediate start

    Sycamore

    Brooklyn, NY
    4 days ago
  • Sycamore is building the trusted agent operating system for the enterprise, enabling companies to build, deploy, and orchestrate AI agents with security and control. We are a small, engineering-led team working with Fortune 500 enterprises. We are looking for engineers... 
    Suggested

    Sycamore

    Brooklyn, NY
    4 days ago
  •  ...discipline, or equivalent practical experience in AI Safety. Deep technical understanding of LLM safety, including adversarial attacks,...  ...building automated evaluation pipelines or large-scale ML systems. Experience with Reinforcement Learning (RLHF/RLAIF) and how... 
    Suggested
    Work at office
    Visa sponsorship

    Visa Hunt

    Brooklyn, NY
    4 days ago
  •  ...accessible to all. About the Role Build and scale distributed training systems that power frontier model pre-training. Work closely with...  ...for distributed workloads. Experience working closely with ML researchers to productionize experimental training workflows. Strong... 
    Work at office
    Visa sponsorship

    Visa Hunt

    Brooklyn, NY
    5 days ago
  •  ...Method Innovation We are looking for strong technical builders and researchers who deeply...  ...have: Strong experimental rigor Solid systems and modeling intuition Hands-on engineering...  ...-context and memory-efficient modeling Inference acceleration and serving optimization... 

    DeepRoute

    Brooklyn, NY
    4 days ago
  •  ...platform for AI applications. We are looking for team members who love building enabling systems that empower our engineers and power our rapidly growing...  ...LLM applications, including model integrations, inference workloads, evaluation pipelines, observability, and the... 
    Work at office

    LlamaIndex, Inc.

    Brooklyn, NY
    2 days ago
  •  ...Solid software engineering capabilities with experience building large-scale systems. Experience with large-scale ETL workflows and training data preparation. Deep understanding of large-scale ML, especially as it relates to language models, distributed training, and... 
    Work at office
    Visa sponsorship

    Visa Hunt

    Brooklyn, NY
    2 days ago
  •  ...architectures, but from better data. As a member of the Data Team, your mission...  ...building data pipelines, QA systems, or evaluation workflows for...  ...in Python and building ML / LLM workflows. Must be...  ...to clearly articulate complex technical concepts across teams What We... 
    Work at office
    Visa sponsorship

    Visa Hunt

    Brooklyn, NY
    4 days ago
  • $160k - $230k

    About the role As a Technical Support Engineer at a pioneering AI company...  ...training, fine tuning, and inference solutions with Together AI. You...  ...migrations by validating system health and traffic routing. Monitor...  ..., with knowledge of AI, ML, GPU technologies and their integration... 
    Full time
    Remote work
    Monday to Friday
    Flexible hours
    Night shift
    Weekend work
    Day shift
    Weekday work

    Neura Market

    Brooklyn, NY
    6 days ago
  • $227.5k - $401k

     ...your career. We are motivated individuals who tackle unique technical challenges at scale and solve them as a team, delivering...  ...AI research within the financial technology sector. As a Member of Technical Staff, you will operate with a high degree of autonomy and responsibility... 
    Work at office
    Immediate start
    Relocation
    Flexible hours

    Jobzhr

    Brooklyn, NY
    5 days ago
  • $13 per hour

     ...America’s $13T mortgage market is one of the most important financial systems in the world. It underwrites the middle class and is the...  ...accessible. Tech Stack TypeScript Custom DSLs for rule encoding AI/ML tooling and agentic infrastructure NestJS + GraphQL SQL (... 

    Pylon

    Brooklyn, NY
    2 days ago
  •  ...and research settings. This field-facing technical specialist role serves as a key...  ...environments. As a Technical Specialist - KRYPTOR Systems and Assays, you will play a critical role...  ...with laboratory leaders, technical staff and other key personnel in supporting both... 
    Work at office
    Flexible hours

    RXinsider LTD.

    Brooklyn, NY
    6 days ago
  • Build the runtime, evaluation, and learning systems that every agent on the platform depends...  ...are not something you could reasonably infer from outside. Tell us what you have built...  ...introductory conversation. Two 60-minute technical interviews, one focused on systems design... 

    Sycamore

    Brooklyn, NY
    4 days ago
  • Sycamore in Palo Alto is seeking a Member of Technical Staff to build product surfaces across AI agent experiences, from the UI through backend...  ...reliability and accessibility. The role emphasizes ownership, design systems, streaming and non-deterministic behavior, and... 

    Sycamore

    Brooklyn, NY
    4 days ago
  • Perplexity is seeking an intrepid, polymathic Member of Technical Staff to take on one of the AI industry's most unique engineering roles. You'll...  ...in U.S. federal court. Engineer privacy and compliance systems that efficiently scale with our growing portfolio of frontier... 

    Neura Market

    Brooklyn, NY
    6 days ago
  • $12 per hour

     ...reduce errors, and accelerate project delivery. Were building the system of record for design production in a $12T+ industry that has...  ...requirements into clean, scalable solutions Own features end-to-end, from technical design to production deployment Write high-quality,... 
    For contractors

    Pirros

    Brooklyn, NY
    18 hours ago
  •  ...services/APIs) Own projects full lifecycle Design discussions & technical scoping Implementation & testing Post-launch iteration Translate ideas to intuitive, performant, scalable UX Contribute to system architecture - ensure reliable, maintainable, scalable stack Balance... 
    Work at office
    Remote work
    Visa sponsorship
    Monday to Friday

    ProductNow

    Brooklyn, NY
    1 day ago
  •  ...your career. We are motivated individuals who tackle unique technical challenges at scale and solve them as a team, delivering...  ...AI research within the financial technology sector. As a Member of Technical Staff , you will operate with a high degree of autonomy and responsibility... 
    Flexible hours

    EngineersOfAI

    Brooklyn, NY
    18 hours ago
  • Member of Technical Staff, Design Engineering Own the design system and the interface craft behind products used by enterprises and written by agents. About Sycamore Sycamore is building the trusted agent operating system for the enterprise. Our platform helps companies... 
    Contract work

    Sycamore

    Brooklyn, NY
    4 days ago
  • THE ROLE You\'ll build the secure, reliable systems beneath Valkai\'s agents and products. The scope spans compute, storage, deployment, data pipelines, indexing, and retrieval. You will make these systems observable and dependable across cloud and self-hosted environments... 
    Immediate start

    Valkai, Inc.

    Brooklyn, NY
    2 days ago
  •  ...About the Role Conduct critical comparative analysis to advance our understanding of model capabilities Build and refine evaluation systems and processes that create tight feedback loops between data, evals, and model behavior Develop generalizable evaluation frameworks... 
    Work at office
    Visa sponsorship

    Visa Hunt

    Brooklyn, NY
    4 days ago
  •  ...excitement to make smart vehicles for a smart world. Technical Expert (LL6) position leading global suspension and steering system integration from concept, design and...  ...Vehicle discount program for employees and family members and management leases Tuition assistance... 
    Immediate start
    Flexible hours

    Ford

    Brooklyn, NY
    2 days ago
  •  ...powers all of engineering. You'll design and validate the infrastructure behind PB-scale workloads, own incident response, harden systems against failure, and build the monitoring, security, and CI/CD tooling the whole team relies on. This role is ideal for someone who... 

    Sieve, Inc.

    Brooklyn, NY
    5 days ago
  •  ...security foundations that let enterprise AI agents act on real systems without exceeding their authority, exposing customer data, or weakening...  ...model. A 30‑minute introductory conversation. Two 60‑minute technical interviews, one focused on security systems design and threat... 

    Sycamore

    Brooklyn, NY
    4 days ago
  • View all jobs Member of Technical Staff, Generalist Bay Area Engineering In office Full-time Inception creates the world’s fastest, most efficient AI models. Our Mercury model is the world’s fastest reasoning LLM and first commercially available diffusion LLM, delivering... 
    Full time
    Work at office
    Immediate start
    Flexible hours

    Inception Labs

    Brooklyn, NY
    4 days ago
  • $122.88k - $184.32k

     ...of building large in‑house AI/ML infrastructure. Built by...  ...large‑scale GPU orchestration to inference optimization, we own the hard...  ...processes, and hands‑on technical oversight. You will own day‑...  ...issues, including GPU‑based systems and fiber networks. Solid understanding... 

    Nebius

    Brooklyn, NY
    3 days ago
  • Relativity is seeking a Technical Support Specialist in Kentucky to troubleshoot software and networked systems, and to provide exceptional customer support via phone and email...  ...resolve tickets, and work with senior team members to diagnose incidents. The role requires... 
    Remote job
    Shift work

    Relativity

    Brooklyn, NY
    4 days ago
  • $208k - $312k

     ...primary agentic interface for getting work done across Vercel, from answering questions and analyzing data to executing complex, multi-system workflows. Build the agent architecture that allows V to understand intent, plan work, select the right skills and tools, recover... 
    Remote job
    Full time
    Work from home
    Worldwide
    Flexible hours

    Neura Market

    Brooklyn, NY
    6 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Member of Technical Staff - ML Systems & Inference. Be the first to apply!