Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior ML Platform Engineer: Scalable GPU Inference

$170k - $220k

Charlie Health

Charlie Health, located in New York City, is hiring an ML Platform Engineer to lead and build foundational systems for their AI capabilities. This role demands solid experience in software engineering and a keen understanding of ML infrastructure. Ideal candidates will have at least 4 years of professional experience with a strong foundation in Python, cloud ML services, and infrastructure as code. The role requires 4 days in the NYC office, and offers a salary between $170,000 to $220,000 annually. #J-18808-Ljbffr Charlie Health

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior ML Platform Engineer: Scalable GPU Inference in New York, NY vacancy
  •  ...foundation for AI teams. With instant GPU access, sub-second container...  ...jobs, and serve low-latency inference. We have thousands of...  ...olympiad medalists, and experienced engineering and product leaders with...  ...engineers with experience in making ML systems performant at scale.... 
    Senior

    Modal Labs

    New York, NY
    1 day ago
  • $227.2k - $417k

    Tubi is looking for a Software Engineer in New York City to work on the ML Infrastructure team. This role involves designing scalable systems and collaborating with Machine Learning...  ...and Product teams to enhance their inference platforms. Candidates should have experience... 
    Suggested
    Flexible hours

    Tubi

    New York, NY
    1 day ago
  • $170k - $220k

     ...000 clients nationwide. Our ML and AI capabilities are expanding...  ...As our first dedicated ML Platform Engineer, you’ll define the technical...  ...and are investing in hosted GPU inference to support the next...  ...needs and translate them into scalable platform capabilities Foster... 
    Senior
    Full time
    Work at office
    Local area

    Charlie Health

    New York, NY
    1 day ago
  • Nscale is seeking a Staff Observability Platform Engineer to enhance our observability platform for GPU clusters and AI workloads. This role requires a strong technical leader capable of implementing scalable solutions and improving operational efficiency. The ideal candidate... 
    Senior

    Nscale

    New York, NY
    1 day ago
  • $160k - $240k

    Bloomberg L.P. in New York is seeking a Senior Software Engineer for AI Inference to design and build scalable infrastructure for machine learning applications. The ideal candidate will have over 5 years of software engineering experience, expertise in distributed systems... 
    Senior

    Bloomberg

    New York, NY
    4 days ago
  • $152k - $228k

     ...Job Description Senior ML Engineer About Invoca Invoca...  ...powered revenue execution platform that brings together...  ...fine-tuning through inference optimization and...  ...and Kubernetes-based GPU infrastructure. Profile...  ...throughput, and build robust, scalable APIs for internal and... 
    Senior
    Currently hiring
    Remote work
    Flexible hours

    Invoca

    New York, NY
    25 days ago
  •  ...infrastructure company based in New York is seeking experienced engineers to enhance the performance of ML systems and contribute to open-source projects. Ideal...  ...writing high-quality code and familiarity with Nvidia GPU architecture and ML frameworks. This role offers... 

    Modal

    New York, NY
    1 day ago
  • Sigma is looking for an experienced AI/ML Engineer to join their innovative team in New York City. In this role, you will partner with various teams to leverage AI/ML opportunities and significantly impact the future of data interactions. The ideal candidate will have 1... 
    Senior
    Flexible hours

    Sigma

    New York, NY
    1 day ago
  • $165k - $330k

    A leading AI company in New York is seeking an Infrastructure Software Engineer to develop and maintain components of their ML inference platform. Responsibilities include implementing Kubernetes deployments, enhancing monitoring systems, and developing infrastructure... 

    Baseten

    New York, NY
    1 day ago
  • Reflection seeks a skilled professional in New York to design and operate large-scale GPU infrastructure for model inference and reinforcement learning. The role demands several years of experience in deploying GPU systems, optimizing model performance, and working with... 
    Senior

    Reflection

    New York, NY
    3 days ago
  •  ...Inc. is seeking a Principal Software Engineer for the ML Inference team in NYC. This role leads technical...  ...scale inference services, and drives scalable deployments across product lines. You...  ...engineers while shaping the company’s ML platform direction. #J-18808-Ljbffr Snap

    Snap

    New York, NY
    1 day ago
  • J.P. Morgan is seeking an Applied AI ML Engineer-Senior Associate to design and implement scalable machine learning solutions within the broader software development lifecycle in New York. The role emphasizes collaboration with cross-functional teams, performance optimization... 
    Senior

    Gravity Engineering Services Pvt Ltd.

    New York, NY
    16 hours ago
  • Sigma Computing is seeking an experienced AI/ML professional to join their innovative team. The role involves collaborating with cross-functional teams, building scalable AI/ML systems, and creating natural language interfaces to enhance user interaction with data. Candidates... 
    Senior

    Sigma Computing

    New York, NY
    1 day ago
  • Rocket Money is seeking a Data Platform Engineer in New York City to own and evolve our data platform infrastructure. The role includes building scalable data systems, ensuring their security and performance, and collaborating with stakeholders to integrate new data sources... 
    Senior

    Rocket Money

    New York, NY
    1 day ago
  • Salesforce is seeking a Sr. Software Engineer to join the Platform Service team within Digital Marketing Technology. You will shape architecture, implement scalable distributed systems, and ensure high-quality releases with a team of world-class engineers. You will work... 
    Senior

    salesforce.com, inc.

    New York, NY
    1 day ago
  • $280k - $325k

    SoundCloud is looking for a Senior Principal Machine Learning Engineer to lead the development of its ML systems. This role involves a significant focus on large-scale modeling techniques and the opportunity to drive strategic initiatives. Applicants should have over 1... 
    Senior

    SoundCloud

    New York, NY
    1 day ago
  • A leading data analytics firm in San Francisco is seeking a Senior Machine Learning Engineer for their Match Team. This role blends advanced statistical research with engineering to enhance customer-facing data products. The ideal candidate will have over five years of... 
    Senior

    Enigma

    New York, NY
    1 day ago
  •  ...technology, please visit Senior Machine Learning Engineer Position Summary: We...  ...care more about deep ML/CV ability than any...  ...Design systems that infer structured attributes...  ..., quantization, and GPU acceleration Read current...  ...Implement efficient, scalable data pipelines and... 
    Senior

    clearview

    New York, NY
    1 day ago
  • $132.3k - $245.7k

     ...York is seeking a Machine Learning Engineer for their Video AI Platform. The role involves building and maintaining...  ...search services, and designing scalable model serving solutions. The ideal...  ...candidate has over 5 years of experience in ML engineering, particularly in model... 
    Senior

    Warner Bros. Discovery

    New York, NY
    1 day ago
  • $140k - $200k

     ...expertise with engineering excellence to help...  ...modernize platforms, unlock data insights...  ...are seeking a Senior Platform...  ...enables secure, scalable deployment of Generative...  ...supporting AI/ML workloads,...  ...applications, model inference endpoints, API...  ...supporting GPU‑enabled compute... 
    Senior
    Temporary work
    Remote work
    Worldwide

    BIP US

    New York, NY
    1 day ago
  • $160k - $240k

    A leading financial technology company in New York is seeking a Senior MLOps Engineer to help enhance AI systems and processes. Candidates should have at least 4 years of experience in programming, knowledge of machine learning frameworks, and experience with cloud technologies... 
    Senior

    Bloomberg L.P.

    New York, NY
    1 day ago
  • $250k - $300k

    A cloud financial management company is seeking a Mid-Senior Software Engineer to build scalable systems for cloud expense management. Responsibilities...  ...problems, and collaborating with a team to enhance the platform's capabilities. Candidates should have at least 5... 
    Senior

    North

    New York, NY
    4 days ago
  • $256k - $285k

    Garner Health is seeking a Senior MLOps Engineer to support their platform engineering team in New York City. In this role, you will be pivotal in building...  ...engineering experience and a strong grasp of operating ML systems. Garner Health offers a competitive salary range... 
    Senior

    Garner Health

    New York, NY
    1 day ago
  • $256k - $285k

     ...Health Technology, Inc. is seeking a Senior Machine Learning Operations Engineer in New York City to build and operate...  ...role involves close teamwork with the platform and data science teams to ensure quality and efficiency in ML deployment. The candidate will need a... 
    Senior

    Garner Health Technology, Inc.

    New York, NY
    1 day ago
  • Future Secure AI Pty is looking for a Sr. AI/ML Software Engineer to develop and maintain key components for the FutureSecure.ai platform. You will focus on building and scaling infrastructure for intelligent interactions, requiring strong skills in TypeScript/Node.js... 
    Senior

    Future Secure AI Pty

    New York, NY
    1 day ago
  •  ...cutting-edge technology company is looking for exceptional generalist engineers who thrive with autonomy. This fully remote role allows you to...  ...'s degree and a strong track record in systems programming or ML infrastructure. Competitive compensation and benefits are... 
    Senior
    Remote job

    Inferact

    New York, NY
    1 day ago
  • Unity in New York is seeking a Staff ML Engineer to design and enhance its large-scale offline ML platform aimed at improving decision-making through reliable infrastructure. This role involves building data pipelines for ML training and collaborating with various teams... 

    Unity

    New York, NY
    1 day ago
  • Crypto Pro Network is seeking a Software Engineer to join their Data team in New York. This role involves designing and implementing data architecture and pipelines while collaborating with various teams to support data-driven decisions. The ideal candidate will have over... 
    Senior

    Crypto Pro Network

    New York, NY
    1 day ago
  • Wagmo, located in New York, NY, is hiring a Senior Software Engineer, Data Platform to build and scale its data infrastructure. This role involves designing robust pipelines and managing data warehouses while ensuring clean, reliable data flows across the business. You... 
    Senior

    Wagmo, Inc.

    New York, NY
    1 day ago
  • $192k - $240k

    Brex in New York is seeking a Data Infrastructure Engineer to join the Data Enablement Platform team. You will be responsible for maintaining Brex's data platform, partnering with product teams to launch data-backed products, and improving data architectures. This role... 
    Senior
    Work at office
    3 days per week

    Brex

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior ML Platform Engineer: Scalable GPU Inference. Be the first to apply!