Senior ML Platform Engineer: Scalable GPU Inference
$170k - $220kCharlie Health
Charlie Health, located in New York City, is hiring an ML Platform Engineer to lead and build foundational systems for their AI capabilities. This role demands solid experience in software engineering and a keen understanding of ML infrastructure. Ideal candidates will have at least 4 years of professional experience with a strong foundation in Python, cloud ML services, and infrastructure as code. The role requires 4 days in the NYC office, and offers a salary between $170,000 to $220,000 annually. #J-18808-Ljbffr Charlie Health
- ...foundation for AI teams. With instant GPU access, sub-second container... ...jobs, and serve low-latency inference. We have thousands of... ...olympiad medalists, and experienced engineering and product leaders with... ...engineers with experience in making ML systems performant at scale....Senior
$227.2k - $417k
Tubi is looking for a Software Engineer in New York City to work on the ML Infrastructure team. This role involves designing scalable systems and collaborating with Machine Learning... ...and Product teams to enhance their inference platforms. Candidates should have experience...SuggestedFlexible hours$170k - $220k
...000 clients nationwide. Our ML and AI capabilities are expanding... ...As our first dedicated ML Platform Engineer, you’ll define the technical... ...and are investing in hosted GPU inference to support the next... ...needs and translate them into scalable platform capabilities Foster...SeniorFull timeWork at officeLocal area- Nscale is seeking a Staff Observability Platform Engineer to enhance our observability platform for GPU clusters and AI workloads. This role requires a strong technical leader capable of implementing scalable solutions and improving operational efficiency. The ideal candidate...Senior
$160k - $240k
Bloomberg L.P. in New York is seeking a Senior Software Engineer for AI Inference to design and build scalable infrastructure for machine learning applications. The ideal candidate will have over 5 years of software engineering experience, expertise in distributed systems...Senior$152k - $228k
...Job Description Senior ML Engineer About Invoca Invoca... ...powered revenue execution platform that brings together... ...fine-tuning through inference optimization and... ...and Kubernetes-based GPU infrastructure. Profile... ...throughput, and build robust, scalable APIs for internal and...SeniorCurrently hiringRemote workFlexible hours- ...infrastructure company based in New York is seeking experienced engineers to enhance the performance of ML systems and contribute to open-source projects. Ideal... ...writing high-quality code and familiarity with Nvidia GPU architecture and ML frameworks. This role offers...
- Sigma is looking for an experienced AI/ML Engineer to join their innovative team in New York City. In this role, you will partner with various teams to leverage AI/ML opportunities and significantly impact the future of data interactions. The ideal candidate will have 1...SeniorFlexible hours
$165k - $330k
A leading AI company in New York is seeking an Infrastructure Software Engineer to develop and maintain components of their ML inference platform. Responsibilities include implementing Kubernetes deployments, enhancing monitoring systems, and developing infrastructure...- Reflection seeks a skilled professional in New York to design and operate large-scale GPU infrastructure for model inference and reinforcement learning. The role demands several years of experience in deploying GPU systems, optimizing model performance, and working with...Senior
- ...Inc. is seeking a Principal Software Engineer for the ML Inference team in NYC. This role leads technical... ...scale inference services, and drives scalable deployments across product lines. You... ...engineers while shaping the company’s ML platform direction. #J-18808-Ljbffr Snap
- J.P. Morgan is seeking an Applied AI ML Engineer-Senior Associate to design and implement scalable machine learning solutions within the broader software development lifecycle in New York. The role emphasizes collaboration with cross-functional teams, performance optimization...Senior
- Sigma Computing is seeking an experienced AI/ML professional to join their innovative team. The role involves collaborating with cross-functional teams, building scalable AI/ML systems, and creating natural language interfaces to enhance user interaction with data. Candidates...Senior
- Rocket Money is seeking a Data Platform Engineer in New York City to own and evolve our data platform infrastructure. The role includes building scalable data systems, ensuring their security and performance, and collaborating with stakeholders to integrate new data sources...Senior
- Salesforce is seeking a Sr. Software Engineer to join the Platform Service team within Digital Marketing Technology. You will shape architecture, implement scalable distributed systems, and ensure high-quality releases with a team of world-class engineers. You will work...Senior
$280k - $325k
SoundCloud is looking for a Senior Principal Machine Learning Engineer to lead the development of its ML systems. This role involves a significant focus on large-scale modeling techniques and the opportunity to drive strategic initiatives. Applicants should have over 1...Senior- A leading data analytics firm in San Francisco is seeking a Senior Machine Learning Engineer for their Match Team. This role blends advanced statistical research with engineering to enhance customer-facing data products. The ideal candidate will have over five years of...Senior
- ...technology, please visit Senior Machine Learning Engineer Position Summary: We... ...care more about deep ML/CV ability than any... ...Design systems that infer structured attributes... ..., quantization, and GPU acceleration Read current... ...Implement efficient, scalable data pipelines and...Senior
$132.3k - $245.7k
...York is seeking a Machine Learning Engineer for their Video AI Platform. The role involves building and maintaining... ...search services, and designing scalable model serving solutions. The ideal... ...candidate has over 5 years of experience in ML engineering, particularly in model...Senior$140k - $200k
...expertise with engineering excellence to help... ...modernize platforms, unlock data insights... ...are seeking a Senior Platform... ...enables secure, scalable deployment of Generative... ...supporting AI/ML workloads,... ...applications, model inference endpoints, API... ...supporting GPU‑enabled compute...SeniorTemporary workRemote workWorldwide$160k - $240k
A leading financial technology company in New York is seeking a Senior MLOps Engineer to help enhance AI systems and processes. Candidates should have at least 4 years of experience in programming, knowledge of machine learning frameworks, and experience with cloud technologies...Senior$250k - $300k
A cloud financial management company is seeking a Mid-Senior Software Engineer to build scalable systems for cloud expense management. Responsibilities... ...problems, and collaborating with a team to enhance the platform's capabilities. Candidates should have at least 5...Senior$256k - $285k
Garner Health is seeking a Senior MLOps Engineer to support their platform engineering team in New York City. In this role, you will be pivotal in building... ...engineering experience and a strong grasp of operating ML systems. Garner Health offers a competitive salary range...Senior$256k - $285k
...Health Technology, Inc. is seeking a Senior Machine Learning Operations Engineer in New York City to build and operate... ...role involves close teamwork with the platform and data science teams to ensure quality and efficiency in ML deployment. The candidate will need a...Senior- Future Secure AI Pty is looking for a Sr. AI/ML Software Engineer to develop and maintain key components for the FutureSecure.ai platform. You will focus on building and scaling infrastructure for intelligent interactions, requiring strong skills in TypeScript/Node.js...Senior
- ...cutting-edge technology company is looking for exceptional generalist engineers who thrive with autonomy. This fully remote role allows you to... ...'s degree and a strong track record in systems programming or ML infrastructure. Competitive compensation and benefits are...SeniorRemote job
- Unity in New York is seeking a Staff ML Engineer to design and enhance its large-scale offline ML platform aimed at improving decision-making through reliable infrastructure. This role involves building data pipelines for ML training and collaborating with various teams...
- Crypto Pro Network is seeking a Software Engineer to join their Data team in New York. This role involves designing and implementing data architecture and pipelines while collaborating with various teams to support data-driven decisions. The ideal candidate will have over...Senior
- Wagmo, located in New York, NY, is hiring a Senior Software Engineer, Data Platform to build and scale its data infrastructure. This role involves designing robust pipelines and managing data warehouses while ensuring clean, reliable data flows across the business. You...Senior
$192k - $240k
Brex in New York is seeking a Data Infrastructure Engineer to join the Data Enablement Platform team. You will be responsible for maintaining Brex's data platform, partnering with product teams to launch data-backed products, and improving data architectures. This role...SeniorWork at office3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior ML Platform Engineer: Scalable GPU Inference. Be the first to apply!
- graduate machine learning engineer New York, NY
- junior machine learning research engineer New York, NY
- data scientist machine learning engineer New York, NY
- machine learning engineer New York, NY
- ai ml engineer New York, NY
- machine learning software engineer New York, NY
- senior ml engineer New York, NY
- machine learning ai engineer New York, NY
- computer vision machine learning engineer New York, NY
- data platform engineer New York, NY

