Model API Engineer - High-Performance Inference
$180k - $360kBaseten
A leading AI platform provider in New York seeks a Model API Engineer focused on infrastructure for hosted AI models. Responsibilities include optimizing performance, building benchmarking frameworks, and collaborating on robust model serving solutions. Ideal candidates have 3+ years in distributed systems and a strong background in backend services. With a competitive compensation range of $180K - $360K and a comprehensive benefits package, this role offers a unique opportunity to shape the future of AI within a diverse and inclusive team. #J-18808-Ljbffr Baseten
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Model API Engineer - High-Performance Inference in New York, NY vacancy
$109k - $163.7k
...seeking a skilled LLM Engineer I to join our team... ...large language model (LLM) applications... ...for compliance, performance, and patient safety... ...foundation model APIs and SDKs (e.g., OpenAI... ..., including inference optimization, latency... ...communities by delivering high-quality care to...PerformanceTraineeshipLocal areaFlexible hours$175k - $280k
...is seeking an expert in optimizing machine learning models to turbocharge their serving layer, integrating LLM,... ...has significant experience in systems programming and performance engineering, aiming to improve high-throughput, low-latency serving. Join a team dedicated...Performance$180k - $360k
...mission‑critical inference for the world's most... ...cutting‑edge models into production. We... ...build the platform engineers turn to to ship AI... ...Role Baseten’s Model Performance (MP) team is... ...ll focus on Model API's — the infrastructure... ...’ll join a small, high‑impact team operating...PerformanceFlexible hours- Baseten is seeking a GPU Kernel Engineer in New York, NY. The ideal candidate will design high-performance GPU kernels and optimize computation for AI workloads. Responsibilities include implementing advanced features, contributing to open-source GPU libraries, and collaborating...PerformanceFlexible hours
$160k - $200k
...Baseten powers mission-critical inference for the world's most dynamic... ...of AI to bring cutting-edge models into production. We're... ...and help build the platform engineers turn to to ship AI products.... ...sitting at the intersection of high-performance computing (HPC) and Large...PerformanceFlexible hours- ...seeking a Legal Technology Senior Software Engineer in New York City (hybrid). You will... ...the full product lifecycle, delivering high‑performance software for complex legal workflows. You... ..., and JS/TS frameworks, build RESTful APIs, and mentor other engineers while...Performance
- ...for a skilled Backend Engineer III to design, develop,... ...connectivity with external APIs. You will play a key... ...architecture, design decisions, performance optimization, and... ...proficiency and data modeling skills. Ability to... ...and deliver medium-to-high complexity technical projects...Performance
$40 per hour
...is looking for a Satellite Systems Engineer to join their team, focusing on training AI models. In this remote position, you'll evaluate the logic and performance of AI chatbots, providing coding... ...hour, with additional bonuses for high-quality work. #J-18808-Ljbffr DataAnnotationPerformanceRemote jobHourly payFlexible hours$90k
...services industry and is evolving from a high-impact brand into a technology-... ..., and maintain AML compliance models and transaction monitoring scenarios... ...support AML model development, feature engineering, model validation, performance monitoring, and explainability....PerformanceHourly payFull timeContract workWork at officeShift workSantander Holdings USA Inc
New York, NY7 days ago$350k
...committed researchers, engineers, policy experts, and business... ...The Role Anthropic's inference fleet serves Claude to... ...: accelerator kernels, model servers, distributed... ...system and holding it to a high bar across four... ...measure how the fleet performs against its theoretical...PerformanceVisa sponsorship$320k
Anthropic is hiring a Staff + Senior Software Engineer, specializing in Inference, to design and build distributed systems for its AI platform... ...infrastructure, distributed systems, and optimizing performance in a high-scale environment. The role requires a Bachelor’s degree...Performance- ...Management AI Agent Engineer The property... ...language interfaces, model evaluation... ...Systems: Ensure optimal performance while engineering... ...domain knowledge. High-Performance... ...and efficient model inference while maintaining... ...not just another API wrapper around ChatGPT...PerformanceRelocation
HAVEN
New York, NY4 days ago - ...LLM Engineer (Large Language Model Engineer) We are seeking a highly skilled LLM Engineer to design, develop... ...enterprise systems, APIs, databases, and cloud... ...frameworks to measure model performance, accuracy, and... ...model optimization, and inference strategies. Strong...PerformanceFull timeRemote work
Ova Technologies
New York, NY3 days ago $180k
...in a meritocratic environment and contribute hands-on to challenging projects. Core responsibilities include addressing critical modeling challenges. The ideal candidate is passionate about truth-seeking AI and looking forward to a competitive compensation package that...- Goldman Sachs in New York, NY seeks a senior trading platform engineer to design, build, and maintain high-performance options trading systems for global clients. You will work with product managers, traders, and engineers to translate requirements into robust, low-latency...Performance
- ...designing, and maintaining VMware environments while ensuring optimal performance and capacity planning. The ideal candidate will have strong... ...storage technology knowledge, alongside proficiency in REST APIs, JSON, and YAML. Excellent communication skills are essential for...Performance
- ...York to design and operate large-scale GPU infrastructure for model inference and reinforcement learning. The role demands several years of experience in deploying GPU systems, optimizing model performance, and working with frameworks like SGLang and Megatron. The position...Performance
- ...job poster from EDGE Engineering and Science, LLC Recruitment... ...Senior Air Dispersion Modeler to lead and manage... ...opportunity to lead high-impact projects, mentor... ...matched 401(k) plan. Annual performance bonus program. Student... ...Science, LLC by 2x Inferred from the description...PerformanceFull timeFor contractorsLocal areaRemote work
- A forward-thinking tech company is seeking a Software Engineer in New York to design and implement high-performance distributed systems primarily using golang. We value self-guided learning and innovation while promoting a culture of experimentation. Ideal candidates are...Performance
- A leading investment bank in New York is seeking a Market Access System Engineer. In this role, you will support and enhance high-performance trading infrastructure, ensuring stability and efficiency in a fast-paced financial environment. The ideal candidate will have strong...Performance
$50 - $65 per hour
...hyper relevant to team The Engineer Full Stack is responsible for... ..., code, debug and document high traffic web applications and... ...Infrastructure. Ensure quality and performance standards are met across... ...Program Interfaces (APIs). Four (4) years of professional...PerformanceContract workTemporary workWork experience placementWork at officeImmediate startRemote workFlexible hoursNight shift- ...Integration Specialist to manage API integrations across platforms... ...is vital for ensuring the performance and stability of business-... ...will collaborate closely with engineers and analysts, leveraging your... ...position offers a hybrid work model in New York. #J-18808-Ljbffr...PerformanceRemote job
$175k - $200k
We are seeking a highly skilled C++ engineer with extensive experience in high-frequency trading systems to join our trading team. In this role... ...HFT systems that have a direct impact on our trading performance. Responsibilities Lead the design and development of low...Performance$40 per hour
A technology firm in New Jersey is seeking a Full Stack Developer to train AI models. The role involves evaluating AI chatbots and measuring their performance. Applicants should be proficient in Python or JavaScript, with a strong understanding of algorithms and debugging...PerformanceHourly payFor contractorsRemote workDataAnnotation
New York, NY1 day ago- NVIDIA is currently seeking a Senior Developer Technology Engineer for High-Performance Databases! Would you enjoy researching new algorithms and... ...generation hardware architectures, software, and programming models in collaboration with research, hardware, system software,...Performance
- ...and deploying frontier models for developers and... ...team of researchers, engineers, designers, and more,... ...the boundaries of LLM inference efficiency. We develop... ...stack to improve core performance metrics by diving deep... ...of experience writing high‑performance, production...PerformanceFull timeWork at officeRemote workFlexible hours
- Metric Geo in New York seeks a motivated Commissioning Engineer to support delivery of high performance building systems. You will plan, execute, and validate MEP systems across multiple projects, collaborating with multidisciplinary teams to ensure quality and efficiency...PerformanceFor contractors
- MERIT Beauty is seeking an AI Model Training Specialist based in New York, NY. This role involves training AI systems and enhancing model performance through data annotation and validation, specifically utilizing Bash scripting and command-line tools. Candidates should...PerformanceHourly pay
- A renowned trading firm in New York is seeking a Software Engineer skilled in low-level systems programming and optimization. You will... ...with quantitative researchers to design and optimize high-performance trading systems. While experience in OCaml is not necessary,...Performance
- ...Developer in New York, United States, with expertise in RESTful API design, distributed systems, and CI/CD practices. The ideal... ...This position offers opportunities to work in a dynamic environment focused on performance and scalability. #J-18808-Ljbffr Curate PartnersPerformance
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Model API Engineer - High-Performance Inference. Be the first to apply!
Related searches
- application performance engineer New York, NY
- acting performance New York, NY
- performance coach New York, NY
- performance test architect New York, NY
- lead performance test engineer New York, NY
- performance test engineer New York, NY
- performance engineer New York, NY
- performance improvement consultant New York, NY
- senior performance engineer New York, NY
- senior performance tester New York, NY