Staff Engineer, Inference Runtime — Performance & Scale
Menlo Ventures
Menlo Ventures is looking for a Staff Engineer to lead technical efforts in their Inference organization. This senior role involves setting the technical direction for the inference runtime, ensuring it scales efficiently across various platforms. The ideal candidate will have a strong background in systems engineering and experience with ML infrastructure, optimizing performance in distributed systems. The role is based in New York, NY, with a hybrid work policy. #J-18808-Ljbffr Menlo Ventures
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Staff Engineer, Inference Runtime — Performance & Scale in New York, NY vacancy
- Blink Health, based in New York City, seeks a Staff Design Systems Engineer to shape and scale the visual and interaction foundations of its digital products... ...teams to ensure high standards of quality and performance in UI components. Join a diverse and collaborative team...Performance
$405k
...committed researchers, engineers, policy experts,... ...Role Anthropic's Inference organization... ...’re looking for a Staff Engineer to be a technical... ...for Inference Runtime: the team that owns... ...stack, whose performance, correctness, and... ...spanning serving, scaling, and accelerator teams...PerformanceVisa sponsorship$175k - $250k
...edge autonomous agent runtime focused on high‑... ...market outcomes. The Staff AI Engineer will be responsible for... ...configuration errors and performance degradation across... ...strategies. Model & Inference Infrastructure Ownership... ...cost‑efficiency at scale. Essential...PerformanceFull timeImmediate startRemote workShift work$188k - $275k
...facing features in a large-scale production environment... ...video storyteller. As a Staff User Experience Engineer specializing in delivering... ...between UX outlook and high-performance implementation, taking full... ...optimizing for maintainability, runtime performance, and code base...Performance- ...professional in New York to design and operate large-scale GPU infrastructure for model inference and reinforcement learning. The role demands several... ...experience in deploying GPU systems, optimizing model performance, and working with frameworks like SGLang and Megatron...Performance
- A leading AI infrastructure company based in New York is seeking experienced engineers to enhance the performance of ML systems and contribute to open-source projects. Ideal candidates will have over 5 years of experience in writing high-quality code and familiarity with...Performance
- ...intelligence - training pipelines, inference systems, evaluation tooling,... ...evaluation pipelines covering performance, robustness, safety, and bias,... ..., latency reduction, and scaling policies. Collaborate closely with application engineering to integrate ML systems cleanly...Performance
- ...We’re looking for a Senior Staff Machine Learning Engineer to lead Reddit’s next-... ...modeling approaches (e.g., large-scale embeddings, user interest... ...latency, cost, and performance. Reimagine user understanding... ...dynamic user profiles, intent inference, semantic reasoning over...PerformanceRemote jobImmediate startShift work
$180k - $230k
Kiddom Inc in New York is looking for a Staff Backend Software Engineer who will be involved in designing, developing, and maintaining high‑performance backend systems. Ideal candidates should have a strong background in backend technologies and system architecture. The...Performance- A leading AI infrastructure company in San Francisco is seeking a Staff Backend Engineer to design and build robust, high-performance systems. This role involves collaborating with a talented tech team to shape innovative AI solutions and requires extensive backend experience...PerformanceRemote jobFlexible hours
- ...team of registered architects, engineers, and city planners to deliver... ...operate agents securely at scale with session isolation, long-... ...Operationalize on Bedrock AgentCore: Use Runtime for secure, scalable hosting... ...cycles and lifts model performance—turning raw construction...PerformanceFull timeSummer workWork at officeFlexible hours
53 Stations
New York, NY1 day ago - A leading gaming and sports technology firm is seeking a Staff Engineer, Client Services, to join their innovative team in New York. This... ...in relevant technologies, and a passion for building high-performance solutions. Competitive salary and benefits, including bonuses...Performance
$188k - $275k
...enables innovators to build and scale AI with confidence. Trusted... ...superior infrastructure performance with deep technical... ...’ll Do: We are seeking a Staff Security Engineer to lead the most complex technical... ..., supply chain security, runtime protection) * Experience...PerformancePermanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$175k - $250k
...urgency, who believe in the scale of our ambition and thrive... ..., and be part of a high-performing team that believes in each... ...is seeking a Sr. to Senior Staff level Solutions Engineer to work closely with our... ...Kubernetes—especially for inference and model training workflows...PerformanceTemporary work$200.2k - $357.5k
...transform their operations at scale. Working at Samsara... .... We’re hiring a Staff / Senior Staff Machine... ...Learning Infrastructure Engineer to lead the design and... ..., batch and online inference, and edge deployment,... ...opportunities tied to performance, subject to plan terms...PerformanceFull timeWork at officeRemote workFlexible hours- ...comprised of experienced engineers and product designers.... .... Developing the inference and model training backend... ...reliability and performance for enterprise use-cases... ...mentoring the team as we scale. Qualifications... ...infrastructure engineer (staff IC with 7+ years of experience...PerformanceRelocationFlexible hours
$200k - $300k
NinjaOne is looking for a Staff Performance Software Engineer to lead performance testing and data generation initiatives. This remote-friendly position requires strong expertise in performance optimization with JavaScript and k6, as well as experience in cloud native environments...PerformanceRemote job- ...immediate impact. Design and implement high-performance Solana programs in Rust that handle... ...Work closely with backend and frontend engineers to design clean on-chain / off‑chain boundaries... ...programs that operate at meaningful scale, with real users, sustained volume, and...PerformanceImmediate start
- We’re looking for a Staff-level Geospatial Engineer to own and evolve our geospatial data platform—from... ...reliability, lineage, and observability at scale. What You’ll Do Design and operate... ...schemes, spatial indexing, and high-performance retrieval . Hands‑on experience...PerformanceRemote work
$253.9k - $298.7k
Senior Staff Protocol Engineer to join the Base Protocols team to enable and accelerate the success... ...of new initiatives for improving and scaling Base's throughput. Hack on both... ...Familiarity with database internals and high‑performance database systems. Understanding of...PerformanceLocal area- ...sourced technology for the high-performance Sei Blockchain, the first... ...Layer 1 blockchain designed to scale with the industry. The unique... ...for more details. Platform Engineering at Sei We're building Sei into... ...belongs in CI vs. CD vs. runtime, and when to reach for chaos...Performance
$192k - $260k
...improve their business. Founded by engineers and customer-obsessed, we... ...for interfacing with data to scaling our services and... ...and AI. We are looking for a Staff Database Engineer to help build... ...database design to maximize performance. What we look for: A passion...PerformanceLocal areaWorldwideDatabricks
New York, NY5 days ago- ...highly skilled Senior Fullstack Engineer to join our dynamic team.... ...implement scalable, secure, and high-performance solutions. As a technical... ...: Guide and upskill senior/staff engineers and engineering... ...influencing tech direction at scale. Solid understanding of data...Performance
$179k - $205k
...projects transacted and built at scale. Today, most transactions in... ...reporting Raise the bar on engineering quality: reliability,... ...Past leadership in platform or staff-level engineering roles Exposure... ...your location. We also offer a performance-based annual bonus and...PerformanceFull timeRemote workFlexible hours$150k - $175k
Nscale is the GPU cloud engineered for AI. We provide cost-effective, high-performance infrastructure for AI start-ups and large enterprise... .... About the Role We’re hiring a Staff Engineer, Customer Trust to architect, automate, and scale a technically rigorous customer...PerformanceFlexible hours$123.69k - $170.08k
Corning Incorporated is hiring a Senior Staff Engineer, Controls in Corning, NY . This is a... ...This role offers real ownership, real scale, and the autonomy to lead. Key Responsibilities... ...equipment capability and project performance. Coordinate with project managers, manufacturing...PerformanceFull timeFor contractorsRelocation packageMonday to Friday- Staff Engineer, Web Team (Next.js, React) We’re looking for a Staff Front-End Engineer who can... ...enterprises to confidently ship and scale amazing application at a velocity they... ...using Next.js/React ensuring exceptional performance, reliability, and developer experience...PerformanceFull timeRemote work
$145k - $190k
EverPro - Staff Engineer at EverCommerce At EverCommerce [Nasdaq: EVCM], we are on a mission... ...seamless invoicing experience. Optimize performance and reliability of core services through... ...and ensure data integrity at scale. Lead efforts to scale data storage solutions...PerformanceWork experience placementWork at officeRemote workFlexible hours- ...others haven't seen. Short Story Engineering: As a fast-growing startup... ...backend services to scaling design systems and refining order... ...this stage of our company, a Staff Engineer isn’t just a strong... ...integrations are robust and performant. Use data to drive impact :...PerformanceRemote work
- Staff Search Engineer As a Staff Search Engineer, you’ll help lead the design and ongoing evolution... ...Elasticsearch clusters, develop high-performance APIs in Go, and ensure the platform remains... ..., reliable, and responsive at large scale. This role blends hands‑on...PerformanceWork at officeWork from homeHome office
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Engineer, Inference Runtime — Performance & Scale. Be the first to apply!
Related searches
- assistant civil engineer New York, NY
- engineering aide New York, NY
- assistant engineering manager New York, NY
- project engineer assistant project manager New York, NY
- senior staff systems engineer New York, NY
- staff automation engineer New York, NY
- staff design engineer New York, NY
- staff security engineer New York, NY
- staff engineer New York, NY
- staff data engineer New York, NY