Staff Engineer, Production AI & Scalable LLMs
cohere
Cohere is seeking a Senior Engineer to design and implement scalable training systems for frontier AI models. The role focuses on production-ready software, tooling for research, and cross-team collaboration to bridge research with practical deployment. You will work on distributed training environments, leverage Kubernetes, Ray, and Python ML frameworks, and contribute to ML/LLM research. This is a remote-friendly, production-oriented position with generous perks. #J-18808-Ljbffr cohere
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Staff Engineer, Production AI & Scalable LLMs in New York, NY vacancy
$252k - $315k
About Scale AIScale AI is the data foundation... ...and deploy reliable production AI applications. We... ...one of the hardest engineering challenges.As a Staff Frontier Agent Engineer... ...that combine LLMs, traditional machine... ...successful solutions into scalable production systems....SuggestedFull time$192k - $260k
...their business. Founded by engineers — and customer obsessed... ...team building new products from the ground up. We'... ...enterprise-grade ML and AI personalization to every... ...customer problems into scalable, trustworthy... ...productionFamiliarity with LLMs and generative AI, including...SuggestedWork at officeLocal areaWorldwide$218k - $273k
...Scale AI is the data foundation for AI, helping... ...and deploy reliable production AI applications. We... ...value. Our agents are scalable systems built around... ...Role As a Senior/Staff Machine Learning Engineer (MLE) on the General... ...understanding of modern LLMs, prompt-, context-,...SuggestedFull timeScale Ai
New York, NY19 hours ago- LeoForce is hiring a senior engineer to help build agentic systems that automate complex workflows with scalable backend architecture. You will own end-to-end... ...development of APIs, distributed services, and AI-powered features in production environments, contributing to a fast-...Suggested
- General Information Job Title ML Staff Engineer - LLM & Production Systems Job ID 107242 Work... ...teams to build the next generation of AI- and machine learning-powered... ...direction of ML platforms that enable scalable, reliable, and impactful solutions for...SuggestedPermanent employmentFull timeWork at officeLocal area1 day per week
- ...As a Senior / Staff Forward Deployed AI Engineer, you’ll sit at the intersection of engineering, AI, and... ...move quickly from idea to prototype to production, and you enjoy being face‑to‑face with... ...(with a strong focus on LLMs) to solve diverse real‑world problems...Full time
Accruetalent
New York, NY19 hours ago $244k - $305k
...designs, builds, and maintains the production network infrastructure that... ...improve the foundations our engineers and customers rely on. This... ..., and developers—ensuring scalable, secure, and reliable network... ...and security platform for the AI era, providing businesses with...Work at office$230k - $290k
...distribution. Kalepa is building AI that can perform that work.We... ...successfully over time.Our products are already in production with... ...re looking for strong backend engineers who love building reliable systems... ....Bonus: experience with LLMs/generative AI, distributed systems...Work at officeRemote work- ...building and running the world’s best data and AI infrastructure platform so our customers... ...to improve their business. Founded by engineers — and customer obsessed — we leap at... ...You'll own the joint roadmap with their product teams, drive the development of integrations...Worldwide
$251k - $310k
...vehicle platforms and product use cases. The Waymo Driver... ...mission of the Waymo AI Foundations team is to... ...-of-the-art Multimodal LLMs and World models to perform... ...effectively with engineering and research teams across... ...Develop and maintain scalable data pipelines for Training...Full timeTemporary workRemote workWaymo
New York, NY19 hours ago$229k - $343k
...team builds cutting-edge AI technologies that power creative, scalable experiences for hundreds... ...worldwide. From multimodal LLMs and video generation to... ...looking for a Machine Learning Engineer to join Snap Inc!What you... ...learning technology and products that serve millions of...Full timeLive inWork at officeLocal areaWorldwide- ...about ourTotal Rewards philosophy.AI is a fundamental part of how... ...We keep the path from idea to production short, and measure ourselves... ...escalation behaviorWork directly with LLMs, including prompting, tool/... ...shipped capabilitiesMentor engineers and set the bar for how we...Full timeWork at officeLocal area2 days per week3 days per week
- ...accounting firms. Atlas, Basis’s internal team, embeds within product groups to deepen intelligence in workflows. The company is advancing... ...and is expanding rapidly in a hands-on, knowledge-driven engineering culture. We seek engineers who can reason from first...
- ...use to create their own products. Plaid powers the tools... ...and tooling that help engineering teams develop, deploy,... ...product team. As a Staff Site Reliability Engineer... ...fast and safe even as AI-assisted development increases... ...incident response, and scalable deployment health....Permanent employmentFull timeWork experience placementLocal area
Plaid
New York, NY10 days ago $144.25k - $256.25k
...benefitsJob Function: Engineering &... ...American Express, AI is reshaping the future... ...building platforms, products, and governance that... ...Role As a Senior Staff AI Engineer - Agentic... ...ambiguity into reliable, scalable agentic systems.... ...and open-source LLMs into agentic...Work at officeVisa sponsorship3 days per week$258.8k - $304.2k
...quickly. We are hiring a Forward Deployed Engineer to build and deploy Operational... ...and cross-functional teammates to build production-ready systems that improve how businesses... ...automation layer, an internal application, or an AI-enabled interface that helps users act on...Local areaImmediate startFlexible hours- A leading AI infrastructure company based in New York is seeking experienced engineers to enhance the performance of ML systems and contribute to open-source projects. Ideal candidates will have over 5 years of experience in writing high-quality code and familiarity with...
- Roku in New York is seeking a staff-level machine learning engineer to lead marketplace intelligence and demand optimization in the Ad Serving team.... ...challenges into ML solutions, design experiments, and build production ML systems for a high-scale ad marketplace. You have 10...
$176k - $256k
...complex operational issues that may arise in production, and would then follow that up with the... ..., mentorship, and application of good engineering principles.Minimum qualifications:... ...compromising on latency or connectivity.The AI and Infrastructure team is redefining what...WorldwideShift work- Jobot is hiring software engineers to help design, build, and scale the core systems... ...role where you’ll work across product, infrastructure, and AI driven systems to solve complex, real... ...automate complex end-to-end workflows, scalable backend systems and APIs, and AI powered...
$220.8k - $331.2k
...looking for an experienced AI Research Engineer to join our Duolingo Monetization... ...in and help drive strategic product and business decision-making... ...learning, particularly in LLMs and bandits, and apply this... ...delivery of high-quality, scalable, and efficient machine learning...Work experience placement$180k - $270k
...is its people. As a Staff Enterprise, and Cloud Engineer on our Corporate Cloud... ...SCIM, and our SaaS and AI platforms at the center. You’ll design scalable identity governance that keeps teams productive while reducing risk,... ...tools (Claude Code, LLMs) to accelerate engineering...Remote work$223k - $278k
...ourTotal Rewards philosophy.AI is a fundamental part... ...:We’re hiring seasoned engineers to join our teams that... ...for extensibility and scalability, and building the... ...partnerships from Engineering, Product Management, Design,... ...with current AI tools (LLMs, Agents) and their shortcomings...Full timeWork at officeLocal area2 days per week3 days per week$194k - $267k
...Every Identity, from AI to HumanIdentity is the... ....We're looking for a Staff level Platform Engineer to join a team of... ...pair-programmers and LLMs (such as Copilot and... ...to ensure systems are scalable, redundant, and multi... ...with architects, QA, product owners, security and...Permanent employmentLocal areaWorldwideFlexible hours$199k - $249k
...AreAddepar is a global data and AI platform empowering investment... ...RoleWe are seeking a well rounded Staff Security Engineer to join our growing Information... ...with engineering and product teams to architect, build, and deploy scalable, resilient security solutions.Enablement...H1bRemote workWorldwideVisa sponsorshipWork visa$188k - $275k
...is The Essential Cloud for AI. Built for pioneers by pioneers... ...You’ll Do:We are seeking a Staff Security Engineer to lead the most complex... ...will design and implement scalable triage, prioritization, and... ...integrations, decision logic, and production hardeningImplement end-to-...Permanent employmentFull timeTemporary workCasual workWork at officeFlexible hours$244k - $293k
...Role: We are hiring a Staff Machine Learning Engineer to drive the design,... ...systems that power our core products in User Growth and Monetization... ...to accelerate the AI/ML development and deployment... ...implement for availability, scalability, operational excellence,...Full timeWork experience placementRemote workMatch Group
New York, NY19 hours ago$262k - $365k
..., toil, and operational risks for both Google engineering teams and external partner operators.Develop and... ...senior technical oversight for critical production and staging environments.Lead the design and adoption of AI/ML solutions—including in-universe agentic tooling...Local areaShift work$298k - $351k
...reimagining healthcare in the U.S. — and using AI to scale that impact further and faster... ...role: We are seeking an exceptional Staff MLOps Engineer to join our Platform Engineering... ..., and cost-efficiency of our production machine learning systems. You will lead...Work at officeWork visaFlexible hours3 days per weekGarner Health
New York, NY19 days ago$119.3k - $196.6k
..., fragrance, and hair care products, and is a steward of luxury... ...BALMAIN Beauty.DescriptionAs a Staff Machine Learning Engineer, you're a player-coach: a... ..., and deploy production AI products and the platform beneath... ...problems into reliable, scalable deliverables.The core of...Full timeLocal areaImmediate start
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Staff Engineer, Production AI & Scalable LLMs. Be the first to apply!
Related searches
- assistant engineering manager New York, NY
- assistant civil engineer New York, NY
- assistant engineer New York, NY
- staff engineer New York, NY
- staff data engineer New York, NY
- software engineer staff New York, NY
- assistant chief engineer New York, NY
- staff design engineer New York, NY
- senior staff engineer New York, NY
- senior staff systems engineer New York, NY