Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

LLM Systems Engineer & Research

Scale AI, Inc.

Scale AI, Inc. in New York is seeking a talented individual to build and optimize their training and inference framework as part of their ML platform team. In this role, you'll collaborate with various teams to enhance research and development capabilities while integrating advanced technologies. The ideal candidate will have a strong background in system optimization and experience with distributed ML systems, along with excellent software engineering skills. Scale offers competitive salaries along with comprehensive benefits including health, dental, and retirement plans. #J-18808-Ljbffr Scale AI, Inc.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the LLM Systems Engineer & Research in New York, NY vacancy
  • $100k - $200k

    MoneyLion is seeking a Senior LLM Systems Engineer to enhance LLM-driven components for oracle automation. This production role focuses on improving accuracy and resilience of systems that manage prediction market rules. Required experience includes 3+ years in Python... 
    Suggested
    Remote job

    MoneyLion

    New York, NY
    1 day ago
  • $100k - $200k

    Blockchain Capital is looking for a Senior LLM Systems Engineer to enhance its LLM-driven oracle automation stack. This role emphasizes accuracy, performance, and operational quality of production systems using LLMs for various prediction market rules. The successful candidate... 
    Suggested
    Remote job

    blockchaincapital.com

    New York, NY
    4 days ago
  •  ...applications, while supporting end-to-end system reliability, real-time inference...  ...Drive product evolution: Partner with our Engineering and ML teams to ensure the lessons learned...  ...vector databases, agentic development, and LLM observability tools. Ownership: You treat... 
    Suggested

    AI Chopping Block, Inc.

    New York, NY
    3 days ago
  • $264.8k - $331k

     ...world. The Enterprise ML Research Lab works on the front lines...  .... As an ML Sys Research Engineer, you'll work on building out the...  ...technologies to optimize our ML system. Your customer will be other MLREs...  ...: At least 1-3 years of LLM training in a production... 
    Suggested
    Full time

    Scale AI

    New York, NY
    6 days ago
  • $250k - $350k

     ...the world. The Enterprise ML Research Lab works on the front lines of...  .... As an ML Sys Research Engineer, you’ll work on building out the...  ...technologies to optimize our ML system. Your customer will be other MLREs...  ...have: At least 1‑3 years of LLM training in a production... 
    Suggested
    Full time

    Scale AI, Inc.

    New York, NY
    2 days ago
  • $175k - $200k

    Iovance Biotherapeutics seeks a senior engineer to design and deploy AI systems focused on operational productivity. Ideal candidates will have over 10 years...  ...in software/AI engineering, including designing LLM-based applications. The role involves working with cross... 

    Iovance Biotherapeutics

    New York, NY
    3 days ago
  •  ...New York or remote. The role focuses on building AI systems, production ML, and collaborating with engineering teams. Ideal candidates have over 5 years of...  ...development, especially with Python, and knowledge of LLM capabilities. This position offers a competitive salary... 
    Remote job

    NTT DATA North America

    New York, NY
    2 days ago
  • The Consensus is seeking early-career Software Engineers to innovate in performance benchmarking and LLM engineering. This role provides the chance to work at the...  ...intersection of hardware and software, focusing on systems that drive AI capabilities. Ideal candidates are... 

    The Consensus

    New York, NY
    4 days ago
  • A leading AI consulting firm is seeking a Software Engineer to build, deploy, and operate production LLM-powered applications. This role requires strong software engineering skills with a focus on AI-driven features. Ideal candidates should have 3+ years of experience,... 
    Remote job
    Full time

    Click2.ai

    New York, NY
    2 days ago
  • $180k - $220k

     ...make high-stakes decisions. Our research has been cited by Fortune,...  ...industry. Now we're building AI systems to make that quality...  ...this role, you'll own the core LLM infrastructure powering two products...  ...solutions while maintaining engineering best practices Nice to Have... 
    Immediate start
    Remote work
    Flexible hours

    NewtonX

    New York, NY
    4 days ago
  • Role Overview NeuralCraft AI is building the next generation of enterprise AI products and we need a Prompt Engineer & LLM Systems Designer who can sit at the intersection of language, logic, and product. You won't be training models; you'll be crafting the instruction... 

    ti Steps

    New York, NY
    4 days ago
  • $200.8k - $251k

     ...member to build and optimize a machine learning framework for large language models. Candidates should have system optimization experience and solid software engineering skills, particularly in tools like CUDA and Pytorch. This full-time position offers a competitive salary... 
    Full time

    Scale AI

    New York, NY
    1 day ago
  • $120k - $160k

     ...Systems Engineer Sunnyvale, CA or San Diego, CA or Seattle, WA or New York, NY About Us...  ...compensation at the time of posting. Research has shown that women & underrepresented...  ...Use of artificial intelligence or a LLM such as ChatGPT during the interview process... 
    Flexible hours

    RADAR

    New York, NY
    11 hours ago
  •  ...York (US-NY), United States (US). Job Duties Build agentic AI systems: Design and implement tool‑calling agents that combine...  ...change orchestration, policy enforcement) following MCP protocol. Engineer robust guardrails for safety, compliance, and least‑privilege access... 
    Hourly pay
    Remote work

    NTT DATA North America

    New York, NY
    2 days ago
  • HartleyCo in New York is hiring a Senior Engineer to lead the development of production-level AI systems. This role involves designing workflows, improving retrieval pipelines, and ensuring reliability in a high-autonomy environment. You will work directly with the founders... 

    HartleyCo

    New York, NY
    2 days ago
  •  ...leading staffing agency is seeking an AI Engineer to join a rapidly growing AI team. The role...  ...on building and deploying generative AI systems, collaborating with talented engineers,...  ...candidates will have strong experience with LLM frameworks and prompt engineering, along... 
    Remote job
    Full time

    Prestige Staffing

    New York, NY
    2 days ago
  • $103.2k - $189.2k

     ...massive datasets in real time to building systems that operate reliably on a global scale....  ...meet you. We are seeking a Senior Systems Engineer, Commercial Intelligence and Analytics to...  ...Snowflake, Tableau, Git/GitLab (CI/CD), LLM APIs, Docker, Jira, Confluence What you’... 
    Full time
    Temporary work
    Local area
    Worldwide

    The Trade Desk

    New York, NY
    2 days ago
  • $25k

    SYSTEM ENGINEER - AI - 18+ yrs of Experience - TS/SCI w/Poly clearance is required - PP Posted On 06/02/2026 Job Information Technology Work...  .... Familiarity with modern AI application patterns, including LLM‑based applications, RAG, prompt engineering, agentic systems,... 
    Contract work
    Temporary work
    Work experience placement
    Remote work
    Shift work

    Halogen Engineering Group, Inc

    New York, NY
    1 day ago
  • Tata Consultancy Services Limited is looking for a skilled AI/LLM Engineer in New York, NY to design and build intelligent agent-based systems. The candidate will develop systems that reason, plan, and act autonomously using frameworks like LangChain. Key responsibilities... 

    Tata Consultancy Services Limited

    New York, NY
    3 days ago
  •  ...We’re looking for a talented and driven Systems Engineering Manager to join our team — with a clear path to advancement. This role is designed with succession in mind: the successful candidate will be positioned to step into the Director of Engineering & Operations role... 
    Temporary work
    Work at office
    Local area

    Acord (association For Cooperative Operations Research And D...

    New York, NY
    3 days ago
  •  ...source projects (e.g.,Seaborn,Luig i ), academic researchers, international olympiad medalists, and experienced engineering and product leaders with decades of experience...  ...engineering culture as they tackle complex systems challenges in distributed computing, large-... 

    Modal

    New York, NY
    2 days ago
  • $101.9k - $168.8k

     ...Systems Engineering Manager We are seeking a Systems Engineering Manager to join our Rail and Transit team in Seattle, WA, Austin, TX, New...  ...and integration. Complexity: Work involves coordination, research and problem solving on a variety of engineering projects... 
    Contract work
    Temporary work
    Flexible hours

    Atkins Realis

    New York, NY
    1 day ago
  • $124k - $280k

     ...people in data and analytics engineering focus on leveraging advanced...  ...optimising algorithms, models, and systems to enable intelligent...  ...risk stratification, clinical research, and operational efficiency -...  ...data sources for use in AI and LLM-powered solutions Manage daily... 
    Full time
    H1b

    PwC

    New York, NY
    2 days ago
  • $110 per hour

     ...creative and technical talent with leading AI research labs. Headquartered in San Francisco,...  ...Responsibilities Guide research and engineering teams to close knowledge gaps and...  ...structured solutions to MLOps and ML systems problems . Evaluate MLOps tasks and... 
    Remote job
    Contract work
    Summer work
    Weekday work

    Mercor

    New York, NY
    2 days ago
  •  ...to-market motion runs on data. Every named account, every campaign, every event, every pipeline conversation is only as good as the systems underneath it. The GTM Systems Manager owns that layer. This is a builder role, not a maintenance role. You'll architect how data... 
    Work at office
    Immediate start
    Flexible hours

    Camber

    New York, NY
    1 day ago
  •  ...Achira, we are building a team of world-class scientists, ML researchers, and engineers to work together to move beyond the beaten path in drug...  ...individual who thrives at the intersection of machine learning systems architecture and distributed computing. You will help... 
    Work at office

    Achira

    New York, NY
    4 days ago
  • $115k - $135k

     ...position is a hands-on cloud and platform engineering role with a strong focus on AI-enabled...  ...primarily within Microsoft Azure. The CCSI Systems Senior Engineer is a full-time role...  ...enabled platforms and large language model (LLM) services using Azure-native capabilities... 
    Full time
    Work at office
    Remote work
    Relocation package
    Monday to Friday

    AlixPartners

    New York, NY
    2 days ago
  •  ...is seeking a highly skilled and versatile Machine Learning Engineer to join our Research team. As a member of the Research Staff, you will partner...  ...novel modeling ideas, then scale them through robust training systems for speech technologies, internal tooling, and innovative... 
    Remote work
    Home office
    Flexible hours

    Remote Jobs

    New York, NY
    2 days ago
  • $115.2k - $195.8k

    WSP in the U.S. is seeking a V2X Systems Engineer/Project Manager to support V2X projects across the US, with remote work options. The role involves serving as a technical resource, developing system engineering documents, and overseeing contractors. Candidates should... 
    Remote job
    For contractors

    WSP in the U.S.

    New York, NY
    2 days ago
  •  ...mission is to create reliable, interpretable, and steerable AI systems. We want AI to be safe and beneficial for our users and for...  ...a whole. Our team is a quickly growing group of committed researchers, engineers, policy experts, and business leaders working together to... 
    Work at office
    Visa sponsorship
    Flexible hours

    Menlo Ventures

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to LLM Systems Engineer & Research. Be the first to apply!