Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer- LLM Systems (Remote)

$180k - $220k

NewtonX

About NewtonX

NewtonX delivers AI-powered B2B insights to the world's most demanding clients—McKinsey, Blackstone, Microsoft, Google, KKR—who use our data to make high-stakes decisions. Our research has been cited by Fortune, Forbes, TechCrunch, Adweek and more. We've built a reputation as the quality standard in the industry. Now we're building AI systems to make that quality infinitely scalable.

NewtonX has raised $47M in funding from VCs like Two Sigma Ventures, Third Prime, XFund and Citi Ventures.

The Role

In this role, you'll own the core LLM infrastructure powering two products redefining B2B research:

Hub – The central cockpit for B2B research. Build self-serve features that compress weeks into days: question → expert insight → follow-up, powered by RAG and adaptive workflows.

Prime – Syndicated intelligence at scale. Architect automated systems that continuously capture expert opinions—creating longitudinal datasets and refreshable dashboards that compound in value.

The technical challenge: fusing structured survey data with unstructured expert knowledge, building semantic search across proprietary corpora, and creating AI pipelines that maintain research-grade quality at scale. If you love building novel data systems that turn raw signals into defensible, high-margin products, this is where you'll do the most important work of your career.

What We're Looking For
Required
  • You write exceptional code, fast. 3-4 years of experience shipping production code in a fast-paced environment
  • Full-stack expertise: Moderate proficiency in React, TypeScript, and modern frontend frameworks. Backend experience with Python, Node.js, or similar
  • AI/ML implementation experience: Hands-on experience integrating LLMs, building with OpenAI/Anthropic APIs, or implementing ML models in production. We care more about a demonstrated eagerness to learn and an understanding of complex systems than specific years.
  • Cloud and infrastructure: Experience with AWS, Docker, and modern deployment practices
  • Quality mindset: Experience with testing, code reviews, and maintaining high code quality standards
  • Customer focus: Ability to translate user needs into technical solutions while maintaining engineering best practices
Nice to Have
  • RAG systems, embeddings, semantic search
  • Real-time data processing or streaming architectures
  • Open-source contributions in AI/ML

What actually matters We care less about credentials and more about demonstrated ability. If you've built something interesting with LLMs- a side project, an open-source contribution, a blog post that shows how you think- put that at the top of your application.

Why Join NewtonX?
  • Frontier technology: Work with cutting-edge AI systems, pushing the boundaries of what's possible in enterprise AI applications
  • Exceptional traction: Strong product-market fit with the world's largest investment banks, hedge funds, and consulting firms
  • World-class team: We take talent density seriously. Work alongside incredibly smart, driven people who are passionate about their craft
  • High velocity: Ship features that directly impact how billion-dollar decisions are made
  • Growth opportunity: Join during a hypergrowth phase with clear paths for technical and career advancement
  • Impact: Your work will directly shape how the world's leading organizations make critical business decisions
What We Offer
  • Competitive compensation with a total compensation range of $180-220k (includes base and annual performance bonus) and equity. (Please note that salary and compensation may vary based on skills, experience, performance, and location.)
  • Excellent medical, dental, and vision insurance.
  • 401k match with immediate vesting.
  • Generous Paid time off, holidays, and parental leave.
  • A diverse, collaborative, and positive culture where we invest in and celebrate each other's success. Flexible work environment where we work hard but have fun (happy hours, team projects, and retreats).
Equal Opportunity

NewtonX is proud to be an equal opportunity workplace. We do not discriminate based upon race, religion, color, national origin, sex, sexual orientation, gender identity/expression, age, status as a protected veteran, status as an individual with a disability, or any other applicable legally protected characteristics.

Timezone

Location: Remote Flexible across all US time zones.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Software Engineer- LLM Systems (Remote) in United States vacancy
  •  ...staffing agency is seeking an AI Engineer to join a rapidly growing AI...  ...and deploying generative AI systems, collaborating with talented engineers...  ...have strong experience with LLM frameworks and prompt...  ...time position allows for fully remote work and promises involvement... 
    Remote work
    Full time

    Prestige Staffing

    New York, NY
    3 days ago
  •  ...Role: Senior AI Engineer - Agentic Systems and LLM Client Location: Mason, OH 100% Remote Job Description: We are seeking a senior AI engineer to design and build production-grade LLM-powered applications and agentic systems. This role owns the end-to-end development... 
    Remote work

    Vytwo

    Prosper, TX
    4 days ago
  •  ...Senior AI Engineer - LLM & Agentic Systems (Python) Remote Role Overview We are seeking a senior AI engineer to design and build production-grade LLM-powered applications and agentic systems. This role owns the end-to-end development of intelligent solutions... 
    Remote work

    RIT Solutions, Inc.

    Atlanta, GA
    3 days ago
  •  ...AI/ML Engineer LLM & Agentic Systems (Python) Location: MASON, OH Hybrid Must Have Skills Skill 1 - Yrs of Exp - 10+ - design and build production-grade LLM-powered applications and agentic systems Skill 2 - Yrs of Exp - 6+ - End-to-end development of intelligent... 
    Remote work

    HCL Global Systems

    United States
    2 days ago
  •  ...technology firm is seeking a Senior Software Engineer to join a fully remote team. In this role, you'll design and...  ...integration with dental insurance systems and AI workflows for billing. The ideal...  ..., and hands-on experience with LLM APIs. You'll work collaboratively to... 
    Remote work

    Wisdom

    New York, NY
    2 days ago
  •  ...Innovating in AI systems technologies, the full-time Software Engineer, AI Systems will develop libraries and GPU kernel...  ...collaborating with engineers in a remote or onsite environment. Key responsibilities...  ...extensible abstractions for LLM serving engines and contributing... 
    Remote work
    Full time

    Virtual Vocations Inc

    United States
    2 days ago
  • $160k - $250k

     ...Senior Software Engineer (Agentic Systems) Salary: $160K – $250K + Equity Company Description: High-growth AI research lab Job Description:...  ...Ensure the scalability and observability of production-grade LLM systems while contributing across the full technical... 
    Remote work

    Jack and Jill AI

    United States
    2 days ago
  •  ...Senior Software / Data Engineer Decentriq is the rising leader in data-clean-room technology. With...  ...learning for AdTech. The role can be fully remote (± 4 h CET) or based in our Zürich/...  ...AI-Powered Productivity – Leverage LLM-based code assistants, design generators... 
    Remote work
    Work at office
    Immediate start

    Decentriq

    United States
    2 days ago
  •  ...powers Moveworks' AI agents — the systems that orchestrate, execute,...  ...is a distributed systems engineering role at the heart of the agentic...  ...interaction across multiple LLM calls and tool invocations...  ...trust. Work personas (flexible, remote, or required in office) are... 
    Remote work
    Work at office
    Flexible hours

    ServiceNow

    Mountain View, CA
    1 day ago
  •  ...Senior Software Engineer, Agentic Systems - Moveworks Moveworks is the Agentic AI Assistant platform that...  ...and user interaction across multiple LLM calls and tool invocations Distributed...  ...and trust. Work personas (flexible, remote, or required in office) are... 
    Remote work
    Work at office
    Flexible hours

    ServiceNow

    United States
    3 days ago
  •  ...arms race. Our AI-powered system autonomously discovers, validates...  ...zero-days across the software billions rely on, and...  ...re looking for a Software Engineer with deep expertise in LLM prompting, orchestration,...  ...Should Know # Location: Remote (all team members are remote... 
    Remote work
    Full time
    Contract work

    Xbow Careers

    United States
    2 days ago
  • $180k - $220k

     ...to meet you. As a hands-on AI systems engineer at Atlas Health, you'll...  ...reliable, grounded answers. Build LLM-driven systems that: Extract...  .../ ML Experience 8+ years in software engineering with significant...  ...retirement plan, with company match Remote work equipment, including a... 
    Remote work
    Temporary work
    Work experience placement
    Flexible hours

    Atlas Health

    New York, NY
    3 days ago
  •  ...Description The Role Are you a software engineer who has honed your craft,...  ...and improving production systems, and are looking to apply your...  ...optimization, agent memory, LLM self-reflection and improvement...  .... Work personas (flexible, remote, or required in office) are categories... 
    Remote work
    Work at office
    Immediate start
    Flexible hours

    ServiceNow

    Mountain View, CA
    3 days ago
  • $100k - $160k

     ...every day. Our AI Voice & Telephony Engineering Team builds the systems that power intelligent conversations...  ...What You'll Do: As a Senior Software Engineer, you'll design and build scalable...  ...recognition, text-to-speech, or LLM-based conversational AI.... 
    Remote work
    Full time
    Temporary work
    Local area
    Flexible hours

    Red Ventures

    United States
    2 days ago
  • $197.9k - $270k

     ...depends on experienced embedded software engineers like you joining the Roku OS...  ...stacks, integrating DRM systems, and developing tools to monitor...  ...A familiarity with AI/ML and LLM technologies. ~ Experience...  ...Thursday. Fridays are flexible for remote work except for employees... 
    Remote work
    Work at office
    Local area
    Monday to Thursday
    Flexible hours

    Roku

    San Jose, CA
    2 days ago
  •  ...science, over 8 years of experience, and strong Core Java skills. The environment is fast-paced and supportive of learning, with a remote-first approach. You will join a diverse team and can expect competitive salary and flexible hours, contributing to the leading blockchain... 
    Remote work
    Flexible hours

    binance

    New York, NY
    5 days ago
  •  ...A cutting-edge AI firm is seeking an experienced AI/ML engineer to join their remote team. You will innovate in the field of large language models (LLMs), collaborating on high-performance systems. The role requires at least 2 years of relevant experience working with... 
    Remote work

    Fastino Labs

    New York, NY
    3 days ago
  •  ...Software Engineer Opportunity Baseten powers mission-critical inference for the world's most dynamic...  ...(HPC) and Large Language Model (LLM) engineering. You will be responsible for...  ...and define the benchmarks that ensure our systems are production-ready. Responsibilities... 
    Remote work
    Flexible hours

    Baseten

    United States
    2 days ago
  •  ...Dsilo Ai Technologies is seeking a Senior AI Engineer with over 5 years of experience to design and develop AI solutions utilizing Large...  ...enterprise applications and ensure robust performance across systems. Strong proficiency in Python and hands-on experience with AI deployment... 
    Remote work

    Dsilo Ai Technologies

    New York, NY
    2 days ago
  • $183.34k - $206k

     ...We are currently looking for a Senior Software Engineer – LLM Observability in the United States....  ...this role, you will help define how AI systems are represented, measured, and analyzed...  ...friendly ownership opportunities. Fully remote work environment with a distributed-... 
    Remote job
    Full time
    Home office

    jobgether

    United States
    4 days ago
  •  ...Baseten Engineer Opportunity Baseten powers mission-critical inference...  ...building the global operating system for distributed, heterogeneous...  ...hardware. We believe that as LLM and multi-modal workloads...  ...configuration to architect the software fabric that unifies thousands... 
    Remote work
    Flexible hours

    Baseten

    United States
    2 days ago
  • ProLeads in Deutschland sucht einen AI Engineer mit Schwerpunkt auf RAG zur Entwicklung intelligenter AI-Systeme. In dieser Rolle optimieren Sie Retrieval-Pipelines und...  ...sowie Kenntnisse in Python oder TypeScript. Der Remote-First Arbeitsplatz bietet Flexibilität sowie... 
    Remote job

    ProLeads

    New Bremen, OH
    5 days ago
  •  ...is seeking a full-time Lead AI Engineer to drive the AI engineering function and manage agentic AI systems while leading a team of AI Engineers in a fully remote environment. The ideal candidate...  ...will have extensive experience in software engineering with a strong... 
    Remote work
    Full time

    Gifthealth, Inc.

    New York, NY
    2 days ago
  • $183.34k - $206k

     ...accountability from Day 1. #LI-Remote Little more about the team: The LLM Observability (LLM O11y)...  .... We define how AI systems are represented in...  ...Support and own your software in production. You'll participate...  ...daily. You'll mentor engineers, share knowledge, and delegate... 
    Remote work
    Work at office
    Local area
    Work from home
    Home office
    Visa sponsorship
    Flexible hours
    Shift work

    Honey Comb

    United States
    2 days ago
  • $137k - $180k

     ...A leading financial technology company is looking for a Machine Learning Engineer to join their remote team. The role involves designing and maintaining scalable backend services, collaborating with cross-functional partners, and managing AWS services. Candidates should... 
    Remote work

    SmartAsset

    New York, NY
    3 days ago
  •  ...Senior Software Engineer, Go - LLM Team AssemblyAI builds the best-in-class Voice AI models powering the next generation of voice applications...  ...testing strategies, and building highly reliable systems in service of solving real customer problems. This role... 
    Remote work
    Easy work

    AssemblyAI

    United States
    5 days ago
  • $152k - $241.5k

     ...Join NVIDIA's TensorRT Edge-LLM team and help shape the next...  ...automotive and robotics. We build the software stack that enables Large...  ...Science, Electrical/Computer Engineering, or a closely related field....  ...autoregressive LLM serving systems, including speculative decoding... 
    Remote work

    NVIDIA

    Santa Clara, CA
    5 days ago
  • $40 - $100 per hour

     ...Remote Senior Software Engineer (LLM) - 34953Remote Senior Software Engineer (LLM) - 349533 days ago Be among the first 25 applicantsGet AI-powered...  ...development. Our mission is to empower the next generation of AI systems to reason about and work with real-world software... 
    Remote work
    Full time
    For contractors

    Turing Inc

    New York, NY
    5 days ago
  • $100k

     ...compute framework, a distributed compute orchestration engine, and more. Additionally, as we expand to enable LLM innovation in numerous areas of personalization,...  ...to own and develop our long-term vision. Our systems power some of Netflix's most business-critical models... 
    Remote work
    Hourly pay
    Full time
    Immediate start
    Flexible hours

    Netflix

    United States
    1 day ago
  • $120k - $135k

     ...seeking a Senior Machine Learning Engineer to design and scale machine...  ...experience, particularly with LLM-powered solutions. Responsibilities include developing ML systems, maintaining model quality,...  ...benefits. The position allows for remote work, contributing to an... 
    Remote work

    A Place for Mom

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer- LLM Systems (Remote). Be the first to apply!