Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer- LLM Systems (Remote)

$180k - $220k

NewtonX

About NewtonX

NewtonX delivers AI-powered B2B insights to the world's most demanding clients—McKinsey, Blackstone, Microsoft, Google, KKR—who use our data to make high-stakes decisions. Our research has been cited by Fortune, Forbes, TechCrunch, Adweek and more. We've built a reputation as the quality standard in the industry. Now we're building AI systems to make that quality infinitely scalable.

NewtonX has raised $47M in funding from VCs like Two Sigma Ventures, Third Prime, XFund and Citi Ventures.

The Role

In this role, you'll own the core LLM infrastructure powering two products redefining B2B research:

Hub – The central cockpit for B2B research. Build self-serve features that compress weeks into days: question → expert insight → follow-up, powered by RAG and adaptive workflows.

Prime – Syndicated intelligence at scale. Architect automated systems that continuously capture expert opinions—creating longitudinal datasets and refreshable dashboards that compound in value.

The technical challenge: fusing structured survey data with unstructured expert knowledge, building semantic search across proprietary corpora, and creating AI pipelines that maintain research-grade quality at scale. If you love building novel data systems that turn raw signals into defensible, high-margin products, this is where you'll do the most important work of your career.

What We're Looking For
Required
  • You write exceptional code, fast. 3-4 years of experience shipping production code in a fast-paced environment
  • Full-stack expertise: Moderate proficiency in React, TypeScript, and modern frontend frameworks. Backend experience with Python, Node.js, or similar
  • AI/ML implementation experience: Hands-on experience integrating LLMs, building with OpenAI/Anthropic APIs, or implementing ML models in production. We care more about a demonstrated eagerness to learn and an understanding of complex systems than specific years.
  • Cloud and infrastructure: Experience with AWS, Docker, and modern deployment practices
  • Quality mindset: Experience with testing, code reviews, and maintaining high code quality standards
  • Customer focus: Ability to translate user needs into technical solutions while maintaining engineering best practices
Nice to Have
  • RAG systems, embeddings, semantic search
  • Real-time data processing or streaming architectures
  • Open-source contributions in AI/ML

What actually matters We care less about credentials and more about demonstrated ability. If you've built something interesting with LLMs- a side project, an open-source contribution, a blog post that shows how you think- put that at the top of your application.

Why Join NewtonX?
  • Frontier technology: Work with cutting-edge AI systems, pushing the boundaries of what's possible in enterprise AI applications
  • Exceptional traction: Strong product-market fit with the world's largest investment banks, hedge funds, and consulting firms
  • World-class team: We take talent density seriously. Work alongside incredibly smart, driven people who are passionate about their craft
  • High velocity: Ship features that directly impact how billion-dollar decisions are made
  • Growth opportunity: Join during a hypergrowth phase with clear paths for technical and career advancement
  • Impact: Your work will directly shape how the world's leading organizations make critical business decisions
What We Offer
  • Competitive compensation with a total compensation range of $180-220k (includes base and annual performance bonus) and equity. (Please note that salary and compensation may vary based on skills, experience, performance, and location.)
  • Excellent medical, dental, and vision insurance.
  • 401k match with immediate vesting.
  • Generous Paid time off, holidays, and parental leave.
  • A diverse, collaborative, and positive culture where we invest in and celebrate each other's success. Flexible work environment where we work hard but have fun (happy hours, team projects, and retreats).
Equal Opportunity

NewtonX is proud to be an equal opportunity workplace. We do not discriminate based upon race, religion, color, national origin, sex, sexual orientation, gender identity/expression, age, status as a protected veteran, status as an individual with a disability, or any other applicable legally protected characteristics.

Timezone

Location: Remote Flexible across all US time zones.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Software Engineer- LLM Systems (Remote) in United States vacancy
  • Green Key Resources is seeking an experienced AI Systems Architect in New York. You will lead the design and delivery...  ...a hybrid work environment, providing flexibility for remote work on Fridays, and your expertise in LLM systems and cloud-native development will be pivotal.... 
    Remote work

    Green Key Resources

    New York, NY
    2 days ago
  • $169k - $208k

     ....ai is a fast-growing, remote cybersecurity company dedicated...  ...operators, startup engineers, and formerly...  ...evaluation that lets an LLM-driven agent do this work...  ...layer: the part of the system that decides what to probe...  ...years building production software, with strong Python .... 
    Remote work
    Full time
    Work at office
    Flexible hours

    Horizon3.ai

    United States
    2 days ago
  • Volga Partners is seeking a skilled Software Development Engineer to work on AI-powered applications in a fully remote capacity. You will develop production-grade systems, integrating large language models and backend services. In this role, you will be involved in API... 
    Remote job

    Volga Partners

    New York, NY
    2 days ago
  • eSimplicity Inc. is seeking an LLM Specialist to enhance AI capabilities within a cloud-based analytics ecosystem. This role involves...  ...and developing generative AI solutions. eSimplicity promotes a remote work culture, requiring occasional travel under 5% of work time.... 
    Remote job

    eSimplicity Inc.

    Columbia, MD
    1 day ago
  • eSimplicity is looking for an LLM Specialist to design and operationalize advanced large-language-model capabilities. The role involves leading innovations around AI technologies and overseeing scalable pipelines within a cloud environment. The ideal candidate will have... 
    Remote job

    eSimplicity

    Columbia, MD
    5 days ago
  • $60 per hour

    Role Description We are seeking a senior AI engineer to design and build production-grade LLM-powered applications and agentic systems. This role owns the end-to-end development...  ...someone onsite 3x week but very open to 100% remote for the right candidate. Benefits ~... 
    Remote work
    Full time

    Vytwo

    Remote
    8 days ago
  • Role Description We’re hiring an AI Engineer to design, build, and deploy AI-...  ...tools like n8n, Go High Level, and LLM APIs—while also contributing to...  ...development of more scalable, in-house AI systems over time. If you’re looking for a remote AI engineering job that blends... 
    Remote work
    Full time
    Flexible hours

    Huzzle

    Remote
    2 days ago
  •  ...We are building a distributed operating system, SwoopOS, that decomposes the world's equipment...  ...blocks to be combined at the speed of software, limited by only the hard constraints of...  ...cross-functionally with other engineering teams to debug complex issues spanning firmware... 
    Remote work
    Local area

    Swoop Technologies, LLC

    United States
    3 days ago
  •  ...for the agent-native era -where software isn't static, but a dynamic, constantly changing system of AI agents working on behalf...  ...We're hiring a Staff Platform Engineer to build the core systems and infrastructure...  ...of agent-native workflows. Remote-First Flexibility: We are a... 
    Remote work
    Shift work

    Keycard Labs, Inc

    United States
    5 days ago
  • $180k - $400k

     ...you. About the Role We are looking for a distributed systems engineer to work on the systems that power the syncing engine our...  ...per year, which is location independent in accordance with our remote-first policy. We also offer meaningful equity compensation in... 
    Remote work

    High Touch LLC

    United States
    3 days ago
  • $40 per hour

    A leading AI development company is seeking an Android Software Engineer to design coding solutions for AI systems. This fully remote role offers a flexible schedule with competitive hourly pay starting at $40, alongside exciting opportunities to impact future AI technologies... 
    Remote work
    Hourly pay
    Flexible hours

    DataAnnotation

    Kansas City, MO
    5 days ago
  •  ...Remote - US. At EngFlow, we help developers save time by accelerating software builds and tests. Our cloud-based, distributed service...  ...we build tools that empower engineering teams-from startups to...  ...Engineer with a focus on build systems, compilers, and languages... 
    Remote work

    EngFlow

    New York, NY
    4 days ago
  • $265k - $310k

     ...that they are one of the only pieces of software that you share with your parents as...  ...A small team of language compiler and systems engineers have implemented the protocol that allows...  ...of your career. Location. We're a remote-friendly company and can hire in the US... 
    Remote work
    Full time
    Live in
    Work at office

    The Browser Company

    United States
    2 days ago
  •  ...Senior Software Engineer Voleon is a technology company that applies state-of-the-art AI and...  ...developing the company's production trading systems and the data pipelines that drive our...  ...behaviors. This role is open to remote work in the US or hybrid in our Berkeley... 
    Remote work
    Work at office
    Local area

    The Voleon Group

    Berkeley, CA
    4 days ago
  • $128k - $204k

     ...Senior Software Engineer 2, Game Systems Remote - eligible US locations About the role and about you: As Senior Software Engineer, Game Systems, you'll work with a team of talented engineers to ensure that Zwift customers have a smooth, stable game experience... 
    Remote work
    Full time
    Worldwide

    Zwift

    United States
    1 day ago
  • A leading AI research accelerator is looking for a Software Engineer to evaluate and refine AI-generated code, ensuring efficiency and reliability. Candidates should have over 5 years of experience in software engineering, including top-tier companies. Responsibilities... 
    Remote job
    Contract work
    10 hours per week
    Flexible hours

    Turing Inc

    New York, NY
    5 days ago
  • Lumen Technologies is seeking a Software Engineer II for a remote role that involves designing and developing billing software. The candidate will work in an agile team environment, collaborating with business partners to create effective technical solutions. Applicants... 
    Remote job

    ConnectsBlue

    New York, NY
    3 days ago
  • Whatnot is hiring Senior Software Engineers across multiple pillars to design and deliver scalable product and platform systems powering one of the world’s fastest-growing marketplaces. You will work with Product, Design, Data, and Engineering to turn ambiguous problems... 
    Remote job

    Apply

    California, MO
    2 days ago
  • A leading AI research firm is seeking a software engineer with over 5 years of experience to evaluate AI-generated code and enhance coding solutions...  .... You will work collaboratively to build verification systems, ensuring code reliability and efficiency. This flexible... 
    Remote job
    For contractors
    10 hours per week
    Flexible hours

    Turing

    Dallas, TX
    4 days ago
  • Providence Health Plan Group is seeking a Software Engineer II for a remote position to develop, implement, and maintain information systems that support research and clinical trials. The role involves working closely with researchers to design systems and provide insights... 
    Remote job

    Providence Health Plan Group

    New York, NY
    3 days ago
  • Providence is seeking a Software Engineer II for a remote position focused on the development and maintenance of information systems for research and clinical trials data. Candidates will collaborate directly with researchers on system design and implementation, ensuring... 
    Remote job

    Providence Service

    Portland, OR
    1 day ago
  • ConnectsBlue is seeking a talented OCI Software Engineer Intern for a remote position. This internship offers hands-on training in developing distributed database systems and services while engaging in critical software applications. Ideal candidates possess a strong background... 
    Remote job
    Internship
    Flexible hours

    ConnectsBlue

    New York, NY
    2 days ago
  • $152.4k - $254k

     ...highly experienced and innovation-driven Software Consulting Engineer to lead the architecture, design, and...  ...Transmission & Distribution (T&D) systems. This strategic leadership role...  ...Relocation Assistance Provided: No #LI-Remote - This is a remote position Application... 
    Remote work
    Relocation package

    GE Vernova

    Boston, MA
    4 days ago
  • Micro1 is seeking a Software Engineer to assist in training and evaluating next-generation AI systems through software engineering tasks. The ideal candidate has 3+ years of...  .... This part-time role offers flexibility with remote work options. #J-18808-Ljbffr Micro1
    Remote job
    Contract work
    Part time

    Micro1

    Beaverton, OR
    1 day ago
  • TEKsystems is seeking an AI Knowledge Systems Specialist for a remote role focused on building AI-powered knowledge systems. This position involves working extensively with LLMs to structure data and enhance retrieval in healthcare applications. The ideal candidate will... 
    Remote job
    Hourly pay
    For contractors

    TEKsystems

    Seattle, WA
    3 days ago
  • $115k - $150k

     ...for our customers. As a Software Engineer , you'll join a highly specialized...  ...team focused on building the systems that power how we source,...  ...~ Experience integrating LLM APIs or using AI-assisted development...  ...advantage of in-person and remote collaboration. Check out our... 
    Remote work
    Full time
    Work at office
    Flexible hours

    Vivid Seats

    Chicago, IL
    29 days ago
  • MixRank is hiring generalist software engineers in the United States, Georgia, to work across various technical domains, including data mining and web application development. You will need strong familiarity with technologies like Python and PostgreSQL, as well as a passion... 
    Remote job

    MixRank

    New York, NY
    1 day ago
  • $272k - $425.5k

    Principal Software Engineer – Large-Scale LLM Memory and Storage Systems page is loaded## Principal Software Engineer – Large-Scale LLM Memory and Storage Systemslocations: US, CA, Santa Clara: US, WA, Remote: US, MA, Remotetime type: Full timeposted on: Posted Todayjob... 
    Remote work
    Local area

    NVIDIA

    Santa Clara, CA
    3 days ago
  •  ...seeking a thoughtful AI/NLP Intern for a part-time remote internship to assist in refining a relationship analysis system using LLMs. You will collaborate closely with...  ...graduate program and possess skills in working with LLM APIs. This role offers exposure to real-world AI... 
    Remote work
    Part time
    Internship

    Wayne State

    Miami, FL
    9 days ago
  • Tradeweb Markets seeks an experienced AI/LLM Product Engineer to design and build intelligent, language-driven systems that translate user intent into structured execution workflows. This role sits at the intersection of large language models, data science, and electronic... 

    Tradeweb Markets

    New York, NY
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer- LLM Systems (Remote). Be the first to apply!