Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer- LLM Systems (Remote)

$180k - $220k

NewtonX, Inc.

About NewtonX

NewtonX delivers AI-powered B2B insights to the world's most demanding clients—McKinsey, Blackstone, Microsoft, Google, KKR—who use our data to make high-stakes decisions. Our research has been cited by Fortune, Forbes, TechCrunch, Adweek and more. We've built a reputation as the quality standard in the industry. Now we're building AI systems to make that quality infinitely scalable.

NewtonX has raised $47M in funding from VCs like Two Sigma Ventures, Third Prime, XFund and Citi Ventures.

The Role

In this role, you'll own the core LLM infrastructure powering two products redefining B2B research:

Hub – The central cockpit for B2B research. Build self‑serve features that compress weeks into days: question → expert insight → follow‑up, powered by RAG and adaptive workflows.

Prime – Syndicated intelligence at scale. Architect automated systems that continuously capture expert opinions—creating longitudinal datasets and refreshable dashboards that compound in value.

The technical challenge: fusing structured survey data with unstructured expert knowledge, building semantic search across proprietary corpora, and creating AI pipelines that maintain research‑grade quality at scale. If you love building novel data systems that turn raw signals into defensible, high‑margin products, this is where you’ll do the most important work of your career.

What We’re Looking For

Required

  • You write exceptional code, fast. 3‑4 years of experience shipping production code in a fast‑paced environment
  • Full‑stack expertise: moderate proficiency in React, TypeScript, and modern frontend frameworks. Backend experience with Python, Node.js, or similar
  • AI/ML implementation experience: hands‑on experience integrating LLMs, building with OpenAI/Anthropic APIs, or implementing ML models in production. We care more about a demonstrated eagerness to learn and an understanding of complex systems than specific years.
  • Cloud and infrastructure: experience with AWS, Docker, and modern deployment practices
  • Quality mindset: experience with testing, code reviews, and maintaining high code quality standards
  • Customer focus: ability to translate user needs into technical solutions while maintaining engineering best practices

Nice to Have

  • RAG systems, embeddings, semantic search
  • Real‑time data processing or streaming architectures
  • Open‑source contributions in AI/ML

What actually matters

We care less about credentials and more about demonstrated ability. If you've built something interesting with LLMs— a side project, an open‑source contribution, a blog post that shows how you think— put that at the top of your application.

Why Join NewtonX?

  • Frontier technology: work with cutting‑edge AI systems, pushing the boundaries of what's possible in enterprise AI applications
  • Exceptional traction: strong product‑market fit with the world's largest investment banks, hedge funds, and consulting firms
  • World‑class team: we take talent density seriously. Work alongside incredibly smart, driven people who are passionate about their craft
  • High velocity: ship features that directly impact how billion‑dollar decisions are made
  • Growth opportunity: join during a hyper‑growth phase with clear paths for technical and career advancement
  • Impact: your work will directly shape how the world's leading organizations make critical business decisions

What We Offer

  • Competitive compensation with a total compensation range of $180−220k (includes base and annual performance bonus) and equity. (Please note that salary and compensation may vary based on skills, experience, performance, and location.)
  • Excellent medical, dental, and vision insurance.
  • 401k match with immediate vesting.
  • Generous paid time off, holidays, and parental leave.
  • A diverse, collaborative, and positive culture where we invest in and celebrate each other's success.

Flexible work environment where we work hard but have fun (happy hours, team projects, and retreats).

Equal Opportunity

NewtonX is proud to be an equal opportunity workplace. We do not discriminate based upon race, religion, color, national origin, sex, sexual orientation, gender identity/expression, age, status as a protected veteran, status as an individual with a disability, or any other applicable legally protected characteristics.

Timezone

Location: Remote

Flexible across all US time zones.

#J-18808-Ljbffr
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Software Engineer- LLM Systems (Remote) in New York, NY vacancy
  •  ...Capital One seeks a Distinguished AI Engineer (Remote Eligible) to lead the design, development, and deployment of AI-powered financial services...  ...-grade AI components, including foundation model training, LLM inference, and guardrails, leveraging AWS, HuggingFace, and PyTorch... 
    Remote work

    Capital One Group

    San Francisco, CA
    1 day ago
  • $145k - $275k

     ...the best product managers, software, and hardware talent at innovative...  .... Our team is 100% remote and we work with teams across...  ...them hire. Software Engineer – Edge AI Systems Location - Seattle, WA...  ...Systems team develops advanced LLM-powered autonomous systems... 
    Remote work
    Full time

    Recruiting From Scratch

    Remote
    11 hours ago
  • $197.9k - $270k

     ...depends on experienced embedded software engineers like you joining the Roku OS...  ...stacks, integrating DRM systems, and developing tools to monitor...  ...A familiarity with AI/ML and LLM technologies. ~ Experience...  ...Thursday. Fridays are flexible for remote work except for employees... 
    Remote work
    Full time
    Work at office
    Local area
    Monday to Thursday
    Flexible hours

    Roku

    Remote
    11 hours ago
  • thecompany.com is seeking engineers to build and productionize AI systems that go beyond demos, including live traffic and real users. You'll work on conversational...  ...OpenAI. You'll design and deploy production-grade LLM apps, orchestrate agent frameworks like LangChain,... 
    Remote job

    United States Digital Space LLC

    New York, NY
    11 hours ago
  • $145k - $200k

     ...builds the world’s leading software for data-driven...  ...an experienced Software Engineer to join a newly-formed...  ...deploying advanced AI systems to the tactical edge. This...  ...evaluating, and deploying LLM agents to edge hardware...  ...roles that allow for “Remote” work on an exceptional... 
    Remote work
    Full time
    Work experience placement
    Work at office
    Work from home
    Relocation package

    Palantir Technologies

    Seattle, WA
    11 hours ago
  • $145k - $200k

     ...builds the world’s leading software for data-driven...  ...seeking a Senior Software Engineer to join a customer-facing...  ...for Autonomous Systems for use in operational...  ...threat detectionBuild LLM and AI-driven systems capable...  ...roles that allow for “Remote” work on an exceptional... 
    Remote work
    Full time
    Work experience placement
    Work at office
    Work from home
    Relocation package

    Palantir Technologies

    Palo Alto, CA
    11 hours ago
  • $130.4k - $195.6k

     ...content into other game engines and 3D environments —...  ...network.We’re building systems that allow real-time 3D...  ...game engines and emerging software platforms. We’re also...  ...style tool interfaces, LLM agents, multimodal models...  ....com.SummaryLocation: Remote, Washington, USA;... 
    Remote work
    Full time
    Work at office
    Worldwide

    Unity Technologies

    Bellevue, WA
    2 days ago
  • $183.34k - $206k

     ...accountability from Day 1. #LI-Remote Little more about the team: The LLM Observability (LLM O11y...  .... We define how AI systems are represented in...  ...Support and own your software in production. You'll...  ...use daily. You'll mentor engineers, share knowledge, and delegate... 
    Remote work
    Full time
    Work at office
    Local area
    Work from home
    Home office
    Visa sponsorship
    Flexible hours
    Shift work

    Honeycomb.io

    United States
    11 hours ago
  • $80 - $150 per hour

     ...Overview Help shape conversations about production search systems built for the LLM and agent era. This opportunity centers on the practical decisions...  ...by specific real-world examples. Work Terms Remote, per-task engagement. The initial interview is a 25-minute... 
    Remote work

    SaidGig

    United States
    6 days ago
  •  ...Job Description Job Description Senior Software Engineer — Secure Mission Systems Location: Mainly remote, with onsite work in Laurel, Maryland, typically one...  ...Integrate AI models and support capabilities involving LLM assistants, retrieval-augmented generation, and... 
    Remote work
    Weekly pay
    Contract work
    Work from home
    Home office
    1 day per week

    Rackner

    Laurel, MD
    18 days ago
  •  ...eSimplicity Inc. is seeking an LLM Specialist to enhance AI capabilities within a cloud-based analytics ecosystem. This role involves...  ...and developing generative AI solutions. eSimplicity promotes a remote work culture, requiring occasional travel under 5% of work time.... 
    Remote work

    eSimplicity Inc

    Columbia, MD
    1 day ago
  • $119.98k - $179.97k

    Role Description The Software Engineer (AI Systems), equivalent in scope to a Software Engineer with 5-7 years...  ...building production systems using LLM APIs, including retrieval-augmented generation...  ...Work is normally performed in a remote office environment including, but not... 
    Remote work
    Full time
    Work at office
    Immediate start
    Home office
    Visa sponsorship
    Work visa
    Long distance

    EdReports (Secondary)

    Remote
    11 hours ago
  •  ...Reporting to the Tech GM of Field Engineering, the Specialist Solutions...  ...Service Assistant (m/f/d) - Remote, Germany ICAPE GROUP Logistics...  ...(m/f/d) with a fir… Staff Software Engineer - AI/ML Databricks...  ...Learning Engineer, CustomerLake (ML/LLM) RDQ427R109 - At the company,... 
    Remote work
    Part time

    United States Digital Space LLC

    San Francisco, CA
    1 day ago
  • $183.34k - $206k

     ...Senior Software Engineer II - LLM Observability Remote - United States What We're Building Honeycomb is a service for the near and present future...  ...workloads observable in Honeycomb. We define how AI systems are represented in telemetry (spans, traces, token usage... 
    Remote work
    Work at office
    Work from home
    Home office
    Visa sponsorship
    Flexible hours
    Shift work

    Honey Comb

    United States
    4 days ago
  • Volga Partners is seeking a skilled Software Development Engineer to work on AI-powered applications in a fully remote capacity. You will develop production-grade systems, integrating large language models and backend services. In this role, you will be involved in API... 
    Remote job

    Volga Partners

    New York, NY
    3 days ago
  • ICON is seeking a pragmatic AI Software Engineer to design and ship AI-powered tools, workflows, and autonomous agents for its Government Technology team. The role is remote with periodic travel to ICON HQ in Austin, TX. You will own end-to-end AI feature development,... 
    Remote job

    ICON Technology

    Austin, TX
    2 days ago
  • eSimplicity is looking for an LLM Specialist to design and operationalize advanced large-language-model capabilities. The role involves leading innovations around AI technologies and overseeing scalable pipelines within a cloud environment. The ideal candidate will have... 
    Remote job

    eSimplicity

    Columbia, MD
    1 day ago
  •  ...Overview Build and validate verifiable software engineering tasks and evaluation datasets derived...  ...challenging, realistic code tasks that inform LLM evaluation and training. Key...  ...related CI tooling. Perks Fully remote work. Opportunity to influence how LLMs... 
    Remote work
    For contractors
    Local area

    SaidGig

    United States
    more than 2 months ago
  •  ...Description:** We are seeking an elite **LLM & AI Pipeline Engineer** to lead the backend development of...  ...proof of skill. This is a 100% remote position. We are open to bids based on...  ...Database & State Logic:** Trigger-based systems and strict multi-tenant access control... 
    Remote work

    LearnHow Blue LLC

    Las Vegas, NV
    a month ago
  •  ...team of infrastructure and platform engineers building Fleet Orchestrator, which...  ...our entire fleet state, including software versions and configuration. Our system ensures that every vehicle in the...  ...managing software for embedded or remote hardware.   Candidates are... 
    Remote work
    Full time
    Relocation

    Avride

    Austin, TX
    11 hours ago
  • $180k - $250k

     ...this role:  You are an experienced software engineer who thrives on building large-scale computing...  ...expertise in large scale distributed systems that deal with high complexity, a lot...  ...San Francisco, CA (willing to consider remote for Senior and Staff levels) What... 
    Remote work
    Full time
    Currently hiring
    Relocation package

    Falò

    Remote
    11 hours ago
  • $180k - $260k

     ...to where it is needed, including operational systems and SaaS tools. Traditionally, acting on data has required engineering time and bandwidth, and left most business users...  ...Betterment. We’re based in San Francisco, are remote-friendly, and backed by leading investors such... 
    Remote job
    Full time

    Hightouch

    Remote
    11 hours ago
  • $170k - $216k

     ...simulation across 15+ U.S. states. Software Engineering builds the brains of Waymo's fully autonomous...  ...while collaborating with hardware and systems engineers. If you’re a software...  ...location or, if the role can be performed remote, the specific salary range for your preferred... 
    Remote work
    Full time
    Work experience placement

    Waymo

    San Francisco, CA
    11 hours ago
  • $145k - $200k

     ...Palantir builds the world’s leading software for data-driven decisions and operations...  ...IL-5 and FedRAMP). As a Software Engineer on the Seattle Apollo team, you’ll...  ...and operate a large-scale distributed system to allow the remote operation and maintenance of Kubernetes... 
    Remote work
    Full time
    Work experience placement
    Work at office
    Work from home
    Relocation package

    Palantir Technologies

    Seattle, WA
    11 hours ago
  • Role Description As a Software Engineer on our Research & Development Team,...  ...will play a central role in system integration, feature design,...  ...analytics. ~NLP techniques, LLM integration, or building and...  ...Benefits ~We operate in a fully remote, high-trust environment and... 
    Remote work
    Full time

    Inca Digital, Inc.

    Remote
    5 days ago
  • $200.7k - $250.9k

    Mercury is looking for a Senior Software Engineer to work on Command, their LLM-powered financial assistant. The ideal candidate will have 7+ years of experience and a strong background in building scalable LLM-powered applications. This work includes designing workflows... 
    Remote job

    Mercury

    San Francisco, CA
    3 days ago
  • $15k

     ...ambitious goals for the future. As a Senior Software Engineer on our Back Office Engineering team,...  ...the company's production trading systems and the data pipelines that drive our machine...  ...behaviors. This role is open to remote work in the US or hybrid in our... 
    Remote work
    Full time
    Work at office
    Local area

    The Voleon Group

    Remote
    11 hours ago
  • $115k - $150k

     ...Description Saalex is seeking a Software Engineer (Range Systems) in  Corona, CA.  Saalex is an Engineering and Information Technology Services...  ...150K (depending on experience) Work Location: Hybrid remote/in-office (see onsite requirements below). Preference for... 
    Remote work
    Full time
    Temporary work
    Work at office

    Saalex Corporation

    Remote
    11 hours ago
  • $160k - $194k

    Location: San Francisco, CA (Remote/Hybrid Available) What is Verse? The...  ...intelligence platform for the AI economy. Our software helps the world's largest energy...  ...energy. The Role As a Software Engineer focusing on Distributed Systems at Verse, you will work in... 
    Remote work
    Full time
    Flexible hours

    Ad Verse

    San Francisco, CA
    11 hours ago
  •  ...and infrastructure, operating systems, and autonomy. Eighteen of...  ...This may include occasional remote work, starting the day with morning...  ...the role The Systems Engineering Tools & Traceability Engineer...  ...degree in Computer Science, Software Engineering, Robotics, Electrical... 
    Remote work
    Full time
    For contractors
    For subcontractor
    Casual work
    Work at office
    Day shift

    Applied Intuition

    Remote
    11 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer- LLM Systems (Remote). Be the first to apply!