Software Engineer- LLM Systems (Remote)
$180k - $220kNewtonX
About NewtonX
NewtonX delivers AI-powered B2B insights to the world's most demanding clients—McKinsey, Blackstone, Microsoft, Google, KKR—who use our data to make high-stakes decisions. Our research has been cited by Fortune, Forbes, TechCrunch, Adweek and more. We've built a reputation as the quality standard in the industry. Now we're building AI systems to make that quality infinitely scalable.
NewtonX has raised $47M in funding from VCs like Two Sigma Ventures, Third Prime, XFund and Citi Ventures.
The Role
In this role, you'll own the core LLM infrastructure powering two products redefining B2B research:
Hub – The central cockpit for B2B research. Build self-serve features that compress weeks into days: question → expert insight → follow-up, powered by RAG and adaptive workflows.
Prime – Syndicated intelligence at scale. Architect automated systems that continuously capture expert opinions—creating longitudinal datasets and refreshable dashboards that compound in value.
The technical challenge: fusing structured survey data with unstructured expert knowledge, building semantic search across proprietary corpora, and creating AI pipelines that maintain research-grade quality at scale. If you love building novel data systems that turn raw signals into defensible, high-margin products, this is where you'll do the most important work of your career.
What We're Looking For
Required
- You write exceptional code, fast. 3-4 years of experience shipping production code in a fast-paced environment
- Full-stack expertise: Moderate proficiency in React, TypeScript, and modern frontend frameworks. Backend experience with Python, Node.js, or similar
- AI/ML implementation experience: Hands-on experience integrating LLMs, building with OpenAI/Anthropic APIs, or implementing ML models in production. We care more about a demonstrated eagerness to learn and an understanding of complex systems than specific years.
- Cloud and infrastructure: Experience with AWS, Docker, and modern deployment practices
- Quality mindset: Experience with testing, code reviews, and maintaining high code quality standards
- Customer focus: Ability to translate user needs into technical solutions while maintaining engineering best practices
Nice to Have
- RAG systems, embeddings, semantic search
- Real-time data processing or streaming architectures
- Open-source contributions in AI/ML
What actually matters We care less about credentials and more about demonstrated ability. If you've built something interesting with LLMs- a side project, an open-source contribution, a blog post that shows how you think- put that at the top of your application.
Why Join NewtonX?
- Frontier technology: Work with cutting-edge AI systems, pushing the boundaries of what's possible in enterprise AI applications
- Exceptional traction: Strong product-market fit with the world's largest investment banks, hedge funds, and consulting firms
- World-class team: We take talent density seriously. Work alongside incredibly smart, driven people who are passionate about their craft
- High velocity: Ship features that directly impact how billion-dollar decisions are made
- Growth opportunity: Join during a hypergrowth phase with clear paths for technical and career advancement
- Impact: Your work will directly shape how the world's leading organizations make critical business decisions
What We Offer
- Competitive compensation with a total compensation range of $180-220k (includes base and annual performance bonus) and equity. (Please note that salary and compensation may vary based on skills, experience, performance, and location.)
- Excellent medical, dental, and vision insurance.
- 401k match with immediate vesting.
- Generous Paid time off, holidays, and parental leave.
- A diverse, collaborative, and positive culture where we invest in and celebrate each other's success. Flexible work environment where we work hard but have fun (happy hours, team projects, and retreats).
Equal Opportunity
NewtonX is proud to be an equal opportunity workplace. We do not discriminate based upon race, religion, color, national origin, sex, sexual orientation, gender identity/expression, age, status as a protected veteran, status as an individual with a disability, or any other applicable legally protected characteristics.
Timezone
Location: Remote Flexible across all US time zones.
- ...staffing agency is seeking an AI Engineer to join a rapidly growing AI... ...and deploying generative AI systems, collaborating with talented engineers... ...have strong experience with LLM frameworks and prompt... ...time position allows for fully remote work and promises involvement...Remote workFull time
- ...Role: Senior AI Engineer - Agentic Systems and LLM Client Location: Mason, OH 100% Remote Job Description: We are seeking a senior AI engineer to design and build production-grade LLM-powered applications and agentic systems. This role owns the end-to-end development...Remote work
- ...Senior AI Engineer - LLM & Agentic Systems (Python) Remote Role Overview We are seeking a senior AI engineer to design and build production-grade LLM-powered applications and agentic systems. This role owns the end-to-end development of intelligent solutions...Remote work
- ...AI/ML Engineer LLM & Agentic Systems (Python) Location: MASON, OH Hybrid Must Have Skills Skill 1 - Yrs of Exp - 10+ - design and build production-grade LLM-powered applications and agentic systems Skill 2 - Yrs of Exp - 6+ - End-to-end development of intelligent...Remote work
- ...technology firm is seeking a Senior Software Engineer to join a fully remote team. In this role, you'll design and... ...integration with dental insurance systems and AI workflows for billing. The ideal... ..., and hands-on experience with LLM APIs. You'll work collaboratively to...Remote work
- ...Innovating in AI systems technologies, the full-time Software Engineer, AI Systems will develop libraries and GPU kernel... ...collaborating with engineers in a remote or onsite environment. Key responsibilities... ...extensible abstractions for LLM serving engines and contributing...Remote workFull time
$160k - $250k
...Senior Software Engineer (Agentic Systems) Salary: $160K – $250K + Equity Company Description: High-growth AI research lab Job Description:... ...Ensure the scalability and observability of production-grade LLM systems while contributing across the full technical...Remote work- ...Senior Software / Data Engineer Decentriq is the rising leader in data-clean-room technology. With... ...learning for AdTech. The role can be fully remote (± 4 h CET) or based in our Zürich/... ...AI-Powered Productivity – Leverage LLM-based code assistants, design generators...Remote workWork at officeImmediate start
- ...powers Moveworks' AI agents — the systems that orchestrate, execute,... ...is a distributed systems engineering role at the heart of the agentic... ...interaction across multiple LLM calls and tool invocations... ...trust. Work personas (flexible, remote, or required in office) are...Remote workWork at officeFlexible hours
- ...Senior Software Engineer, Agentic Systems - Moveworks Moveworks is the Agentic AI Assistant platform that... ...and user interaction across multiple LLM calls and tool invocations Distributed... ...and trust. Work personas (flexible, remote, or required in office) are...Remote workWork at officeFlexible hours
- ...arms race. Our AI-powered system autonomously discovers, validates... ...zero-days across the software billions rely on, and... ...re looking for a Software Engineer with deep expertise in LLM prompting, orchestration,... ...Should Know # Location: Remote (all team members are remote...Remote workFull timeContract work
$180k - $220k
...to meet you. As a hands-on AI systems engineer at Atlas Health, you'll... ...reliable, grounded answers. Build LLM-driven systems that: Extract... .../ ML Experience 8+ years in software engineering with significant... ...retirement plan, with company match Remote work equipment, including a...Remote workTemporary workWork experience placementFlexible hours- ...Description The Role Are you a software engineer who has honed your craft,... ...and improving production systems, and are looking to apply your... ...optimization, agent memory, LLM self-reflection and improvement... .... Work personas (flexible, remote, or required in office) are categories...Remote workWork at officeImmediate startFlexible hours
$100k - $160k
...every day. Our AI Voice & Telephony Engineering Team builds the systems that power intelligent conversations... ...What You'll Do: As a Senior Software Engineer, you'll design and build scalable... ...recognition, text-to-speech, or LLM-based conversational AI....Remote workFull timeTemporary workLocal areaFlexible hours$197.9k - $270k
...depends on experienced embedded software engineers like you joining the Roku OS... ...stacks, integrating DRM systems, and developing tools to monitor... ...A familiarity with AI/ML and LLM technologies. ~ Experience... ...Thursday. Fridays are flexible for remote work except for employees...Remote workWork at officeLocal areaMonday to ThursdayFlexible hours- ...science, over 8 years of experience, and strong Core Java skills. The environment is fast-paced and supportive of learning, with a remote-first approach. You will join a diverse team and can expect competitive salary and flexible hours, contributing to the leading blockchain...Remote workFlexible hours
- ...A cutting-edge AI firm is seeking an experienced AI/ML engineer to join their remote team. You will innovate in the field of large language models (LLMs), collaborating on high-performance systems. The role requires at least 2 years of relevant experience working with...Remote work
- ...Software Engineer Opportunity Baseten powers mission-critical inference for the world's most dynamic... ...(HPC) and Large Language Model (LLM) engineering. You will be responsible for... ...and define the benchmarks that ensure our systems are production-ready. Responsibilities...Remote workFlexible hours
- ...Dsilo Ai Technologies is seeking a Senior AI Engineer with over 5 years of experience to design and develop AI solutions utilizing Large... ...enterprise applications and ensure robust performance across systems. Strong proficiency in Python and hands-on experience with AI deployment...Remote work
$183.34k - $206k
...We are currently looking for a Senior Software Engineer – LLM Observability in the United States.... ...this role, you will help define how AI systems are represented, measured, and analyzed... ...friendly ownership opportunities. Fully remote work environment with a distributed-...Remote jobFull timeHome office- ...Baseten Engineer Opportunity Baseten powers mission-critical inference... ...building the global operating system for distributed, heterogeneous... ...hardware. We believe that as LLM and multi-modal workloads... ...configuration to architect the software fabric that unifies thousands...Remote workFlexible hours
- ProLeads in Deutschland sucht einen AI Engineer mit Schwerpunkt auf RAG zur Entwicklung intelligenter AI-Systeme. In dieser Rolle optimieren Sie Retrieval-Pipelines und... ...sowie Kenntnisse in Python oder TypeScript. Der Remote-First Arbeitsplatz bietet Flexibilität sowie...Remote job
- ...is seeking a full-time Lead AI Engineer to drive the AI engineering function and manage agentic AI systems while leading a team of AI Engineers in a fully remote environment. The ideal candidate... ...will have extensive experience in software engineering with a strong...Remote workFull time
$183.34k - $206k
...accountability from Day 1. #LI-Remote Little more about the team: The LLM Observability (LLM O11y)... .... We define how AI systems are represented in... ...Support and own your software in production. You'll participate... ...daily. You'll mentor engineers, share knowledge, and delegate...Remote workWork at officeLocal areaWork from homeHome officeVisa sponsorshipFlexible hoursShift work$137k - $180k
...A leading financial technology company is looking for a Machine Learning Engineer to join their remote team. The role involves designing and maintaining scalable backend services, collaborating with cross-functional partners, and managing AWS services. Candidates should...Remote work- ...Senior Software Engineer, Go - LLM Team AssemblyAI builds the best-in-class Voice AI models powering the next generation of voice applications... ...testing strategies, and building highly reliable systems in service of solving real customer problems. This role...Remote workEasy work
$152k - $241.5k
...Join NVIDIA's TensorRT Edge-LLM team and help shape the next... ...automotive and robotics. We build the software stack that enables Large... ...Science, Electrical/Computer Engineering, or a closely related field.... ...autoregressive LLM serving systems, including speculative decoding...Remote work$40 - $100 per hour
...Remote Senior Software Engineer (LLM) - 34953Remote Senior Software Engineer (LLM) - 349533 days ago Be among the first 25 applicantsGet AI-powered... ...development. Our mission is to empower the next generation of AI systems to reason about and work with real-world software...Remote workFull timeFor contractors$100k
...compute framework, a distributed compute orchestration engine, and more. Additionally, as we expand to enable LLM innovation in numerous areas of personalization,... ...to own and develop our long-term vision. Our systems power some of Netflix's most business-critical models...Remote workHourly payFull timeImmediate startFlexible hours$120k - $135k
...seeking a Senior Machine Learning Engineer to design and scale machine... ...experience, particularly with LLM-powered solutions. Responsibilities include developing ML systems, maintaining model quality,... ...benefits. The position allows for remote work, contributing to an...Remote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer- LLM Systems (Remote). Be the first to apply!
- software sales engineer United States
- software engineer full time United States
- facebook software engineer United States
- startup software engineer United States
- intermediate software engineer United States
- research software engineer United States
- software developer no experience United States
- labview software developer United States
- rust software engineer United States
- freelance software developer United States


