Software Engineer - Evals
$175k - $275kMaven Ventures
SpaceXAI’s mission is to create AI systems that can accurately understand the universe and aid humanity in its pursuit of knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who appreciate challenging themselves and thrive on curiosity. We operate with a flat organizational structure. All employees are expected to be hands-on and to contribute directly to the company’s mission. Leadership is given to those who show initiative and consistently deliver excellence. Work ethic and strong prioritization skills are important. All employees are expected to have strong communication skills. They should be able to concisely and accurately share knowledge with their teammates.
You will own and elevate our mission-critical research platform that directly accelerates xAI’s frontier work.
The evals team creates and executes instruments for measuring model capabilities and behaviors. These instruments are used to clean datasets, provide feedback for experiments, and track growth throughout training. The evals team also diagnoses why agents fail and how to make improvements both short and long term. We manage the execution infrastructure, design data sets and grading schemes.
You will design, build, and ship delightful and bulletproof systems that engineers love to use every day. This role values a strong attention to details, first principles reasoning, and great taste.
We are open to all levels from new grads to senior engineers.
Requirements
- Software engineering proficiency and 3+ years of experience actively writing code.
- A track record of shipping high quality projects and a strong sense of urgency.
- Exceptional product taste - you have a sharp sense for what “good” looks like in outputs, and you can translate fuzzy notions of quality, helpfulness, truthfulness, and safety into concrete, measurable criteria.
- Strong attention to detail.
Bonus Points
- Previously founded a startup or joined a fast-growing early-stage startup.
- Familiarity with AI/ML workflows, annotation tools, or evals.
- Experience creating and maintaining component libraries, design systems, or internal tools.
COMPENSATION AND BENEFITS:
$175,000 - $275,000 USD
Base salary is just one part of our total rewards package at xAI, which also includes equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.
- equity, comprehensive medical, vision, and dental coverage, access to a 401(k) retirement plan, short & long-term disability insurance, life insurance, and various other discounts and perks.
SpaceXAI is an equal opportunity employer. For details on data processing, view our Recruitment Privacy Notice.
#J-18808-Ljbffr$175k - $275k
...small, highly motivated, and focused on engineering excellence. This organization is for individuals... ...SpaceXAI's frontier work. The evals team creates and executes instruments... ...to senior engineers. Requirements Software engineering proficiency and 3+ years of...SuggestedTemporary work$161.3k - $274.2k
...ServiceNow’s leading workflow automation with Moveworks’ Reasoning Engine and natural language capabilities, we deliver the AI platform... ...with run-to-run comparison as a first-class operationConsolidating evals that run today as one-off workflows onto a single orchestration...SuggestedContract workWork at officeRemote workFlexible hours$130k - $152k
...high, and so are the rewards. Robinhood is seeking a Senior Software Engineer to join the Enterprise Build team: the small, high-leverage team... ...handoffs as part of your definition of done: runbooks, evals, and dashboards.Establish the paved patterns with the Enterprise...SuggestedWork at officeFlexible hoursShift work3 days per week$174k - $252k
...fitness data.Write production-grade code and evals to enable secure data retrieval layers... ...Managers, UX Designers, and frontend engineers to refine the user experience and resolve... ...health, diagnosis and resolution, and software test engineering.Experience developing Generative...Suggested$207k - $300k
...equivalent practical experience.8 years of experience in software development.5 years of experience testing, and launching... ...in applied ML in the generative AI era (prompt engineering, agentic system, evals, synthetic data generation).Google's software engineers...Suggested$171k - $231.5k
...one of Intuit's fastest-growing segments, is seeking a Senior Software Engineer to help build the industry's AI-native ERP. This is an... ...evaluate, and iterate on AI-powered features in production: offline evals, online experimentation and A/B testing, and quality/safety...Work experience placementWorldwide$140.5k - $190k
...OverviewCome join the GBSG Mid-Market Intelligence team as a Software Engineer 2. Mid-Market is one of the fastest growing segments of the business... ...of AI-powered features through automated tests, offline evals, and golden datasets.- Resolve defects/bugs during QA testing...Work experience placementInternshipWorldwide- ...actively developing the technologies to make this possible, with the ultimate goal of enabling human life on Mars.FULL STACK SOFTWARE ENGINEER (STARLINK)At SpaceX we’re leveraging our experience in building rockets and spacecraft to deploy Starlink, the world’s most advanced...Permanent employmentTemporary workInternshipWorldwideWeekend work
- ...Technology and ITLocation: Menlo Park, CAContract: ContractPosted: 2026-10-08Deadline: 0001-01-01Our client is seeking a Full Stack Software Engineer to join their team. As a Full Stack Software Engineer, you will be part of the engineering organization supporting product and...Temporary workFlexible hours
$174k - $252k
...Share Senior Software Engineer, Google Health Google Mountain View, CA, USA X In most instances, this position requires in-person interviews... ..., and fitness data. Write production-grade code and evals to enable secure data retrieval layers and investigative tools...- ...decides how to fix a denied claim, with evals, dry runs, and audit trails rigorous enough... ...touches production. Scale a rule engine that runs hundreds of configurable conditions... ...extensive experience ~5+ years of professional software development industry experience ~...Work at officeImmediate start
$215k - $300k
...people — move around the planet. We are a team of mission-driven engineers with experience across aerospace, robotics and self-driving... ...cars working to make this future a reality.As a Senior Fullstack Software Engineer at Reliable Robotics, you will design, and implement...Permanent employmentCasual work- ...Full Stack Engineer - Digital Payments About Gen: Gen is a global company dedicated to powering Digital Freedom through its trusted consumer brands including Norton, Avast, LifeLock, MoneyLion and more. Our combined heritage is rooted in financial empowerment and...Work experience placementFlexible hours
$162k - $260k
...LinkedIn.What we are looking forWe’re searching for a Senior Software Engineer, ML Evaluation & Introspection Infrastructure to join our Behavior... ...Analysis builds the systems that make that call: the evals that compare model versions, the embedding search that makes...Work at officeLocal area3 days per week$174.4k - $237.8k
...’s possible for industrial robotics in the near future - with software and data at the core.Our mission is to make industrial robotics... ..., entrepreneurs, and developers. We are a dynamic team of engineers, roboticists, designers, and technologists who are passionate...Full timeWork experience placementLocal area$132k - $198.45k
...Uber, NVIDIA, Google, Softbank, Fidelity, T. Rowe Price, and other leading investors.About the TeamWe're looking for a Fullstack Software Engineer to join the Fleet Platform & Operations Tooling team. You'll build the internal tools and platform systems that Nuro's...Immediate startFlexible hours$139k - $223k
...safer, get crucial goods where they need to go, and make mobility more efficient and accessible for all. We’re searching for a Software Engineer to Vehicle Platform Integrations Team.In this role, you willWork within our vehicle integration team to develop infrastructure...Work at officeLocal area3 days per week$135k - $155k
...Today SpaceX is actively developing the technologies to make this possible, with the ultimate goal of enabling human life on Mars.SOFTWARE ENGINEER (PLATFORM TEAM) The Platform Team is responsible for building the foundational tooling and security infrastructure that...Permanent employmentTemporary work$155k - $260k
...fraud/cloaking detection, and invalid-traffic signals as they intersect the serving path.RequirementsRequired5+ years of backend engineering experience building and operating distributed, high-QPS, low-latency production services (Java, Go, C++, or similar).Strong system...Full timeLocal areaWork from home$160.36k - $240.54k
...Uber, NVIDIA, Google, Softbank, Fidelity, T. Rowe Price, and other leading investors.About the RoleOur software team is growing, and we are looking for talented engineers to join us and be instrumental to one of the following areas: Onboard Systems, Performance, and...Immediate startFlexible hours$147.2k - $200.9k
...’s possible for industrial robotics in the near future - with software and data at the core.Our mission is to make industrial robotics... ..., entrepreneurs, and developers. We are a dynamic team of engineers, roboticists, designers, and technologists who are passionate...Full timeLocal areaFlexible hours$85.4k - $232.7k
...from garbage.First-principles thinker with vision. You break problems to their core, question the assumptions, and rebuild. A software engineer's job is to architect solutions, not wrestle with syntax. You don't copy an architecture because "that's how it's done" — you...Immediate startShift work$210k - $260k
...Software Engineer, APIs & Context Platform Glean is the Work AI platform that helps everyone work smarter with AI. What began as the industry’s most advanced enterprise search has evolved into a full-scale Work AI ecosystem, powering intelligent Search, an AI Assistant...Work at officeHome officeFlexible hours$180k
...knowledge. Our team is small, highly motivated, and focused on engineering excellence. This organization is for individuals who... ...Science ~5+ years of industry experience working on commercial software application or services ~ Distributed Systems experience (Kafka...Temporary work$160.36k - $240.54k
...logs. Additionally, the team collaborates closely with system engineers to thoroughly validate the autonomous driving system before its... ...driving technical standards and best practices across broader software organizationA bachelor's degree in Computer Science,...Immediate startFlexible hours$160k - $200k
...intersection of creativity and AI with real impact. Join us to help shape the future of enterprise marketing. What You'll DoAs a Senior Software Engineer, Platform, you will be responsible for building features end-to-end. You will work closely with cross-functional teams...Work at office3 days per week- ...and we are leading a national collaborative effort to develop software for anatomic modeling, virtual surgery, and simulations pertaining... ...translation.The lab is looking for a SimVascular Software Engineer and Architect who will be eligible to work remotely and whose duties...Part timeRemote work
$199k - $234k
...Robinhood — today giving a growing number of engineers and employees an AI teammate that ships... ...for a visionary leader with a strong software engineering background, a passion for... ...agent orchestration, tool integration, evals, and permissioning for consequential actions...Work at officeFlexible hoursShift work$209k - $313k
...addition to Bitmoji, Saturn, and other digital services.Snap Engineering teams build fun and technically sophisticated products that reach... ...execute with privacy at the forefront.We’re looking for a Software Engineer to join the ML Platform Experience team, part of the...Full timeLive inWork at officeLocal area$174k - $252k
...experience in code and system health, diagnosis and resolution, and software test engineering. Experience developing Generative AI Agents. About the... ..., and fitness data. Write production-grade code and evals to enable secure data retrieval layers and investigative tools...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer - Evals. Be the first to apply!
- software engineer amazon Palo Alto, CA
- information technology software engineer Palo Alto, CA
- federal - software developer Palo Alto, CA
- graduate software developer Palo Alto, CA
- rust software engineer Palo Alto, CA
- software engineer remote Palo Alto, CA
- junior software developer internship Palo Alto, CA
- remote entry level software developer Palo Alto, CA
- software engineer contract Palo Alto, CA
- network software engineer Palo Alto, CA


