Senior Backend Engineer (Python/FastAPI) - AI Evaluation (US-based) [Remote]
AuraOne Human Data
- Remote job
Senior Backend Engineer (Python/FastAPI) - AI Evaluation (US-based) is a remote engineering review track for evaluating Python code, debugging traces, and developer-facing AI outputs against real-world correctness standards. Reviewers reproduce failures, write the unit test the model should have written, and explain the fix so the modeling team can target the gap.
Why this role matters
Python model quality lives or dies on whether the generated code actually compiles, passes tests, and handles edge cases. AuraOne pairs experienced engineers with the modeling team to grade outputs the way a code reviewer would.
Responsibilities
- Run and reproduce Python code outputs in a sandboxed environment for Senior Backend Engineer (Python/FastAPI) - AI Evaluation (US-based) assignments.
- Grade python engineering solutions for correctness, style, and edge-case handling.
- Write minimal failing tests that demonstrate the bug a model output missed.
- Compare paired solutions and rank them with a written rationale tied to the rubric.
- Tag failure modes (compile error, runtime crash, off-by-one, security issue) with severity scores.
- Document recurring code-generation failures so the modeling team can target them.
- Calibrate against gold-standard reviews to keep inter-rater agreement above target.
Qualifications
- Strong day-job Python experience — you can read, run, and debug unfamiliar code for Senior Backend Engineer (Python/FastAPI) - AI Evaluation (US-based) work.
- Comfort writing concise unit tests that capture a single failure mode.
- Familiarity with a testing framework. pytest, Jest, or JUnit. Go test, RSpec, or whatever you use.
- Clear written reasoning — your review note has to convince another senior engineer.
- Reliable async availability for at least 10 hours per week.
- Prior code-review or technical-interview-grading experience is a plus.
Example tasks
- Reproduce a generated Python solution to a coding task, run the test suite, and grade it.
- Write the smallest failing test that demonstrates a model's edge-case bug.
- Compare two paired solutions and rank them with a written rationale tied to the rubric.
- Triage a security issue surfaced by a model and document the patch the model should have produced.
Nice to have
- Open-source contributions or a public portfolio that demonstrates production-quality code.
- Experience with Python's standard tooling, linters, and idiomatic style guides.
- Familiarity with security-review checklists (OWASP, CWE) and AppSec patterns.
Skills
- Code review
- Debugging
- Unit testing
- Software engineering judgment
- Python engineering
- Python
- JavaScript
- Java
- C++
- Rust
- Software development
Work model
Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.
Compensation
Hourly rate confirmed after the interview process.
Application process
Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.
- ...About Us Based in San Francisco, California,... ...accelerator for frontier AI labs and a trusted... ...in software engineering, logical reasoning... ...Software Engineering evaluator, you will create... ...corrections in Python, C/C++, Rust, Go,... ...infrastructure, or backend development using...SeniorContract workFor contractorsFlexible hours
- ...Senior Backend Engineer | FinTech Data Platform We're partnering with an innovative... ...delivered through cutting-edge AI, NLP, and machine learning technologies... ...Skills & Experience: Strong Python development experience, particularly with FastAPI Excellent knowledge of...SeniorWork at officeRemote work
- ...About Us Based in San Francisco, California, Turing... ...accelerator for frontier AI labs and a trusted... ...specialize in software engineering, logical reasoning, STEM... ...Software Engineering evaluator, you will create cutting... ...making corrections in Python, JavaScript (including...SeniorContract workFor contractorsFlexible hours
$500 per month
...Why Backend Engineering at Langfuse Your work will have an outsized... ...ingests terabytes of AI tracing data per day.... ...in production : when evaluating a new ClickHouse... ...Flexible time off in the US, generous entitlement... ...harassment of any type based on factors such as...SeniorRemote jobFull timeLocal areaImmediate startHome officeFlexible hours$180k - $210k
...We combine advanced AI, real-world data from... ...team of scientists, engineers, and parents is... ...genuinely matters, join us. You'll be the founding backend engineer on a new Growth... ...first R&D engineer based at our US site,... ...the team makes can be evaluated on real data rather...SeniorTemporary workWork at officeRemote workWork from homeFlexible hours2 days per week3 days per week- ...leading data, AI, analytics,... ...solution engineering firm. We... ...thoughtful evaluation, and disciplined... ...As a Senior AI Engineer... ...Develop backend services, APIs... ...experience using Python, Java, C#,... ...such as FastAPI, Flask, Spring... ...within the US and COL. Atlanta-based applicants...SeniorFull timeRemote work
$80k - $150k
...About Us Wellington Management... ...Senior Software Developer (Python) Work Location... ...Senior Software Engineer to join our... .... Evaluate and leverage modern AI-assisted development... ...building backend systems... ...libraries such as FastAPI Spring React... .... The base salary range...SeniorFull timeWork experience placementWork at officeRemote workFlexible hours1 day per week- ...Software Engineer At Payflows, we build... ...the UK, and the US while choosing to... ...improve. Build backend tools that our AI agents use to perform... ...stack evolves based on our challenges... ...trendy tools. Python is our core language... ...Backend: FastAPI + Pydantic Data...SeniorWork at officeRemote workFlexible hours
$180k - $230k
...B2C company, expand its engineering presence in New York. Combining AI, advanced software, and connected... ...a large global customer base, and an experienced... ...? We're looking for a Senior Backend Engineer with an entrepreneurial... ...work. As the first US-based engineer and a...SeniorFull timeWork from homeFlexible hours$160k - $200k
...sequencing, advanced AI methods for genome... ...functionality to backend systems to support... ...~ Proficient in Python and Python-based frameworks (Django, FastAPI, Ninja) ~ Proven... ...responsibility ~ Performance engineering experience,... ...Location: Remote in the US or open to hybrid,...SeniorWork at officeRemote work- ...Job Description Job Description Senior Backend Engineer (Golang & Python) Frisco, Texas (Hybrid) | Engineering... ...This is a hybrid position based in Frisco, TX. You will be on-site as... ...latency services Familiarity with AI/ML-powered platforms, LLM integrations...SeniorWork from homeWorldwideHome officeRelocation package
- ...Senior Backend Engineer (Infra & Integrations)Data is the lifeblood... ..., and Agnes, our AI Supply Chain Manager,... ...your monitoring tells us before they notice.What... ...with our backend stack: Python, FastAPI, SQLAlchemy, and... ...single place to plan, evaluate tradeoffs, and execute...SeniorRemote workFlexible hours
$213k - $246k
...candidates. About Us Insurance... ...are building AI that can... ...looking for strong backend engineers who love... ...decisions. As a Senior Backend Engineer... ...is tasked with evaluating our core operations... ...systems in Python on AWS: services... ...and scale LLM-based systems that process...SeniorWork at officeRemote work$150k
...About Us TeamSnap is made up of innovators... ...is seeking a Senior Software Engineer (Backend) interested in... ...Brainstorm and evaluate new product... ...development with Node, Python, Golang, Ruby or... ...0 , inclusive of base and bonus, with comp... ...Employer. AI Notice We...SeniorPermanent employmentFull timeCurrently hiringRemote workHome officeFlexible hours$170k - $235k
...Get to Know Us Horizon3 is a... ...operators, startup engineers, and formerly... ...'ll Do As a Senior Backend Engineer on the... ...agents run on. Our AI researchers... ...researchers train and evaluate against.... ...functional languages (Python, Go, Scala, C++... ...position: Base salary range: $...SeniorFull timeWork at officeRemote workFlexible hours$160k - $210k
...truly converged AI workspace unifying... ...daily, and we evaluate AI fluency as part... ...process. Join us and help redefine... ...authorization engine, the permission... ...built on. It is backend-heavy, high-blast... ...re looking for a Senior Backend Engineer... ...authorization, relationship-based access control,...SeniorFull timeLocal areaRemote workVisa sponsorshipWork visa$187k - $220k
...Senior Backend Engineer Small businesses represent 99.9% of all... ...into one easy-to-use, AI-powered platform. We're... ...support a growing user base. Technical Stack And... ...thoughtfulness as you evaluate tradeoffs in pursuit... ...,000 USD All other US Locations: $169,000 -...SeniorRemote workFlexible hours$200k
...Senior Backend Engineer Location: San Francisco, CA Company Stage... ...Compensation About Us We are building an AI-first global consumer neobank... ...$200K to $600K cash base depending on seniority and... ...be working with our Python (FastAPI) monolith, which runs in...SeniorH1bWork at officeRemote workFlexible hours- ...Position Overview As a Senior Principal Software Engineer on the Conversational AI team at Savvy (... ..., rank, and evaluate results using ML-based predictions to determine... ...experience working in backend systems, designing RESTful... ...remote across the US & Canada...SeniorFull timeRemote workFlexible hours
- ...profitability allows us not only to... ...looking for a senior engineer who lives at... ...operations and AI. You've built systems... .... The stack is Python, the domain is... ...large Postgres-based warehouse and... ...3 (asyncio, FastAPI/aio SQLAlchemy,... ...required — the backend is yours) What...SeniorFull time
$170k - $200k
...further, using AI to help brands operationalize... ...people to help us scale. This is a... ...looking for a senior-level software engineer who leans backend and can take... ...help marketers evaluate performance and... ...such as role-based access control (... ...written in Python. ~ Multiple...SeniorFull timeRemote workWork from homeFlexible hours$160k - $200k
...in polygenic and AI-based integrative risk modeling... ...scientists, engineers, clinicians, and professionals... ...functionality to backend systems to support... ...~ Proficient in Python and Python-based... ...(Django, FastAPI, Ninja) ~ Proven... ...Location: Remote in the US or open to hybrid,...SeniorWork at officeRemote work$156k - $215k
...our future. As AI reshapes how organizations... .... About Us SentinelOne... ...Staff Software Engineer on the Agent... ...Continuously evaluate and adopt technologies... ...Our backend services are primarily... ...with Go and Python also playing important... ...U.S. role has a base pay range that...Full timeWorldwideHome officeFlexible hours$220k - $275k
...0 people across the US and Europe, backed by... ...early-stage engineers, product builders, and... ...Salary range for Senior Engineer : $220,000 - $275,000 (base salary) + equity (... ...designing APIs and building backend services. You enjoy... ...produce. You use AI as a core part of...SeniorWork at officeRemote workWork from homeHome office$110k - $270k
...Senior Software Engineer – Python Veeva Systems is a mission-driven organization... ...environment. Join us in transforming the... ...our next major AI-driven platform — one... ...including Python, Git, FastAPI, Pydantic Fast-... ...Compensation Base pay: $110,000 – $270,...SeniorWork at officeLocal areaRemote workWork from homeFlexible hours$60k - $130k
...combination of AI and computer vision... ...team members based in the US, India, Japan... ...Entrupy is seeking a Senior Infrastructure / DevOps Engineer to join our... ...are written in Python, and this role... ...Python backend APIs for our mobile... ...frameworks (Flask, FastAPI, Django) and...SeniorFull timeRemote work- ...Statistician & Optimization Expert – AI Training & Model Evaluation Role Type: Contractor Location:... ...# Strong practical proficiency in Python. # Deep expertise in at least one relevant... ...Compensation Compensation is output-based, with payment for tasks that meet...SeniorRemote jobFor contractorsImmediate startFlexible hours
$125k - $145k
...re looking for a Senior Python Developer to build backend applications, APIs, and AI-enabled software... ...product managers, engineers, QA, and other stakeholders... ...to work in the US.... ...stakeholders, and evaluate new technologies... ...W2 position. ~ Base salary: $125,000...SeniorRemote jobFull time$230k - $280k
...We're building an AI-driven marketplace... ...Role At Mochi, our engineering team operates with... ...are looking for a Senior Backend Engineer to own... ...we build. You will evaluate proposed workflows... ...collaboration -- The base salary for this... ...and allows us to deliver the best...SeniorFull timeCasual workWork at officeLocal areaRemote workWeekday work- Senior AI Engineer (Python) Miratech helps visionaries change the world... ...to join our US Healthcare client. You... ...conversational AI and chat-based experiences. Implement... ...platforms, backend services, and APIs. Experience... ...monitoring, telemetry, and evaluation platforms. Strong...SeniorFull timeInternshipRemote workRelocation
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Backend Engineer (Python/FastAPI) - AI Evaluation (US-based) [Remote]. Be the first to apply!
- remote back end developer Remote
- back-end developer Remote
- senior backend developer Remote
- backend software engineer Remote
- python developer Remote
- senior python developer Remote
- full stack / python developer (remote) Remote
- python developer remote Remote
- python developer data analytics Remote
- python programmer Remote




