Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Backend Engineer (Python/FastAPI) - AI Evaluation (US-based) [Remote]

AuraOne Human Data

Remote
  • Remote job

Senior Backend Engineer (Python/FastAPI) - AI Evaluation (US-based) is a remote engineering review track for evaluating Python code, debugging traces, and developer-facing AI outputs against real-world correctness standards. Reviewers reproduce failures, write the unit test the model should have written, and explain the fix so the modeling team can target the gap.

Why this role matters

Python model quality lives or dies on whether the generated code actually compiles, passes tests, and handles edge cases. AuraOne pairs experienced engineers with the modeling team to grade outputs the way a code reviewer would.

Responsibilities

  • Run and reproduce Python code outputs in a sandboxed environment for Senior Backend Engineer (Python/FastAPI) - AI Evaluation (US-based) assignments.
  • Grade python engineering solutions for correctness, style, and edge-case handling.
  • Write minimal failing tests that demonstrate the bug a model output missed.
  • Compare paired solutions and rank them with a written rationale tied to the rubric.
  • Tag failure modes (compile error, runtime crash, off-by-one, security issue) with severity scores.
  • Document recurring code-generation failures so the modeling team can target them.
  • Calibrate against gold-standard reviews to keep inter-rater agreement above target.

Qualifications

  • Strong day-job Python experience — you can read, run, and debug unfamiliar code for Senior Backend Engineer (Python/FastAPI) - AI Evaluation (US-based) work.
  • Comfort writing concise unit tests that capture a single failure mode.
  • Familiarity with a testing framework. pytest, Jest, or JUnit. Go test, RSpec, or whatever you use.
  • Clear written reasoning — your review note has to convince another senior engineer.
  • Reliable async availability for at least 10 hours per week.
  • Prior code-review or technical-interview-grading experience is a plus.

Example tasks

  • Reproduce a generated Python solution to a coding task, run the test suite, and grade it.
  • Write the smallest failing test that demonstrates a model's edge-case bug.
  • Compare two paired solutions and rank them with a written rationale tied to the rubric.
  • Triage a security issue surfaced by a model and document the patch the model should have produced.

Nice to have

  • Open-source contributions or a public portfolio that demonstrates production-quality code.
  • Experience with Python's standard tooling, linters, and idiomatic style guides.
  • Familiarity with security-review checklists (OWASP, CWE) and AppSec patterns.

Skills

  • Code review
  • Debugging
  • Unit testing
  • Software engineering judgment
  • Python engineering
  • Python
  • JavaScript
  • Java
  • C++
  • Rust
  • Software development

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Senior Backend Engineer (Python/FastAPI) - AI Evaluation (US-based) [Remote] in Remote vacancy
  •  ...About Us Based in San Francisco, California,...  ...accelerator for frontier AI labs and a trusted...  ...in software engineering, logical reasoning...  ...Software Engineering evaluator, you will create...  ...corrections in Python, C/C++, Rust, Go,...  ...infrastructure, or backend development using... 
    Senior
    Contract work
    For contractors
    Flexible hours

    Turing

    Remote
    13 days ago
  •  ...Senior Backend Engineer | FinTech Data Platform We're partnering with an innovative...  ...delivered through cutting-edge AI, NLP, and machine learning technologies...  ...Skills & Experience: Strong Python development experience, particularly with FastAPI Excellent knowledge of... 
    Senior
    Work at office
    Remote work

    WSS Associates

    New York, NY
    2 days ago
  •  ...About Us Based in San Francisco, California, Turing...  ...accelerator for frontier AI labs and a trusted...  ...specialize in software engineering, logical reasoning, STEM...  ...Software Engineering evaluator, you will create cutting...  ...making corrections in Python, JavaScript (including... 
    Senior
    Contract work
    For contractors
    Flexible hours

    Turing

    Remote
    13 days ago
  • $500 per month

     ...Why Backend Engineering at Langfuse Your work will have an outsized...  ...ingests terabytes of AI tracing data per day....  ...in production : when evaluating a new ClickHouse...  ...Flexible time off in the US, generous entitlement...  ...harassment of any type based on factors such as... 
    Senior
    Remote job
    Full time
    Local area
    Immediate start
    Home office
    Flexible hours

    clickhouse

    New York, NY
    9 days ago
  • $180k - $210k

     ...We combine advanced AI, real-world data from...  ...team of scientists, engineers, and parents is...  ...genuinely matters, join us. You'll be the founding backend engineer on a new Growth...  ...first R&D engineer based at our US site,...  ...the team makes can be evaluated on real data rather... 
    Senior
    Temporary work
    Work at office
    Remote work
    Work from home
    Flexible hours
    2 days per week
    3 days per week

    Nanit

    New York, NY
    6 days ago
  •  ...leading data, AI, analytics,...  ...solution engineering firm. We...  ...thoughtful evaluation, and disciplined...  ...As a Senior AI Engineer...  ...Develop backend services, APIs...  ...experience using Python, Java, C#,...  ...such as FastAPI, Flask, Spring...  ...within the US and COL. Atlanta-based applicants... 
    Senior
    Full time
    Remote work

    Aimpoint Digital

    Remote
    5 days ago
  • $80k - $150k

     ...About Us Wellington Management...  ...Senior Software Developer (Python) Work Location...  ...Senior Software Engineer to join our...  .... Evaluate and leverage modern AI-assisted development...  ...building backend systems...  ...libraries such as FastAPI Spring React...  .... The base salary range... 
    Senior
    Full time
    Work experience placement
    Work at office
    Remote work
    Flexible hours
    1 day per week

    Wellington Management

    Needham, MA
    3 days ago
  •  ...Software Engineer At Payflows, we build...  ...the UK, and the US while choosing to...  ...improve. Build backend tools that our AI agents use to perform...  ...stack evolves based on our challenges...  ...trendy tools. Python is our core language...  ...Backend: FastAPI + Pydantic Data... 
    Senior
    Work at office
    Remote work
    Flexible hours

    Payflows

    United States
    1 day ago
  • $180k - $230k

     ...B2C company, expand its engineering presence in New York. Combining AI, advanced software, and connected...  ...a large global customer base, and an experienced...  ...? We're looking for a Senior Backend Engineer with an entrepreneurial...  ...work. As the first US-based engineer and a... 
    Senior
    Full time
    Work from home
    Flexible hours

    Expert Executive Recruiters (EER Global)

    New York, NY
    1 hour ago
  • $160k - $200k

     ...sequencing, advanced AI methods for genome...  ...functionality to backend systems to support...  ...~ Proficient in Python and Python-based frameworks (Django, FastAPI, Ninja) ~ Proven...  ...responsibility ~ Performance engineering experience,...  ...Location: Remote in the US or open to hybrid,... 
    Senior
    Work at office
    Remote work

    MyOme

    San Francisco, CA
    15 hours ago
  •  ...Job Description Job Description Senior Backend Engineer (Golang & Python) Frisco, Texas (Hybrid) | Engineering...  ...This is a hybrid position based in Frisco, TX. You will be on-site as...  ...latency services Familiarity with AI/ML-powered platforms, LLM integrations... 
    Senior
    Work from home
    Worldwide
    Home office
    Relocation package

    Syndesus

    Frisco, TX
    25 days ago
  •  ...Senior Backend Engineer (Infra & Integrations)Data is the lifeblood...  ..., and Agnes, our AI Supply Chain Manager,...  ...your monitoring tells us before they notice.What...  ...with our backend stack: Python, FastAPI, SQLAlchemy, and...  ...single place to plan, evaluate tradeoffs, and execute... 
    Senior
    Remote work
    Flexible hours

    Spherecast

    New York, NY
    3 days ago
  • $213k - $246k

     ...candidates. About Us Insurance...  ...are building AI that can...  ...looking for strong backend engineers who love...  ...decisions. As a Senior Backend Engineer...  ...is tasked with evaluating our core operations...  ...systems in Python on AWS: services...  ...and scale LLM-based systems that process... 
    Senior
    Work at office
    Remote work

    Recruiting from Scratch

    United States
    2 days ago
  • $150k

     ...About Us TeamSnap is made up of innovators...  ...is seeking a Senior Software Engineer (Backend) interested in...  ...Brainstorm and evaluate new product...  ...development with Node, Python, Golang, Ruby or...  ...0 , inclusive of base and bonus, with comp...  ...Employer. AI Notice We... 
    Senior
    Permanent employment
    Full time
    Currently hiring
    Remote work
    Home office
    Flexible hours

    TeamSnap

    Remote
    1 day ago
  • $170k - $235k

     ...Get to Know Us Horizon3 is a...  ...operators, startup engineers, and formerly...  ...'ll Do As a Senior Backend Engineer on the...  ...agents run on. Our AI researchers...  ...researchers train and evaluate against....  ...functional languages (Python, Go, Scala, C++...  ...position: Base salary range: $... 
    Senior
    Full time
    Work at office
    Remote work
    Flexible hours

    Horizon3

    Remote
    10 days ago
  • $160k - $210k

     ...truly converged AI workspace unifying...  ...daily, and we evaluate AI fluency as part...  ...process. Join us and help redefine...  ...authorization engine, the permission...  ...built on. It is backend-heavy, high-blast...  ...re looking for a Senior Backend Engineer...  ...authorization, relationship-based access control,... 
    Senior
    Full time
    Local area
    Remote work
    Visa sponsorship
    Work visa

    ClickUp

    Remote
    2 days ago
  • $187k - $220k

     ...Senior Backend Engineer Small businesses represent 99.9% of all...  ...into one easy-to-use, AI-powered platform. We're...  ...support a growing user base. Technical Stack And...  ...thoughtfulness as you evaluate tradeoffs in pursuit...  ...,000 USD All other US Locations: $169,000 -... 
    Senior
    Remote work
    Flexible hours

    Quo

    United States
    1 day ago
  • $200k

     ...Senior Backend Engineer Location: San Francisco, CA Company Stage...  ...Compensation About Us We are building an AI-first global consumer neobank...  ...$200K to $600K cash base depending on seniority and...  ...be working with our Python (FastAPI) monolith, which runs in... 
    Senior
    H1b
    Work at office
    Remote work
    Flexible hours

    Recruiting from Scratch

    United States
    21 hours ago
  •  ...Position Overview As a Senior Principal Software Engineer on the Conversational AI team at Savvy (...  ..., rank, and evaluate results using ML-based predictions to determine...  ...experience working in backend systems, designing RESTful...  ...remote across the US & Canada... 
    Senior
    Full time
    Remote work
    Flexible hours

    gen-trellis

    Remote
    9 days ago
  •  ...profitability allows us not only to...  ...looking for a senior engineer who lives at...  ...operations and AI. You've built systems...  .... The stack is Python, the domain is...  ...large Postgres-based warehouse and...  ...3 (asyncio, FastAPI/aio SQLAlchemy,...  ...required — the backend is yours) What... 
    Senior
    Full time

    Telnyx

    Remote
    9 days ago
  • $170k - $200k

     ...further, using AI to help brands operationalize...  ...people to help us scale. This is a...  ...looking for a senior-level software engineer who leans backend and can take...  ...help marketers evaluate performance and...  ...such as role-based access control (...  ...written in Python. ~ Multiple... 
    Senior
    Full time
    Remote work
    Work from home
    Flexible hours

    Northbeam

    Remote
    17 days ago
  • $160k - $200k

     ...in polygenic and AI-based integrative risk modeling...  ...scientists, engineers, clinicians, and professionals...  ...functionality to backend systems to support...  ...~ Proficient in Python and Python-based...  ...(Django, FastAPI, Ninja) ~ Proven...  ...Location: Remote in the US or open to hybrid,... 
    Senior
    Work at office
    Remote work

    MyOme

    Boston, MA
    1 day ago
  • $156k - $215k

     ...our future. As AI reshapes how organizations...  .... About Us SentinelOne...  ...Staff Software Engineer on the Agent...  ...Continuously evaluate and adopt technologies...  ...Our backend services are primarily...  ...with Go and Python also playing important...  ...U.S. role has a base pay range that... 
    Full time
    Worldwide
    Home office
    Flexible hours

    SentinelOne

    Remote
    12 days ago
  • $220k - $275k

     ...0 people across the US and Europe, backed by...  ...early-stage engineers, product builders, and...  ...Salary range for Senior Engineer : $220,000 - $275,000 (base salary) + equity (...  ...designing APIs and building backend services. You enjoy...  ...produce. You use AI as a core part of... 
    Senior
    Work at office
    Remote work
    Work from home
    Home office

    Software Engineering

    New York, NY
    25 days ago
  • $110k - $270k

     ...Senior Software Engineer – Python Veeva Systems is a mission-driven organization...  ...environment. Join us in transforming the...  ...our next major AI-driven platform — one...  ...including Python, Git, FastAPI, Pydantic Fast-...  ...Compensation Base pay: $110,000 – $270,... 
    Senior
    Work at office
    Local area
    Remote work
    Work from home
    Flexible hours

    Venturefizz Product Management Community

    United States
    1 day ago
  • $60k - $130k

     ...combination of AI and computer vision...  ...team members based in the US, India, Japan...  ...Entrupy is seeking a Senior Infrastructure / DevOps Engineer to join our...  ...are written in Python, and this role...  ...Python backend APIs for our mobile...  ...frameworks (Flask, FastAPI, Django) and... 
    Senior
    Full time
    Remote work

    Entrupy

    Remote
    6 days ago
  •  ...Statistician & Optimization Expert – AI Training & Model Evaluation Role Type: Contractor Location:...  ...# Strong practical proficiency in Python. # Deep expertise in at least one relevant...  ...Compensation Compensation is output-based, with payment for tasks that meet... 
    Senior
    Remote job
    For contractors
    Immediate start
    Flexible hours

    YO AI Labs

    New York, NY
    11 days ago
  • $125k - $145k

     ...re looking for a Senior Python Developer to build backend applications, APIs, and AI-enabled software...  ...product managers, engineers, QA, and other stakeholders...  ...to work in the US....  ...stakeholders, and evaluate new technologies...  ...W2 position. ~ Base salary: $125,000... 
    Senior
    Remote job
    Full time

    jbs-dev

    United States
    9 days ago
  • $230k - $280k

     ...We're building an AI-driven marketplace...  ...Role At Mochi, our engineering team operates with...  ...are looking for a Senior Backend Engineer to own...  ...we build. You will evaluate proposed workflows...  ...collaboration -- The base salary for this...  ...and allows us to deliver the best... 
    Senior
    Full time
    Casual work
    Work at office
    Local area
    Remote work
    Weekday work

    Mochi Health

    San Francisco, CA
    15 days ago
  • Senior AI Engineer (Python) Miratech helps visionaries change the world...  ...to join our US Healthcare client. You...  ...conversational AI and chat-based experiences. Implement...  ...platforms, backend services, and APIs. Experience...  ...monitoring, telemetry, and evaluation platforms. Strong... 
    Senior
    Full time
    Internship
    Remote work
    Relocation

    Miratech

    New York, NY
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Backend Engineer (Python/FastAPI) - AI Evaluation (US-based) [Remote]. Be the first to apply!