Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Python Engineer: LLM Eval & Repo Validation Remote

$19 - $20 per hour

Crossing Hurdles

A tech consulting firm is seeking a Senior Software Engineer specializing in Python to evaluate and validate LLM performance in real-world scenarios. This remote position involves analyzing GitHub issues, developing software solutions, and collaborating with researchers. Candidates should have strong software development and Python skills and be able to work independently. The role offers a contractor assignment for 3 months at a competitive rate of $19-$20 per hour. #J-18808-Ljbffr

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Python Engineer: LLM Eval & Repo Validation Remote in United States vacancy
  •  ...Senior Python Developer Join us at Provectus as part of a team dedicated...  ..., cloud services, and data engineering, and we take pride in our...  ...and ship Python services and LLM features (including RAG, tools...  ...term B2B collaboration; ~100% remote — with flexible hours; ~... 
    Remote work
    Senior
    Flexible hours

    Provectus

    United States
    22 hours ago
  • Senior Staff Machine Learning Engineer, Data & Eval United States AI and ML are at the heart of the...  ...services, and tools including LLM fine‑tuning and...  ...platforms for agent behavior validation, safety/guardrails, and...  ...This position is US - Remote Eligible. The role may include... 
    Remote work
    Senior
    Work experience placement
    Casual work
    Live in
    Work at office

    airbnb, Inc.

    San Francisco, CA
    16 hours ago
  • $80 - $100 per hour

     ...real software engineering work: Design...  ...across large repos and multi-language...  ...) ~ Expert Python — clean,...  ...and implementing LLM coding benchmarks...  ...confirm they have valid documentation...  ...to Have Senior or Lead-level profile...  ...: Fully remote — work from anywhere... 
    Remote work
    Senior
    Full time
    Contract work
    For contractors

    G2i Inc.

    United States
    4 days ago
  •  ...Senior AI Engineer - LLM & Agentic Systems (Python) Remote Role Overview We are seeking a senior AI engineer to design and build production-grade LLM-powered applications and agentic systems. This role owns the end-to-end development of intelligent solutions... 
    Remote work
    Senior

    RIT Solutions, Inc.

    Atlanta, GA
    2 days ago
  • $40 per hour

     ...Senior Python Data Scraping Engineer Mindrift is looking for highly skilled Senior Python...  .... This part-time remote opportunity is ideal for technical...  ...data collection, validation, and task execution while...  ...Hands-on experience with LLM frameworks (LangChain, OpenRouter... 
    Remote work
    Senior
    Hourly pay
    Part time
    Freelance
    10 hours per week

    Mind Rift

    United States
    21 hours ago
  •  ...accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in software engineering, logical reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises... 
    Remote job
    Senior
    For contractors
    Flexible hours

    Turing

    Chicago, IL
    2 days ago
  •  ...Senior Python Engineer - Backend & Data (Remote) Bold Business is an AI-first U.S.-based company building automation...  ...) Own data quality — validation, monitoring, failure handling Structure...  ...(Expected Working Level) LLM API integration (OpenAI, Anthropic... 
    Remote work
    Senior

    Bold Business

    United States
    23 hours ago
  • $45 per hour

     ...are currently looking for a Senior Python Data Scraping Engineer (Freelance) in United...  ...ownership of technical decisions, validation processes, and workflow...  ..., cloud infrastructure, LLM frameworks, and dynamic web...  ...AI initiatives. This remote role offers flexibility, autonomy... 
    Remote work
    Senior
    Hourly pay
    Part time
    Freelance
    10 hours per week
    Flexible hours

    Jobgether

    United States
    4 days ago
  •  ...Title : Senior Python Engineer Duration: 6 Months Location: Remote Required experience • Python ETL • Customer has an existing, working,...  ...story is written (in a Sprint), the story is validated in Grafana, so they need to know Grafana but... 
    Remote work
    Senior

    3B Staffing LLC

    New York, NY
    1 day ago
  •  ...hiring a highly agile Full-Stack Engineer who thrives in early-stage...  ...and backend APIs • Connect AI/LLM systems into real product...  ...experience with Vue + TypeScript and Python backends • Experience with...  ...work • Ability to validate and harden AI-generated code... 
    Remote work
    Senior

    Curotec

    United States
    4 days ago
  •  ...We are looking for a Senior Software Engineer to contribute to the development...  ..., data annotation, or LLM evaluation projects....  ...independently in a remote, asynchronous, fast‑...  ...‑Have Experience with Python‑heavy workflows,...  ...environments. Experience with repo‑level code reasoning,... 
    Remote work
    Senior

    KAKE

    United States
    1 day ago
  •  ...security, user fund transparency, trading engine speed, deep liquidity, and an unmatched portfolio...  ...world. Responsibilities: AI / LLM application quality assurance Design...  .... Experiences in LLM development or eval is a plus. Excellent self-driven and ownership... 
    Remote work
    Senior
    Work from home

    binance

    United States
    22 hours ago
  •  ...A leading technology consulting firm is seeking a Senior / Lead Python Engineer for a remote role in the US. The position involves working on an established...  ...integration issues, and collaborating with teams to validate changes. Candidates should have strong Python skills... 
    Remote work
    Senior
    Flexible hours

    Grid Dynamics

    Cupertino, CA
    4 days ago
  • $213k - $263k

     ...unique challenges. The Eval Authoring APIs team's...  ...creation, validation, testing, and publishing...  ...technically hands-on Senior Software Engineer to design and implement...  ...proficiency in C++ or Python. ~ Exceptional communication...  ...can be performed remote, the specific salary... 
    Remote work
    Senior
    Full time

    Waymo

    Mountain View, CA
    1 day ago
  • €4,000 - €7,600 per month

     ...Connect with your team: Klaidas Lekavičius, Engineering manager. What You Will Do Design...  ...and other top engineers on cutting-edge LLM-based projects Share knowledge and...  ...What we expect Strong experience with Python as well as knowledge about most common... 
    Remote work
    Senior
    Work experience placement

    Hostinger

    United States
    22 hours ago
  •  ...We are currently hiring a Senior / Lead Python Engineer for a remote role in the US.ResponsibilitiesWork on an established infrastructure codebase used...  ...workflowsCollaborate with platform and infrastructure teams to validate changes and ensure compatibilityRequirementsStrong... 
    Remote work
    Senior
    Currently hiring

    Grid Dynamics

    San Ramon, CA
    4 days ago
  • $200k - $225k

     ...Senior Python Engineer Remote - USA The Role We're looking for a Senior Software Engineer to build and scale the backend systems that power...  ...through scalable, well-architected backend systems ML and LLM capabilities are seamlessly integrated into product... 
    Remote work
    Senior
    Flexible hours

    Wizard

    United States
    3 days ago
  •  ...Senior Python Engineer Manchester, United Kingdom Job Title: Senior Python Engineer Location: Remote (UK) with Occasional Travel - Applications from non-UK countries will be rejected...  ...that incorporate generative AI and LLM-based capabilities. Prior experience with... 
    Remote work
    Senior
    Flexible hours

    Inizio

    United States
    23 hours ago
  •  ...Engineering At Lawhive We are a team of 40 engineers and researchers, responsible for architecting...  ...firm The Role We're looking for a Senior Python Engineer to join our AI Engineering &...  ...and debugging. Nice to Have LLM Observability & Evaluation – familiarity... 
    Remote work
    Senior

    Lawhive

    United States
    2 days ago
  • $80 per hour

     ...RoleThis project is suited for a Senior Python developer with deep...  ...of experience as a Software Engineer (primarily Python)Deep experience...  ...to read and understand with LLM many coding languages (for example...  ...(powered by Toloka AI)Fully remote and flexible participation —... 
    Remote work
    Senior
    Permanent employment
    Temporary work
    Freelance
    Flexible hours

    Mind Rift

    Houston, TX
    4 days ago
  • $125k - $209k

     ...Senior Software Engineer II As a member of the Sophos Agentic AI team, the Senior...  ...and REST APIs using Python, FastAPI, and Celery. Build...  ...deploying Generative AI or LLM-powered solutions. Understanding...  ...? · Sophos operates a remote-first working model, making... 
    Remote work
    Senior
    Local area

    Sophos

    United States
    20 hours ago
  •  ...Senior Python Developer / Data Engineer / ML Pipelines 100% Remote role Responsibilities Design and build large-scale data pipelines for ingestion, transformation and...  ...engineering setup Plus Experience with NLP or LLM-based systems Familiarity with MLOps tools like MLflow... 
    Remote work
    Senior

    EITACIES

    New York, NY
    2 days ago
  •  ...Senior Python Engineer Dimensional was built around a set of ideas bigger than the firm itself. With a confidence in markets, deep connections...  ...pipelines at various stages including data ingestion, data validation, and quality control, data integration, storage, management... 
    Remote work
    Senior
    Work experience placement

    Dimensional Fund Advisors

    United States
    1 day ago
  •  ...Senior Python Software Engineer (Perm, USA, Remote + Travel) United States Full‑time, permanent opportunity for candidates based in the United States and authorized...  ..., with a drive to stay at the forefront of emerging LLM technologies. Practical experience delivering in an... 
    Remote work
    Senior
    Permanent employment
    Full time
    Immediate start
    Flexible hours

    NearForm

    New York, NY
    2 days ago
  • • Develop and implement state-of-the-art NLP and LLM solutions • Design , engineer and evaluate NLP pre-processing, model training and inference pipelines...  ...Deep learning algorithms • Excellent Experience with Python and working with Jupyter notebooks • Experience... 
    Remote work

    Exaways Corporation

    United States
    3 days ago
  • $120k - $135k

     ...A leading senior care platform in the United States is seeking a Senior Machine Learning Engineer to design and scale machine learning applications...  ..., particularly with LLM-powered solutions. Responsibilities...  .... The position allows for remote work, contributing to an impactful... 
    Remote work
    Senior

    A Place for Mom

    New York, NY
    2 days ago
  •  ...include defining evaluation strategies, assessing LLM outputs, and creating high-quality datasets....  ...solid background in data integrity, programming in Python, and automated evaluation pipelines. This position allows for remote work flexibility within the USA or Canada,... 
    Remote work
    Senior

    Veeva Systems

    New York, NY
    2 days ago
  •  ...Senior Full-Stack Engineer We are looking for a Senior Full-Stack Engineer to join...  ...engineering experience with Python as well as solid front-end...  ...Gemini, or integration with LLM-powered services. Experience...  ...Flexible working format - remote, office-based or flexible... 
    Remote work
    Senior
    Freelance
    Work at office
    Flexible hours

    N-iX

    United States
    23 hours ago
  • $110.23k - $170.24k

     ...Senior Software Engineer (Python/Node) Location : Remote Salary Range: $110,228 - $170,241 per year, depending on experience...  ...This position applies AI and LLM technologies to improve...  ...maintaining strict standards for validation, security, and reliability. The... 
    Remote work
    Senior
    Full time
    Temporary work
    Work at office
    Local area
    Flexible hours

    Fortress Information Security

    United States
    1 day ago
  • $141k - $208k

     ...accelerating momentum was recently validated by a $400M Series D...  ...the role As a Senior Software Engineer specializing in Python and the Data Ecosystem ,...  ...pipelines, backends for LLM-powered agents, and real-...  ...distributed company and remote-friendly. We currently operate... 
    Remote work
    Senior
    Local area
    Worldwide
    Home office
    Flexible hours
    Shift work

    ClickHouse

    United States
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Python Engineer: LLM Eval & Repo Validation Remote. Be the first to apply!