Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Python Engineer: LLM Eval & Repo Validation Remote

$19 - $20 per hour

Crossing Hurdles

A tech consulting firm is seeking a Senior Software Engineer specializing in Python to evaluate and validate LLM performance in real-world scenarios. This remote position involves analyzing GitHub issues, developing software solutions, and collaborating with researchers. Candidates should have strong software development and Python skills and be able to work independently. The role offers a contractor assignment for 3 months at a competitive rate of $19-$20 per hour. #J-18808-Ljbffr

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Python Engineer: LLM Eval & Repo Validation Remote in New York, NY vacancy
  •  ...Senior Python Developer Join us at Provectus as part of a team dedicated...  ..., cloud services, and data engineering, and we take pride in our...  ...and ship Python services and LLM features (including RAG, tools...  ...term B2B collaboration; ~100% remote — with flexible hours; ~... 
    Remote work
    Senior
    Flexible hours

    Provectus

    United States
    1 day ago
  • Senior Staff Machine Learning Engineer, Data & Eval United States AI and ML are at the heart of the...  ...services, and tools including LLM fine‑tuning and...  ...platforms for agent behavior validation, safety/guardrails, and...  ...This position is US - Remote Eligible. The role may include... 
    Remote work
    Senior
    Work experience placement
    Casual work
    Live in
    Work at office

    airbnb, Inc.

    San Francisco, CA
    15 hours ago
  •  ...accelerating frontier research with high-quality data, advanced training pipelines, plus top AI researchers who specialize in software engineering, logical reasoning, STEM, multilinguality, multimodality, and agents; and second, by applying that expertise to help enterprises... 
    Remote job
    Senior
    For contractors
    Flexible hours

    Turing

    Chicago, IL
    2 days ago
  • $45 per hour

     ...looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project...  .... This part-time remote opportunity is ideal for technical...  ...data collection, validation, and task execution while...  ...Hands-on experience with LLM frameworks (LangChain, OpenRouter... 
    Remote work
    Senior
    Hourly pay
    Part time
    Freelance
    10 hours per week

    Mind Rift

    United States
    15 hours ago
  •  ...Senior AI / LLM Backend Engineer (Python) Publicis Sapient is a digital transformation partner helping established organizations get to their future, digitally enabled state, both in the way they work and the way they serve their customers. We help unlock value through... 
    Remote work
    Senior

    Prodigious Worldwide

    United States
    4 days ago
  •  ...Senior Python Engineer - Backend & Data (Remote) Bold Business is an AI-first U.S.-based company building automation...  ...) Own data quality — validation, monitoring, failure handling Structure...  ...(Expected Working Level) LLM API integration (OpenAI, Anthropic... 
    Remote work
    Senior

    Bold Business

    United States
    1 day ago
  •  ...hiring a highly agile Full-Stack Engineer who thrives in early-stage...  ...and backend APIs • Connect AI/LLM systems into real product...  ...experience with Vue + TypeScript and Python backends • Experience with...  ...work • Ability to validate and harden AI-generated code... 
    Remote work
    Senior

    Curotec

    United States
    4 days ago
  •  ...Have ~3–6+ years of experience with Python (Python 3) and async development (...  ...Experience with Pydantic or Marshmallow for validation and serialization ~ Experience integrating...  ...and maintainable code Mentor junior engineers and support technical growth... 
    Remote work
    Senior

    AltexSoft

    United States
    4 days ago
  •  ...security, user fund transparency, trading engine speed, deep liquidity, and an unmatched portfolio...  ...world. Responsibilities: AI / LLM application quality assurance Design...  .... Experiences in LLM development or eval is a plus. Excellent self-driven and ownership... 
    Remote work
    Senior
    Work from home

    binance

    United States
    15 days ago
  • A leading technology consulting firm is seeking a Senior / Lead Python Engineer for a remote role in the US. The position involves working on an established...  ...integration issues, and collaborating with teams to validate changes. Candidates should have strong Python skills... 
    Remote work
    Senior
    Flexible hours

    Grid Dynamics

    Cupertino, CA
    4 days ago
  • $213k - $263k

     ...large foundation models to smaller real-time models. Explore LLM/VLM distillation recipes to maximally transfer the quality gains...  ...salary range for the role location or, if the role can be performed remote, the specific salary range for your preferred location, during... 
    Remote work
    Senior

    Waymo

    Mountain View, CA
    10 days ago
  • €4,000 - €7,600 per month

     ...Connect with your team: Klaidas Lekavičius, Engineering manager. What You Will Do Design...  ...and other top engineers on cutting-edge LLM-based projects Share knowledge and...  ...What we expect Strong experience with Python as well as knowledge about most common... 
    Remote work
    Senior
    Work experience placement

    Hostinger

    United States
    1 day ago
  •  ...Senior Python Engineer N-iX is seeking a Senior Python Engineer to build production-grade application...  ...ERP systems, enforcing strict validation logic before any transaction is committed...  ...offer: Flexible working format - remote, office-based or flexible A... 
    Remote work
    Senior
    Freelance
    Work at office
    Flexible hours

    N-iX

    United States
    1 day ago
  • $213k - $263k

     ...Senior Software Engineer, Eval Authoring APIs Waymo is an autonomous driving technology...  ..., encompassing creation, validation, testing, and publishing....  ...proficiency in C++ or Python. ~ Exceptional...  ...the role can be performed remote, the specific salary range... 
    Remote work
    Senior
    Full time

    Waymo

    Mountain View, CA
    2 days ago
  • $200k - $225k

     ...Senior Python Engineer Remote - USA The Role We're looking for a Senior Software Engineer to build and scale the backend systems that power...  ...through scalable, well-architected backend systems ML and LLM capabilities are seamlessly integrated into product... 
    Remote work
    Senior
    Flexible hours

    Wizard

    United States
    3 days ago
  •  ...Senior Python Engineer Remote (UK) with Occasional Travel - Applications from non-UK countries will be rejected - Division: Inizio Medical – Data...  ...applications, including systems that incorporate generative AI and LLM-based capabilities. Prior experience with generative AI is... 
    Remote work
    Senior
    Flexible hours

    Inizio

    United States
    1 day ago
  •  ...Engineering At Lawhive We are a team of 40 engineers and researchers, responsible for architecting...  ...firm The Role We're looking for a Senior Python Engineer to join our AI Engineering &...  ...and debugging. Nice to Have LLM Observability & Evaluation – familiarity... 
    Remote work
    Senior

    Lawhive

    United States
    12 days ago
  •  ...Senior Python Engineer Dimensional was built around a set of ideas bigger than the firm itself. With a confidence in markets, deep connections...  ...pipelines at various stages including data ingestion, data validation, and quality control, data integration, storage, management... 
    Remote work
    Senior
    Work experience placement

    Dimensional Fund Advisors

    United States
    2 days ago
  •  ...We are currently hiring a Senior / Lead Python Engineer for a remote role in the US. Responsibilities Work on an established infrastructure codebase...  ...Collaborate with platform and infrastructure teams to validate changes and ensure compatibility Requirements... 
    Remote work
    Senior
    Currently hiring
    Work at office
    Flexible hours

    Grid Dynamics

    Cupertino, CA
    4 days ago
  • $80 per hour

     ...This project is suited for a Senior Python developer with deep functional...  ...of experience as a Software Engineer (primarily Python) ~ Deep experience...  ...to read and understand with LLM many coding languages (for...  ...by Toloka AI) Fully remote and flexible participation —... 
    Remote work
    Senior
    Permanent employment
    Temporary work
    Freelance
    Flexible hours

    Mind Rift

    Houston, TX
    4 days ago
  • $150k - $220k

     ...Senior Python Engineer At Slingshot Aerospace, we're on a mission to make space safer and more secure...  ...DC–Baltimore area. Work is mostly done remotely but regular site visits in the DC area...  ...with agent-driven AI architectures and LLM-powered automation workflows. Strong... 
    Remote work
    Senior
    Currently hiring

    Slingshot Aerospace

    United States
    3 days ago
  • $204k - $259k

     ...diverse set of sensors, enabling engineers like you to (1) develop...  ...large-scale model development (LLM, VLM, or similar foundation models...  ...Strong coding proficiency in Python and deep learning frameworks (...  ...if the role can be performed remote, the specific salary range for... 
    Remote work
    Senior

    Waymo

    Mountain View, CA
    10 days ago
  • $180k

     ...Senior Python Software Engineer (Perm, USA, Remote + Travel) This is a full-time, permanent opportunity for candidates based in the United States and authorized...  ..., with a drive to stay at the forefront of emerging LLM technologies. Practical experience of delivering... 
    Remote work
    Senior
    Permanent employment
    Full time
    Immediate start
    Flexible hours

    NearForm

    United States
    4 days ago
  • $125k - $209k

     ...Senior Software Engineer II As a member of the Sophos Agentic AI team, the Senior...  ...and REST APIs using Python, FastAPI, and Celery. Build...  ...deploying Generative AI or LLM-powered solutions. Understanding...  ...? · Sophos operates a remote-first working model, making... 
    Remote work
    Senior
    Local area

    Sophos

    United States
    1 day ago
  • $90 - $100 per hour

     ...Eliassen Group is seeking a Senior AI/ML Engineer to design and deliver cloud-...  ...AWS. Responsibilities include LLM orchestration, predictive...  ...functional teams. This is a remote position requiring U.S. citizenship...  ...in software/IT, strong Python skills, and AWS expertise.... 
    Remote work
    Senior
    Permanent employment

    Eliassen Group

    New York, NY
    4 days ago
  •  ...GenAI and Large Language Model (LLM) features. Architect...  ...and Job Requirements ~5+ Python experience ~ GenAI & LLM:...  ...What We Offer ~100% Remote Work: Enjoy the freedom to work...  ...Professionals: Join forces with senior talent. All of our team members... 
    Remote work
    Senior

    TrueLogic Company

    United States
    4 days ago
  •  ...An industrial technology company seeks a Senior Agentic AI Engineer to innovate and develop complex LLM agents. This remote role involves coding sophisticated AI modules, integrating...  ...strong engineering background, expertise in Python, and significant experience with GenAI... 
    Remote work
    Senior

    Trimble

    New Bremen, OH
    4 days ago
  •  ...Senior Python Developer / Data Engineer / ML Pipelines 100% Remote role Responsibilities Design and build large-scale data pipelines for ingestion, transformation and...  ...engineering setup Plus Experience with NLP or LLM-based systems Familiarity with MLOps tools like MLflow... 
    Remote work
    Senior

    EITACIES

    New York, NY
    2 days ago
  • • Develop and implement state-of-the-art NLP and LLM solutions • Design , engineer and evaluate NLP pre-processing, model training and inference pipelines...  ...Deep learning algorithms • Excellent Experience with Python and working with Jupyter notebooks • Experience... 
    Remote work

    Exaways Corporation

    United States
    3 days ago
  • $63.22k - $131.7k

     ...NTT DATA is looking for a Senior Data Scientist Consultant in Plano, Texas. This role involves conducting model validation, risk assessment, and compliance governance. The ideal...  ...candidate should possess strong skills in Python, SQL, and familiarity with machine learning... 
    Remote work
    Senior

    NTT DATA

    Plano, TX
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Python Engineer: LLM Eval & Repo Validation Remote. Be the first to apply!