Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Software Engineer, AI Data & LLM Evaluation (Remote)

KAKE

Kake is seeking a Senior Software Engineer to contribute to developing AI training data for a leading human data platform. This role involves working at the intersection of software engineering and AI, helping to build better models.

Candidates should have 5+ years of experience in software engineering, with strong skills in evaluating AI-generated code and terminal-based workflows. This position is remote and offers a unique opportunity to influence AI advancements.

#J-18808-Ljbffr
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Software Engineer, AI Data & LLM Evaluation (Remote) in Poland, NY vacancy
  •  ...Kake is seeking a Senior Software Engineer to help develop and evaluate AI training data for an expert platform serving AI agents. This unique role requires strong software...  ...terminal-based workflows. The position offers remote work in a fast-paced environment focused on AI... 
    Remote work
    Senior

    KAKE

    Peru, IL
    2 days ago
  •  ...Senior Engineer, Data & AI Vendelux is transforming how companies discover, evaluate, and maximize the impact of events. Event marketers are...  ...thrives at the intersection of software engineering, data...  ...prompt engineering, RAG, and LLM deployment. ~ Strong grasp... 
    Remote work
    Senior

    Vendelux

    United States
    12 days ago
  •  ...Senior Engineer, Data & AI Vendelux is transforming how companies discover, evaluate, and maximize the impact of events. Event marketers are...  ...thrives at the intersection of software engineering, data...  ...prompt engineering, RAG, and LLM deployment. ~ Strong grasp... 
    Remote work
    Senior
    Work at office

    Vendelux

    United States
    3 days ago
  • $185k - $225k

     ...unifying technology, data, and fund...  ...purpose-built AI platform, we're...  ...ranging from a fully remote experience to...  ...of modern data engineering and applied AI. As a Senior Software Engineer, Data,...  ...tools and LLM-assisted development...  ...• Critically evaluate AI-generated... 
    Remote work
    Senior
    Full time
    Work at office
    Local area
    Work from home
    Flexible hours

    Juniper Square

    United States
    8 hours ago
  • $125k - $156.3k

     ...seeking an experienced Senior Software Engineer with modern data engineering and AI-enabled development skills...  ...tools (e.g., LLM copilots) to accelerate...  ...lifecycle ~ Ability to evaluate emerging data and AI technologies...  ...considerations. Remote USA $125,000-$156,300... 
    Remote work
    Senior
    Work at office
    Immediate start
    Worldwide

    Natera

    United States
    2 days ago
  • $185k - $225k

     ...unifying technology, data, and fund...  ...our purpose-built AI platform, we're reimagining...  ...from a fully remote experience to working...  ...Airflow. As a Senior Software Engineer on the Data Platform...  ...coding tools and LLM-assisted...  ...operates • Critically evaluate AI-generated code... 
    Remote work
    Senior
    Full time
    Work at office
    Local area
    Work from home
    Flexible hours

    Juniper Square

    Canada, KY
    3 days ago
  • $190k - $210k

     ...Senior Software Engineer As a Senior Software Engineer at Read AI, your contributions will directly impact the...  ...responsible for owning the data flows and ML...  ...interactions with third party llm providers, data...  ...reliability. Continuously evaluate and implement best... 
    Remote work
    Senior
    Flexible hours

    Read AI

    United States
    8 hours ago
  •  ...A leading tech firm is seeking an AI Software Engineer with strong LLM experience to work on advanced AI model training. This role involves collaborating...  ...with cross-functional teams, curating code examples, evaluating AI-generated code, and ensuring production-grade... 
    Remote work

    SWITS DIGITAL Private Limited

    New York, NY
    6 days ago
  • $80 - $100 per hour

     ...benchmarks and evaluation pipelines used to test frontier AI models on real software engineering work: Design...  ...scalable data pipelines for evaluation...  ...implementing LLM coding benchmarks...  ...Nice to Have Senior or Lead-level...  ...Location: Fully remote — work from anywhere... 
    Remote work
    Senior
    Full time
    Contract work
    For contractors

    G2i Inc.

    United States
    3 days ago
  •  ...Senior Engineer - Ai Platform At LightBox, we strive to not only equip confident, data-driven decisions across sectors, but...  ...management interfaces, evaluation dashboards, trace...  ...~6+ years of software engineering experience...  ...~ Familiarity with LLM integration patterns... 
    Remote work
    Senior
    Weekend work
    Afternoon shift

    Lightbox

    United States
    8 hours ago
  • $40 - $100 per hour

     ...Remote Senior Software Engineer (LLM) - 34953Remote Senior Software Engineer (LLM) - 349533 days ago Be among the first 25 applicantsGet AI-powered advice on this job and more exclusive features.Sign...  ...:We're building high-quality evaluation and training datasets to... 
    Remote work
    Senior
    Full time
    For contractors

    Turing Inc

    New York, NY
    3 days ago
  •  ...We are looking for a Senior Software Engineer to contribute to the development and evaluation of AI training data for a leading expert human data...  ...RLHF, data annotation, or LLM evaluation projects. Excellent...  ...to work independently in a remote, asynchronous, fast‑paced environment... 
    Remote work
    Senior

    KAKE

    New York, NY
    3 days ago
  • $183.34k - $206k

     ...from Day 1. #LI-Remote Little more...  ...team: The LLM Observability (...  ...layer that makes AI workloads...  ...and ensure that data from diverse ecosystems...  ...and own your software in production....  ...You'll mentor engineers, share...  ...frameworks for evaluating how to approach... 
    Remote work
    Senior
    Work at office
    Local area
    Work from home
    Home office
    Visa sponsorship
    Flexible hours
    Shift work

    Honey Comb

    United States
    1 day ago
  • $175k - $245k

     ...Senior Software Engineer II - Applied AI and Evaluations (Remote Eligible) -REMOTE, USA- For over 20 years, Smartsheet has helped...  ...position at the intersection of LLM evaluation, prompt and context engineering...  ...skills; comfortable working in data‑heavy environments (Databricks,... 
    Remote work
    Senior
    Full time
    Temporary work
    Local area
    Immediate start

    Smartsheet

    Bellevue, WA
    10 days ago
  •  ...research accelerator for frontier AI labs and a trusted partner...  ...research with high-quality data, advanced training pipelines,...  ...researchers who specialize in software engineering, logical reasoning, STEM,...  ...Does a Typical Day Look Like? Evaluate and refine AI-generated code... 
    Remote job
    Senior
    For contractors
    Flexible hours

    Turing

    Chicago, IL
    1 day ago
  •  ...Senior AI Engineer In Pre-training Evaluation Aleph Alpha Research's mission is to deliver category-defining AI...  ...which training runs we pursue, which data mixtures we prioritize, and how we...  ...Your Profile Experience with LLM evaluation, benchmark design, evaluation... 
    Remote work
    Senior
    Relocation
    Flexible hours

    Aleph Alpha

    United States
    8 hours ago
  • $100 per hour

     ...pioneering leader at the forefront of AI research and advanced system...  ..., is looking for qualified Senior Software Engineers to assist in a one-time project to assist with their LLM training. Selected...  ...expected to be ~1 hour. * Evaluate and improve large language... 
    Remote work
    Senior
    Hourly pay
    Temporary work

    Aquent

    United States
    7 days ago
  • $170k - $240k

     ...We’re hiring a Senior Software Engineer for a fast-growing legal AI infrastructure startup building the data layer behind modern legal research....  ..., citation systems, APIs, evaluation, and the reliability of large...  ...NYC preferred. Remote candidates may be considered... 
    Remote work
    Senior

    Magnetizer Inc.

    New York, NY
    2 days ago
  • $204k - $259k

     ...Senior Machine Learning Engineer – VLM/LLM Evaluation Waymo is an autonomous driving technology...  ...of the Waymo AI Foundations team is...  ...to a Senior Staff Software Engineer. You will...  ...extend large scale data and evaluation...  ...role can be performed remote, the specific salary... 
    Remote work
    Senior
    Full time
    Temporary work

    Waymo

    Kirkland, WA
    8 hours ago
  •  ...Kake is looking for a Senior Software Engineer in San Francisco to contribute to the development of AI training data for a leading human data platform. This unique role merges...  ...responsibilities will include creating coding tasks, evaluating AI-generated solutions, and ensuring high... 
    Remote work
    Senior

    KAKE

    San Francisco, CA
    2 days ago
  • $160.9k - $257.1k

     ...Senior Software Engineer, Big Data At Zillow, data is one of our most valuable assets...  ...time analytics, and emerging AI-driven applications....  ...specialized expertise. Evaluate and integrate modern streaming...  ...has been categorized as a Remote position. "Remote" employees... 
    Remote work
    Senior
    Permanent employment
    Live in
    Work at office
    Local area

    Zillow Referrals

    United States
    8 hours ago
  • $180k - $230k

     ...Senior Data Engineer Remote - Canada Narvar is growing! We're building the data infrastructure behind...  ...scale, and we expect you to work in an AI-native way, using agentic coding tools...  ...our data layer for agentic and LLM-powered use cases with semantic clarity... 
    Remote work
    Senior
    Worldwide

    Narvar

    United States
    8 hours ago
  • $210k - $267k

     ...ingest large‑scale data—weather, prices,...  ...re looking for an engineer to help lead the scaling...  ...Temporal. Strong software engineering skills...  ...data for use in AI‑based weather...  ...storing predictions and evaluation metrics for large‑...  ...’s your policy on remote work? We value the... 
    Remote work
    Senior
    Work at office
    Work from home
    Home office
    Flexible hours
    3 days per week

    Gridmatic

    Cupertino, CA
    2 days ago
  • $160.9k - $257.1k

     ...Zillow Group's Housing Trends Data Engineering team brings innovative...  ...with a group of versatile software developers in a collaborative...  ...has been categorized as a Remote position. "Remote" employees...  ...have. ~ Familiarity with LLM and Agentic AI technologies and... 
    Remote work
    Senior
    Permanent employment
    Live in
    Work at office
    Local area

    Zillow

    United States
    5 days ago
  •  ...Texas Sports Academy Main is seeking a Software Engineer (AI-Forward) to build software for managing...  ...in AI coding tools, and involvement in LLM-powered features. You'll work closely with...  ...background. This position supports remote work for candidates in India or Pakistan... 
    Remote work
    Senior

    Texas Sports Academy Main

    New York, NY
    5 days ago
  • $141k - $208k

     ...Senior Software Engineer - Python and Data Ecosystem United States (Remote) About ClickHouse Recognized on the 2025 Forbes Cloud...  ...warehousing, observability, and AI workloads. The company's...  ...for RAG pipelines, backends for LLM-powered agents, and real-time... 
    Remote work
    Senior
    Local area
    Worldwide
    Home office
    Flexible hours
    Shift work

    ClickHouse

    United States
    3 days ago
  •  ...Stimulus is an AI-powered relationship...  ...that combines data insights,...  ...technology. We work remotely and thrive on...  ...Intelligence Engineer to join our Data...  ...Technologies GenAI & LLM Systems...  ...observability, evaluation, and scaling LLM...  ...an AI engineer, software engineer, or similar... 
    Remote work
    Senior
    Visa sponsorship

    Stimulus Inc.

    Mission, KS
    13 days ago
  •  ...seeking experienced AI infrastructure Engineers to design and implement...  ...for massive data workloads. Join Tether...  ...systems for scalable evaluation and annotation, including...  ...tooling domains. Strong software engineering experience...  ...collaboration of LLM and/or video foundation... 
    Remote work
    Senior

    Framework Ventures

    United States
    5 days ago
  • An AI research lab is seeking a Software Engineer specializing in large-scale data processing for LLM development. This remote role entails designing and maintaining scalable data infrastructure for research applications. Candidates should have over 5 years of relevant... 
    Remote job
    Senior

    Titan Holdings

    San Francisco, CA
    4 days ago
  • $179.4k - $224.3k

     ...Senior Software Engineer, Data Engineering Remote, USA Omada Health is on a mission to inspire and engage people in...  ...within defined SLAs. Impact Evaluate, benchmark, and improve the scalability...  ...Scientists, Data Analysts, and AI/ML Engineers. You want to make... 
    Remote work
    Senior
    Local area
    Work from home
    Flexible hours

    Omada Health

    California, MO
    12 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Software Engineer, AI Data & LLM Evaluation (Remote). Be the first to apply!