Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Data Flywheel Engineer: Real-World ML Data & Evaluation

Sierra Ventures

Reflection is a research lab making intelligence open and accessible for everyone to use, customize, and build on. The Data Flywheel team builds signals, data, and feedback loops to turn model usage into measurable improvements. This hands-on role sits at the intersection of research and deployment, collaborating with researchers, engineers, customers, partners, vendors, and the open-source community to drive real-world impact. #J-18808-Ljbffr

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Data Flywheel Engineer: Real-World ML Data & Evaluation in San Francisco, CA vacancy
  •  ...Reflection AI is seeking a hands-on ML/data role at the intersection of...  ...translate model behaviors into measurable evaluations, design data-centric pipelines, and collaborate with researchers, engineers, and partners to drive real-world improvements. You will own end-to-end... 
    Suggested

    Reflection AI

    San Francisco, CA
    2 days ago
  •  ...datasets, continuously enriched by real-world clinical data. Together, we're building a...  ...for an exceptional Research Engineer or Research Scientist to advance how we curate data and evaluate frontier AI models for...  ...pipelines, evaluation systems, or ML research infrastructure.... 
    Suggested

    Alt

    San Francisco, CA
    1 day ago
  • $180k - $220k

     ...rely on to retrieve real-time, accurate, and...  ...Our team includes engineers, researchers, product...  ...delivering real-world impact. Whether you...  ...looking for a hands‑on Data Engineer to help...  ...tracking Support AI/ML and agent‑based...  ...and applicable evaluation criteria. If AI‑... 
    Suggested
    Full time
    Immediate start
    Remote work
    Work from home
    Flexible hours

    Mixpeek

    San Francisco, CA
    4 days ago
  • $185k - $221.4k

     ...develop and critically evaluate therapeutic hypotheses....  ...Build and own production data infrastructure. Design,...  ...time. Uphold high engineering standards and collaborate...  ...mentor peers; partner with ML engineers,...  ...resolution across messy real-world sources, and data quality... 
    Suggested
    Remote work
    Flexible hours

    Foresite Labs

    San Francisco, CA
    18 hours ago
  •  ...Founding Data Scientist / ML EngineerThe platform sees more about...  ...and recall right on real shipments is the work....  ...'ll build the offline evaluation and online experimentation...  ...: pipelines, feature engineering, and the messy work of making real-world data usable. You have... 
    Suggested
    Work at office
    Remote work

    Zoomlogi

    San Francisco, CA
    18 hours ago
  •  ...compute, environments, evaluations, secure sandboxes, high...  ...own workflows, tools, data, and feedback loops into...  ...of frontier research, real infrastructure, and go-...  ...Requirements Strong software engineering skills in Python and...  ...evaluation systems, or ML workflows used by... 
    Remote work
    Visa sponsorship
    Relocation package
    Flexible hours

    Wwshemi

    San Francisco, CA
    3 days ago
  • $240k - $295k

     ...the Technical Staff - Data Engineer Why Join Stand :...  ...delivery mechanism. The real product is a scalable risk engine, our Stand World Model . We stay when...  .... Curating data for ML and evals — training sets...  ...they use AI, how they evaluate its output, and how it... 
    Hourly pay
    Permanent employment
    Full time
    Temporary work
    H1b
    Work at office
    Local area
    Visa sponsorship
    Work visa
    Flexible hours

    Stand Insurance

    San Francisco, CA
    4 days ago
  • $218.4k - $365.2k

     ...Category Software Engineering Job Details...  ...a way of life. The world of work as we know...  ...fundamentally changing how data gets created,...  ...patterns Build real-time data products...  ...platforms that serve AI/ML workloads — not...  ...recruiters assess and evaluate candidates’ resumes... 

    Slack

    San Francisco, CA
    4 days ago
  •  ...Brain Co. in San Francisco seeks a Machine Learning Engineer to deploy state-of-the-art models and automate real-world problems in healthcare, government, and energy....  ...powered solutions while staying at the forefront of ML development and engineering practices. #J-18808-... 

    BRAIN CORP

    San Francisco, CA
    2 days ago
  •  ...it up, and makes it real. That means defining the evaluation frameworks, building...  ...Partner with research and engineering leads across pre-...  ...operations, or ML engineering, with demonstrated...  ...evaluation design, data pipelines, and...  ...to build the world's most capable open-... 
    Work at office
    Visa sponsorship

    Sierra Ventures

    San Francisco, CA
    2 days ago
  • $172.5k - $260.1k

     ...it’s a way of life. The world of work as we know it...  ...management. We are looking for engineers to develop the Sales...  ...platform that manages real-time ingestion and...  ...processes conversational data from voice, video, and...  ...recruiters assess and evaluate candidates’ resumes and... 
    Full time

    Salesforce

    San Francisco, CA
    5 days ago
  • $170k - $200k

    About the RoleWe're looking for a Data Engineer who wants to operate like a founder. Not someone...  ...impact how our products behave in the real world.The best people for this role think in systems...  ...architectureExperience supporting AI or ML productsYou've used tools like Claude... 
    Work at office
    Remote work
    Flexible hours
    Shift work

    11x AI

    San Francisco, CA
    6 days ago
  •  ...your development. The real magic happens when you...  ...backgrounds and experiences.World-class benefits: On top...  ...build the foundational data infrastructure that...  ...simple hypotheses into engineered features, manage secure...  ...workflows, automated agent evaluation (LangSmith, Opik,... 
    Apprenticeship
    Work at office
    Local area
    Easy work

    McKinsey & Company

    San Francisco, CA
    6 days ago
  •  ...members the best of both worlds: plenty of focus time...  ...for team members for our Data Platform roles are our San...  ...’re looking for a Data Engineer to join our Data Foundations...  ...platform, enabling both real-time and batch...  ...teams, back-end engineers, ML engineers, and Data Science... 
    Worldwide
    Home office
    Flexible hours

    Superhuman

    San Francisco, CA
    5 days ago
  •  ...Vercel is seeking a Staff-level Engineer to lead the design and development of a next-generation Data Platform. You will architect a foundational system powering data across products, including real-time analytics and AI/ML initiatives. You'll define the technical vision... 
    Remote work

    Mosaec

    San Francisco, CA
    2 days ago
  • $175k - $275k

     ...results that are changing lives. Senior Data Engineer About the role HealthLeap runs on...  ...delivery. Produce trusted data for ML pipelines, customer analytics, and user-...  ...passionate about applying frontier AI to real-world impact, join us in building healthcare's... 
    Work at office
    Work from home
    Home office

    Alt

    San Francisco, CA
    4 days ago
  •  ...SoLo is building the data function of the future:...  ...risk, fraud, and data engineering across the entire SoLo...  ...fraud detection sharp in real time. Translate ambiguous...  ...Build and refine the evaluation harnesses that keep agent...  ...observability systems for ML or agent pipelines.... 
    Remote work

    MaC VC

    San Francisco, CA
    18 hours ago
  •  ...the fastest-growing AI data business in history. We...  ...researchers to create evaluations, publish benchmarks, and...  ...Partner hand-in-hand with world-class AI labs, Fortune...  ...Work together with engineers, scientists, operators,...  ...products. On the Data and ML Platform team, you will... 
    Full time
    Work at office
    Local area
    Remote work
    Flexible hours

    Handshake

    San Francisco, CA
    3 days ago
  •  ...transformed the digital world. But the physical...  ...Physical AI— real-world robots for the...  ...We are roboticists, engineers, operators, and builders...  ...scale multimodal data enabling machines...  ...pretraining, finetuning, evaluation, inference, and...  ..., simulation, and ML infrastructure.... 

    Cssmerge

    San Francisco, CA
    2 days ago
  •  ...Senior Data Engineer San Francisco, CA Hybrid About us Metriport...  ...and exchange patient data in real-time: record retrieval that...  ...customer growth, and helping evaluate the right tools (batch and...  ...and beyond. Supporting AI/ML efforts - making sure the AI... 
    Work at office
    Remote work
    Work from home
    Relocation
    Flexible hours

    Metriport

    San Francisco, CA
    4 days ago
  •  ...We build the AI Growth Engine that Fortune 500 enterprises...  ...revenue drivers in real-time.We are expanding our...  ...Whether we are ingesting data into our high-performance...  ...'ll need to master both worlds.The AI Semantic Layer:...  ...models to power our generic ML systems.Enterprise... 

    Hilbert's AI

    San Francisco, CA
    3 days ago
  •  ...compensation platform, combining the world's largest real-time compensation dataset...  ..., and Craft Ventures.The Data Team @ PaveAs part of the...  ...product managers and software engineers to translate product needs...  ...data warehouses.Exposure to ML workflows - you've collaborated... 
    Flexible hours

    Trove Information Technologies

    San Francisco, CA
    6 days ago
  • $150k - $200k

     ...entrepreneurially minded and data-driven people who also...  ...communities around the world.Taskrabbit is a hybrid...  ...'re hiring a Staff Data Engineer to build the data foundation...  ...major product bet with real evidence rather than...  ...Marketing, BizOps, and ML partners in a small, fast... 
    Seasonal work
    H1b
    Work at office
    Immediate start
    Flexible hours

    Taskrabbit

    San Francisco, CA
    8 days ago
  •  ...THE ROLE To build the data foundation that powers Stuut's intelligence...  ...closely with our product and engineering teams to transform raw...  ...reporting, and our AI/ML systems Design the canonical...  ...something usable Have worked with real-world data from SaaS APIs, ERPs,... 
    Full time
    Flexible hours

    OfferGenie

    San Francisco, CA
    4 days ago
  •  ...Sr Data EngineerDisney Entertainment and ESPN Product...  ...global organization of engineers, product developers, designers...  ...creativity to build world-class products, enhance...  ...with robust, reliable, real-time data. As a Senior Engineer...  ...with infrastructure, ML engineering, product,... 

    Disney

    San Francisco, CA
    4 days ago
  • $198k - $297k

     ...Data EngineerIt all started with an idea at Block...  ...We want to redefine the world's relationship with money...  ....The RoleAs a Data Engineer, you will handle everything...  ...frameworks, and ML-ready datasets that enable...  ...equal opportunity employer evaluating all employees and job... 
    Work at office
    Local area
    Remote work
    Flexible hours

    Block | Square

    San Francisco, CA
    22 hours ago
  • $300k

     ...companies ever see. The Data Engineering team turns raw product data into...  ...senior leadership to answer real business questions, with...  ...layers that data scientists, ML engineers, and Data Daddy all...  ...charting a path to make the world more free, equal, and just.... 
    Work at office
    Immediate start
    Worldwide
    Flexible hours

    Grindr

    San Francisco, CA
    18 hours ago
  • $250k - $300k

     ...Researcher or engineer? This role wants both, in one person. A profitable...  ...and post-training data for leading AI labs in the US...  ...many fields, from science to ML research itself Scaling data...  ...more headcount Judging which real-world tasks are worth building, because... 
    Full time

    Rnb Consultancy

    San Francisco, CA
    3 days ago
  • $15k

     ...Staff Software Engineer, Data Infrastructure Location Employment...  ...machine learning techniques to real-world problems in finance. For...  ...the frontier of applying AI/ML to investment management. We...  ...to deployment, effectively evaluating dependent technologies and collaborating... 
    Full time
    Work at office
    Local area
    Remote work

    Voleon

    Berkeley, CA
    4 days ago
  • $180k - $250k

     ...company in San Francisco seeks a talented engineer to build infrastructure for voice AI conversations...  .... The role involves creating distributed data pipelines and optimizing systems for large...  ...candidates should have experience with AI/ML products, particularly in handling... 

    MetaVoice

    San Francisco, CA
    18 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Flywheel Engineer: Real-World ML Data & Evaluation. Be the first to apply!