Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Member of Technical Staff - Engineering Lead, Data Ingestion

Reflection AI

Data Ingestion LeadReflection's Data team builds the training corpora our frontier models learn from. Before a model can learn anything, the data has to be found, fetched, extracted, and delivered reliably, responsibly, and at enormous scale. The ingestion layer is the machinery that turns the open web, licensed corpora, and other large-scale sources into well-structured, versioned, auditable datasets for pre-training.As Data Ingestion Lead, you'll provide front-line leadership of the team that builds this layer, spanning all three of its pillars web crawl, data ingestion pipelines, and data lakes. You'll build, mentor, and grow a team of data ingestion engineers, guide the technical and architectural decisions across crawling, extraction, and corpus storage/delivery, and work closely with the pre-training research, data quality, and data partnerships teams that depend on what you ship. You'll stay close enough to the stack to make targeted contributions as an individual contributor and to maintain a deep understanding of the team's technical work. Subtle decisions at the ingestion layer what we crawl, how we extract, what we keep ripple through training and directly affect where our models are strong, safe, and where they fail.What You'll DoBuild, mentor, and grow a high-performing team of data ingestion engineers. Coach and support your reports in understanding, and pursuing, their professional growth.Provide front-line leadership across the full ingestion stack — web crawling and acquisition, extraction and normalization pipelines, and the data lakes that version and deliver training corpora and the campaigns that run across all three.Stay hands-on: become familiar with the team's technical stack enough to make targeted contributions as an individual contributor.Manage day-to-day execution: prioritize the team's work and run data acquisition and ingestion campaigns in a highly dynamic, fast-paced environment.Guide technical and architectural decisions, emphasizing scalability, reliability, auditability, and cost crawler architecture and politeness/scheduling, distributed processing (Ray/Beam/Spark), orchestration (Airflow/Prefect), storage formats and layout (Parquet, JSONL, WARC; object stores and lakehouse formats), deduplication, and dataset versioning and delivery.Close the loop with research: partner with pre-training and data quality teams to tie ingestion decisions to measurable downstream model impact, and run experiments to evaluate crawling strategies, extraction methods, and ingestion tradeoffs.Work across the wider data effort data partnerships, digitization operations, and external vendors to onboard new sources within legal, licensing, and robots.txt constraints.Raise the bar for technical judgment, prioritization, communication, and execution in a fast-moving environment.What We're Looking ForExperience building, mentoring, and growing data or infrastructure engineering teams while staying technically hands-on. (Comfortable growing into leading a larger team quickly if you haven't managed at that scale before.)Deep experience building web-scale data acquisition or ingestion systems, with real ownership of production-grade pipelines at multi-TB to PB scale.Strong coding ability and the credibility to earn the technical trust of a strong team.Deep expertise in at least one of web crawling & acquisition, large-scale extraction & ingestion pipelines, or data lakes / corpus storage & delivery with working knowledge across the others, and the ability to learn the rest.Fluency with the modern large-scale data toolkit: distributed compute (Ray, Beam, Spark), orchestration (Airflow, Prefect), formats (Parquet, JSONL, WARC), and object-store / data-lake architectures.Familiarity with how LLMs are trained and evaluated, and an intuition for what makes data useful for training; comfortable designing experiments and using proxy quality signals to guide system improvements.Ability to guide strategy and drive execution across concurrent data campaigns, and to partner effectively with research teams, external data vendors, and partnerships/legal on acquisition.What We Offer:We believe that to make intelligence open and accessible to all, you need to start at the foundation. Joining Reflection means building from the ground up as part of a talent-dense team. You will help define our future as a company, and help define the future of open foundational models.We want you to do the most impactful work of your career with the confidence that you and the people you care about most are supported.Top-tier compensation: salary and equity structured to recognize and retain our talent globally.Stock options: everyone who joins and contributes to Reflection's success gets to share in the upside through stock options.Health & wellness: comprehensive medical, dental, vision, and life, with an annual wellness allowance.Meals: lunch and dinner are provided in the office daily.Life & family: 22 weeks paid parental leave for all new birthing and non-birthing parents, including adoptive and surrogate journeys.Vacation days: unlimited paid time off in the U.S. and 30 days in the U.K.Sponsorship support: we sponsor visas to help exceptional talent join our team and support long-term immigration pathways where applicable.Team building: we have regular off-sites, happy hours, and team celebrations.Export Control Notice: This position may require access to technology or source code subject to the U.S. Export Administration Regulations. Any offer of employment for this role may be conditioned on the Company's ability to provide the candidate with access to such technology or source code in compliance with applicable U.S. export control laws, which may require the Company to seek government authorization. Reflection AI

Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Member of Technical Staff - Engineering Lead, Data Ingestion in New York, NY vacancy
  •  ...is building the trusted data backbone for the world'...  ...environments unifying ingestion, processing, and orchestration...  ...for a front-line technical leader to build,...  ...technical credibility as an engineer and now multiplies it through...  .... A track record as a staff/principal-level... 
    Suggested
    Work at office
    Visa sponsorship

    Reflection AI Ltd

    New York, NY
    2 days ago
  • $200k - $300k

     ...Founding Data Engineer | NYC (On-Site) I'm working with a rapidly growing HealthTech startup...  ...✅ Trusted by 50+ pharma brands and leading life sciences organizations ✅ Backed...  ...platform end-to-end • Design scalable ingestion, transformation, and attribution pipelines... 
    Suggested
    Full time
    Visa sponsorship

    Storm3

    New York, NY
    15 hours ago
  • $180k - $260k

     ...real user prompts and growing, Profound’s data shows you what people ask AI and what the...  ...their AI presence. As an Analytics Engineer, you will build and own the product analytics...  ...engineers to instrument events, maintain data ingestion pipelines, and uphold high data quality... 
    Suggested
    Work at office
    Visa sponsorship

    Profound

    New York, NY
    3 days ago
  • About the Role Data is playing an increasingly crucial role at...  ..., but from better data. As a member of the Data Team, your mission...  ...campaigns. We're looking for engineers who combine strong engineering...  ...clearly articulate complex technical concepts across teams What We... 
    Suggested
    Work at office
    Visa sponsorship

    Reflection AI

    New York, NY
    4 days ago
  •  ...layer just works. As Shared Services Lead, you'll provide leadership of the...  ...You'll build, mentor, and grow the engineers who own this layer, guide the technical and architectural decisions that...  ...Notice: We collect and process personal data about applicants for the purposes... 
    Suggested
    Work at office
    Visa sponsorship

    Reflection AI Ltd

    New York, NY
    2 days ago
  •  ...the foundational layer every engineering team depends on — cloud and multi...  .... As Platform Foundations Lead, you'll provide front-line...  ...infrastructure engineers, guide the technical and architectural decisions...  ...collect and process personal data about applicants for the... 
    Work at office
    Visa sponsorship

    Reflection AI Ltd

    New York, NY
    2 days ago
  •  ...complex, multi-modal clinical data. This spans our causality (...  ...structure, where every team member is empowered to actively contribute...  ...a multidisciplinary team of engineers and scientists....  ...communicating complex results to both technical and non-technical audiences.... 
    Worldwide

    Ataraxis

    New York, NY
    4 days ago
  •  ...About The Role We’re seeking a Design Engineer to bridge the gap between design and...  ...systems that balance aesthetics with technical performance. Lead the technical implementation and evolution...  ...is a distributed company with team members across North America, and soon Europe... 
    Permanent employment
    Currently hiring
    Work at office
    Immediate start
    Shift work

    GC AI

    New York, NY
    3 days ago
  • $250k - $350k

     ...Member of Technical Staff - AI Product Engineer Have you got the right qualifications and skills for this job Find out below, and hit apply to be considered...  ...the full stack , including user interfaces, APIs, data models, application logic, and agent-powered functionality... 

    People In AI

    New York, NY
    5 days ago
  • $180 per hour

     ...ambitious research ideas into scalable training, evaluation, and data-generation capabilities for modern AI models. You will develop...  ...and evaluating open-source machine learning models. Clear technical communication and writing skills. Ability to thrive in a fast-paced... 
    Full time
    Remote work

    SaidGig

    New York, NY
    3 days ago
  •  ...scalable, high-impact products. You will work with a fast-paced engineering team to turn complex mathematical, statistical, and physics-...  ...quality, documentation, and peer review. Clearly communicate technical concepts and project progress in writing and discussion. Qualifications... 
    Full time
    Remote work

    SaidGig

    New York, NY
    4 days ago
  • $125k - $190k

    Founding AI Engineer / Member of Technical Staff Location: New York, NY, United States Department: Information...  ...vast volumes of unstructured data including calls, reports, and transcripts...  ...Own core AI and backend systems that ingest, process, and search across large volumes... 
    Permanent employment
    Full time
    Temporary work
    Work at office
    Relocation package

    Advatix

    New York, NY
    5 days ago
  •  ...Member of Technical Staff $1,000,000-$1,750,000 NYC (Hybrid) Company Overview...  ...team of scientists and engineers builds and deploys fully autonomous...  ...to operate in a dynamic, data-rich environment. Their...  ...of ML workflows: data ingestion, training, evaluation, deployment... 
    Full time

    People In AI

    New York, NY
    2 days ago
  •  ...Software Engineer Overview We are seeking a curious and ambitious  Software Engineer...  ...to work across a broad range of technical challenges. What You’ll Do Build...  ...~ Strong fundamentals in  API design, data modeling, and application security . ~... 
    Full time

    Next Ventures

    New York, NY
    more than 2 months ago
  •  ...feature store on top that makes the data usable by both people and...  ...DoorDash, and Ramp. About the Role Members of Technical Staff (MTS) are the senior engineers who build the platform that everything...  ...S3 and KMS isolation. The ingestion pipeline from QuickBooks, HubSpot... 

    Beacon Holdings

    New York, NY
    2 days ago
  • $164k - $295k

     ...Role: We are seeking an Engineer Manager to be part of the GDI (Getting Data In) group under NG-SIEM with a focus on data ingestion at petabyte-scale. The...  ...latencies. You will be leading a team of 6+ engineers focused...  ...Resident. ~ A strong technical background, including... 
    Permanent employment
    Work experience placement
    Work at office
    Local area
    2 days per week
    3 days per week
    New York, NY
    13 days ago
  • Frontend EngineerPerplexity is looking for a frontend engineer to build the design system behind every Perplexity product. It is the component library and design language shared across web, iOS, Android, macOS, and Windows - the primitives, tokens, and interaction patterns... 

    Perplexity AI

    New York, NY
    4 days ago
  • $180k - $250k

     ...we’ve built the leading healthcare...  ...directories to search engines, AI platforms,...  ...is seeking a Staff Analytics Engineer...  ...a Staff-level member, you'll lead...  ...implementation of complex data transformations...  ...a high bar for technical excellence and...  ...enhance data ingestion, processing... 
    Flexible hours

    ZocDoc

    New York, NY
    2 days ago
  • Medidata Solutions, Inc. is seeking a Staff Data Engineer to lead data ingestion, migrations, and lakehouse modernization. You will architect scalable ETL/ELT and CDC solutions, mentor engineers, and collaborate across product and engineering teams to deliver data products... 

    Medidata Solutions

    New York, NY
    2 days ago
  • $135k - $180k

     ...Medidata offers industry-leading expertise, analytics-...  ...largest clinical trial data sets in the industry. More...  ...operational data easier to ingest, migrate, transform,...  ...Who you are: As a Staff Data Engineer, you will be a hands-on technical leader responsible for solving... 
    Work at office
    Remote work
    Flexible hours

    Dassault Systèmes

    New York, NY
    6 days ago
  • $210k - $265k

     ...quality and post-market data, driving down costs and...  ...sectors.Backed by leading investors, including Bessemer...  ...an experienced Backend Engineer to build and scale the production data ingestion systems that brings...  ...Key ResponsibilitiesOwn technical architecture for our data... 
    Local area
    Work from home
    Flexible hours
    Night shift
    Weekend work

    Axion Ray

    New York, NY
    15 hours ago
  • $160k - $300k

    ⚡ Member of Technical Staff (QA Engineer - Agentic Systems) AI-Powered Pharmaceutical Marketing New York City (on-site) $160k - $300k + equity Join a fast-growing AI startup transforming how pharmaceutical companies create and launch marketing campaigns.... 
    Relocation package

    Nexxt, Inc.

    New York, NY
    2 days ago
  • $200k

     ...models on the largest corpus of action-labeled gaming data in the world. Member of Technical Staff is the title everyone in our technical team holds....  ...you find the most important problem across research, engineering, and infrastructure that aligns with our team's... 

    Game Devs of Color

    New York, NY
    5 days ago
  •  ...international B2B SaaS, in which all members love to create, work in teams,...  ...with Borja, who will be your technical lead, and partnering with Marketing, Product, Data and Revenue to move the team from...  ...As Senior Technical Operations Engineer, Systems optimisation: optimise... 
    Remote job
    Flexible hours
    Weekend work

    Metricool

    New York, NY
    2 days ago
  •  ...models on the largest corpus of action-labeled gaming data in the world. Member of Technical Staff is the title everyone in our technical team holds....  ...you find the most important problem across research, engineering, and infrastructure that aligns with our team's... 

    Medal

    New York, NY
    3 days ago
  •  ...management, and demands, with humans leading every case. We're backed...  ...bottlenecks, and fragmented data. We're building the software to fix it. As a Member of the Technical Staff at Finch, you'll own...  ...product is evolving quickly and engineers have real ownership – expect... 
    Work at office
    Remote work
    Flexible hours
    1 day per week

    Finch Services

    New York, NY
    5 days ago
  •  ...companies of the AI era. The Role We're looking for a Member of Technical Staff to help build the core product and infrastructure behind...  ...orchestration layer that ties everything together. All engineers at Melius own features end-to-end , from shaping product... 
    Work at office

    Melius AI, Inc

    New York, NY
    3 days ago
  •  ...creatives, technologists, and engineers working together to empower...  ...The ideal candidate will bring technical mastery, fluency with...  ...observational and experimental data. We value people who are eager...  ...and recognize that great team members might not perfectly match a job... 
    Hourly pay
    Full time
    Currently hiring
    Work at office
    Relocation package
    Flexible hours

    Abridge Al, Inc

    New York, NY
    1 day ago
  • $300 per month

     ...many other operators/technical leaders. _"Basis is...  ...Prashant Mital, Applied AI Lead, OpenAI_ The Work Being a Member of Technical Staff at Basis means you'll...  ...shift to building the data pipelines to hydrate...  ...expands. It's common to see engineers do core infra work one... 
    Work at office
    Shift work

    Basis

    New York, NY
    1 day ago
  •  ...Member of Technical Staff Shared Context is building adaptive personal AI that understands the...  ...intention. We're looking for a senior engineer who is hands-on and cares deeply...  ...of the company. We are funded by leading VCs and are a startup-in-residence at... 

    Shared Context Lab

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Member of Technical Staff - Engineering Lead, Data Ingestion. Be the first to apply!