Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Member of Technical Staff - Engineering Lead, Data Ingestion

Reflection AI Ltd

Our Mission Reflection is a research lab making intelligence open and accessible for everyone to use, customize, and build on. We build open models that let anyone control their intelligence and help shape the future of AI. Our mission: make intelligence open and accessible to all. ABOUT THE ROLE Reflection's Data team builds the training corpora our frontier models learn from. Before a model can learn anything, the data has to be found, fetched, extracted, and delivered reliably, responsibly, and at enormous scale. The ingestion layer is the machinery that turns the open web, licensed corpora, and other large-scale sources into well-structured, versioned, auditable datasets for pre-training. As Data Ingestion Lead, you'll provide front-line leadership of the team that builds this layer, spanning all three of its pillars web crawl , data ingestion pipelines , and data lakes . You'll build, mentor, and grow a team of data ingestion engineers, guide the technical and architectural decisions across crawling, extraction, and corpus storage/delivery, and work closely with the pre-training research, data quality, and data partnerships teams that depend on what you ship. You'll stay close enough to the stack to make targeted contributions as an individual contributor and to maintain a deep understanding of the team's technical work. Subtle decisions at the ingestion layer what we crawl, how we extract, what we keep ripple through training and directly affect where our models are strong, safe, and where they fail. WHAT YOU'LL DO Build, mentor, and grow a high-performing team of data ingestion engineers. Coach and support your reports in understanding, and pursuing, their professional growth. Provide front-line leadership across the full ingestion stack — web crawling and acquisition, extraction and normalization pipelines, and the data lakes that version and deliver training corpora and the campaigns that run across all three. Stay hands-on: become familiar with the team's technical stack enough to make targeted contributions as an individual contributor. Manage day-to-day execution: prioritize the team's work and run data acquisition and ingestion campaigns in a highly dynamic, fast-paced environment. Guide technical and architectural decisions, emphasizing scalability, reliability, auditability, and cost crawler architecture and politeness/scheduling, distributed processing (Ray/Beam/Spark), orchestration (Airflow/Prefect), storage formats and layout (Parquet, JSONL, WARC; object stores and lakehouse formats), deduplication, and dataset versioning and delivery. Close the loop with research: partner with pre-training and data quality teams to tie ingestion decisions to measurable downstream model impact, and run experiments to evaluate crawling strategies, extraction methods, and ingestion tradeoffs. Work across the wider data effort data partnerships, digitization operations, and external vendors to onboard new sources within legal, licensing, and robots.txt constraints. Raise the bar for technical judgment, prioritization, communication, and execution in a fast-moving environment. WHAT WE'RE LOOKING FOR Experience building, mentoring, and growing data or infrastructure engineering teams while staying technically hands-on. (Comfortable growing into leading a larger team quickly if you haven't managed at that scale before.) Deep experience building web-scale data acquisition or ingestion systems, with real ownership of production-grade pipelines at multi-TB to PB scale. Strong coding ability and the credibility to earn the technical trust of a strong team. Deep expertise in at least one of: web crawling & acquisition , large-scale extraction & ingestion pipelines , or data lakes / corpus storage & delivery with working knowledge across the others, and the ability to learn the rest. Fluency with the modern large-scale data toolkit: distributed compute (Ray, Beam, Spark), orchestration (Airflow, Prefect), formats (Parquet, JSONL, WARC), and object-store / data-lake architectures. Familiarity with how LLMs are trained and evaluated, and an intuition for what makes data useful for training; comfortable designing experiments and using proxy quality signals to guide system improvements. Ability to guide strategy and drive execution across concurrent data campaigns, and to partner effectively with research teams, external data vendors, and partnerships/legal on acquisition. What We Offer: We believe that to make intelligence open and accessible to all, you need to start at the foundation. Joining Reflection means building from the ground up as part of a talent-dense team. You will help define our future as a company, and help define the future of open foundational models. We want you to do the most impactful work of your career with the confidence that you and the people you care about most are supported. Top-tier compensation: Salary and equity structured to recognize and retain our talent globally. Stock options: Everyone who joins and contributes to Reflection's success gets to share in the upside through stock options. Health & wellness: Comprehensive medical, dental, vision, and life, with an annual wellness allowance. Meals: Lunch and dinner are provided in the office daily. Life & family: 22 weeks paid parental leave for all new birthing and non-birthing parents, including adoptive and surrogate journeys. Vacation days: Unlimited paid time off in the U.S. and 30 days in the U.K. Sponsorship support: We sponsor visas to help exceptional talent join our team and support long-term immigration pathways where applicable. Team building: We have regular off-sites, happy hours, and team celebrations. Export Control Notice: This position may require access to technology or source code subject to the U.S. Export Administration Regulations. Any offer of employment for this role may be conditioned on the Company's ability to provide the candidate with access to such technology or source code in compliance with applicable U.S. export control laws, which may require the Company to seek government authorization. Candidate and Employee Privacy Notice: We collect and process personal data about applicants for the purposes described in our Candidate and Employee Privacy Notice #J-18808-Ljbffr Reflection AI Ltd

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Member of Technical Staff - Engineering Lead, Data Ingestion in New York, NY vacancy
  •  ...is building the trusted data backbone for the world'...  ...environments unifying ingestion, processing, and orchestration...  ...for a front-line technical leader to build,...  ...technical credibility as an engineer and now multiplies it through...  .... A track record as a staff/principal-level... 
    Suggested
    Work at office
    Visa sponsorship

    Reflection AI Ltd

    New York, NY
    1 day ago
  • $200k - $300k

     ...Founding Data Engineer | NYC (On-Site) I'm working with a rapidly growing HealthTech startup...  ...✅ Trusted by 50+ pharma brands and leading life sciences organizations ✅ Backed...  ...platform end-to-end • Design scalable ingestion, transformation, and attribution pipelines... 
    Suggested
    Full time
    Visa sponsorship

    Storm3

    New York, NY
    4 days ago
  • $180k - $260k

     ...real user prompts and growing, Profound’s data shows you what people ask AI and what the...  ...their AI presence. As an Analytics Engineer, you will build and own the product analytics...  ...engineers to instrument events, maintain data ingestion pipelines, and uphold high data quality... 
    Suggested
    Work at office
    Visa sponsorship

    Profound

    New York, NY
    2 days ago
  •  ...layer just works. As Shared Services Lead, you'll provide leadership of the...  ...You'll build, mentor, and grow the engineers who own this layer, guide the technical and architectural decisions that...  ...Notice: We collect and process personal data about applicants for the purposes... 
    Suggested
    Work at office
    Visa sponsorship

    Reflection AI Ltd

    New York, NY
    1 day ago
  •  ...systems problems. As Compute Platform Lead, you'll provide front-line leadership...  ...mentor, and grow a team of strong systems engineers, guide the technical and architectural decisions across...  ...— multi-cloud storage, petabyte-scale data replication, and GPU-to-GPU network performance... 
    Suggested
    Work at office
    Visa sponsorship

    Reflection AI Ltd

    New York, NY
    1 day ago
  •  ...About The Role We’re seeking a Design Engineer to bridge the gap between design and...  ...systems that balance aesthetics with technical performance. Lead the technical implementation and evolution...  ...is a distributed company with team members across North America, and soon Europe... 
    Permanent employment
    Currently hiring
    Work at office
    Immediate start
    Shift work

    GC AI

    New York, NY
    2 days ago
  • $125k - $190k

    Founding AI Engineer / Member of Technical Staff Location: New York, NY, United States Department: Information...  ...vast volumes of unstructured data including calls, reports, and transcripts...  ...Own core AI and backend systems that ingest, process, and search across large volumes... 
    Permanent employment
    Full time
    Temporary work
    Work at office
    Relocation package

    Advatix

    New York, NY
    4 days ago
  •  ...Member of Technical Staff $1,000,000-$1,750,000 NYC (Hybrid) Company Overview...  ...team of scientists and engineers builds and deploys fully autonomous...  ...to operate in a dynamic, data-rich environment. Their...  ...of ML workflows: data ingestion, training, evaluation, deployment... 
    Full time

    People In AI

    New York, NY
    23 hours ago
  •  ...Software Engineer Overview We are seeking a curious and ambitious  Software Engineer...  ...to work across a broad range of technical challenges. What You’ll Do Build...  ...~ Strong fundamentals in  API design, data modeling, and application security . ~... 
    Full time

    Next Ventures

    New York, NY
    more than 2 months ago
  • $180k - $250k

     ...we’ve built the leading healthcare...  ...directories to search engines, AI platforms,...  ...is seeking a Staff Analytics Engineer...  ...a Staff-level member, you'll lead...  ...implementation of complex data transformations...  ...a high bar for technical excellence and...  ...enhance data ingestion, processing... 
    Flexible hours

    ZocDoc

    New York, NY
    6 days ago
  • AlphaSense is seeking a Staff Software Engineer to join the Reference and Entity Data Systems (REDS) team and lead the design and evolution of our entity data platform. You will ingest data from global vendors, resolve it into authoritative records, and deliver accurate... 

    Communitech

    New York, NY
    3 days ago
  • $155k - $195k

    Senior Data Engineer Insurance underwriting runs on human...  ...this role, you will: Lead data platform strategy...  ...associated services — from ingestion to serving. This...  ...platform's edges are. Your technical toolkit is strong:...  ...At Sixfold, every team member plays a crucial role,... 
    Work experience placement

    Sixfold AI

    New York, NY
    2 days ago
  • $140k - $215k

     ...Role:We are seeking an Engineer Manager to be part of the GDI (Getting Data In) group under NG-SIEM with a focus on data ingestion at petabyte-scale. The group...  ...latencies. You will be leading a team of 6+ engineers...  ...Permanent Resident.A strong technical background, including... 
    Permanent employment
    Full time
    Work experience placement
    Work at office
    Local area

    CrowdStrike

    New York, NY
    6 days ago
  • Req ID: JR112532 Member of Technical Staff, Agentic AI Architect Our vision is to...  ...looking for an ambitious engineer (Member of Technical Staff...  ...Agents and the agentic and data pipelines that power them,...  ...pipelines, including document ingestion, chunking, embeddings, and... 
    Local area
    Relocation

    Micron Technology, Inc.

    New York, NY
    4 days ago
  • $210k - $265k

     ...quality and post-market data, driving down costs and...  ...sectors.Backed by leading investors, including Bessemer...  ...an experienced Backend Engineer to build and scale the production data ingestion systems that brings...  ...Key ResponsibilitiesOwn technical architecture for our data... 
    Local area
    Work from home
    Flexible hours
    Night shift
    Weekend work

    Axion Ray

    New York, NY
    4 days ago
  • $160k - $300k

    ⚡ Member of Technical Staff (QA Engineer - Agentic Systems) AI-Powered Pharmaceutical Marketing New York City (on-site) $160k - $300k + equity Join a fast-growing AI startup transforming how pharmaceutical companies create and launch marketing campaigns.... 
    Relocation package

    Nexxt, Inc.

    New York, NY
    1 day ago
  • $140k - $270k

     ...will follow. The Team At Anterior, engineers share a strong "sense of product" and...  ...application. About The Role Members of Technical Staff at Anterior own problems end-to-end —...  ...building backend services, APIs, and data pipelines that power our AI platform... 
    Apprenticeship
    Flexible hours

    SupportFinity

    New York, NY
    1 day ago
  •  ...models on the largest corpus of action-labeled gaming data in the world. Member of Technical Staff is the title everyone in our technical team holds....  ...you find the most important problem across research, engineering, and infrastructure that aligns with our team's ambitious... 

    Engg

    New York, NY
    2 days ago
  •  ...Member of Technical Staff About Proxima Proxima (formerly VantAI) is advancing an AI-native...  ...model machine learning, a scalable data generation engine, and a partnership track record...  ...collaborations across the world’s leading biopharma and tech organizations. We... 

    Proxima

    New York, NY
    5 days ago
  •  ...world. Role We're looking for a Member of Technical Staff who will partner with our team on...  ...high priority areas are: 1) Backend engineer to own our extraction pipelines, 2) Full...  ...in you for the long-term. You'll be leading the company not just in engineering but... 

    Pace

    New York, NY
    5 days ago
  •  ...About the job Member of Technical Staff Position Overview: Our client is seeking a highly motivated and skilled Member of Technical...  ...York, NY. In this role, you will work closely with our engineering team to design, develop, and implement software solutions... 

    UpCore Solutions

    New York, NY
    5 days ago
  •  ...The role As a Member of Technical Staff focused on Applied AI, you'll own our AI stack end to end. One framing we keep coming back to: agents...  ...users of our system of record. Everything we build (the data models, the APIs, the UI) has to work for a non-human user... 
    Work at office
    1 day per week

    NxT Level

    New York, NY
    2 days ago
  •  ...As a Member of Technical Staff (Frontend) at Quadrillion Labs, you'll help maintain and improve our...  ...Python. Strong full-stack / systems engineering knowledge Ability to move quickly...  ...research - running experiments, analyzing data, and surfacing insight for the people... 
    Work at office
    Local area

    Quadrillion Labs, Inc

    New York, NY
    3 days ago
  • $150k - $250k

     ...States to help them hire. Member of Technical Staff Location: New York, NY...  ...growing startup backed by leading investors and a large network...  ...with and manage financial data and processes through...  ...the founders and founding engineering team. This is an opportunity... 
    H1b
    Work at office
    Remote work

    Recruiting from Scratch

    New York, NY
    2 days ago
  •  ...the most important sale of their lives... Until now. Our engineers built software to automate 80%+ of analyst work with AI,...  ...started. Read more about our story: The Role As a Member of Technical Staff, you'll work directly with the CTO to build the AI-native... 
    Work experience placement
    Relocation package

    OffDeal, Inc

    New York, NY
    1 day ago
  • $160k - $320k

     ...Member Of Technical Staff Liquid is a trading platform to trade anything, anytime, and anywhere. Our team is small, highly efficient, motivated, and focused on engineering excellence. We cultivate individuals that enjoy ownership and thrive off of agency. We operate... 
    Work at office

    Liquid

    New York, NY
    4 days ago
  •  ...international B2B SaaS, in which all members love to create, work in teams,...  ...with Borja, who will be your technical lead, and partnering with Marketing, Product, Data and Revenue to move the team from...  ...As Senior Technical Operations Engineer, Systems optimisation: optimise... 
    Remote job
    Flexible hours
    Weekend work

    Metricool

    New York, NY
    1 day ago
  • $200k - $400k

    Staff Data EngineerLocation: New York City, NYEmployment...  ...for a Staff Data Engineer to join its engineering...  ...team.This is a highly technical, hands-on role for an...  ...pipelinesDevelop systems for ingesting, processing, and...  ...operating at a Staff, Lead, Principal, or comparable... 
    Full time

    CyberCoders

    New York, NY
    5 days ago
  • $193k - $242k

    Make Your Mark: As a member of the Data & BI Engineering team you will primarily focus on advancing our Enterprise...  ...'s strategic goals. The Staff Data Engineer will work in a dynamic...  ...role requires a strong combination of technical expertise, leadership skills, and a... 
    Full time
    Temporary work
    Work at office
    Shift work
    3 days per week

    BlackLine

    New York, NY
    5 days ago
  •  ...creatives, technologists, and engineers working together to empower...  ...The ideal candidate will bring technical mastery, fluency with...  ...observational and experimental data. We value people who are eager...  ...and recognize that great team members might not perfectly match a job... 
    Hourly pay
    Full time
    Currently hiring
    Work at office
    Relocation package
    Flexible hours

    Abridge Al, Inc

    New York, NY
    5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Member of Technical Staff - Engineering Lead, Data Ingestion. Be the first to apply!