Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Member of Technical Staff - Engineering Lead, Data Ingestion

Reflection

Our Mission Reflection is a research lab making intelligence open and accessible for everyone to use, customize, and build on. We build open models that let anyone control their intelligence and help shape the future of AI. Our mission: make intelligence open and accessible to all. About The Role Reflection’s Data team builds the training corpora our frontier models learn from. Before a model can learn anything, the data has to be found, fetched, extracted, and delivered reliably, responsibly, and at enormous scale. The ingestion layer is the machinery that turns the open web, licensed corpora, and other large-scale sources into well-structured, versioned, auditable datasets for pre-training. As Data Ingestion Lead, you’ll provide front-line leadership of the team that builds this layer, spanning all three of its pillars web crawl , data ingestion pipelines , and data lakes . You’ll build, mentor, and grow a team of data ingestion engineers, guide the technical and architectural decisions across crawling, extraction, and corpus storage/delivery, and work closely with the pre-training research, data quality, and data partnerships teams that depend on what you ship. You’ll stay close enough to the stack to make targeted contributions as an individual contributor and to maintain a deep understanding of the team’s technical work. Subtle decisions at the ingestion layer what we crawl, how we extract, what we keep ripple through training and directly affect where our models are strong, safe, and where they fail. What You’ll Do Build, mentor, and grow a high-performing team of data ingestion engineers. Coach and support your reports in understanding, and pursuing, their professional growth. Provide front-line leadership across the full ingestion stack — web crawling and acquisition, extraction and normalization pipelines, and the data lakes that version and deliver training corpora and the campaigns that run across all three. Stay hands-on: become familiar with the team’s technical stack enough to make targeted contributions as an individual contributor. Manage day-to-day execution: prioritize the team’s work and run data acquisition and ingestion campaigns in a highly dynamic, fast-paced environment. Guide technical and architectural decisions, emphasizing scalability, reliability, auditability, and cost crawler architecture and politeness/scheduling, distributed processing (Ray/Beam/Spark), orchestration (Airflow/Prefect), storage formats and layout (Parquet, JSONL, WARC; object stores and lakehouse formats), deduplication, and dataset versioning and delivery. Close the loop with research: partner with pre-training and data quality teams to tie ingestion decisions to measurable downstream model impact, and run experiments to evaluate crawling strategies, extraction methods, and ingestion tradeoffs. Work across the wider data effort data partnerships, digitization operations, and external vendors to onboard new sources within legal, licensing, and robots.txt constraints. Raise the bar for technical judgment, prioritization, communication, and execution in a fast-moving environment. What We’re Looking For Experience building, mentoring, and growing data or infrastructure engineering teams while staying technically hands-on. (Comfortable growing into leading a larger team quickly if you haven’t managed at that scale before.) Deep experience building web-scale data acquisition or ingestion systems, with real ownership of production-grade pipelines at multi-TB to PB scale. Strong coding ability and the credibility to earn the technical trust of a strong team. Deep expertise in at least one of: web crawling & acquisition, large-scale extraction & ingestion pipelines, or data lakes / corpus storage & delivery with working knowledge across the others, and the ability to learn the rest. Fluency with the modern large-scale data toolkit: distributed compute (Ray, Beam, Spark), orchestration (Airflow, Prefect), formats (Parquet, JSONL, WARC), and object-store / data-lake architectures. Familiarity with how LLMs are trained and evaluated, and an intuition for what makes data useful for training; comfortable designing experiments and using proxy quality signals to guide system improvements. Ability to guide strategy and drive execution across concurrent data campaigns, and to partner effectively with research teams, external data vendors, and partnerships/legal on acquisition. What We Offer We believe that to make intelligence open and accessible to all, you need to start at the foundation. Joining Reflection means building from the ground up as part of a talent-dense team. You will help define our future as a company, and help define the future of open foundational models. We want you to do the most impactful work of your career with the confidence that you and the people you care about most are supported. Top-tier compensation: Salary and equity structured to recognize and retain our talent globally. Stock options: Everyone who joins and contributes to Reflection’s success gets to share in the upside through stock options. Health & wellness: Comprehensive medical, dental, vision, and life, with an annual wellness allowance. Meals: Lunch and dinner are provided in the office daily. Life & family: 22 weeks paid parental leave for all new birthing and non-birthing parents, including adoptive and surrogate journeys. Vacation days: Unlimited paid time off in the U.S. and 30 days in the U.K. Sponsorship support: We sponsor visas to help exceptional talent join our team and support long-term immigration pathways where applicable. Team building: We have regular off-sites, happy hours, and team celebrations. Export Control Notice: This position may require access to technology or source code subject to the U.S. Export Administration Regulations. Any offer of employment for this role may be conditioned on the Company’s ability to provide the candidate with access to such technology or source code in compliance with applicable U.S. export control laws, which may require the Company to seek government authorization. #J-18808-Ljbffr Reflection

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Member of Technical Staff - Engineering Lead, Data Ingestion in New York, NY vacancy
  •  ...accessible to all. About The Role Data plays a crucial role at the...  ..., but from better data. As a member of the Data Team, your...  ...is to build and operate the ingestion systems that turn the open web...  ...performance. This role is ideal for engineers who love building robust... 
    Suggested
    Relocation package

    Reflection

    New York, NY
    2 days ago
  • Member of Technical Staff: Data Engineering Monk is an AI-native accounts receivable platform for B2B companies. We automate billing, collections, and payments...  ...correct every time. You will own the pipelines that ingest, normalize, and reconcile financial data across every... 
    Suggested
    Immediate start

    Monk

    New York, NY
    17 hours ago
  • $200k - $300k

     ...We are building a commercial engine that allows pharmaceutical marketers...  ...a difficult, consequential data problem. About the role...  ...to end: the cloud warehouse, ingestion and transformation pipelines,...  ...business goal into a technical plan, ship it, and operate it... 
    Suggested
    Full time
    H1b
    Visa sponsorship

    Solstice

    New York, NY
    4 days ago
  • $180k - $238.1k

     ...Member of Technical Staff (Performance Engineering) New York, NY Category-defining tech. Career-defining work. Lots of tech companies disrupt. But, many fail when they try to scale. We're different. CockroachDB makes it easier for companies to build and scale... 
    Suggested
    Local area
    Remote work
    Worldwide
    Flexible hours

    Cockroach Labs

    New York, NY
    3 days ago
  •  ...systems problems. As Compute Platform Lead, you'll provide front-line leadership...  ...mentor, and grow a team of strong systems engineers, guide the technical and architectural decisions across...  ...— multi‑cloud storage, petabyte‑scale data replication, and GPU‑to‑GPU network performance... 
    Suggested
    Work at office
    Visa sponsorship

    Doist

    New York, NY
    5 days ago
  • $175k - $240k

     ...ambitious team run by scientists and engineers from leading institutions across biology, physics...  ..., and AI. The Role As a Member of Technical Staff (Full-stack, Backend-Focused, Python...  ...building backend services, APIs, and data pipelines, while also contributing to... 
    Full time
    Work at office

    Edison Scientific

    New York, NY
    2 days ago
  •  ...accessible to all. Role Overview Reflection AI is looking for a Member of Technical Staff - IT Engineer. In this role, you’ll be expected to manage a broad...  ...operate more efficiently Act as the on-prem IT lead at our New York headquarters Provide white-glove operational... 
    Work at office
    Visa sponsorship

    Visa Hunt

    New York, NY
    17 hours ago
  •  ...About the Role As a Member of Technical Staff - Internal Agent Engineering at Entendre, you will build systems that make Entendre AI native, enhancing the core developer experience and internal operations. You will drive the creation of internal agents to improve efficiency... 
    Full time

    Entendre Finance

    New York, NY
    15 days ago
  • Learn more about this opportunity for a Member of Technical Staff for Product Engineering at an AI finance startup in New York, NY . Position Overview Applicants must be authorized to work in the United States on a full-time basis without the need for current or future... 
    Full time
    Visa sponsorship

    ECLARO

    New York, NY
    3 days ago
  • Member of Technical Staff, Transparency (Backend Engineer) At Anchorage Digital, we are building the world’s most advanced digital...  ..., settlement, and the industry's leading security infrastructure. You will...  ...‑end APIs, capturing critical data for record keeping and auditing,... 

    Crypto Pro Network

    New York, NY
    3 days ago
  •  ...settlement, and the industry's leading security...  ...culture cannot. As a member of the Custody organization...  ...outside of the Member of Technical Staff, Custody role:...  ...according to Anchorage's engineering and team standards, and...  ...concurrency, algorithms, and data structures (Formal CS... 

    Pantera Capital

    New York, NY
    5 days ago
  • Member of Technical Staff - Applied AI Engineer Valthos | Posted Mar 3 Full-time Negotiable Advanced (5-10 yrs) Valthos Inc. Valthos is an applied biological...  ...and commercial use. We are seeking a highly skilled, data-centric AI Engineer to develop and apply state-of-the-... 
    Full time
    Work at office

    Valthos

    New York, NY
    3 days ago
  • About the Role The Data Platform team owns...  ...Perplexity, from ingestion through processing...  .... In this senior/staff role, you will shape...  ...the long-term technical direction of Perplexity...  ...computation. Lead the architecture of...  ...platforms that let engineers, data scientists,... 

    Perplexity AI Inc.

    New York, NY
    2 days ago
  •  ...representations and real‑world action. We're looking for a Robotics Engineer to bring our video‑native foundation models onto real hardware:...  .... You will work across the full stack of robot learning — from data collection and task design, to policy deployment, to physical... 
    Work at office
    Relocation

    Runway

    New York, NY
    4 days ago
  •  ...document-based surfaces. This is a full-stack product engineering role with a high bar for interaction design, technical quality, and ownership. WHAT WE ARE LOOKING FOR...  ...: You can move between frontend, backend, data, and AI systems to ship a complete product. Pragmatic... 

    Valkai

    New York, NY
    4 days ago
  •  ...this role Perplexity is seeking strong engineers with a passion for delivering frontier intelligence...  ..., and scaling these interfaces. As a member of our team, you'll work on an eclectic...  ...experience alike. You'll also define technical strategy for how we scale to meet... 

    Perplexity AI Inc.

    New York, NY
    3 days ago
  • $236k

     ...org is searching for a Staff Engineer, Data and AI Enablement to...  ...Engineering. As a key member of our Data and AI Enablement...  ...-time pipelines that ingest, transform, and...  ...optimization. Raise the technical bar for data and AI infrastructure by leading architectural decisions... 
    Full time
    Currently hiring

    Change.org

    New York, NY
    2 days ago
  • $123.25k - $175.1k

     ...role?Roku is seeking a Senior Solutions Engineer, Ad Data Ingestion to join our Solutions Engineering...  ...pixel-based events. This role is the technical owner of the ingestion surface: the Conversion...  ...intelligent features, we want team members who see AI as a core part of how they... 
    Work at office
    Local area
    Remote work
    Monday to Thursday
    Flexible hours

    Roku

    New York, NY
    2 days ago
  • $175k - $240k

     ...medicines. We are an ambitious team run by scientists and engineers from leading institutions across biology, physics, chemistry, and...  ..., Software Engineering, Mathematics, Physics, Data Science, or a related technical field. Proficiency in Python and/or TypeScript, with... 
    Full time
    Work at office

    Edison Scientific

    New York, NY
    2 days ago
  • Reflection is seeking a Data Ingestion Lead to head the team building the ingestion layer for our frontier models. You will mentor data ingestion engineers, guide architecture across crawling, extraction, and corpus storage, and work with pre-training and data partnerships... 

    Reflection

    New York, NY
    3 days ago
  •  ...Software Engineer Overview We are seeking a curious and ambitious Software Engineer...  ...to work across a broad range of technical challenges. What You’ll Do Build...  ...~ Strong fundamentals in API design, data modeling, and application security . ~... 
    Full time

    Next Ventures

    New York, NY
    16 days ago
  •  ...seeking creative, AI native engineers to join our Enterprise Adoption...  ...for the nuances of our technical and business teams' work across...  ...Collaborate closely with PM, Design, Data Science, Sales, and...  ...of the work of non-technical staff across enterprises, along with... 

    Perplexity

    New York, NY
    5 days ago
  •  ...small team of scientists and engineers builds and deploys fully...  ...learning to operate in a dynamic, data-rich environment. Their...  .... Role Summary: As a Member of Technical Staff, you’ll help bridge the gap...  ...stack of ML workflows: data ingestion, training, evaluation, deployment... 

    People In AI

    New York, NY
    4 days ago
  •  ...feature store on top that makes the data usable by both people and...  ...and Ramp. About the Role Members of Technical Staff (MTS) are the senior engineers who build the platform that everything...  ...S3 and KMS isolation. The ingestion pipeline from QuickBooks, HubSpot... 

    BEACON SOFTWARE COMPANY

    New York, NY
    3 days ago
  •  ...built and why. Shape our culture of our technical team, standards, and practices while we'...  ...-stage startup where you helped set engineering standards (nice-to-have). Familiarity with legal tech, document processing, or data-heavy workflows (nice-to-have). Core Competencies... 

    Jobtailor

    New York, NY
    2 days ago
  •  ...Perplexity is an AI-powered answer engine built to serve the world’s...  .... It combines multiple leading models with real-time search...  ...candidate will possess sound technical judgment forged in the trenches...  ...empathy for) the work of technical staff across disciplines, along... 
    Shift work

    Perplexity AI Inc.

    New York, NY
    17 hours ago
  • $207k - $275k

     ...confidence. Trusted by leading AI labs, startups,...  ...performance with deep technical expertise to accelerate...  ....What You'll Do:The Data Engineering Team builds and...  ...role:We're seeking a Staff Data Engineer to define...  ...query, processing, and ingestion systems such as StarRocks... 
    Permanent employment
    Full time
    Temporary work
    Casual work
    Work at office
    Flexible hours

    CoreWeave

    New York, NY
    2 days ago
  • $185k - $195k

     ...Staff Data Engineer Company Description Butterfly Network, Inc. (NYSE: BFLY) is driving a...  ...migration workstreams, take ownership of ingestion pipelines and dbt models, and help...  ...work model for most positions, with team members spending two or more days a week in... 
    Full time
    Work at office
    Immediate start
    Work visa
    2 days per week

    Butterfly Network

    New York, NY
    3 days ago
  •  ...frontier AI research, agent systems, platform engineering, and product innovation. Tech Stack :...  ...to backend services, evaluation, data models, and production operations. Build...  ...simple, reliable product experiences. Set technical direction on ambiguous problems and raise... 

    Apply

    New York, NY
    3 days ago
  • $100k - $300k

     ...industries. Founded by seasoned former engineering and product leaders from companies such...  ...systems Identify appropriate datasets and data representations to support system development...  ..., support and uplevel future team members Mentor and grow future junior team members... 

    Cogent Security

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Member of Technical Staff - Engineering Lead, Data Ingestion. Be the first to apply!