Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Technical Lead, Data Engineering

Full-time

Distributed Spectrum

DS creates systems that power the next generation of radio spectrum intelligence. We collect radio data from all over the world, train neural networks to decipher it, and run them on the smallest chips we can. We’re solving a new, technically hard problem where nothing from other fields works out of the box, and along the way, we’ve built our own stack from scratch, including entirely new embedding model architectures, custom GPU kernels, and much more.

Joining DS means owning major parts of a fast-growing AI research organization, joining a collaborative, talent-dense team with decades of experience in probabilistic ML, accelerated computing, embedded systems, and signal theory, and growing your career in the areas that interest you. You’ll fit in if you want to come to work for the problem itself and don’t want to choose between technical rigor, business value, and real-world impact.

We work with high ownership and trust.

The Role

DS collects radio data at a scale few organizations ever see - continuous, high-rate streams from sensors around the globe. We're hiring a Technical Lead, Data Engineering to design the platform that turns that firehose into an asset: a data lakehouse that serves researchers training models, production systems running inference, and agents retrieving context in real time.

You'll own the architecture from ingestion through storage, cataloging, vector search, and access, and you'll design it explicitly for AI/ML workloads, not just analytics.


What You'll Do

  • Architect and build our data lakehouse: ingestion pipelines, open table formats, partitioning and compaction strategies, cataloging, and governance

  • Design and operate vector database infrastructure for embedding storage, similarity search, and retrieval at scale - choosing, tuning, and evolving the right systems for our workloads

  • Build large-scale data management systems: lifecycle and retention, lineage, versioning of datasets for reproducible training, quality monitoring, and cost management across petabyte-class storage

  • Design data platform capabilities that directly support ML use cases - feature and embedding pipelines, training-set assembly, evaluation datasets, and low-latency retrieval for agents

  • Establish schema and data-contract standards across teams, and build tooling that lets researchers and engineers self-serve

  • Own reliability and performance of data pipelines in production, including observability and failure handling

  • Mentor engineers and lead technical design across the data domain

What We're Looking For

  • 4–6+ years of software / data engineering experience, including several years designing and operating large-scale data platforms in production

  • Deep experience with lakehouse architectures and technologies - e.g., Apache Iceberg, Delta Lake, or Hudi; Parquet; Spark, Flink, Trino, DuckDB, or similar engines

  • Hands-on experience with vector databases and embedding retrieval (e.g., pgvector, Milvus, Qdrant, Weaviate, Pinecone, LanceDB, or FAISS-based systems), including indexing trade-offs and scaling

  • Strong experience with AWS or another major cloud provider - object storage, managed data services, compute, and cost optimization at scale

  • Fluency in Python and SQL; experience with orchestration tools (Airflow, Dagster, Prefect, Step Functions, etc.)

  • Demonstrated experience designing data architectures specifically for ML / AI workloads: training data pipelines, feature stores, dataset versioning, or retrieval systems

  • Strong grasp of data modeling, consistency, and the trade-offs between batch and streaming

  • Must currently hold or be eligible to obtain and maintain a U.S. government security clearance


Nice To Have

  • Experience with streaming ingestion at high volume (Kafka, Kinesis, Pulsar)

  • Experience with time-series, geospatial, or signal / sensor data

  • Familiarity with data governance and security requirements in regulated environments

  • Experience with Rust, Go, or C++ for performance-critical data paths

Who Thrives at Distributed Spectrum

  • Fast learners over specific backgrounds – We care more about how quickly you can pick up new skills than where you’ve worked before.

  • Intellectual honesty – The right answer matters more than being right. You challenge assumptions, test ideas, and pivot when needed.

  • Adaptability – We’re organized, but sometimes things change quickly. You find a way to make it work and balance short-term deliverables with long-term goals.

  • Ownership of outcomes – You optimize your own time, focus on what matters to deliver quickly, and cut out inefficiencies.

  • Not building in a vacuum – You stay connected to the rest of our teams and our customers to make sure all the pieces fit together.

What We Offer

  • Above-market salary, equity, and benefits package.

  • Early Series A Equity

  • Excellent health, dental, and vision coverage

  • 401(k) match - up to 4% of your salary

  • Flexible PTO

  • Daily office lunches in NYC

ITAR Requirements

To conform to U.S. Government technology export regulations, including the International Traffic in Arms Regulations (ITAR) you must be a U.S. citizen, lawful permanent resident of the U.S., protected individual as defined by 8 U.S.C. 1324b(a)(3), or eligible to obtain the required authorizations from the U.S. Department of State. Learn more about the ITAR here .

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Technical Lead, Data Engineering in New York, NY vacancy
  • $174k - $180k

     ...Absolute Return, Multi-Strategy, Total Portfolio Management, and Public Real Assets.Job Title: Blackstone Multi-Asset Investing - Lead Data Engineer-Product ManagementJob Responsibilities:Support BXMA Product Management, the team responsible for the development, governance,... 
    Suggested
    Full time
    Local area

    Blackstone Group

    New York, NY
    1 day ago
  • $120k - $180k

     ...within the newly consolidated Data and Analytics (D&A)...  ...infrastructure, data governance, data engineering, data modeling, data analysis...  ...intelligence, data science, and AI.The Lead Data Engineer is crucial to D...  ..., business systems analyst, technical leads, project managers, and... 
    Suggested
    Full time
    Temporary work
    Work at office
    Local area
    Relocation package
    3 days per week

    Metropolitan Life Insurance Company

    New York, NY
    15 hours ago
  •  ...StatesWorkplace: HybridPosted: 2026-11-05Job Role: Data engineer-EngineeringExperience (In Years): 9-12Job Description: Lead Databricks Data EngineerJob Title: Lead...  ...Lakehouse architecture. This role requires strong technical leadership, solution architecture expertise,... 
    Suggested

    EXL Service

    New York, NY
    2 days ago
  • $137.7k - $229.5k

    Position Summary Our Deloitte AI & Engineering team works to transform technology...  ...through innovation.Work You’ll DoAs a Lead Data Engineer II on the team, you will be responsible...  ..., and support delivery across technical workstreamsSkills for SuccessAbility to... 
    Suggested
    Local area

    Deloitte

    New York, NY
    4 days ago
  • $112k - $200k

    Join Mizuho as a Lead Data Engineer!We are seeking an experienced LeadData Engineer with 7+ years of experience designing, building, and delivering...  ...data pipelines and data platforms while contributing to technical architecture, engineering standards, performance, data... 
    Suggested
    Full time
    Work experience placement
    Work at office
    Worldwide

    Mizuho Financial Group

    New York, NY
    3 days ago
  •  ...A global financial institution is seeking a Lead Data Platform Engineer to drive adoption and enablement for a strategic enterprise cloud data...  ...hands-on data-engineering experience and can now operate as a technical enablement leader across platform onboarding, framework... 
    Full time
    Immediate start

    Madison-Davis, LLC

    New York, NY
    1 day ago
  • Job Description:DXC Technology is a leading global technology services provider helping...  ...Insurance.Position SummaryThe Data Engineering Lead is responsible for the design, development...  ...analytics capabilities. This role provides technical leadership for data engineering... 
    Minimum wage
    Full time
    Worldwide

    DXC Technology

    New York, NY
    3 days ago
  •  ...spectrum intelligence. We collect radio data from all over the world, train neural...  ...chips we can. We’re solving a new, technically hard problem where nothing from other...  ...around the globe. We're hiring a Technical Lead, Data Engineering to design the platform that turns that... 
    Permanent employment
    Full time
    Contract work
    Temporary work
    Work at office
    Flexible hours

    distributed-spectrum

    New York, NY
    8 hours ago
  • $10,500 per month

     ...A World-Changing Company Palantir builds the world's leading software for data-driven decisions and operations. By bringing the right data to...  ...our connectivity software. Working alongside experienced engineers, you will take on real problems in our production systems.... 
    Work experience placement
    Internship
    Work at office
    Remote work
    Work from home

    Palantir

    New York, NY
    4 days ago
  • $125k - $225k

     ...About the Role: We are seeking an Engineer III to be part of the Data Onboarding Team under NG-SIEM. The...  ...opportunities to contribute and grow into leading cross-team platform initiatives...  ...informally guiding other engineers on technical design or code quality #LI-SS1... 
    Permanent employment
    Work experience placement
    Work at office
    Local area
    Remote work
    2 days per week
    3 days per week
    New York, NY
    10 days ago
  •  ...stakeholders, understand their data and analytics needs,...  ...and align on delivery plan. Lead discovery of the current reporting...  ...fail recommendations to IT and engineering partners Prepare rollout...  ...Support table retirement and technical debt reduction by coordinating... 

    Inizio Partners

    New York, NY
    23 days ago
  • $10,500 per month

     ...Company Palantir builds the world's leading software for data-driven decisions and operations. By bringing...  ...trust us with. We want someone whose technical skill is matched by integrity and...  ...to become a world-class security engineer. You'll be treated like a full-time engineer... 
    Full time
    Work experience placement
    Internship
    Work at office
    Remote work
    Work from home

    Palantir

    New York, NY
    4 days ago
  •  ...Job Description Job Description Title: Lead AWS Data Engineer Location: OWING MILLS, MD Duration: Full Time Salary: 120K Job Description: " 12 years of solid hands-on experience in Python, AWS Data Services, DBT, Apache Airflow (on Astronomer platform... 
    Full time

    Diverse Lynx

    New York, NY
    23 days ago
  •  ...Architect, build, and maintain resilient data pipelines for real-time and batch...  ...data science, informatics, and product engineering teams to provide high-integrity data extracts...  ...concrete data systems and collaborate across technical and scientific functions. Hands-on... 
    Full time
    Work at office
    Local area
    Flexible hours

    Prove

    New York, NY
    1 day ago
  • $135k - $180k

     ...patients, Medidata offers industry-leading expertise, analytics-powered...  ...the largest clinical trial data sets in the industry. More...  ...are seeking a Lead AI & Data Engineer to design, build, and deploy...  ...solutions. You will drive technical architecture, data pipeline development... 
    Full time
    Work at office
    Local area
    Remote work
    Flexible hours

    Dassault Systèmes

    New York, NY
    6 days ago
  • $130k - $155k

     ...Report Developer to join our data team, specializing in the Media...  ...revenue strategies. You will be a technical leader, setting visualization...  ...Visualization Leadership: Lead the entire lifecycle (design,...  ...extensively with Data Engineers and Scientists to define and refine... 
    Full time
    Temporary work
    Part time
    Local area

    WFMY News 2

    New York, NY
    2 days ago
  • $176k

     ...Current PhD, AI Engineering Internship Program - Summer 2027 Key Role Details This is a...  ...engineering teams to deliver our industry leading capabilities with breakthrough product experiences...  ...with clarity. You are deeply Technical. You possess a strong foundation in... 
    Full time
    Part time
    Summer work
    Internship
    Local area

    Capital One

    New York, NY
    15 hours ago
  •  ...The Junior Data & AI Engineer will support data pipelines, cloud-based data solutions, and AI-enabled applications, including data preparation...  ...data access, and approved AI use; escalate data-quality or technical issues when guidance is needed. Required Skills: ·... 
    Full time
    Internship

    PRI Technology

    New York, NY
    15 hours ago
  •  ...About the Role We are seeking a highly motivated AI Engineer | Data Scientist to join an innovative R&D team driving the next wave of...  ...with cross-functional teams to translate business needs into technical AI/ML solutions. Develop machine learning models for prediction... 
    Full time

    Suron

    New York, NY
    3 days ago
  •  ...Guidance & Assistance, Inc. (SGA) is searching for a Senior Data Engineer - Investment Technology (Python) for a Direct Hire assignment...  ...analytical and problem-solving skills. Ability to work closely with technical and business stakeholders in an investment-facing environment... 
    Remote work

    Software Guidance & Assistance

    New York, NY
    15 hours ago
  • $136.75k - $218.8k

     ...differences. We believe that belonging leads to better outcomes and a...  ...as a Security Operations Engineer at Capital Group. The Security...  ...candidate possesses strong technical knowledge in security operations...  ...business stakeholders to support data-driven decision making.... 
    Full time
    Temporary work
    Local area
    Flexible hours

    Capital Group

    New York, NY
    4 days ago
  • $120k - $160k

     ...and Payments verticals, supplemented with Data & AI, Cybersecurity, Risk & Compliance,...  ...seeking a hands-on Reference Data Software Engineer with 5+ years of professional software...  ...and functionality within an established technical architecture. The successful candidate will... 
    Full time
    Temporary work
    Remote work
    Worldwide

    BIP US

    New York, NY
    15 hours ago
  • $190k - $250k

     ...The Role We are seeking a hands-on Lead Data Content Curation Engineer to transform complex financial and enterprise datasets into trusted, research-ready data products. Working closely with investment research teams, data engineers and platform specialists, you will... 

    Schonfeld

    New York, NY
    7 days ago
  •  ...Position Summary As a Full Stack Tech Lead, you'll own the technical direction of a core product team...  ...codebase. You'll lead a small group of engineers from architecture discussions to...  ...frameworks (Spring Boot, Spring MVC, Spring Data) ~ Proven experience leading or... 

    Roc360

    New York, NY
    27 days ago
  •  ...building automation pipelines, building integrations, submitting technical requests such as build of materials, firewall rule changes,...  ...standards throughout the project. • Provide technical direction and lead the development team in building a secure and robust solution.... 
    Permanent employment

    3B Staffing LLC

    New York, NY
    19 hours ago
  • $216.2k - $324.8k

     ...people every day. We are looking for a technical lead who craves the challenge of architecting...  ...review code and designs, mentor senior engineers, and raise the engineering bar for the team...  ..., latency, and throughput, and of data correctness patterns (e.g. idempotency,... 
    Contract work
    Relocation

    Apple

    New York, NY
    1 day ago
  • $65 - $70 per hour

     ...Immediate need for a talented Full Stack Tech Lead . This is a 06+ Months Contract opportunity with long-term potential and is located...  ...partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered... 
    Contract work
    Local area
    Immediate start

    Pyramid Consulting, Inc

    New York, NY
    12 days ago
  • $10k

     ...closing books.The problems are high-stakes, data-dense, and unforgiving.We hire people...  ..., coach, and grow the Ramp Travel engineering team (~6 engineers today).Own delivery...  ...at Ramp is a builder.Current enough technically to lead a design review and evaluate an architecture... 
    Full time
    Work at office
    Home office
    Flexible hours

    Ramp

    New York, NY
    3 days ago
  •  ...Job Overview We are seeking a highly experienced Senior Technical SaaS Platform Lead / CLM Technical Owner to serve as the technical owner of an...  ...integrations. Review and understand JSON schemas, API payloads, data structures, and integration mappings. Oversee enterprise... 
    Contract work

    Prime Hiring Solutions

    New York, NY
    15 hours ago
  •  ...Job Description The Microsoft Dynamics Technical Lead, reporting into theEnterprise Systems, is...  ...Enterprise Architecture, Enterprise Data & Analytics, and M&A teams, this role is...  ...developers, integration specialists, data engineers, and system integrators Manage vendor... 
    Full time

    Flex Employee Services

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Technical Lead, Data Engineering. Be the first to apply!