Technical Lead, Data Engineering
distributed-spectrum
DS creates systems that power the next generation of radio spectrum intelligence. We collect radio data from all over the world, train neural networks to decipher it, and run them on the smallest chips we can. We’re solving a new, technically hard problem where nothing from other fields works out of the box, and along the way, we’ve built our own stack from scratch, including entirely new embedding model architectures, custom GPU kernels, and much more.
Joining DS means owning major parts of a fast-growing AI research organization, joining a collaborative, talent-dense team with decades of experience in probabilistic ML, accelerated computing, embedded systems, and signal theory, and growing your career in the areas that interest you. You’ll fit in if you want to come to work for the problem itself and don’t want to choose between technical rigor, business value, and real-world impact.
We work with high ownership and trust.
The Role
DS collects radio data at a scale few organizations ever see - continuous, high-rate streams from sensors around the globe. We're hiring a Technical Lead, Data Engineering to design the platform that turns that firehose into an asset: a data lakehouse that serves researchers training models, production systems running inference, and agents retrieving context in real time.
You'll own the architecture from ingestion through storage, cataloging, vector search, and access, and you'll design it explicitly for AI/ML workloads, not just analytics.
What You'll Do
Architect and build our data lakehouse: ingestion pipelines, open table formats, partitioning and compaction strategies, cataloging, and governance
Design and operate vector database infrastructure for embedding storage, similarity search, and retrieval at scale - choosing, tuning, and evolving the right systems for our workloads
Build large-scale data management systems: lifecycle and retention, lineage, versioning of datasets for reproducible training, quality monitoring, and cost management across petabyte-class storage
Design data platform capabilities that directly support ML use cases - feature and embedding pipelines, training-set assembly, evaluation datasets, and low-latency retrieval for agents
Establish schema and data-contract standards across teams, and build tooling that lets researchers and engineers self-serve
Own reliability and performance of data pipelines in production, including observability and failure handling
Mentor engineers and lead technical design across the data domain
What We're Looking For
4–6+ years of software / data engineering experience, including several years designing and operating large-scale data platforms in production
Deep experience with lakehouse architectures and technologies - e.g., Apache Iceberg, Delta Lake, or Hudi; Parquet; Spark, Flink, Trino, DuckDB, or similar engines
Hands-on experience with vector databases and embedding retrieval (e.g., pgvector, Milvus, Qdrant, Weaviate, Pinecone, LanceDB, or FAISS-based systems), including indexing trade-offs and scaling
Strong experience with AWS or another major cloud provider - object storage, managed data services, compute, and cost optimization at scale
Fluency in Python and SQL; experience with orchestration tools (Airflow, Dagster, Prefect, Step Functions, etc.)
Demonstrated experience designing data architectures specifically for ML / AI workloads: training data pipelines, feature stores, dataset versioning, or retrieval systems
Strong grasp of data modeling, consistency, and the trade-offs between batch and streaming
Must currently hold or be eligible to obtain and maintain a U.S. government security clearance
Nice To Have
Experience with streaming ingestion at high volume (Kafka, Kinesis, Pulsar)
Experience with time-series, geospatial, or signal / sensor data
Familiarity with data governance and security requirements in regulated environments
Experience with Rust, Go, or C++ for performance-critical data paths
Who Thrives at Distributed Spectrum
Fast learners over specific backgrounds – We care more about how quickly you can pick up new skills than where you’ve worked before.
Intellectual honesty – The right answer matters more than being right. You challenge assumptions, test ideas, and pivot when needed.
Adaptability – We’re organized, but sometimes things change quickly. You find a way to make it work and balance short-term deliverables with long-term goals.
Ownership of outcomes – You optimize your own time, focus on what matters to deliver quickly, and cut out inefficiencies.
Not building in a vacuum – You stay connected to the rest of our teams and our customers to make sure all the pieces fit together.
What We Offer
Above-market salary, equity, and benefits package.
Early Series A Equity
Excellent health, dental, and vision coverage
401(k) match - up to 4% of your salary
Flexible PTO
Daily office lunches in NYC
ITAR Requirements
To conform to U.S. Government technology export regulations, including the International Traffic in Arms Regulations (ITAR) you must be a U.S. citizen, lawful permanent resident of the U.S., protected individual as defined by 8 U.S.C. 1324b(a)(3), or eligible to obtain the required authorizations from the U.S. Department of State. Learn more about the ITAR here .
$174k - $180k
...Absolute Return, Multi-Strategy, Total Portfolio Management, and Public Real Assets.Job Title: Blackstone Multi-Asset Investing - Lead Data Engineer-Product ManagementJob Responsibilities:Support BXMA Product Management, the team responsible for the development, governance,...SuggestedFull timeLocal area$120k - $180k
...within the newly consolidated Data and Analytics (D&A)... ...infrastructure, data governance, data engineering, data modeling, data analysis... ...intelligence, data science, and AI.The Lead Data Engineer is crucial to D... ..., business systems analyst, technical leads, project managers, and...SuggestedFull timeTemporary workWork at officeLocal areaRelocation package3 days per week- ...StatesWorkplace: HybridPosted: 2026-11-05Job Role: Data engineer-EngineeringExperience (In Years): 9-12Job Description: Lead Databricks Data EngineerJob Title: Lead... ...Lakehouse architecture. This role requires strong technical leadership, solution architecture expertise,...Suggested
$137.7k - $229.5k
Position Summary Our Deloitte AI & Engineering team works to transform technology... ...through innovation.Work You’ll DoAs a Lead Data Engineer II on the team, you will be responsible... ..., and support delivery across technical workstreamsSkills for SuccessAbility to...SuggestedLocal area$112k - $200k
Join Mizuho as a Lead Data Engineer!We are seeking an experienced LeadData Engineer with 7+ years of experience designing, building, and delivering... ...data pipelines and data platforms while contributing to technical architecture, engineering standards, performance, data...SuggestedFull timeWork experience placementWork at officeWorldwide- ...A global financial institution is seeking a Lead Data Platform Engineer to drive adoption and enablement for a strategic enterprise cloud data... ...hands-on data-engineering experience and can now operate as a technical enablement leader across platform onboarding, framework...Full timeImmediate start
- Job Description:DXC Technology is a leading global technology services provider helping... ...Insurance.Position SummaryThe Data Engineering Lead is responsible for the design, development... ...analytics capabilities. This role provides technical leadership for data engineering...Minimum wageFull timeWorldwide
$10,500 per month
...A World-Changing Company Palantir builds the world's leading software for data-driven decisions and operations. By bringing the right data to... ...our connectivity software. Working alongside experienced engineers, you will take on real problems in our production systems....Work experience placementInternshipWork at officeRemote workWork from home$125k - $225k
...About the Role: We are seeking an Engineer III to be part of the Data Onboarding Team under NG-SIEM. The... ...opportunities to contribute and grow into leading cross-team platform initiatives... ...informally guiding other engineers on technical design or code quality #LI-SS1...Permanent employmentWork experience placementWork at officeLocal areaRemote work2 days per week3 days per week- ...stakeholders, understand their data and analytics needs,... ...and align on delivery plan. Lead discovery of the current reporting... ...fail recommendations to IT and engineering partners Prepare rollout... ...Support table retirement and technical debt reduction by coordinating...
$10,500 per month
...Company Palantir builds the world's leading software for data-driven decisions and operations. By bringing... ...trust us with. We want someone whose technical skill is matched by integrity and... ...to become a world-class security engineer. You'll be treated like a full-time engineer...Full timeWork experience placementInternshipWork at officeRemote workWork from home- ...Job Description Job Description Title: Lead AWS Data Engineer Location: OWING MILLS, MD Duration: Full Time Salary: 120K Job Description: " 12 years of solid hands-on experience in Python, AWS Data Services, DBT, Apache Airflow (on Astronomer platform...Full time
- ...Architect, build, and maintain resilient data pipelines for real-time and batch... ...data science, informatics, and product engineering teams to provide high-integrity data extracts... ...concrete data systems and collaborate across technical and scientific functions. Hands-on...Full timeWork at officeLocal areaFlexible hours
$135k - $180k
...patients, Medidata offers industry-leading expertise, analytics-powered... ...the largest clinical trial data sets in the industry. More... ...are seeking a Lead AI & Data Engineer to design, build, and deploy... ...solutions. You will drive technical architecture, data pipeline development...Full timeWork at officeLocal areaRemote workFlexible hours$130k - $155k
...Report Developer to join our data team, specializing in the Media... ...revenue strategies. You will be a technical leader, setting visualization... ...Visualization Leadership: Lead the entire lifecycle (design,... ...extensively with Data Engineers and Scientists to define and refine...Full timeTemporary workPart timeLocal area$176k
...Current PhD, AI Engineering Internship Program - Summer 2027 Key Role Details This is a... ...engineering teams to deliver our industry leading capabilities with breakthrough product experiences... ...with clarity. You are deeply Technical. You possess a strong foundation in...Full timePart timeSummer workInternshipLocal area- ...The Junior Data & AI Engineer will support data pipelines, cloud-based data solutions, and AI-enabled applications, including data preparation... ...data access, and approved AI use; escalate data-quality or technical issues when guidance is needed. Required Skills: ·...Full timeInternship
- ...About the Role We are seeking a highly motivated AI Engineer | Data Scientist to join an innovative R&D team driving the next wave of... ...with cross-functional teams to translate business needs into technical AI/ML solutions. Develop machine learning models for prediction...Full time
- ...Guidance & Assistance, Inc. (SGA) is searching for a Senior Data Engineer - Investment Technology (Python) for a Direct Hire assignment... ...analytical and problem-solving skills. Ability to work closely with technical and business stakeholders in an investment-facing environment...Remote work
$136.75k - $218.8k
...differences. We believe that belonging leads to better outcomes and a... ...as a Security Operations Engineer at Capital Group. The Security... ...candidate possesses strong technical knowledge in security operations... ...business stakeholders to support data-driven decision making....Full timeTemporary workLocal areaFlexible hours$120k - $160k
...and Payments verticals, supplemented with Data & AI, Cybersecurity, Risk & Compliance,... ...seeking a hands-on Reference Data Software Engineer with 5+ years of professional software... ...and functionality within an established technical architecture. The successful candidate will...Full timeTemporary workRemote workWorldwide$190k - $250k
...The Role We are seeking a hands-on Lead Data Content Curation Engineer to transform complex financial and enterprise datasets into trusted, research-ready data products. Working closely with investment research teams, data engineers and platform specialists, you will...- ...Position Summary As a Full Stack Tech Lead, you'll own the technical direction of a core product team... ...codebase. You'll lead a small group of engineers from architecture discussions to... ...frameworks (Spring Boot, Spring MVC, Spring Data) ~ Proven experience leading or...
- ...building automation pipelines, building integrations, submitting technical requests such as build of materials, firewall rule changes,... ...standards throughout the project. • Provide technical direction and lead the development team in building a secure and robust solution....Permanent employment
$216.2k - $324.8k
...people every day. We are looking for a technical lead who craves the challenge of architecting... ...review code and designs, mentor senior engineers, and raise the engineering bar for the team... ..., latency, and throughput, and of data correctness patterns (e.g. idempotency,...Contract workRelocation$65 - $70 per hour
...Immediate need for a talented Full Stack Tech Lead . This is a 06+ Months Contract opportunity with long-term potential and is located... ...partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or undelivered...Contract workLocal areaImmediate start$10k
...closing books.The problems are high-stakes, data-dense, and unforgiving.We hire people... ..., coach, and grow the Ramp Travel engineering team (~6 engineers today).Own delivery... ...at Ramp is a builder.Current enough technically to lead a design review and evaluate an architecture...Full timeWork at officeHome officeFlexible hours- ...Job Overview We are seeking a highly experienced Senior Technical SaaS Platform Lead / CLM Technical Owner to serve as the technical owner of an... ...integrations. Review and understand JSON schemas, API payloads, data structures, and integration mappings. Oversee enterprise...Contract work
- ...Job Description The Microsoft Dynamics Technical Lead, reporting into theEnterprise Systems, is... ...Enterprise Architecture, Enterprise Data & Analytics, and M&A teams, this role is... ...developers, integration specialists, data engineers, and system integrators Manage vendor...Full time
$270k - $350k
...understand US law. Think search engine, not chatbot. Free access to... ...'d join a lean team (founder, data engineer, AI engineer, UX engineer... ...seat. What you'll do Lead architecture and build across... ...Eventually help represent the technical vision to VCs and enterprise clients...Full time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Technical Lead, Data Engineering. Be the first to apply!
- technical lead manager New York, NY
- technical lead New York, NY
- technical leader New York, NY
- senior technical service engineer New York, NY
- technical director engineering New York, NY
- technical engineer New York, NY
- technical application engineer New York, NY
- technical marketing engineer New York, NY
- data intern New York, NY
- data collection researcher New York, NY







