Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior R&D Data Engineer, Hardware Systems

$130k - $180k

Lydian

Job Description

Job Description

Company Overview

Lydian is developing the lowest cost sustainable fuels from waste CO2, water, and renewable electricity to decarbonize the aviation industry. Our breakthrough technology replaces oil and gas refining with fully electrified, modular, and flexible reactor systems that produce fuel with 95% lower emissions than traditional jet fuel.

Since our founding in 2021, Lydian has achieved key milestones in record time, including the production of our first liquid fuel from our pilot system, capable of producing ~10,000 gallons of fuel per year for a fraction of the capital and time of alternative approaches. Lydian is backed by top climate investors including Congruent Ventures, Galvanize Climate Solutions, Union Square Ventures, Voyager Ventures, Grok Ventures, and Overture. We are building a motivated, diverse, and collaborative team that is passionate about addressing the growing climate crisis and is committed to excellence in their work. In particular, we look for tenacious people who are energized by solving the hardest, highest impact problems that come their way.

Position Overview

Lydian is looking for an R&D Data Engineer to build and own the data backbone of our technical organization. As we scale from pilot operations toward commercial production, our teams are generating a growing volume of experimental, manufacturing, and quality data. The ability to store, connect, and analyze that data well has become central to how quickly we can learn and improve. In this role you will develop our data infrastructure, build the analysis and visualization tools our engineers and scientists rely on, and carry out statistical analyses in support of the entire technical team.

This is a data generalist role at the intersection of hardware and software. You should be equally at home designing a database schema, writing Python to wrangle time-series data streaming off lab instruments, building a clear plot or dashboard, and talking through an analysis with a process engineer. You will report to the VP of R&D and work closely with the full R&D team as well as our mechanical and process engineering groups.

Responsibilities
  • Design and maintain data infrastructure. Establish structured, systematic data storage across our tools (currently Nominal and Notion, plus others as needs evolve). Ensure experimental run data (time series), run metadata, and manufacturing and QC data are integrated, consistently formatted, and easy to sort, filter, and query for analysis

  • Build analysis and visualization tools. Create the data views, plots, and statistical tools that help the team analyze data faster and better. For example, this will include standardizing and automating run summary statistics and overall performance metrics across R&D and pilot experiments

  • Enable laboratory data acquisition. Program and maintain data-acquisition software (e.g., DAQ Factory, Ignition) so that R&D and pilot test equipment stream reliably into our centralized databases. Build in data validation checks that quality-control data at the point of acquisition or entry

  • Run cross-functional analyses. Perform statistical and regression analyses that connect manufacturing and QC data with experimental run data to surface insights across functions

  • Partner across the technical team. Work with scientists and engineers to understand their data needs and translate them into reliable tools and workflows, and help maintain the IT infrastructure of servers and software systems that house our data

Qualifications
  • BS/MS in engineering, physical science, computer science, data science, or related field

  • 5+ years experience with data in a hardware, lab, or physical-science R&D environment (software-only experience does not qualify)

  • Demonstrated strength across the full data lifecycle: acquisition, infrastructure, pipelines, visualization, and statistical analysis

  • Proven track record establishing or improving data storage and analysis infrastructure

  • Expert level SQL and Python proficiency (pandas/NumPy, query optimization, schema design)

  • Experience handling time-series and sensor data; alignment, gap-filling, and reconciling schema drift across instrument runs and batches

  • Statistical/regression analysis on experimental data, with the ability to turn it into clear visualizations and dashboards

  • Proficiency with at least one DAQ platform (LabVIEW, DAQ Factory, or Ignition)

  • Fluency using AI coding assistants to scaffold and debug pipelines and SQL, with judgment to validate their output

  • Strong communication skills; able to work independently as the team's senior-most data professional

Preferred Qualifications
  • Background in chemical/materials/mechanical engineering

  • Modern data-stack tools (Airflow, Dagster, dbt, Snowflake/DuckDB/Iceberg)

  • Automated data testing (Great Expectations, dbt tests)

  • Experience with Notion, Nominal, or JMP

  • Additional DAQ platform familiarity

  • Basic IT and networking skills

Company Culture and Benefits
  • Challenging, collaborative, and meaningful work and an important voice in company development

  • Competitive salary commensurate with experience

  • Meaningful equity compensation

  • Generous PTO allowing employees to take time off to rest, recharge, and enjoy life outside work

  • Excellent insurance with 100% of healthcare, vision, and dental premiums covered for the employee, and 80% coverage for dependents

  • 401(k) with company match

Compensation Range: $130K - $180K

Vacancy posted 17 days ago
Similar jobs that could be interesting for youBased on the Senior R&D Data Engineer, Hardware Systems in Boston, MA vacancy
  • $140k - $195k

     ...transforming the way they approach health and performance. WHOOP is seeking a highly skilled Senior Systems Engineer to join our Systems Engineering team within the hardware organization. This position bridges multiple disciplines—Electrical, Mechanical, Firmware, Signal... 
    Senior
    Full time
    Work at office
    Relocation

    Whoop

    Boston, MA
    2 days ago
  • $124k - $280k

     ...At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques...  ...optimising algorithms, models, and systems to enable intelligent decision-making...  ...health system and health plans. As a Senior Manager, you will drive use case... 
    Senior
    H1b

    PwC

    Boston, MA
    1 day ago
  • $168k - $252k

     ...leader, join a small team of engineers that owns all software running...  ...on the edge. Generate system solutions to increase reliability...  ...mission systems, including hardware selection, compute, storage and...  ...Proven understanding of data structures, algorithms, concurrency... 
    Senior
    Full time
    Work experience placement
    Local area
    Remote work
    Relocation package
    Flexible hours

    Anduril Industries

    Boston, MA
    21 hours ago
  • $166k - $220k

     ...Anduril is changing how military systems are designed, built and sold...  ...that turns thousands of data streams into a realtime, 3D...  ...highly motivated and experienced Senior Systems Engineer to join our Maritime team....  ...Electromechanical hardware experience; able to troubleshoot... 
    Senior
    Full time
    Work experience placement
    Immediate start
    Shift work

    Anduril Industries

    Quincy, MA
    2 days ago
  •  ...A government-focused technology firm in Boston is seeking a Commvault Systems Engineer to support backup and recovery solutions for federal environments. The ideal candidate should have extensive experience with Commvault applications and networking knowledge. Responsibilities... 
    Senior
    Full time

    CGS Federal (Contact Government Services)

    Boston, MA
    2 days ago
  • $172k - $229k

     ...petabytes of multimodal sensor data. Our next-generation...  ...framework, is the engine that powers this discovery. As a Senior Machine Learning Engineer...  ...optimization, and reasoning systems. Your work will directly...  ..., throughput, and hardware efficiency across GPU/CPU... 
    Senior
    Full time
    Work at office
    Remote work

    Motional

    Boston, MA
    21 hours ago
  • Join to apply for the Senior Data Engineer role at Summit Global Consulting 4 days ago Be among the first 25 applicants Join to apply for the Senior Data Engineer role at Summit Global Consulting Get AI-powered advice on this job and more exclusive features. Take the first... 
    Senior
    Full time

    Summit Global Consulting

    Boston, MA
    4 days ago
  • $150k - $190k

     ...A global IT solutions provider is seeking a Senior Data Engineer in Boston, MA, to drive data engineering initiatives and ETL development. The role requires over 10 years of experience in data applications and a strong understanding of database design and data modeling... 
    Senior

    SHI GmbH

    Boston, MA
    2 days ago
  • $166k - $220k

     ...Anduril is changing how military systems are designed, built and sold....  ...that turns thousands of data streams into a realtime, 3D command...  ...THE TEAM: The Reliability Engineering team partners across Anduril'...  ...deep technical knowledge of hardware reliability and failure... 
    Senior
    Full time
    Work experience placement
    For subcontractor
    Immediate start

    Anduril Industries

    Waltham, MA
    9 hours ago
  • $110k - $120k

    A leading tech staffing provider is looking for a Mid-Senior level Data Engineer based in Boston, Massachusetts. This full-time role involves transforming data systems, designing automated data pipelines, and collaborating with cross-functional teams. The ideal candidate... 
    Senior
    Full time
    Remote work

    Softworld, a Kelly Company

    Boston, MA
    21 hours ago
  •  ...Responsibilities Develop advanced data engineering solutions that power critical investment decisions Design robust data models and ETL pipelines Apply modern DevOps and Agile practices Requirements Strong software development background in the Financial Industry Expertise... 
    Senior

    Jobtailor

    Boston, MA
    4 days ago
  • $100k - $120k

     ...Division: Information Technology Department: Enterprise Systems & Data Reports to: Senior Manager, Enterprise Systems & Data Supervisory Duties: No...  ...to project teams and business leaders. The Senior Data Engineer supports the design, build, and optimization of our analytical... 
    Senior
    Full time

    Consigli Construction

    Boston, MA
    1 day ago
  •  ...and evolving the firm's next-generation data platform. The team is focused on designing...  ...that move data from operational systems into a centralized data platform built on...  ...Snowflake technologies. This is a hands‑on engineering role working on large‑scale data ingestion... 
    Senior
    Contract work
    Work at office
    Local area
    3 days per week

    DeWinter Group

    Boston, MA
    2 days ago
  •  ...in the global travel and hospitality industry is seeking a Senior Data Engineer to join its Technology team. In this role, you will help build...  ...to operate effectively in environments that combine legacy systems with modern cloud architecture Experience mentoring junior... 
    Senior
    Full time
    Flexible hours

    Motion Recruitment

    Boston, MA
    2 days ago
  •  ...The Senior Data Engineer will help transform our cloud data systems by designing and operating architectures that drive analytical and business value from a wide range of data sources. This role partners closely with analysts, traders, product owners, and IT teams to deliver... 
    Senior

    Boston Energy Trading and Marketing

    Boston, MA
    3 days ago
  • $156.28k - $223.25k

     ...We are looking for a Data/Backend Engineer to join our team. We are at the forefront of deriving foundational knowledge through vectors and representations...  ...- volume, heterogeneous data, preferably with distributed systems such as Hadoop, BigTable, Cassandra, GCP, AWS or Azure You... 
    Senior
    Flexible hours

    Spotify

    Boston, MA
    5 days ago
  • $120k - $140k

     ...Section 1: Position Summary As a Senior Data Engineer at Ascensus, you will enable data-driven decision making by collecting, transforming and...  ...design, build, maintain and troubleshoot data processing systems with emphasis on security, reliability, fault-tolerance, scalability... 
    Senior
    Work experience placement
    Second job

    Ascensus

    Newton, MA
    2 days ago
  •  ...As a Senior Data Engineer, CASM Platform, you will: Data Integration, API Development: Integrate diverse cybersecurity data sources using a...  ...S., or Ph.D. in Computer Science, Data Science, Information Systems, or a related field, or equivalent professional experience.... 
    Senior
    Contract work

    CeDent

    Boston, MA
    2 days ago
  •  ...or Indianapolis This is a U.S. based role We are seeking a Senior Data Engineer with strong analytical skills to join our growing Data and Analytics...  ...Develop automated tests across multiple scopes (Unit, System, Integration, Regression) to ensure reliability and accuracy... 
    Senior
    Work at office
    Local area
    Flexible hours
    Shift work

    Liberty Mutual Insurance

    Boston, MA
    3 days ago
  • $110k - $120k

     ...experience with DBT. ~2+ years of data modeling experience. ~...  ..., scale and optimize data systems, with an understanding of distributed...  ...Collaborate closely with BI Engineers, Finance teams, and cross‑...  ...adopters of the platform. Seniority Level ~ Mid‑Senior level... 
    Senior
    Full time
    For subcontractor
    Remote work

    Softworld, a Kelly Company

    Boston, MA
    3 days ago
  • Mass Digital Health is seeking a Technical Services Engineer II to ensure the availability, performance, and security of its corporate infrastructure...  ...Boston. The role involves maintaining and optimizing cloud and data center environments as well as administering server platforms.... 
    Senior

    Mass Digital Health

    Boston, MA
    2 days ago
  • $90k - $180k

    Senior Data Engineer As a member of the Science Research Technology team, you will help design, build, and scale data-driven solutions for the Science Analysts, especially in the Equity space. Responsibilities Design, develop, and maintain end-to-end data pipelines and... 
    Senior
    Work at office
    Remote work
    Flexible hours

    Wellington Management

    Boston, MA
    3 days ago
  •  ...Geode Capital Management is seeking a full‑time Senior Data Engineer to join our Data team. The Senior Data Engineer will report to the Director of Data Engineering and will design and build scalable data solutions, working closely with operations teams, data analysts... 
    Senior
    Full time
    Work at office
    Remote work
    Monday to Friday

    Geode Capital Management

    Boston, MA
    2 days ago
  •  ...Are you ready to make an impact? West Monroe is seeking a Senior Data Engineer to join our Data & AI practice. In this role, you will design, build, and optimize modern cloud data platforms that enable advanced analytics, AI, and business intelligence. Working with technologies... 
    Senior
    Work at office
    Flexible hours

    PVH (Tommy Hilfiger/Calvin Klein)

    Boston, MA
    2 days ago
  •  ...real problems and meet real customer needs. We are seeking Senior Data Engineers who are passionate about marrying data with emerging technologies...  ...design and development of scalable data architectures and systems that extract, store, and process data from all lines of... 
    Senior
    Full time
    Part time
    Internship
    Local area

    Capital One Financial Corp

    Cambridge, MA
    3 days ago
  • A government-focused technology firm in Boston is seeking a Commvault Systems Engineer to support backup and recovery solutions for federal environments. The ideal candidate should have extensive experience with Commvault applications and networking knowledge. Responsibilities... 
    Senior
    Full time

    CGS Federal (Contact Government Services)

    Boston, MA
    21 hours ago
  •  ...optimize SaaS spend, and the analytics surface area is a meaningful piece of the product itself — not just an internal BI tool. As Senior Data Engineer you will own the analytical data platform end to end: ingestion via Fivetran and custom connectors, transformation in dbt on... 
    Senior

    Kovoro

    Boston, MA
    2 days ago
  •  ...of hands-on builders, engineers, and innovators reinventing...  ..., ensuring our hardware products are reliable so...  ...actionable insights from the data.  Are you a versatile...  ...who can see the whole system—from the smallest part...  ...join our small and agile R&D Reliability Engineering... 
    Full time
    Work at office
    Worldwide
    Flexible hours

    Formlabs

    Somerville, MA
    21 hours ago
  • firstPRO is now accepting resumes for a Senior Data Engineer role in Boston, MA. This is a direct hire role and onsite 2-3 days per week. Responsibilities...  ...to design and deploy new applications and migrate existing systems to the cloud. Technology Experience Hands-on experience... 
    Senior
    Full time
    2 days per week
    3 days per week

    firstPRO, Inc

    Boston, MA
    1 day ago
  • Senior Data Engineer Department: Development - Software Development Employment Type: Permanent - Full Time Location: Boston, US Reporting To: Andrew Rawnsley Description Location - Pittsburgh, Boston, Toronto or Montreal At Confluence, we’re always driven by innovation... 
    Senior
    Permanent employment
    Full time
    Flexible hours

    Confluence Technologies, Inc.

    Boston, MA
    21 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior R&D Data Engineer, Hardware Systems. Be the first to apply!