Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Staff R&D Data Engineer, Hardware Systems

$160k - $210k

Lydian

Job Description

Job Description

Company Overview

Lydian is developing the lowest cost sustainable fuels from waste CO2, water, and renewable electricity to decarbonize the aviation industry. Our breakthrough technology replaces oil and gas refining with fully electrified, modular, and flexible reactor systems that produce fuel with 95% lower emissions than traditional jet fuel.

Since our founding in 2021, Lydian has achieved key milestones in record time, including the production of our first liquid fuel from our pilot system, capable of producing ~10,000 gallons of fuel per year for a fraction of the capital and time of alternative approaches. Lydian is backed by top climate investors including Congruent Ventures, Galvanize Climate Solutions, Union Square Ventures, Voyager Ventures, Grok Ventures, and Overture. We are building a motivated, diverse, and collaborative team that is passionate about addressing the growing climate crisis and is committed to excellence in their work. In particular, we look for tenacious people who are energized by solving the hardest, highest impact problems that come their way.

Position Overview

Lydian is looking for an R&D Data Engineer to build and own the data backbone of our technical organization. As we scale from pilot operations toward commercial production, our teams are generating a growing volume of experimental, manufacturing, and quality data. The ability to store, connect, and analyze that data well has become central to how quickly we can learn and improve. In this role you will develop our data infrastructure, build the analysis and visualization tools our engineers and scientists rely on, and carry out statistical analyses in support of the entire technical team.

This is a data generalist role at the intersection of hardware and software. You should be equally at home designing a database schema, writing Python to wrangle time-series data streaming off lab instruments, building a clear plot or dashboard, and talking through an analysis with a process engineer. You will report to the VP of R&D and work closely with the full R&D team as well as our mechanical and process engineering groups.

Responsibilities
  • Design and maintain data infrastructure. Establish structured, systematic data storage across our tools (currently Nominal and Notion, plus others as needs evolve). Ensure experimental run data (time series), run metadata, and manufacturing and QC data are integrated, consistently formatted, and easy to sort, filter, and query for analysis

  • Build analysis and visualization tools. Create the data views, plots, and statistical tools that help the team analyze data faster and better. For example, this will include standardizing and automating run summary statistics and overall performance metrics across R&D and pilot experiments

  • Enable laboratory data acquisition. Program and maintain data-acquisition software (e.g., DAQ Factory, Ignition) so that R&D and pilot test equipment stream reliably into our centralized databases. Build in data validation checks that quality-control data at the point of acquisition or entry

  • Run cross-functional analyses. Perform statistical and regression analyses that connect manufacturing and QC data with experimental run data to surface insights across functions

  • Partner across the technical team. Work with scientists and engineers to understand their data needs and translate them into reliable tools and workflows, and help maintain the IT infrastructure of servers and software systems that house our data

Qualifications
  • BS/MS in engineering, physical science, computer science, data science, or related field

  • 10+ years experience with data in a hardware, lab, or physical-science R&D environment (software-only experience does not qualify)

  • Demonstrated strength across the full data lifecycle: acquisition, infrastructure, pipelines, visualization, and statistical analysis

  • Proven track record establishing or improving data storage and analysis infrastructure

  • Expert level SQL and Python proficiency (pandas/NumPy, query optimization, schema design)

  • Experience handling time-series and sensor data; alignment, gap-filling, and reconciling schema drift across instrument runs and batches

  • Statistical/regression analysis on experimental data, with the ability to turn it into clear visualizations and dashboards

  • Proficiency with at least one DAQ platform (LabVIEW, DAQ Factory, or Ignition)

  • Fluency using AI coding assistants to scaffold and debug pipelines and SQL, with judgment to validate their output

  • Strong communication skills; able to work independently as the team's senior-most data professional

Preferred Qualifications
  • Background in chemical/materials/mechanical engineering

  • Modern data-stack tools (Airflow, Dagster, dbt, Snowflake/DuckDB/Iceberg)

  • Automated data testing (Great Expectations, dbt tests)

  • Experience with Notion, Nominal, or JMP

  • Additional DAQ platform familiarity

  • Basic IT and networking skills

Company Culture and Benefits
  • Challenging, collaborative, and meaningful work and an important voice in company development

  • Competitive salary commensurate with experience

  • Meaningful equity compensation

  • Generous PTO allowing employees to take time off to rest, recharge, and enjoy life outside work

  • Excellent insurance with 100% of healthcare, vision, and dental premiums covered for the employee, and 80% coverage for dependents

  • 401(k) with company match

Compensation Range: $160K - $210K

Vacancy posted 18 days ago
Similar jobs that could be interesting for youBased on the Staff R&D Data Engineer, Hardware Systems in Boston, MA vacancy
  • $95k - $245k

     ...exploration to biomedical engineering, lives often depend on...  ...Summary:The Data Retrieval, Engineering,...  ...Engineering Data Solutions Systems Engineer to develop next...  ...plans.• Develop real-time hardware interfaces, integrate legacy...  ...a nationally renowned R&D innovation company... 
    Suggested
    Full time
    Local area

    Draper Laboratory

    Cambridge, MA
    2 days ago
  •  ...of hands-on builders, engineers, and innovators reinventing...  ..., ensuring our hardware products are reliable so...  ...actionable insights from the data.  Are you a versatile...  ...who can see the whole system—from the smallest part...  ...join our small and agile R&D Reliability Engineering... 
    Suggested
    Full time
    Work at office
    Worldwide
    Flexible hours

    Formlabs

    Somerville, MA
    15 hours ago
  • McKinsey & Company in North America seeks a senior Data Engineer to design and lead scalable data architectures for AI and agentic systems. You will own data pipelines, governance, and security while mentoring junior engineers and collaborating with clients and cross‑functional... 
    Suggested

    McKinsey & Company

    Boston, MA
    3 days ago
  • $128k - $252.5k

     ...We are hiring a Senior Data Scientist to collaborate...  ...on solving complex and R&D problems.Recruiting for...  ...data scientists, engineers, architects, and consultants...  ...clinical trials, autonomous systems and edge AI, agentic...  ..., network design, and hardware optimizationValidate AI... 
    Suggested
    Local area

    Deloitte

    Boston, MA
    15 hours ago
  •  ...DescriptionA cutting-edge automation company is hiring a Lead Data Platform Engineer to help power the next generation of intelligent warehouse...  ...intelligence, computer vision, and large-scale software systems, the company is transforming how products move through modern... 
    Suggested
    Full time

    Motion Recruitment

    Boston, MA
    2 days ago
  • $137k - $215.27k

     ...Implementation team at Takeda is in search of a data Sr. Staff Engineer to contribute to the design,...  ...shared infrastructureMonitor data capture systems to identify inefficiencies and remove bottlenecksSupport internal & external R&D projects, working with domain experts... 
    Minimum wage
    Temporary work
    Local area
    Remote work

    Takeda

    Boston, MA
    15 hours ago
  • $100k - $116k

    Company DescriptionBoston Engineering is a technology-driven consulting firm that provides innovative...  ...specializes in product development, systems engineering, and technology...  ...control systems, automation, and embedded hardware. You will work collaboratively with cross... 
    Permanent employment
    Work at office
    Relocation
    Relocation package

    Boston Engineering

    Waltham, MA
    4 days ago
  • $120k - $217.5k

     ...key enabler for our business to deliver data and insights to our clients. We’re driving...  ...What you will be responsible forAs Data Engineering Lead you will:· Lead the design,...  ...domains, ensuring clear lineage from source systems through consumption layersPartner with business... 
    Full time
    Temporary work
    Flexible hours

    State Street Bank

    Quincy, MA
    6 hours ago
  • $210k - $245k

     ...strong foundation of reliable, well-modeled data that powers decisions across the...  ...between our Analytics and Data Platform Engineering teams, ensuring alignment on architecture...  ...commerce, health/wellness, or consumer hardware.Background in data governance, data contracts... 
    Full time

    WHOOP

    Boston, MA
    4 days ago
  • Netpreme is seeking a motivated LLM Systems Engineer to explore and prototype inference systems for next‑gen hardware. You’ll guide the hardware team on product definitions and push ML systems research forward in a hands‑on role. The role blends engineering and research... 

    Netpreme

    Cambridge, MA
    4 days ago
  • $110k - $130k

     ...and building the most advanced hardware, software, and AI technology...  ...sleep into a personalized, data-driven recovery experience. We...  ...looking for a Clinical Data Engineer who will own the end-to-end data...  ..., retrieval, and archival systems in AWS, including handling long... 
    Full time
    Immediate start
    Worldwide
    Night shift

    Eight Sleep

    Boston, MA
    5 days ago
  • $168k - $240k

     ...onlyHybrid work 2-3 days - onsite work is mandatoryDirector - Data & Software Engineering, is responsible for leading the core Data Engineering and...  ...modernization, oversee delivery of business-critical systems, and ensure platforms are scalable, secure, reliable, maintainable... 
    Full time
    Local area

    Yoh

    Boston, MA
    1 day ago
  • $95k - $165k

    Job OverviewInvestment Data Systems team is responsible for developing technology solutions supporting Arrowstreet Capital’s investment services...  ...The ideal candidate is a self-driven, team-oriented hands-on engineer who enjoys working on complex problems as part of a team. This... 
    Full time
    Local area

    Arrowstreet Capital

    Boston, MA
    15 hours ago
  • Mass General Brigham Incorporated is seeking an Epic Data Courier Administrator, Systems Engineer to support Epic data migration, change control, and deployment operations across environments. In this highly visible role, you will collaborate with Epic analysts and application... 

    Mass General Brigham

    Somerville, MA
    4 days ago
  • The Space Systems Analysis and Test Group aims to solve our...  .... What will you do?Our staff are skilled scientists and engineers with broad experience, eager...  ...to process observational data from optical, radar, and...  ...to theoretical models.Hardware Prototyping - Design and... 

    Lincoln Laboratory

    Lexington, MA
    2 days ago
  • $171k - $200k

    Staff/Sr Staff Technical Program Manager, Hardware Systems Lightmatter is leading the revolution in AI data center infrastructure, enabling the next giant leaps in human progress. The...  ...the world’s first 3D-stacked photonics engine, Passage™, capable of connecting thousands... 
    Full time
    Contract work
    Temporary work
    Flexible hours
    Shift work

    Lightmatter

    Boston, MA
    1 day ago
  •  ...manufacturing.   We are engineers with deep experience across the...  ...initial ideas to shipping hardware, across industries and specializations...  ...and generate quantitative data, Lumafield promises to...  ....   We rebuilt the whole system, from X-ray capture, to computer... 
    Full time
    Work at office
    Work visa
    Flexible hours

    Lumafield

    Boston, MA
    8 days ago
  • $172k - $229k

     ...petabytes of multimodal sensor data. Our next-generation...  ...data mining framework, is the engine that powers this discovery....  ...optimization, and reasoning systems. Your work will directly influence...  ...for latency, throughput, and hardware efficiency across GPU/CPU clusters... 
    Full time
    Work at office
    Remote work

    Motional

    Boston, MA
    15 hours ago
  • $100k

     ...Tenstorrent is building next-generation AI systems that push the boundaries of model...  ...cutting-edge AI research and high-performance hardware, bringing state-of-the-art machine...  ...across custom hardware.Compensation for all engineers at Tenstorrent ranges from $100k - $500k... 
    Permanent employment

    Tenstorrent

    Boston, MA
    2 days ago
  • Mass General Brigham Incorporated’s MGB Digital is hiring an Epic Data Courier Administrator, Systems Engineer. This highly visible role sits at the center of Epic change management and deployment operations, collaborating with Epic application teams to ensure updates... 

    Mass General Brigham (Enterprise Services)

    Somerville, MA
    1 day ago
  • $137.8k - $206.6k

     ...Location: Boston, MassachusettsShift: Department: HC-NA-IDA Analytics Engineering & BI ArchitectureRecruiter: Troy BradleyThis information is for...  ...not share outside of the organization.Your RoleAt EMD Serono, data, analytics, and AI are core to how we bring innovative... 
    Work experience placement
    Work at office
    Local area
    Immediate start
    Work from home
    2 days per week
    3 days per week

    Merck

    Boston, MA
    2 days ago
  • $106k - $176.6k

    We are seeking an experienced Machine Learning Data Engineer to develop, operationalize, and continuously improve production bioinformatics pipelines and data products that support AI-driven discovery within the Internal Medicine Research Unit (IMRU).The successful candidate... 
    Permanent employment
    Full time
    H1b
    Local area
    Visa sponsorship
    Work visa
    Relocation package

    Pfizer

    Cambridge, MA
    3 days ago
  • $106.8k

     ...your ambitions.   We are looking for a seasoned engineer to join our Systems Engineering department within the...  ...professionals, planning test method developments, analyzing data, implementing the solutions in hardware and software according to Boston Scientific’s product... 
    Hourly pay
    Shift work

    Boston Scientific

    Waltham, MA
    8 days ago
  •  ...members and civilians with intelligent systems. Its products include Hivemind...  ...and YouTube.  Job Description: As a Hardware Reliability Engineer (Engineer II) at Shield AI, you will...  ...investigations, and help analyze test and field data to identify potential reliability... 
    Full time
    Temporary work
    Part time
    Internship
    Worldwide

    Shield AI

    Boston, MA
    19 days ago
  • $150k - $215k

     ...level through a deeper understanding of their bodies and daily lives.WHOOP is hiring a Senior Data Engineer to lead the design, development, and evolution of the data systems that power analytics, experimentation, machine learning, and business decision-making across the... 
    Full time

    WHOOP

    Boston, MA
    1 day ago
  • $98k - $142k

     ...Plymouth Rock, a fast-growing, analytics-driven insurer, we believe data engineering can redefine how insurance operates. As the Data Engineer on...  ...and manage the data pipelines that connect internal systems, third-party sources, and advanced analytical platforms, directly... 

    Plymouth Rock Assurance

    Boston, MA
    6 hours ago
  •  ...a premier Google Cloud partner helping organizations modernize data ecosystems, build real-time analytics capabilities, and responsibly...  ...Foundation Models, and Gemini Enterprise.You AreA hands-on Engineer with foundational experience in Data Engineering, Analytics, or... 
    Full time
    Work experience placement
    Live in
    Work at office
    Local area

    Accenture

    Boston, MA
    2 days ago
  •  ...mission to centralize, enrich, and validate investment data so that the investment teams can focus on acting on...  ...intelligence. What we are looking for is a Data Engineer who will work to build and maintain the systems that make investment data accessible, reliable, and... 
    Full time

    Motion Recruitment

    Boston, MA
    15 hours ago
  • $137.95k

     ...Berkeley Street, Boston, MA 02116Job Title: Data EngineerJob Duties: Discover hidden...  ...solutions;Set up monitoring and alerting systems to ensure data pipeline health and reliability...  ...in Computer Science, Electrical Engineering, Electronic Engineering, Information Systems... 
    Full time
    Temporary work
    Local area
    Remote work

    John Hancock

    Boston, MA
    3 days ago
  •  ...Science, Business Analytics, Engineering, Mathematics, or related field...  ...of professional experience in data engineering, software engineering...  ...of distributed systems such as (Spark, Dask, Flink) and...  ...innovative projects, contributing to R&D, and learning from top-tier talent... 
    Apprenticeship
    Easy work

    McKinsey & Company

    Boston, MA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Staff R&D Data Engineer, Hardware Systems. Be the first to apply!