Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer - Data Platform (Staff)

$195k - $300k

Deterrence Defense, Inc.

Software Engineer – Data Platform (Staff) – San Francisco Bay Area

 

Summary

Deterrence builds autonomous production lines for energetics and munitions. Those lines generate process data that cannot be bought or synthesized: millions of signals per facility, tied to individual parts, kept as quality evidence for decades and used to train our models. The Staff Data Platform Engineer owns how that data moves from the factory edge into AWS GovCloud, how it is kept permanently, and how people and models read it: a complete, never-deleted lakehouse record on one path, and a sub-second live feed for line and customer dashboards on the other. The ideal candidate has run production data infrastructure where losing or mislabeling data was not an option, treats correctness and tenant isolation as properties to be tested rather than assumed, and wants their work to be the system of record for real factories.

 

Key Responsibilities

• Own the data and telemetry architecture end to end: the bulk path from edge historians to an S3 and Apache Iceberg lake, and the serving path from MQTT to a low-latency search store and live dashboards.

• Build edge-to-cloud export that survives outages: durable edge buffers, export–confirm–delete semantics, idempotent landing, backlog replay, and disk guards, so that a cloud outage never stops a production cell.

• Run the lakehouse: raw-to-Iceberg conversion, partitioning by tenant and date, compaction and snapshot maintenance, schema evolution, storage tiering, and audited purges in a store whose default is never delete.

• Own signal identity and data contracts: a registry that gives every signal a stable ID, unit and conversion; source-time semantics; clock-drift detection; and canaries that prove the live and historical views agree.

• Make multi-tenant isolation provable across index aliases, IAM prefix policies and PostgreSQL row-level security, with CI tests that fail if one customer can read another's data.

• Deliver the datasets the business runs on: SQL that joins process telemetry to part genealogy for quality investigations, training and feature datasets for ML, and cost-bounded summaries for dashboards.

• Bring inspection results, images and video into the same record, correlated to the machine jobs and parts that produced them.

• Measure before scaling: signal change rates, historian and edge-buffer capacity, and per-tenant query cost, turned into capacity and cost models.

• Write and review the architecture decision records for each data component, mentor engineers, and lead technical work across the edge, controls, traceability and front-end teams.

 

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering or a related field, or equivalent experience.

• 8+ years building production data infrastructure or distributed systems, including on-call ownership and recovery of a system where data loss was unacceptable.

• Deep hands-on experience with a lakehouse table format (Iceberg, Delta Lake or Hudi) on object storage: partitioning, compaction, snapshot management, schema evolution and row-level deletes.

• Strong production Python and advanced SQL; comfortable in a second language (Go, Rust, TypeScript, Java or Scala).

• Time-series data at scale: high cardinality, late and out-of-order data, bucketing and downsampling, source time versus arrival time.

• Distributed-systems correctness in practice: idempotence, retries, replay, backpressure, at-least-once delivery with de-duplication, and durable buffering over unreliable links.

• Hands-on AWS data services (S3, Athena, Glue, IAM) and operation of OpenSearch or Elasticsearch: index and shard design, aliases, refresh tuning.

• PostgreSQL depth: partitioning, row-level security, query performance.

• Infrastructure as code (Terraform or CDK) and CI/CD for data pipelines.

 

Level Expectations

This is a Staff role. You own the data architecture across edge and cloud, approve the design of every data component, set the standards for data contracts, retention and isolation testing, and are accountable for the platform's correctness and cost. You lead multi-team initiatives and raise the bar for the engineers around you.

 

Your First Year

• Measure real change rates and historian capacity on a production cell, and size the platform from the result.

• Stand up the lake with tenant isolation enforced and tested, and answer the query it exists for: what was this cell doing while this serial number was being made?

• Ship the signal registry, so that the live and historical views of every selected signal show the same series.

 

Preferred Skills

• AWS GovCloud or other regulated environments: ITAR, CUI, NIST 800-171, CMMC or FedRAMP.

• Multi-tenant data platforms with server-side isolation.

• ML data infrastructure: training datasets, feature pipelines, SageMaker or similar.

• Streaming at scale (Kinesis, Kafka or MQTT) and edge or intermittently connected systems (AWS IoT Core, Greengrass).

• Manufacturing, quality or traceability data; hardware-adjacent domains.

• Cost engineering of data platforms: knowing what a query, a message and a stored byte cost, and designing to it.

 

How We Build

Our data platform is AWS-native by design: in GovCloud we add no third-party data software, and the platform only reads from the plant, never writes to it. If your experience centers on Snowflake or Databricks, expect to build the equivalent on S3, Iceberg, Athena and OpenSearch, and to own the parts a managed vendor would normally run for you.

 

Compensation. The base salary range for this position is $195,000 – $300,000. This is a good-faith estimate; actual base pay depends on job-related knowledge, skills, experience, and level. This role is also eligible for equity (employee stock options) and benefits including medical, dental, vision, 401(k), and paid time off. Roles with significant travel may be eligible for an assignment premium.

 

Export Control. This position may require access to information controlled under the International Traffic in Arms Regulations (ITAR) or Export Administration Regulations (EAR). Applicants must be a U.S. person as defined in 22 CFR 120.62 (U.S. citizen, lawful permanent resident, or protected individual) or be eligible to obtain any required authorization.

 

Equal Opportunity. Deterrence Defense, Inc. is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other characteristic protected by law. We are committed to working with and providing reasonable accommodations to applicants with disabilities; if you need an accommodation at any point in the process, contact View email address on us.fitly.work.

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Software Engineer - Data Platform (Staff) in Fremont, CA vacancy
  • $191k - $299k

     ...safety standards and years of proven deployment data, we're pioneering a new era of automation that...  ...Join the cutting-edge team building the data platform that powers fleet-scale humanoid robotics. As a Staff Software Engineer on our Data Platform team, you will play a... 
    Software
    Full time
    Temporary work
    Remote work
    Relocation package
    Flexible hours

    Agility Robotics

    Fremont, CA
    28 days ago
  • $149.8k - $262.2k

     ...Company Description It all started when engineer Fred Luddy wrote code that...  ...business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow— helping 85% of...  ...About the team: We are seeking a Staff Software Engineer (IC4 Level) to join our... 
    Software
    Permanent employment
    Full time
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours
    2 days per week

    ServiceNow

    Pleasanton, CA
    2 days ago
  • $149.8k - $262.2k

     ...Company Description It all started when engineer Fred Luddy wrote code that...  ...business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow— helping 85% of...  ...team: We are seeking a Senior Staff Software Engineer (IC5 Level) to join our... 
    Software
    Permanent employment
    Full time
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours
    2 days per week

    ServiceNow

    Pleasanton, CA
    2 days ago
  •  ...DescriptionJob Description Title: Data Governance Analyst (807900)...  ...Architecture, Data Engineers, Project Teams, and Information...  ...data ingested into the AWS Data Platform and consumed through Snowflake...  ...are an Award-Winning Global Software Consultancy solving complex problems... 
    Software
    Work at office

    InterSources

    Fremont, CA
    2 days ago
  •  ...Description Job Description Title: Senior AI Platform Engineer Location: New York City, NY/Hybrid...  ...The ideal candidate combines strong software engineering fundamentals with practical...  ..., logging/monitoring, rate limits, data-access controls). Work with cross-... 
    Software

    InterSources Inc.

    Fremont, CA
    20 days ago
  • $188.4k - $276.32k

     ...s proprietary technology and software-defined vehicle architecture,...  ...and sustainability, design and engineering, ambition and integrity. In...  ...future of mobility.The ADAS Data Infrastructure team builds and...  ...development. We create scalable platforms, services, and data pipelines... 
    Software
    Hourly pay

    Lucid Motors

    Newark, CA
    1 day ago
  • $38 - $41 per hour

     ...Consulting, Digital Product Engineering, Digital Workplace Services,...  ..., and upgrading hardware and software as needed. This role requires...  ...business operations. IT Support staff work in a dynamic, fast-paced...  ...with IT policies, including data protection and confidentiality... 
    Software
    Hourly pay
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Worldwide

    Milestone Technologies, Inc.

    Fremont, CA
    3 days ago
  • $140k - $170k

     ...is an IT infrastructure and engineering company that designs, manufactures...  ...with reliable, scalable platforms. In this role, you will help...  ...standards Analyze business data and metrics to measure the effectiveness...  ...vendors, consultants, and software providers Prepare project... 
    Software
    Flexible hours

    AMAX

    Fremont, CA
    3 days ago
  •  ...with unparalleled accuracy and stability. Our staff includes physicists and engineers with expertise covering a wide array of disciplines...  ..., and rf electronics Basic knowledge of data acquisition and simulation software such as MATLAB, LabVIEW, Visual Basic, Python,... 
    Software
    Permanent employment
    Local area
    Shift work

    AOSense

    Fremont, CA
    5 days ago
  • $130k - $185k

     ...together the best scientists, engineers, and operators from the...  ...core of our experimental fusion platform. This role is deeply hands‑on...  ..., controls, diagnostics, and data analysis. The ideal candidate...  ...design, control systems, and PLC software development. Experience with... 
    Software
    Casual work

    Pacific Fusion

    Fremont, CA
    4 days ago
  • $73.54 per hour

     ...Job Title: Simulation Engineer Location: Fremont, CA Employment Type...  ...process, manufacturing, and data science teams to drive design...  ...process development, controls, software, and data science Long‑term...  ...experience utilizing simulation platforms such as ANSYS Fluent, ANSYS... 
    Software
    Contract work
    Monday to Friday

    Aleron

    Fremont, CA
    3 days ago
  •  ...has a client that is seeking a Senior Software Development Engineer in Test (SDET)/QA Automation Engineer...  ...* Write complex SQL queries for data validation, troubleshooting, and backend...  ...* Docker and Kubernetes * Cloud platforms such as AWS, Azure, or Google Cloud Platform... 
    Software
    Hourly pay
    Contract work

    Kforce Technology Staffing

    Fremont, CA
    1 day ago
  •  ...About us: We are an IT staffing/placement and software development firm specialized in Java/J2ee / Mean stack/ full stack/Data science and cloud computing domain & providing technically skilled and competent candidates to clients in Northern America and Canada since... 
    Software
    Full time

    SynergisticIT

    Fremont, CA
    25 days ago
  • Akraya is seeking a Software QA Engineer in Fremont, CA to develop automated test environments and drive quality across applications including...  ...Responsibilities include building automated test suites, test data, and executing functional, integration, and regression tests... 
    Software

    Akraya

    Fremont, CA
    4 days ago
  • $101.66k

     ...tool, it's your playground. Our engineers work on scalable systems, cloud services...  ...to developing ground breaking software and devices that change entire...  ...an experienced cross-disciplinary staff to provide full life-cycle support to AWS Data Centers from design inception... 
    Software
    Full time
    Summer work
    Internship
    Local area
    Relocation
    Monday to Friday

    Amazon

    Hayward, CA
    1 day ago
  •  ...density storage devices, our solutions are engineered to meet the demanding needs of today's...  ...for procurement business system data input and integrity and cost control in...  ...Technology Document and presentation software: Microsoft Word, Excel, Power Point, Adobe... 
    Software

    Unigen Corporation

    Newark, CA
    4 days ago
  • $222.9k - $334.3k

     ...500 company and a leading AI platform for managing people, money, and...  ...for you too.About the TeamThe Data Cloud organization is at the forefront...  ...we are building the critical engine that will power the future of...  ...customerAre passionate about software development and think and code... 
    Software
    Full time
    Work at office
    Remote work
    Home office
    Flexible hours

    Workday

    Pleasanton, CA
    2 days ago
  •  ...finalize designs using Adobe Creative Suite and other relevant software. Ensure designs align with brand standards and meet all...  ...in managing tasks and projects. Familiarity with social media platforms and internet-savvy. Bachelor’s degree in Design or a related... 
    Software
    Flexible hours

    Bay Central Printing

    Union City, CA
    2 days ago
  •  ...was founded in 2007 providing intelligent data solutions to clients across industries...  ...products on Business Intelligence & Big Data platform simplifying and transforming the way...  ...empowers Corporations and end users using Softwares liek Tableau,Business Objects, MicroStrategy... 
    Software

    InterSources

    Fremont, CA
    4 days ago
  • $164.6k - $241.45k

     ...proprietary technology and software-defined vehicle...  ...sustainability, design and engineering, ambition and integrity...  ...the future of mobility.Staff Software Development Engineer In Test, Platform SoftwareWe are seeking...  ...Careers website.Candidate Data Privacy: By submitting... 
    Software
    Hourly pay

    Lucid Motors

    Newark, CA
    1 day ago
  • $160k - $220k

     ...leading Industrial AI autonomy platform, helping customers across...  ...contextualizes and connects operational data across siloed systems,...  ...avathon.comWe are hiring an Engineering Lead to build the core of the...  ...'ll Have8+ years of software engineering experience, including... 
    Software
    Work at office
    Local area

    Avathon

    Pleasanton, CA
    1 day ago
  • $24 - $28 per hour

     ...support in a corporate environment Troubleshoot hardware, software, and network issues across Windows, macOS, and Linux systems...  ...knowledge base articles Collaborate with IT infrastructure and engineering teams Requirements: ~34+ years of strong Help Desk /... 
    Software
    Temporary work
    Remote work
    Shift work

    Eastridge Workforce Solutions

    Fremont, CA
    6 days ago
  • $75k - $85k

     ...recommend improvements. They communicate effectively with headquarters staff, the sales team, customer support, production, quality, and...  ...experience with NetSuite and/or Salesforce (or similar ERP/CRM software). Medium to high proficiency in Excel, plus Microsoft Office (... 
    Software
    Full time
    Work at office
    Flexible hours

    Q'apel Medical

    Fremont, CA
    3 days ago
  • $175.4k - $263.2k

     ...500 company and a leading AI platform for managing people, money, and...  ...launched the Enterprise Data and Analytics (ED&A) team with...  ...the RoleAs a Principal DataOps Engineer (P5), you serve as a preeminent...  ...directly into our master software continuous delivery pipelinesAI... 
    Software
    Full time
    Work at office
    Remote work
    Home office
    Flexible hours

    Workday

    Pleasanton, CA
    2 days ago
  • $179.4k - $263.12k

     ...proprietary technology and software-defined vehicle...  ...sustainability, design and engineering, ambition and integrity...  ...the future of mobility.Staff Embedded Software Engineer – AUTOSAR, Platform SoftwareAt our cutting-...  ...interpreting schematics and data sheetsExperience with... 
    Software
    Hourly pay

    Lucid Motors

    Newark, CA
    4 days ago
  •  ...building, testing, troubleshooting complex software controlled electro-mechanical sensing...  ...provide complete documentation to the SAP data steward. Plan and coordinate preventive and...  ...established procedures. Support Quality Engineers in issuing and tracking quality alerts by... 
    Software

    Artech

    Fremont, CA
    2 days ago
  • $75 - $90 per hour

     ...a complex flow of financial data, and an opportunity to make the...  ...You'll partner directly with Engineering and Finance to turn manual...  ...to a production orchestration platform. Implement scheduling, monitoring...  ...: 5+ years of relevant software engineering, data engineering... 
    Software
    Hourly pay
    Contract work
    Local area
    Remote work

    Jobot

    Milpitas, CA
    2 days ago
  •  ...Qualifications: ~ Bachelor’s degree in electrical engineering. ~5 + years of large high speed FPGA...  ...Capture RAM (ECR) block and the ECR data transfer block to move the data to the...  ...with the hardware design team and the software team to assist bring-up and driver... 
    Software

    SoloPoint

    Fremont, CA
    3 days ago
  •  ...robots as easy to build and deploy as software. Today, robotics is fragmented,...  ..., delivering a plug-and-play platform for developers, researchers, and...  ...We are looking for a Software Engineer to build the infrastructure that powers data, models, and AI runtime across Dexmate... 
    Software
    Full time

    dexmate

    Fremont, CA
    2 days ago
  • $3,000 - $6,000 per month

    A Silicon Valley medical device startup is seeking a Full Stack Software Engineer to design and maintain backend services for medical AI applications. The ideal candidate will have at least 2 years of experience, with strong skills in Python and Go. This role offers a contract... 
    Software
    Full time
    Contract work

    Tiposi

    Milpitas, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer - Data Platform (Staff). Be the first to apply!