Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer - Data Platform (Staff)

$195k - $300k

Deterrence Defense

Software Engineer – Data Platform (Staff) – San Francisco Bay Area

 

Summary

Deterrence builds autonomous production lines for energetics and munitions. Those lines generate process data that cannot be bought or synthesized: millions of signals per facility, tied to individual parts, kept as quality evidence for decades and used to train our models. The Staff Data Platform Engineer owns how that data moves from the factory edge into AWS GovCloud, how it is kept permanently, and how people and models read it: a complete, never-deleted lakehouse record on one path, and a sub-second live feed for line and customer dashboards on the other. The ideal candidate has run production data infrastructure where losing or mislabeling data was not an option, treats correctness and tenant isolation as properties to be tested rather than assumed, and wants their work to be the system of record for real factories.

 

Key Responsibilities

• Own the data and telemetry architecture end to end: the bulk path from edge historians to an S3 and Apache Iceberg lake, and the serving path from MQTT to a low-latency search store and live dashboards.

• Build edge-to-cloud export that survives outages: durable edge buffers, export–confirm–delete semantics, idempotent landing, backlog replay, and disk guards, so that a cloud outage never stops a production cell.

• Run the lakehouse: raw-to-Iceberg conversion, partitioning by tenant and date, compaction and snapshot maintenance, schema evolution, storage tiering, and audited purges in a store whose default is never delete.

• Own signal identity and data contracts: a registry that gives every signal a stable ID, unit and conversion; source-time semantics; clock-drift detection; and canaries that prove the live and historical views agree.

• Make multi-tenant isolation provable across index aliases, IAM prefix policies and PostgreSQL row-level security, with CI tests that fail if one customer can read another's data.

• Deliver the datasets the business runs on: SQL that joins process telemetry to part genealogy for quality investigations, training and feature datasets for ML, and cost-bounded summaries for dashboards.

• Bring inspection results, images and video into the same record, correlated to the machine jobs and parts that produced them.

• Measure before scaling: signal change rates, historian and edge-buffer capacity, and per-tenant query cost, turned into capacity and cost models.

• Write and review the architecture decision records for each data component, mentor engineers, and lead technical work across the edge, controls, traceability and front-end teams.

 

Qualifications

• Bachelor's degree in Computer Science, Computer Engineering or a related field, or equivalent experience.

• 8+ years building production data infrastructure or distributed systems, including on-call ownership and recovery of a system where data loss was unacceptable.

• Deep hands-on experience with a lakehouse table format (Iceberg, Delta Lake or Hudi) on object storage: partitioning, compaction, snapshot management, schema evolution and row-level deletes.

• Strong production Python and advanced SQL; comfortable in a second language (Go, Rust, TypeScript, Java or Scala).

• Time-series data at scale: high cardinality, late and out-of-order data, bucketing and downsampling, source time versus arrival time.

• Distributed-systems correctness in practice: idempotence, retries, replay, backpressure, at-least-once delivery with de-duplication, and durable buffering over unreliable links.

• Hands-on AWS data services (S3, Athena, Glue, IAM) and operation of OpenSearch or Elasticsearch: index and shard design, aliases, refresh tuning.

• PostgreSQL depth: partitioning, row-level security, query performance.

• Infrastructure as code (Terraform or CDK) and CI/CD for data pipelines.

 

Level Expectations

This is a Staff role. You own the data architecture across edge and cloud, approve the design of every data component, set the standards for data contracts, retention and isolation testing, and are accountable for the platform's correctness and cost. You lead multi-team initiatives and raise the bar for the engineers around you.

 

Your First Year

• Measure real change rates and historian capacity on a production cell, and size the platform from the result.

• Stand up the lake with tenant isolation enforced and tested, and answer the query it exists for: what was this cell doing while this serial number was being made?

• Ship the signal registry, so that the live and historical views of every selected signal show the same series.

 

Preferred Skills

• AWS GovCloud or other regulated environments: ITAR, CUI, NIST 800-171, CMMC or FedRAMP.

• Multi-tenant data platforms with server-side isolation.

• ML data infrastructure: training datasets, feature pipelines, SageMaker or similar.

• Streaming at scale (Kinesis, Kafka or MQTT) and edge or intermittently connected systems (AWS IoT Core, Greengrass).

• Manufacturing, quality or traceability data; hardware-adjacent domains.

• Cost engineering of data platforms: knowing what a query, a message and a stored byte cost, and designing to it.

 

How We Build

Our data platform is AWS-native by design: in GovCloud we add no third-party data software, and the platform only reads from the plant, never writes to it. If your experience centers on Snowflake or Databricks, expect to build the equivalent on S3, Iceberg, Athena and OpenSearch, and to own the parts a managed vendor would normally run for you.

 

Compensation. The base salary range for this position is $195,000 – $300,000. This is a good-faith estimate; actual base pay depends on job-related knowledge, skills, experience, and level. This role is also eligible for equity (employee stock options) and benefits including medical, dental, vision, 401(k), and paid time off. Roles with significant travel may be eligible for an assignment premium.

 

Export Control. This position may require access to information controlled under the International Traffic in Arms Regulations (ITAR) or Export Administration Regulations (EAR). Applicants must be a U.S. person as defined in 22 CFR 120.62 (U.S. citizen, lawful permanent resident, or protected individual) or be eligible to obtain any required authorization.

 

Equal Opportunity. Deterrence Defense, Inc. is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other characteristic protected by law. We are committed to working with and providing reasonable accommodations to applicants with disabilities; if you need an accommodation at any point in the process, contact View email address on us.fitly.work.

Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Software Engineer - Data Platform (Staff) in Fremont, CA vacancy
  • $191k - $299k

     ...safety standards and years of proven deployment data, we're pioneering a new era of automation that...  ...Join the cutting-edge team building the data platform that powers fleet-scale humanoid robotics. As a Staff Software Engineer on our Data Platform team, you will play a... 
    Software
    Full time
    Temporary work
    Remote work
    Relocation package
    Flexible hours

    Agility Robotics

    Fremont, CA
    7 days ago
  • $240k - $280k

     ...Solutions transforms complex engineering challenges into production reality...  ...rack-scale infrastructure platforms.Establish validation...  ...planning across hardware, firmware, software, and system integration domains...  ...automation frameworks and data analytics.Experience in customer... 
    Software
    Full time
    Flexible hours

    Hyve Design Solutions

    Fremont, CA
    1 day ago
  • Job Description: Data Platform Engineer Job Title: Data Platform Engineer Location: Remote, USA Job Type: Full-Time Experience Required: 5...  ...standards. You will collaborate with data engineers, analysts, software teams, and platform stakeholders to ensure that the data... 
    Software
    Full time
    Remote work

    Vurke

    Union City, CA
    1 day ago
  • $149.8k - $262.2k

     ...Company Description It all started when engineer Fred Luddy wrote code that...  ...business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow— helping 85% of...  ...team: We are seeking a Senior Staff Software Engineer (IC5 Level) to join our... 
    Software
    Permanent employment
    Full time
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours
    2 days per week

    ServiceNow

    Pleasanton, CA
    7 days ago
  • $188.4k - $276.32k

     ...s proprietary technology and software-defined vehicle architecture,...  ...and sustainability, design and engineering, ambition and integrity. In...  ...future of mobility.The ADAS Data Infrastructure team builds and...  ...development. We create scalable platforms, services, and data pipelines... 
    Software
    Hourly pay

    Lucid Motors

    Newark, CA
    19 hours ago
  • $168k - $300k

     ...an experienced Senior Network Engineer to drive network refresh and...  ...infrastructure operations across data center environments. This...  ...Extensive experience with Juniper platforms (QFX, MX, EX series) and...  ...configuration (Python, Jinja2). Software development experience is a... 
    Software
    Hourly pay
    Daily paid
    Full time
    Contract work
    Temporary work
    Flexible hours

    Tesla

    Fremont, CA
    1 day ago
  • $38 - $41 per hour

     ...Consulting, Digital Product Engineering, Digital Workplace Services,...  ..., and upgrading hardware and software as needed. This role requires...  ...business operations. IT Support staff work in a dynamic, fast-paced...  ...with IT policies, including data protection and confidentiality... 
    Software
    Hourly pay
    Full time
    Temporary work
    Work at office
    Local area
    Remote work
    Worldwide

    Milestone Technologies, Inc.

    Fremont, CA
    2 days ago
  •  ...Description Job Description Title: Senior AI Platform Engineer Location: New York City, NY/Hybrid...  ...The ideal candidate combines strong software engineering fundamentals with practical...  ..., logging/monitoring, rate limits, data-access controls). Work with cross-... 
    Software

    InterSources Inc.

    Fremont, CA
    24 days ago
  • $90k - $120k

     ...is an IT infrastructure and engineering company that designs, manufactures...  ...with reliable, scalable platforms.We are looking for a skilled...  ...servers across multi-vendor data center hardware. You will focus...  ...Manage system services and handle software packages.Networking & Host... 
    Software
    Local area

    TruVoice from Corporate Visions (Formerly Primary Intelligen...

    Fremont, CA
    3 days ago
  • $164.6k - $241.45k

     ...proprietary technology and software-defined vehicle...  ...sustainability, design and engineering, ambition and integrity...  ...the future of mobility.Staff Software Development Engineer In Test, Platform SoftwareWe are seeking...  ...Careers website.Candidate Data Privacy: By submitting... 
    Software
    Hourly pay

    Lucid Motors

    Newark, CA
    1 day ago
  • $160k - $220k

     ...leading Industrial AI autonomy platform, helping customers across...  ...contextualizes and connects operational data across siloed systems,...  ...avathon.comWe are hiring an Engineering Lead to build the core of the...  ...'ll Have8+ years of software engineering experience, including... 
    Software
    Work at office
    Local area

    Avathon

    Pleasanton, CA
    19 hours ago
  •  ...with unparalleled accuracy and stability. Our staff includes physicists and engineers with expertise covering a wide array of disciplines...  ..., and rf electronics Basic knowledge of data acquisition and simulation software such as MATLAB, LabVIEW, Visual Basic, Python,... 
    Software
    Permanent employment
    Local area
    Shift work

    AOSense

    Fremont, CA
    4 days ago
  • $179.4k - $263.12k

     ...proprietary technology and software-defined vehicle...  ...sustainability, design and engineering, ambition and integrity...  ...the future of mobility.Staff Embedded Software Engineer – AUTOSAR, Platform SoftwareAt our cutting-...  ...interpreting schematics and data sheetsExperience with... 
    Software
    Hourly pay

    Lucid Motors

    Newark, CA
    3 days ago
  • $175.4k - $263.2k

     ...500 company and a leading AI platform for managing people, money, and...  ...launched the Enterprise Data and Analytics (ED&A) team with...  ...the RoleAs a Principal DataOps Engineer (P5), you serve as a preeminent...  ...directly into our master software continuous delivery pipelinesAI... 
    Software
    Full time
    Work at office
    Remote work
    Home office
    Flexible hours

    Workday

    Pleasanton, CA
    2 days ago
  •  ...maintainable applications. Experience in data mapping and migration of data from legacy...  ...SaaS applications using integration platforms. Designing and implement solutions that...  ...Experience in integration of other enterprise software systems such as Chorus, Gainsight,... 
    Software

    Relanto

    Fremont, CA
    2 days ago
  • $92k - $211k

     ...applications and AI-enabled solutions, and support engineering teams in delivering secure software with appropriate controls for data, access, AI model usage, logging, and human...  ...scanning, or vulnerability management platforms.Basic understanding of CI/CD pipelines and developer... 
    Software
    Work experience placement
    Local area
    Remote work
    Flexible hours
    2 days per week
    3 days per week
    1 day per week

    Lam Research Corporation

    Fremont, CA
    1 day ago
  • $120k - $162k

     ...Description\n The IT Systems Engineer provides services to employees...  ...; manages client systems and software life cycles; acts as an...  ...Mentor Penumbra’s IT support staff \n • Maintain effective relationships...  ...or Python, for cross-platform tasks). \n • Excellent troubleshooting... 
    Software
    Temporary work
    Work at office
    Local area
    Remote work

    Penumbra

    Fremont, CA
    1 day ago
  • $140k - $180k

     ...Software Quality Assurance Engineer DTEX is seeking an experienced Software Quality Assurance Engineer with...  ...security across complex software platforms. What you will do: Develop...  ...including AI-driven automation and data-centric testing ~ Exposure to big... 
    Software
    Remote work
    Worldwide

    Dtex Systems

    Fremont, CA
    4 days ago
  • $175k - $274k

     ...and years of proven deployment data, we're pioneering a new era...  ...human environments. The Data Platform team builds the data infrastructure...  ...machine learning. We enable engineers across robotics, perception,...  ...Do Collaborate with robot software and hardware teams to define,... 
    Software
    Full time
    Temporary work
    Remote work
    Relocation package
    Flexible hours

    Agility Robotics

    Fremont, CA
    18 days ago
  •  ...has a client that is seeking a Senior Software Development Engineer in Test (SDET)/QA Automation Engineer...  ...* Write complex SQL queries for data validation, troubleshooting, and backend...  ...* Docker and Kubernetes * Cloud platforms such as AWS, Azure, or Google Cloud Platform... 
    Software
    Hourly pay
    Contract work

    Kforce Technology Staffing

    Fremont, CA
    19 hours ago
  •  ...revolutionizing power for AI-driven data centers to ensuring...  ...century. We are looking for a Staff Data Engineer to join our team in one of...  ...self-service analytics.Develop software and automation tools in...  ...with Ignition and Sepasoft MES platforms.Experience with source control... 
    Software
    Full time
    Work at office
    Worldwide

    Bloom Energy

    Fremont, CA
    3 days ago
  • $90k - $125k

     ...Overview Hyve Solutions transforms complex engineering challenges into production reality...  ...existing MRP/ERP systems, software applications, and data flows to ensure they effectively support...  ...implement system enhancements, APIs, or new platform integrations.3. Requirements... 
    Software
    Full time
    Flexible hours

    Hyve Solutions

    Fremont, CA
    4 days ago
  •  ...finalize designs using Adobe Creative Suite and other relevant software. Ensure designs align with brand standards and meet all...  ...in managing tasks and projects. Familiarity with social media platforms and internet-savvy. Bachelor’s degree in Design or a related... 
    Software
    Flexible hours

    Bay Central Printing

    Union City, CA
    1 day ago
  • $101.66k

     ...tool, it's your playground. Our engineers work on scalable systems, cloud services...  ...to developing ground breaking software and devices that change entire...  ...an experienced cross-disciplinary staff to provide full life-cycle support to AWS Data Centers from design inception... 
    Software
    Full time
    Summer work
    Internship
    Local area
    Relocation
    Monday to Friday

    Amazon

    Hayward, CA
    1 day ago
  • $102k - $115k

     ...Description:Forward Deployed Engineer (AI)Onsite - Fremont, CaliforniaThis...  ...requires a combination of software engineering, product thinking...  ...AI solutions with enterprise platforms including Microsoft 365,...  ...Science, Software Engineering, Data Science, or a related... 
    Software
    Full time
    Remote work
    Worldwide
    Relocation package

    Nextracker

    Fremont, CA
    2 days ago
  • $120k - $180k

     ...improvements suggestions based on fleet data and known field returns for...  ...organizations. The engineer must be extremely organized,...  ...Science, Information Systems, Software Engineering or equivalent experience...  ...and data visualization platforms like Tableau, Power BIProficiency... 
    Software
    Hourly pay
    Daily paid
    Full time
    Temporary work
    Flexible hours

    Tesla

    Fremont, CA
    1 day ago
  • $197k - $307k

     ...years of proven deployment data, we're pioneering a new...  ...the machine learning platform to power fleet-scale...  ...robotics. As a senior engineer on the ML Infrastructure...  ...Work closely with the Staff ML Infra Engineer and cross...  ...~5+ years of software engineering experience,... 
    Software
    Full time
    Temporary work
    Remote work
    Relocation package
    Flexible hours

    Agility Robotics

    Fremont, CA
    8 days ago
  • $85k - $100k

     ...density storage devices, our solutions are engineered to meet the demanding needs of today's...  ...for procurement business system data input and integrity and cost control in...  ...Technology: # Document and presentation software: Microsoft Word, Excel, Power Point, Adobe... 
    Software

    Unigen

    Newark, CA
    9 days ago
  • $176k - $264k

     ...500 company and a leading AI platform for managing people, money, and...  ...IPE (Infrastructure Platform Engineering) organization and our...  ...impact.About the RoleAs a Senior Software Engineer on this team, you'll...  ...hit the messy parts (stateful data, IAM rewiring, DNS, secrets,... 
    Software
    Full time
    Work at office
    Remote work
    Home office
    Flexible hours

    Workday

    Pleasanton, CA
    3 days ago
  • $24 - $28 per hour

     ...environment Troubleshoot hardware, software, and network issues across...  ...with IT infrastructure and engineering teams Requirements: ~3-...  ...Solutions' Temporary Staff are not eligible for paid time...  ...may vary. Standard message and data rates may apply depending on... 
    Software
    Temporary work
    Local area
    Remote work
    Shift work

    Eastridge Workforce Solutions

    Fremont, CA
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer - Data Platform (Staff). Be the first to apply!