Software Engineer - Data Platform (Staff)
$195k - $300kDeterrence Defense
Software Engineer – Data Platform (Staff) – San Francisco Bay Area
Summary
Deterrence builds autonomous production lines for energetics and munitions. Those lines generate process data that cannot be bought or synthesized: millions of signals per facility, tied to individual parts, kept as quality evidence for decades and used to train our models. The Staff Data Platform Engineer owns how that data moves from the factory edge into AWS GovCloud, how it is kept permanently, and how people and models read it: a complete, never-deleted lakehouse record on one path, and a sub-second live feed for line and customer dashboards on the other. The ideal candidate has run production data infrastructure where losing or mislabeling data was not an option, treats correctness and tenant isolation as properties to be tested rather than assumed, and wants their work to be the system of record for real factories.
Key Responsibilities
• Own the data and telemetry architecture end to end: the bulk path from edge historians to an S3 and Apache Iceberg lake, and the serving path from MQTT to a low-latency search store and live dashboards.
• Build edge-to-cloud export that survives outages: durable edge buffers, export–confirm–delete semantics, idempotent landing, backlog replay, and disk guards, so that a cloud outage never stops a production cell.
• Run the lakehouse: raw-to-Iceberg conversion, partitioning by tenant and date, compaction and snapshot maintenance, schema evolution, storage tiering, and audited purges in a store whose default is never delete.
• Own signal identity and data contracts: a registry that gives every signal a stable ID, unit and conversion; source-time semantics; clock-drift detection; and canaries that prove the live and historical views agree.
• Make multi-tenant isolation provable across index aliases, IAM prefix policies and PostgreSQL row-level security, with CI tests that fail if one customer can read another's data.
• Deliver the datasets the business runs on: SQL that joins process telemetry to part genealogy for quality investigations, training and feature datasets for ML, and cost-bounded summaries for dashboards.
• Bring inspection results, images and video into the same record, correlated to the machine jobs and parts that produced them.
• Measure before scaling: signal change rates, historian and edge-buffer capacity, and per-tenant query cost, turned into capacity and cost models.
• Write and review the architecture decision records for each data component, mentor engineers, and lead technical work across the edge, controls, traceability and front-end teams.
Qualifications
• Bachelor's degree in Computer Science, Computer Engineering or a related field, or equivalent experience.
• 8+ years building production data infrastructure or distributed systems, including on-call ownership and recovery of a system where data loss was unacceptable.
• Deep hands-on experience with a lakehouse table format (Iceberg, Delta Lake or Hudi) on object storage: partitioning, compaction, snapshot management, schema evolution and row-level deletes.
• Strong production Python and advanced SQL; comfortable in a second language (Go, Rust, TypeScript, Java or Scala).
• Time-series data at scale: high cardinality, late and out-of-order data, bucketing and downsampling, source time versus arrival time.
• Distributed-systems correctness in practice: idempotence, retries, replay, backpressure, at-least-once delivery with de-duplication, and durable buffering over unreliable links.
• Hands-on AWS data services (S3, Athena, Glue, IAM) and operation of OpenSearch or Elasticsearch: index and shard design, aliases, refresh tuning.
• PostgreSQL depth: partitioning, row-level security, query performance.
• Infrastructure as code (Terraform or CDK) and CI/CD for data pipelines.
Level Expectations
This is a Staff role. You own the data architecture across edge and cloud, approve the design of every data component, set the standards for data contracts, retention and isolation testing, and are accountable for the platform's correctness and cost. You lead multi-team initiatives and raise the bar for the engineers around you.
Your First Year
• Measure real change rates and historian capacity on a production cell, and size the platform from the result.
• Stand up the lake with tenant isolation enforced and tested, and answer the query it exists for: what was this cell doing while this serial number was being made?
• Ship the signal registry, so that the live and historical views of every selected signal show the same series.
Preferred Skills
• AWS GovCloud or other regulated environments: ITAR, CUI, NIST 800-171, CMMC or FedRAMP.
• Multi-tenant data platforms with server-side isolation.
• ML data infrastructure: training datasets, feature pipelines, SageMaker or similar.
• Streaming at scale (Kinesis, Kafka or MQTT) and edge or intermittently connected systems (AWS IoT Core, Greengrass).
• Manufacturing, quality or traceability data; hardware-adjacent domains.
• Cost engineering of data platforms: knowing what a query, a message and a stored byte cost, and designing to it.
How We Build
Our data platform is AWS-native by design: in GovCloud we add no third-party data software, and the platform only reads from the plant, never writes to it. If your experience centers on Snowflake or Databricks, expect to build the equivalent on S3, Iceberg, Athena and OpenSearch, and to own the parts a managed vendor would normally run for you.
Compensation. The base salary range for this position is $195,000 – $300,000. This is a good-faith estimate; actual base pay depends on job-related knowledge, skills, experience, and level. This role is also eligible for equity (employee stock options) and benefits including medical, dental, vision, 401(k), and paid time off. Roles with significant travel may be eligible for an assignment premium.
Export Control. This position may require access to information controlled under the International Traffic in Arms Regulations (ITAR) or Export Administration Regulations (EAR). Applicants must be a U.S. person as defined in 22 CFR 120.62 (U.S. citizen, lawful permanent resident, or protected individual) or be eligible to obtain any required authorization.
Equal Opportunity. Deterrence Defense, Inc. is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other characteristic protected by law. We are committed to working with and providing reasonable accommodations to applicants with disabilities; if you need an accommodation at any point in the process, contact View email address on us.fitly.work.
$191k - $299k
...safety standards and years of proven deployment data, we're pioneering a new era of automation that... ...Join the cutting-edge team building the data platform that powers fleet-scale humanoid robotics. As a Staff Software Engineer on our Data Platform team, you will play a...SoftwareFull timeTemporary workRemote workRelocation packageFlexible hours$240k - $280k
...Solutions transforms complex engineering challenges into production reality... ...rack-scale infrastructure platforms.Establish validation... ...planning across hardware, firmware, software, and system integration domains... ...automation frameworks and data analytics.Experience in customer...SoftwareFull timeFlexible hours- Job Description: Data Platform Engineer Job Title: Data Platform Engineer Location: Remote, USA Job Type: Full-Time Experience Required: 5... ...standards. You will collaborate with data engineers, analysts, software teams, and platform stakeholders to ensure that the data...SoftwareFull timeRemote work
$149.8k - $262.2k
...Company Description It all started when engineer Fred Luddy wrote code that... ...business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow— helping 85% of... ...team: We are seeking a Senior Staff Software Engineer (IC5 Level) to join our...SoftwarePermanent employmentFull timeWork experience placementWork at officeImmediate startRemote workFlexible hours2 days per week$188.4k - $276.32k
...s proprietary technology and software-defined vehicle architecture,... ...and sustainability, design and engineering, ambition and integrity. In... ...future of mobility.The ADAS Data Infrastructure team builds and... ...development. We create scalable platforms, services, and data pipelines...SoftwareHourly pay$168k - $300k
...an experienced Senior Network Engineer to drive network refresh and... ...infrastructure operations across data center environments. This... ...Extensive experience with Juniper platforms (QFX, MX, EX series) and... ...configuration (Python, Jinja2). Software development experience is a...SoftwareHourly payDaily paidFull timeContract workTemporary workFlexible hours$38 - $41 per hour
...Consulting, Digital Product Engineering, Digital Workplace Services,... ..., and upgrading hardware and software as needed. This role requires... ...business operations. IT Support staff work in a dynamic, fast-paced... ...with IT policies, including data protection and confidentiality...SoftwareHourly payFull timeTemporary workWork at officeLocal areaRemote workWorldwide- ...Description Job Description Title: Senior AI Platform Engineer Location: New York City, NY/Hybrid... ...The ideal candidate combines strong software engineering fundamentals with practical... ..., logging/monitoring, rate limits, data-access controls). Work with cross-...Software
$90k - $120k
...is an IT infrastructure and engineering company that designs, manufactures... ...with reliable, scalable platforms.We are looking for a skilled... ...servers across multi-vendor data center hardware. You will focus... ...Manage system services and handle software packages.Networking & Host...SoftwareLocal area$164.6k - $241.45k
...proprietary technology and software-defined vehicle... ...sustainability, design and engineering, ambition and integrity... ...the future of mobility.Staff Software Development Engineer In Test, Platform SoftwareWe are seeking... ...Careers website.Candidate Data Privacy: By submitting...SoftwareHourly pay$160k - $220k
...leading Industrial AI autonomy platform, helping customers across... ...contextualizes and connects operational data across siloed systems,... ...avathon.comWe are hiring an Engineering Lead to build the core of the... ...'ll Have8+ years of software engineering experience, including...SoftwareWork at officeLocal area- ...with unparalleled accuracy and stability. Our staff includes physicists and engineers with expertise covering a wide array of disciplines... ..., and rf electronics Basic knowledge of data acquisition and simulation software such as MATLAB, LabVIEW, Visual Basic, Python,...SoftwarePermanent employmentLocal areaShift work
$179.4k - $263.12k
...proprietary technology and software-defined vehicle... ...sustainability, design and engineering, ambition and integrity... ...the future of mobility.Staff Embedded Software Engineer – AUTOSAR, Platform SoftwareAt our cutting-... ...interpreting schematics and data sheetsExperience with...SoftwareHourly pay$175.4k - $263.2k
...500 company and a leading AI platform for managing people, money, and... ...launched the Enterprise Data and Analytics (ED&A) team with... ...the RoleAs a Principal DataOps Engineer (P5), you serve as a preeminent... ...directly into our master software continuous delivery pipelinesAI...SoftwareFull timeWork at officeRemote workHome officeFlexible hours- ...maintainable applications. Experience in data mapping and migration of data from legacy... ...SaaS applications using integration platforms. Designing and implement solutions that... ...Experience in integration of other enterprise software systems such as Chorus, Gainsight,...Software
$92k - $211k
...applications and AI-enabled solutions, and support engineering teams in delivering secure software with appropriate controls for data, access, AI model usage, logging, and human... ...scanning, or vulnerability management platforms.Basic understanding of CI/CD pipelines and developer...SoftwareWork experience placementLocal areaRemote workFlexible hours2 days per week3 days per week1 day per week$120k - $162k
...Description\n The IT Systems Engineer provides services to employees... ...; manages client systems and software life cycles; acts as an... ...Mentor Penumbra’s IT support staff \n • Maintain effective relationships... ...or Python, for cross-platform tasks). \n • Excellent troubleshooting...SoftwareTemporary workWork at officeLocal areaRemote work$140k - $180k
...Software Quality Assurance Engineer DTEX is seeking an experienced Software Quality Assurance Engineer with... ...security across complex software platforms. What you will do: Develop... ...including AI-driven automation and data-centric testing ~ Exposure to big...SoftwareRemote workWorldwide$175k - $274k
...and years of proven deployment data, we're pioneering a new era... ...human environments. The Data Platform team builds the data infrastructure... ...machine learning. We enable engineers across robotics, perception,... ...Do Collaborate with robot software and hardware teams to define,...SoftwareFull timeTemporary workRemote workRelocation packageFlexible hours- ...has a client that is seeking a Senior Software Development Engineer in Test (SDET)/QA Automation Engineer... ...* Write complex SQL queries for data validation, troubleshooting, and backend... ...* Docker and Kubernetes * Cloud platforms such as AWS, Azure, or Google Cloud Platform...SoftwareHourly payContract work
- ...revolutionizing power for AI-driven data centers to ensuring... ...century. We are looking for a Staff Data Engineer to join our team in one of... ...self-service analytics.Develop software and automation tools in... ...with Ignition and Sepasoft MES platforms.Experience with source control...SoftwareFull timeWork at officeWorldwide
$90k - $125k
...Overview Hyve Solutions transforms complex engineering challenges into production reality... ...existing MRP/ERP systems, software applications, and data flows to ensure they effectively support... ...implement system enhancements, APIs, or new platform integrations.3. Requirements...SoftwareFull timeFlexible hours- ...finalize designs using Adobe Creative Suite and other relevant software. Ensure designs align with brand standards and meet all... ...in managing tasks and projects. Familiarity with social media platforms and internet-savvy. Bachelor’s degree in Design or a related...SoftwareFlexible hours
$101.66k
...tool, it's your playground. Our engineers work on scalable systems, cloud services... ...to developing ground breaking software and devices that change entire... ...an experienced cross-disciplinary staff to provide full life-cycle support to AWS Data Centers from design inception...SoftwareFull timeSummer workInternshipLocal areaRelocationMonday to Friday$102k - $115k
...Description:Forward Deployed Engineer (AI)Onsite - Fremont, CaliforniaThis... ...requires a combination of software engineering, product thinking... ...AI solutions with enterprise platforms including Microsoft 365,... ...Science, Software Engineering, Data Science, or a related...SoftwareFull timeRemote workWorldwideRelocation package$120k - $180k
...improvements suggestions based on fleet data and known field returns for... ...organizations. The engineer must be extremely organized,... ...Science, Information Systems, Software Engineering or equivalent experience... ...and data visualization platforms like Tableau, Power BIProficiency...SoftwareHourly payDaily paidFull timeTemporary workFlexible hours$197k - $307k
...years of proven deployment data, we're pioneering a new... ...the machine learning platform to power fleet-scale... ...robotics. As a senior engineer on the ML Infrastructure... ...Work closely with the Staff ML Infra Engineer and cross... ...~5+ years of software engineering experience,...SoftwareFull timeTemporary workRemote workRelocation packageFlexible hours$85k - $100k
...density storage devices, our solutions are engineered to meet the demanding needs of today's... ...for procurement business system data input and integrity and cost control in... ...Technology: # Document and presentation software: Microsoft Word, Excel, Power Point, Adobe...Software$176k - $264k
...500 company and a leading AI platform for managing people, money, and... ...IPE (Infrastructure Platform Engineering) organization and our... ...impact.About the RoleAs a Senior Software Engineer on this team, you'll... ...hit the messy parts (stateful data, IAM rewiring, DNS, secrets,...SoftwareFull timeWork at officeRemote workHome officeFlexible hours$24 - $28 per hour
...environment Troubleshoot hardware, software, and network issues across... ...with IT infrastructure and engineering teams Requirements: ~3-... ...Solutions' Temporary Staff are not eligible for paid time... ...may vary. Standard message and data rates may apply depending on...SoftwareTemporary workLocal areaRemote workShift work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer - Data Platform (Staff). Be the first to apply!
- senior software design engineer Fremont, CA
- software web developer Fremont, CA
- senior software engineer Fremont, CA
- software developer fintech Fremont, CA
- senior software engineer ruby on rails Fremont, CA
- intel software engineer Fremont, CA
- graduate software developer no experience Fremont, CA
- software developer positions Fremont, CA
- software development engineer aws Fremont, CA
- junior software developer remote Fremont, CA






