Software Engineer - Data Platform (Staff)
$195k - $300kDeterrence Defense, Inc.
Software Engineer – Data Platform (Staff) – San Francisco Bay Area
Summary
Deterrence builds autonomous production lines for energetics and munitions. Those lines generate process data that cannot be bought or synthesized: millions of signals per facility, tied to individual parts, kept as quality evidence for decades and used to train our models. The Staff Data Platform Engineer owns how that data moves from the factory edge into AWS GovCloud, how it is kept permanently, and how people and models read it: a complete, never-deleted lakehouse record on one path, and a sub-second live feed for line and customer dashboards on the other. The ideal candidate has run production data infrastructure where losing or mislabeling data was not an option, treats correctness and tenant isolation as properties to be tested rather than assumed, and wants their work to be the system of record for real factories.
Key Responsibilities
• Own the data and telemetry architecture end to end: the bulk path from edge historians to an S3 and Apache Iceberg lake, and the serving path from MQTT to a low-latency search store and live dashboards.
• Build edge-to-cloud export that survives outages: durable edge buffers, export–confirm–delete semantics, idempotent landing, backlog replay, and disk guards, so that a cloud outage never stops a production cell.
• Run the lakehouse: raw-to-Iceberg conversion, partitioning by tenant and date, compaction and snapshot maintenance, schema evolution, storage tiering, and audited purges in a store whose default is never delete.
• Own signal identity and data contracts: a registry that gives every signal a stable ID, unit and conversion; source-time semantics; clock-drift detection; and canaries that prove the live and historical views agree.
• Make multi-tenant isolation provable across index aliases, IAM prefix policies and PostgreSQL row-level security, with CI tests that fail if one customer can read another's data.
• Deliver the datasets the business runs on: SQL that joins process telemetry to part genealogy for quality investigations, training and feature datasets for ML, and cost-bounded summaries for dashboards.
• Bring inspection results, images and video into the same record, correlated to the machine jobs and parts that produced them.
• Measure before scaling: signal change rates, historian and edge-buffer capacity, and per-tenant query cost, turned into capacity and cost models.
• Write and review the architecture decision records for each data component, mentor engineers, and lead technical work across the edge, controls, traceability and front-end teams.
Qualifications
• Bachelor's degree in Computer Science, Computer Engineering or a related field, or equivalent experience.
• 8+ years building production data infrastructure or distributed systems, including on-call ownership and recovery of a system where data loss was unacceptable.
• Deep hands-on experience with a lakehouse table format (Iceberg, Delta Lake or Hudi) on object storage: partitioning, compaction, snapshot management, schema evolution and row-level deletes.
• Strong production Python and advanced SQL; comfortable in a second language (Go, Rust, TypeScript, Java or Scala).
• Time-series data at scale: high cardinality, late and out-of-order data, bucketing and downsampling, source time versus arrival time.
• Distributed-systems correctness in practice: idempotence, retries, replay, backpressure, at-least-once delivery with de-duplication, and durable buffering over unreliable links.
• Hands-on AWS data services (S3, Athena, Glue, IAM) and operation of OpenSearch or Elasticsearch: index and shard design, aliases, refresh tuning.
• PostgreSQL depth: partitioning, row-level security, query performance.
• Infrastructure as code (Terraform or CDK) and CI/CD for data pipelines.
Level Expectations
This is a Staff role. You own the data architecture across edge and cloud, approve the design of every data component, set the standards for data contracts, retention and isolation testing, and are accountable for the platform's correctness and cost. You lead multi-team initiatives and raise the bar for the engineers around you.
Your First Year
• Measure real change rates and historian capacity on a production cell, and size the platform from the result.
• Stand up the lake with tenant isolation enforced and tested, and answer the query it exists for: what was this cell doing while this serial number was being made?
• Ship the signal registry, so that the live and historical views of every selected signal show the same series.
Preferred Skills
• AWS GovCloud or other regulated environments: ITAR, CUI, NIST 800-171, CMMC or FedRAMP.
• Multi-tenant data platforms with server-side isolation.
• ML data infrastructure: training datasets, feature pipelines, SageMaker or similar.
• Streaming at scale (Kinesis, Kafka or MQTT) and edge or intermittently connected systems (AWS IoT Core, Greengrass).
• Manufacturing, quality or traceability data; hardware-adjacent domains.
• Cost engineering of data platforms: knowing what a query, a message and a stored byte cost, and designing to it.
How We Build
Our data platform is AWS-native by design: in GovCloud we add no third-party data software, and the platform only reads from the plant, never writes to it. If your experience centers on Snowflake or Databricks, expect to build the equivalent on S3, Iceberg, Athena and OpenSearch, and to own the parts a managed vendor would normally run for you.
Compensation. The base salary range for this position is $195,000 – $300,000. This is a good-faith estimate; actual base pay depends on job-related knowledge, skills, experience, and level. This role is also eligible for equity (employee stock options) and benefits including medical, dental, vision, 401(k), and paid time off. Roles with significant travel may be eligible for an assignment premium.
Export Control. This position may require access to information controlled under the International Traffic in Arms Regulations (ITAR) or Export Administration Regulations (EAR). Applicants must be a U.S. person as defined in 22 CFR 120.62 (U.S. citizen, lawful permanent resident, or protected individual) or be eligible to obtain any required authorization.
Equal Opportunity. Deterrence Defense, Inc. is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, veteran status, or any other characteristic protected by law. We are committed to working with and providing reasonable accommodations to applicants with disabilities; if you need an accommodation at any point in the process, contact View email address on us.fitly.work.
$191k - $299k
...safety standards and years of proven deployment data, we're pioneering a new era of automation that... ...Join the cutting-edge team building the data platform that powers fleet-scale humanoid robotics. As a Staff Software Engineer on our Data Platform team, you will play a...SoftwareFull timeTemporary workRemote workRelocation packageFlexible hours$149.8k - $262.2k
...Company Description It all started when engineer Fred Luddy wrote code that... ...business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow— helping 85% of... ...About the team: We are seeking a Staff Software Engineer (IC4 Level) to join our...SoftwarePermanent employmentFull timeWork experience placementWork at officeImmediate startRemote workFlexible hours2 days per week$149.8k - $262.2k
...Company Description It all started when engineer Fred Luddy wrote code that... ...business reinvention. Our ServiceNow AI platform brings together any AI, any data, and any workflow— helping 85% of... ...team: We are seeking a Senior Staff Software Engineer (IC5 Level) to join our...SoftwarePermanent employmentFull timeWork experience placementWork at officeImmediate startRemote workFlexible hours2 days per week- ...DescriptionJob Description Title: Data Governance Analyst (807900)... ...Architecture, Data Engineers, Project Teams, and Information... ...data ingested into the AWS Data Platform and consumed through Snowflake... ...are an Award-Winning Global Software Consultancy solving complex problems...SoftwareWork at office
- ...Description Job Description Title: Senior AI Platform Engineer Location: New York City, NY/Hybrid... ...The ideal candidate combines strong software engineering fundamentals with practical... ..., logging/monitoring, rate limits, data-access controls). Work with cross-...Software
$188.4k - $276.32k
...s proprietary technology and software-defined vehicle architecture,... ...and sustainability, design and engineering, ambition and integrity. In... ...future of mobility.The ADAS Data Infrastructure team builds and... ...development. We create scalable platforms, services, and data pipelines...SoftwareHourly pay$38 - $41 per hour
...Consulting, Digital Product Engineering, Digital Workplace Services,... ..., and upgrading hardware and software as needed. This role requires... ...business operations. IT Support staff work in a dynamic, fast-paced... ...with IT policies, including data protection and confidentiality...SoftwareHourly payFull timeTemporary workWork at officeLocal areaRemote workWorldwide$140k - $170k
...is an IT infrastructure and engineering company that designs, manufactures... ...with reliable, scalable platforms. In this role, you will help... ...standards Analyze business data and metrics to measure the effectiveness... ...vendors, consultants, and software providers Prepare project...SoftwareFlexible hours- ...with unparalleled accuracy and stability. Our staff includes physicists and engineers with expertise covering a wide array of disciplines... ..., and rf electronics Basic knowledge of data acquisition and simulation software such as MATLAB, LabVIEW, Visual Basic, Python,...SoftwarePermanent employmentLocal areaShift work
$130k - $185k
...together the best scientists, engineers, and operators from the... ...core of our experimental fusion platform. This role is deeply hands‑on... ..., controls, diagnostics, and data analysis. The ideal candidate... ...design, control systems, and PLC software development. Experience with...SoftwareCasual work$73.54 per hour
...Job Title: Simulation Engineer Location: Fremont, CA Employment Type... ...process, manufacturing, and data science teams to drive design... ...process development, controls, software, and data science Long‑term... ...experience utilizing simulation platforms such as ANSYS Fluent, ANSYS...SoftwareContract workMonday to Friday- ...has a client that is seeking a Senior Software Development Engineer in Test (SDET)/QA Automation Engineer... ...* Write complex SQL queries for data validation, troubleshooting, and backend... ...* Docker and Kubernetes * Cloud platforms such as AWS, Azure, or Google Cloud Platform...SoftwareHourly payContract work
- ...About us: We are an IT staffing/placement and software development firm specialized in Java/J2ee / Mean stack/ full stack/Data science and cloud computing domain & providing technically skilled and competent candidates to clients in Northern America and Canada since...SoftwareFull time
- Akraya is seeking a Software QA Engineer in Fremont, CA to develop automated test environments and drive quality across applications including... ...Responsibilities include building automated test suites, test data, and executing functional, integration, and regression tests...Software
$101.66k
...tool, it's your playground. Our engineers work on scalable systems, cloud services... ...to developing ground breaking software and devices that change entire... ...an experienced cross-disciplinary staff to provide full life-cycle support to AWS Data Centers from design inception...SoftwareFull timeSummer workInternshipLocal areaRelocationMonday to Friday- ...density storage devices, our solutions are engineered to meet the demanding needs of today's... ...for procurement business system data input and integrity and cost control in... ...Technology Document and presentation software: Microsoft Word, Excel, Power Point, Adobe...Software
$222.9k - $334.3k
...500 company and a leading AI platform for managing people, money, and... ...for you too.About the TeamThe Data Cloud organization is at the forefront... ...we are building the critical engine that will power the future of... ...customerAre passionate about software development and think and code...SoftwareFull timeWork at officeRemote workHome officeFlexible hours- ...finalize designs using Adobe Creative Suite and other relevant software. Ensure designs align with brand standards and meet all... ...in managing tasks and projects. Familiarity with social media platforms and internet-savvy. Bachelor’s degree in Design or a related...SoftwareFlexible hours
- ...was founded in 2007 providing intelligent data solutions to clients across industries... ...products on Business Intelligence & Big Data platform simplifying and transforming the way... ...empowers Corporations and end users using Softwares liek Tableau,Business Objects, MicroStrategy...Software
$164.6k - $241.45k
...proprietary technology and software-defined vehicle... ...sustainability, design and engineering, ambition and integrity... ...the future of mobility.Staff Software Development Engineer In Test, Platform SoftwareWe are seeking... ...Careers website.Candidate Data Privacy: By submitting...SoftwareHourly pay$160k - $220k
...leading Industrial AI autonomy platform, helping customers across... ...contextualizes and connects operational data across siloed systems,... ...avathon.comWe are hiring an Engineering Lead to build the core of the... ...'ll Have8+ years of software engineering experience, including...SoftwareWork at officeLocal area$24 - $28 per hour
...support in a corporate environment Troubleshoot hardware, software, and network issues across Windows, macOS, and Linux systems... ...knowledge base articles Collaborate with IT infrastructure and engineering teams Requirements: ~34+ years of strong Help Desk /...SoftwareTemporary workRemote workShift work$75k - $85k
...recommend improvements. They communicate effectively with headquarters staff, the sales team, customer support, production, quality, and... ...experience with NetSuite and/or Salesforce (or similar ERP/CRM software). Medium to high proficiency in Excel, plus Microsoft Office (...SoftwareFull timeWork at officeFlexible hours$175.4k - $263.2k
...500 company and a leading AI platform for managing people, money, and... ...launched the Enterprise Data and Analytics (ED&A) team with... ...the RoleAs a Principal DataOps Engineer (P5), you serve as a preeminent... ...directly into our master software continuous delivery pipelinesAI...SoftwareFull timeWork at officeRemote workHome officeFlexible hours$179.4k - $263.12k
...proprietary technology and software-defined vehicle... ...sustainability, design and engineering, ambition and integrity... ...the future of mobility.Staff Embedded Software Engineer – AUTOSAR, Platform SoftwareAt our cutting-... ...interpreting schematics and data sheetsExperience with...SoftwareHourly pay- ...building, testing, troubleshooting complex software controlled electro-mechanical sensing... ...provide complete documentation to the SAP data steward. Plan and coordinate preventive and... ...established procedures. Support Quality Engineers in issuing and tracking quality alerts by...Software
$75 - $90 per hour
...a complex flow of financial data, and an opportunity to make the... ...You'll partner directly with Engineering and Finance to turn manual... ...to a production orchestration platform. Implement scheduling, monitoring... ...: 5+ years of relevant software engineering, data engineering...SoftwareHourly payContract workLocal areaRemote work- ...Qualifications: ~ Bachelor’s degree in electrical engineering. ~5 + years of large high speed FPGA... ...Capture RAM (ECR) block and the ECR data transfer block to move the data to the... ...with the hardware design team and the software team to assist bring-up and driver...Software
- ...robots as easy to build and deploy as software. Today, robotics is fragmented,... ..., delivering a plug-and-play platform for developers, researchers, and... ...We are looking for a Software Engineer to build the infrastructure that powers data, models, and AI runtime across Dexmate...SoftwareFull time
$3,000 - $6,000 per month
A Silicon Valley medical device startup is seeking a Full Stack Software Engineer to design and maintain backend services for medical AI applications. The ideal candidate will have at least 2 years of experience, with strong skills in Python and Go. This role offers a contract...SoftwareFull timeContract work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Software Engineer - Data Platform (Staff). Be the first to apply!
- software engineer internship remote Fremont, CA
- software engineer remote Fremont, CA
- graduate software developer no experience Fremont, CA
- work from home software developer Fremont, CA
- information technology software engineer Fremont, CA
- senior software engineer remote Fremont, CA
- junior software developer remote Fremont, CA
- software engineer travel Fremont, CA
- startup software engineer Fremont, CA
- senior software design engineer Fremont, CA







