Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Software Engineer, Distributed Data Systems (IN)

$500 per month

Logoslabs

About Onehouse

Onehouse is a mission-driven company dedicated to freeing data from data platform lock-in. We deliver the industry’s most interoperable data lakehouse through a cloud-native managed service built on Apache Hudi. Onehouse enables organizations to ingest data at scale with minute-level freshness, centrally store it, and make available to any downstream query engine and use case (from traditional analytics to real-time AI / ML).

We are a team of self-driven, inspired, and seasoned builders that have created large-scale data systems and globally distributed platforms that sit at the heart of some of the largest enterprises out there including Uber, Snowflake, AWS, Linkedin, Confluent and many more. Riding off a fresh $35M Series B backed by Craft, Greylock and Addition Ventures, we're now at $68M total funding and looking for rising talent to grow with us and become future leaders of the team. Come help us build the world's best fully managed and self-optimizing data lake platform!

The Community You Will Join

When you join Onehouse, you're joining a team of passionate professionals tackling the deeply technical challenges of building a 2-sided engineering product. Our engineering team serves as the bridge between the worlds of open source and enterprise: contributing directly to and growing Apache Hudi (already used at scale by global enterprises like Uber, Amazon, ByteDance etc) and concurrently defining a new industry category - the transactional data lake. The Data Infrastructure team is the grounding heartbeat to all of this. We live and breathe databases, building cornerstone infrastructure by working under Hudi's hood to solving incredibly complex optimization and systems problems.

The Impact You Will Drive:

  • As a foundational member of the Data Infrastructure team, you will productionize the next generation of our data tech stack by building the software and data features that actually process all of the data we ingest.

  • Accelerate our open source <> enterprise flywheel by working on the guts of Apache Hudi's transactional engine and optimizing it for diverse Onehouse customer workloads.

  • Act as a SME to deepen our teams' expertise on database internals, query engines, storage and/or stream processing.

A Typical Day:

  • Design new concurrency control and transactional capabilities that maximize throughput for competing writers.

  • Design and implement new indexing schemes, specifically optimized for incremental data processing and analytical query performance.

  • Design systems that help scale and streamline metadata and data access from different query/compute engines.

  • Solve hard optimization problems to improve the efficiency (increase performance and lower cost) of distributed data processing algorithms over a Kubernetes cluster.

  • Leverage data from existing systems to find inefficiencies, and quickly build and validate prototypes.

  • Collaborate with other engineers to implement and deploy, safely rollout the optimized solutions in production.

What You Bring to the Table:

  • Strong, object-oriented design and coding skills (Java and/or C/C++ preferably on a UNIX or Linux platform).

  • Experience with inner workings of distributed (multi-tiered) systems, algorithms, and relational databases.

  • You embrace ambiguous/undefined problems with an ability to think abstractly and articulate technical challenges and solutions.

  • An ability to prioritize across feature development and tech debt with urgency and speed.

  • An ability to solve complex programming/optimization problems.

  • An ability to quickly prototype optimization solutions and analyze large/complex data.

  • Robust and clear communication skills.

  • Nice to haves (but not required):

  • Experience working with database systems, Query Engines or Spark codebases.

  • Experience in optimization mathematics (linear programming, nonlinear optimization).

  • Existing publications of optimizing large-scale data systems in top-tier distributed system conferences.

  • PhD degree with 2+ years industry experience in solving and delivering high-impact optimization projects.

How We'll Take Care of You

  • Equity Compensation; our success is your success with eligible participation in our company equity plan

  • Health & Well-being; we'll invest in your physical and mental well-being by reimbursing up to 20,000 INR for your monthly insurance premium

  • Financial Future; we'll invest in your financial well-being by making this role eligible for the provident fund of which Onehouse will contribute up to 1800 INR/month

  • Location; we are a remote-friendly company (internationally distributed across N. America + India), though some roles will be subject to in-person requirements in alignment with the needs of the business

  • Generous Time Off; unlimited PTO (mandatory 1 week/year minimum), uncapped sick days and 17 paid company holidays

  • Food & Meal Allowance; weekly lunch stipend, in-office snacks/drinks

  • Equipment; we'll provide you with the equipment you need to be successful and a one-time $500 (USD) stipend for your initial office/desk setup

  • Child Bonding!; 26 weeks off for birthing and 12 weeks for surrogate and adoptive parents - fully paid so you can focus your energy on your newest addition

House Values

One Team

Optimize for the company, your team, self - in that order. We may fight long and hard in the trenches, take care of your co-workers with empathy. We give more than we take to build the one house, that everyone dreams of being part of.

Tough & Persevering

We are building our company in a very large, fast-growing but highly competitive space. Life will get tough sometimes. We take hardships in the stride, be positive, focus all energy on the path forward and develop a champion's mindset to overcome odds. Always day one!

Keep Making It Better Always

Rome was not built in a day; If we can get 1% better each day for one year, we'll end up thirty-seven times better. This means being organized, communicating promptly, taking even small tasks seriously, tracking all small ideas, and paying it forward.

Think Big, Act Fast

We have tremendous scope for innovation, but we will still be judged by impact over time. Big, bold ideas still need to be strategized against priorities, broken down, set in rapid motion, measure, refine, repeat. Great execution is what separates promising companies from proven unicorns.

Be Customer Obsessed

Everyone has the responsibility to drive towards the best experience for the customer, be an OSS user or the paid customer. If something is broken, own it, say something, do something; never ignore. Be the change that you want to see in the company.

Pay Range Transparency

Onehouse is committed to fair and equitable compensation practices. Our job titles may span more than one career level. The pay range(s) for this role is listed above and represents the base salary range for non-commissionable roles or on-target earnings for commissionable roles. Actual compensation packages are dependent upon several factors that are unique to each candidate, including but not limited to: job-related skills, depth of transferable experience, relevant certifications and training, business needs, market demands and specific work location. Based on the factors above, Onehouse utilizes the full width of the range; the base pay range is subject to change and may be modified in the future. The total compensation package for this position will also include eligibility for equity options and the benefits listed above.

#J-18808-Ljbffr

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Software Engineer, Distributed Data Systems (IN) in San Francisco, CA vacancy
  • $166k - $225k

     ...passionate about enabling data teams to solve the world...  ...business. Founded by engineers — and customer obsessed...  ...SQL query engines. As a software engineer on the Runtime...  ...building the next generation distributed data storage and processing systems that can outperform... 
    Suggested
    Local area
    Worldwide

    DataBricks

    San Francisco, CA
    6 days ago
  •  ...lidar, radar, and sensor data. Today's data platforms (Databricks...  ...that gap. Our open-source engine, Daft, is purpose-built...  .... Your Role: As a Software Engineer on the Data Systems team, you will build key...  ...perception/robotics data, distributed storage/compute, and... 
    Suggested
    Work at office
    Flexible hours
    Night shift

    Mixpeek

    San Francisco, CA
    1 day ago
  • $295k

     ...Software Engineer - Data Aquisition (systems) | OpenAI Careers Software Engineer - Data Aquisition (systems) Foundations - San Francisco About...  ...Linux, networking, Kubernetes, provisioning, and distributed systems operations. Can write software to automate... 
    Suggested

    OpenAI

    San Francisco, CA
    1 day ago
  • $230k - $310k

     ...role You'll own Gamma's data infrastructure and architecture...  ...architecture, designing distributed systems that handle massive scale with...  ...You'll solve the hardest data engineering challenges we face while...  ...bring ~10+ years as a data or software engineer with deep expertise... 
    Suggested
    Full time
    Work at office
    Work from home

    gamma.app

    San Francisco, CA
    1 day ago
  • Artie, a San Francisco-based real-time data streaming platform, seeks a founding engineer focused on distributed systems. You'll help shape the next-gen data platform, interact with customers, and own cross-cutting infrastructure challenges. You’ll contribute across Go,... 
    Suggested

    Artie

    San Francisco, CA
    17 hours ago
  • Mixpeek is seeking a distributed systems engineer to help scale our data plane and cloud platform. You will build reliable components for vector search, storage, and metadata handling to support AI workloads at scale. You will work primarily with Rust, C++, or Zig, collaborating... 

    Mixpeek

    San Francisco, CA
    17 hours ago
  • $180k - $310k

     ...Software Engineer, Distributed Systems (Infra) We're building the creative layer for modern communication. Every month, over a billion people make presentations...  ...the role You'll build and scale the application and data infrastructure that supports 70M+ users creating... 
    Full time
    Work at office
    Work from home

    gamma.app

    San Francisco, CA
    1 day ago
  • $148.5k - $223.9k

     ...opportunities for senior software developers who want...  ...frameworks in developing distributed filesystems in an ever...  ..., mentoring junior engineers, and providing technical...  ...distributed systems at scale. - Proficiency...  ...Skills:Experience with Big-Data/ML and S3 Hands-on experience... 
    Full time
    Immediate start

    Salesforce

    San Francisco, CA
    3 days ago
  • $117.2k - $223.9k

     ...Join our team of talented engineers and help us advance the...  ...a proactive and skilled Software Security Engineer to join...  ...security, and the security of distributed and scalable distributed systems. This role requires hands...  ...how we use your personal data and your rights,... 
    Full time

    Salesforce

    San Francisco, CA
    5 days ago
  • $153k - $376k

     ...of everything we build. As a Software Engineer on our Infrastructure team,...  ...design, build, and operate the systems that power our real-time...  ...'re looking for experienced distributed systems engineers across a variety...  ..., networking, or real-time data systems, this role offers an... 
    Minimum wage
    Full time
    Local area
    Remote work
    Worldwide
    Flexible hours

    Figma

    San Francisco, CA
    3 days ago
  • $180k - $310k

     ...Software Engineer, Distributed Systems (Trust & Safety) We're building the creative layer for modern communication. Every month, over a billion people...  ..., and rate limiting; helping define and evolve the core data model and storage systems behind abuse detection; and... 
    Full time
    Work at office
    Work from home

    gamma.app

    San Francisco, CA
    1 day ago
  •  ...opportunities for senior software developers who want...  ...frameworks in developing distributed filesystems in an ever...  ..., mentoring junior engineers, and providing technical...  ...distributed systems at scale. - Proficiency...  ...Experience with Big-Data/ML and S3 Hands-on experience... 
    Immediate start

    Leadout Capital

    San Francisco, CA
    1 day ago
  • $170k - $260k

    | Software Engineer, Distributed Systems (Core) | Title of Role: | Software Engineer, Distributed Systems (Core) | Location: San Francisco, CA...  ...Description We're representing a leading Customer Data Platform (CDP) that empowers businesses to maximize their... 
    Work at office
    Remote work
    Visa sponsorship

    Recruiting from Scratch

    San Francisco, CA
    1 day ago
  • $197.3k - $313.7k

     ...tremendous scale with systems that process millions...  ...ManagementInternational Data ResidencyImage Uploads...  ...built on PHP/Hack.The Distributed Data Services TeamWe...  ...the judgment to weigh engineering vs. product trade-offs...  ...Building and releasing software with Docker containersKubernetesExperience... 
    Permanent employment
    Full time

    Salesforce

    San Francisco, CA
    2 days ago
  • $200k

    Senior Software Engineer — Distributed Compute / Spark Systems Location: Mountain View, CA — On-site About Granica Granica builds AI infrastructure for enterprises operating massive data environments. Our platform helps data and engineering teams reduce storage and compute... 
    Work at office

    Granica Computing, Inc.

    San Francisco, CA
    2 days ago
  • Rippling is seeking a backend engineer to help evolve distributed processing engines and databases. You will work across product and platform layers,...  ...backend code in Python, work with MongoDB, CDC, Kafka, and big data tech like Aurora, Trino, Presto, Pinot, Iceberg and Flink... 

    Rippling

    San Francisco, CA
    2 days ago
  •  ...tremendous scale with systems that process millions...  ...Management International Data Residency Image...  ...on PHP/Hack. The Distributed Data Services Team...  ...the judgment to weigh engineering vs. product trade-offs...  ...and releasing software with Docker containers... 
    Permanent employment

    Leadout Capital

    San Francisco, CA
    1 day ago
  • $180k - $275k

     ...Employment Type Full time Department Engineering Why this role matters now AI...  ..., triage, and response systems that would have required a...  ...magical. This means designing distributed systems for real-time content...  ...define and evolve the core data model and storage systems behind... 
    Full time
    Work at office
    Work from home

    Gamma

    San Francisco, CA
    1 day ago
  • $172.5k - $260.1k

     ...Driver's License, Global Entry Card, U.S. Government CAC/PIV.Distributed Systems Software Engineer - GovCloud (Senior/Lead) Our Public Cloud engineering...  ...scale systems, proficiency with solving real-world data management challenges, a strong understanding of how to... 
    Full time
    Local area

    Salesforce

    San Francisco, CA
    1 day ago
  • Senior AI Engineer, MLOps & Distributed SystemsThe OpportunityJoin the team building the...  ...Notifications pod is creating the systems that determine what message a...  ...closely with ML Scientists, Data Scientists, Data Engineering, Product, and Software Engineering. This role is a... 
    Full time
    Internship
    Work at office
    Local area
    Remote work
    Worldwide
    3 days per week

    Hinge Health

    San Francisco, CA
    2 days ago
  •  ...Eventual is building data curation for Physical...  ...spans large-scale data systems, computer vision and ML...  ...team where every engineer has high ownership across...  ...Your Role: As a Software Engineer on the Data Systems...  .../robotics data, distributed storage/compute, and dataloading... 
    Work at office
    Flexible hours
    Night shift

    Mixpeek

    San Francisco, CA
    1 day ago
  •  ...License, Global Entry Card, U.S. Government CAC/PIV. Distributed Systems Software Engineer - GovCloud (Senior/Lead) Our Public Cloud engineering...  ...large scale systems, proficiency with solving real-world data management challenges, a strong understanding of how to... 
    Local area

    Leadout Capital

    San Francisco, CA
    1 day ago
  • $117.2k - $313.7k

     ...duplicating efforts. Job Category Software Engineering Job Details About Salesforce...  ...you are the future of Salesforce. Distributed Systems Software Engineer - Public Cloud (Senior...  ...proficiency with solving real-world data management challenges, a strong... 

    Salesforce.Com Inc

    San Francisco, CA
    17 hours ago
  • $230k

     ...action inside enterprise systems is hard. The moment an...  ...accesses customer data, executes a workflow,...  ...trust become the real engineering challenge. Arcade is...  ...authentication, integrations, distributed systems, and AI...  ...the stack. We build our software with Go, Python, and... 
    Work at office
    Shift work

    The Consensus

    San Francisco, CA
    1 day ago
  • CommodityAI is scaling its engineering team in San Francisco to build the operating system for the global commodities industry. You will design, scale, and maintain backend APIs and data pipelines handling billions in transaction value, while deploying production AI workflows... 

    CommodityAI

    San Francisco, CA
    17 hours ago
  • $227.2k - $324.5k

    About the Role:As a Staff Software Engineer on the ML Infrastructure team,...  ...low-latency ML model serving systems that support Deep Learning,...  ...throughput, and low latency distributed systems using ScalaBuild reusable...  ...state of the art.Take a data driven approach to... 
    Full time
    Temporary work
    Local area
    Flexible hours

    Tubi TV

    San Francisco, CA
    5 days ago
  • $172.5k - $260.1k

     ...autonomous AI agents across clouds, data centers, and continents. As...  ..., high-energy backend Java engineer to lead the design,...  ...intelligent automation that enable our systems to self-heal and self-...  ...by building ultra-resilient distributed systems, driving live-site excellence... 
    Full time

    Salesforce

    San Francisco, CA
    1 day ago
  •  ...autonomous AI agents across clouds, data centers, and continents. As...  ..., high-energy backend Java engineer to lead the design,...  ...intelligent automation that enable our systems to self-heal and self-...  ...by building ultra-resilient distributed systems, driving live-site excellence... 

    Leadout Capital

    San Francisco, CA
    1 day ago
  • $320k

     ...interpretable, and steerable AI systems. We want AI to be safe...  ...researchers, engineers, policy experts, and...  ...We are looking for software engineers to help build...  ...will focus on building distributed and scalable systems to...  ...partner environments where data residency laws apply.... 
    Internship
    Work at office
    Visa sponsorship
    Flexible hours

    Showcify

    San Francisco, CA
    1 day ago
  •  ...intelligence. We build the systems that make large-scale visual...  ...and other leading investors. Engineers at Hedra work across boundaries...  ...for a Senior or Staff Software Engineer with deep experience building and operating distributed production systems. You’ll... 
    Work at office

    Hedra Inc.

    San Francisco, CA
    3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Software Engineer, Distributed Data Systems (IN). Be the first to apply!