Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Software Engineer - Data Platform (Iceberg/Trino)

Full-time

Innovaccer Analytics

Description

About the Role

As a Principal Software Engineer on the Data Platform, you will own the architecture of the lakehouse engine that powers Innovaccer's platform in on-premise deployments: Apache Iceberg as the table format, Trino as the query engine, a REST catalog service, and Spark as transform compute. Cloud data warehouses have no on-premise equivalent, so this is a ground-up engine design, not a re-point. It is the single longest-lead technical track in the program, and the decisions you make on catalog, engine placement, and pipeline redesign gate everything downstream: transforms, serving, and reporting.

A Day in the Life

  • Own the lakehouse reference architecture: Iceberg table design, Trino cluster topology, catalog service, Spark transform compute, and object-storage layout.
  • Design on-premise replacements for cloud-managed warehouse capabilities that have no direct equivalent: change-data-capture streams, scheduled tasks, and write-back paths into operational stores.
  • Run proof-of-concept validation of the catalog and query engine at expected data volumes, and define evidence-based triggers for placement decisions (VM-based versus Kubernetes-native operators).
  • Set platform-wide standards for table layout, partitioning, file sizing, and Iceberg maintenance: compaction, snapshot expiry, and orphan-file cleanup.
  • Lead the SQL dialect strategy for porting existing warehouse workloads to Trino and Spark SQL.
  • Mentor senior engineers across data workstreams, review designs, and raise the bar on engineering quality.
  • Partner with platform engineering on storage sizing, resource isolation, and capacity planning for the lakehouse footprint.

What You Need

  • B.E., B.Tech., M.Sc. degree in Computer Science or a related technical field.
  • 12+ years of industry experience building and operating large-scale data platforms or distributed systems.
  • Deep, hands-on expertise with distributed SQL engines: Trino/Presto or Spark SQL internals, query planning, and performance engineering.
  • Production experience with Apache Iceberg (or Delta Lake/Hudi with willingness to go deep on Iceberg): table spec, merge-on-read versus copy-on-write, and table maintenance at scale.
  • Working knowledge of Iceberg catalog services (REST catalogs such as Polaris or Nessie, or Hive Metastore) and S3 compatible object storage.
  • Strong understanding of cloud warehouse internals (Snowflake, BigQuery, or Redshift) sufficient to design functional equivalents on open-source infrastructure.
  • Professional software development experience with Java and/or Python.
  • Experience delivering data platforms in on-premise, regulated, or air-gapped
  • environments is a strong plus; healthcare data experience is a plus.

We offer competitive benefits to set you up for success in and outside of work.

Here’s What We Offer
  • Generous Paid Time Off: Recharge and relax with 20 days of fixed time off per year, in addition to company holidays—because we believe work-life balance fuels performance.
  • Best-in-Class Parental Leave: Spend quality time with your growing family. We offer one of the industry’s most generous parental leave policies to support you during life’s most important moments.
  • Recognition & Rewards: We celebrate wins—big and small. Get rewarded with monetary incentives and company-wide recognition for your impact and dedication. Your hard work won’t go unnoticed.
  • Comprehensive Insurance Coverage: Stay covered with medical, dental, and vision insurance, plus 100% company-paid short- and long-term disability and basic life insurance. Optional perks include discounted legal aid and pet insurance.

Innovaccer Inc. is an equal opportunity employer. We celebrate diversity and are committed to fostering an inclusive workplace where all employees feel valued and empowered regardless of any characteristic protected by federal, state or local law including, without limitation, race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, medical condition, disability, age, marital status, or veteran status. Innovaccer Inc. participates in the E-Verify program to confirm employment eligibility of all newly hired employees based out of the U.S. and employed by Innovaccer Inc.

For any additional information, please visit the below websites:

Disclaimer: 

Innovaccer does not charge fees or require payment from individuals or agencies for securing employment with us. We do not guarantee job spots or engage in any financial transactions related to employment. If you encounter any posts or requests asking for payment or personal information, we strongly advise you to report them immediately to our HR department at View email address on jobs.jobcopilot.com. Additionally, please exercise caution and verify the authenticity of any requests before disclosing personal and confidential information, including bank account details.


About Innovaccer

Innovaccer activates the flow of healthcare data, empowering providers, payers, and government organizations to deliver intelligent and connected experiences that advance health outcomes. The Healthcare Intelligence Cloud equips every stakeholder in the patient journey to turn fragmented data into proactive, coordinated actions that elevate the quality of care and drive operational performance. Leading healthcare organizations like CommonSpirit Health, Atlantic Health, and Banner Health trust Innovaccer to integrate a system of intelligence into their existing infrastructure, extending the human touch in healthcare. For more information, visit .

Check us out on YouTube , Glassdoor , LinkedIn , Instagram , and the Web .

Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Principal Software Engineer - Data Platform (Iceberg/Trino) in United States vacancy
  •  ...guidance provided Facilitate software application design...  ...experience in Spark/PySpark, Apache Iceberg and Trino.•Experience writing complex...  ...Experience of BI, Reporting and Data Warehousing.Ability to play...  ...to lead offshore data engineers.Preferred Skill and Experience... 
    Suggested
    Full time
    Temporary work
    Work experience placement
    Relocation

    Infosys Technologies

    Austin, TX
    2 days ago
  • Infosys Limited is hiring a Spark Data Engineer for our US operations in Austin, TX. You will work with Apache Iceberg, Trino, Snowflake, and Tableau to design, develop, and optimize scalable data pipelines and dashboards. The role emphasizes strong SQL, Python scripting... 
    Suggested

    Infosys Limited

    Austin, TX
    4 days ago
  • $195k - $290k

     ...advanced AI-native platform. We work on large...  ...the Role:Our Data Platform group at...  ...role, you will be a Principal Engineer within Data...  ...within Spark, Flink, Iceberg or Pinot or an equivalent...  ...Lake, Presto/Trino, Pinot, Druid,...  ...systems design and the software development... 
    Suggested
    Full time
    Work experience placement
    Work at office
    Local area
    Remote work

    CrowdStrike

    Austin, TX
    1 day ago
  •  ...adding hardware, installing software, or changing a line of...  .... That’s a lot of data. On the Town Lake team,...  ...agentic-first data lakehouse platform based on Trino and Apache Iceberg, and all the supporting...  ..., product-minded principal software engineer to help take Town Lake... 
    Suggested
    Local area

    CloudFlare

    Austin, TX
    1 day ago
  • $198k - $205k

     ...the Role We are seeking a Principal Software Engineer to lead the architecture and evolution of our data and machine learning infrastructure...  ...product, data science, and platform teams to set technical...  ...data lake on AWS S3 with Apache Iceberg as the table format to ensure... 
    Suggested
    Full time
    Work at office
    Local area
    2 days per week

    The New York Times

    New York, NY
    1 day ago
  • $87.5k - $202.8k

     ...to the company’s success. As a(n) Software Engineer Principal within PNC's Data and Automation organization, you will...  ...or supporting the OpenShift platform itself. You will work closely with...  ...creationc. Strong experience with Spark, Trino, Airflow, and Icebergd. Proven... 
    Full time
    Temporary work
    Part time
    Work experience placement
    Work at office

    The PNC Financial Services Group

    Strongsville, OH
    4 days ago
  • $181.2k - $317.1k

     ...Description It all started when engineer Fred Luddy wrote code...  .... Our ServiceNow AI platform brings together any AI, any data, and any workflow— helping...  ...operational excellence. Design software that is easy to use,...  ...using: Apache Iceberg (tables, catalogs, schema... 
    Permanent employment
    Full time
    Work experience placement
    Work at office
    Immediate start
    Remote work
    Flexible hours
    2 days per week

    ServiceNow

    San Diego, CA
    2 days ago
  • $200k - $275k

     ...an experienced and visionary Staff Engineer to technically anchor our new AI Data Engine team. This pivotal role...  ...closely with ML research, ML Training platform, and data engineering teams to...  ...modern data storage formats (Parquet, Iceberg) and vector databases (LanceDB,... 
    Work at office
    Remote work

    Motional

    Boston, MA
    3 days ago
  • $222.5k - $257.5k

     ...day.Observability Engineering owns the breadth and...  ...the shared platform every engineering...  ...understand how their software behaves in production...  ...facing software. As a Principal Software Engineer...  ...& Telemetry Data), you will set the...  ...Delta Lake, Apache Iceberg), Spark or comparable... 
    Full time
    Temporary work
    Work at office
    Local area
    Remote work

    Smartsheet

    Bellevue, WA
    2 hours ago
  • $200.6k - $250.4k

    Principal Software Engineer, Semantic Data ServicesAbout the RoleWEX is reimagining its enterprise data platform with an ambitious goal: make our data understandable not only to people and...  ...such as Spark, Flink, Kafka, Iceberg, Snowflake, Databricks, cloud-native... 
    Full time
    Flexible hours

    WEX

    Portland, ME
    1 day ago
  •  ...agencies worldwide. As we expand our platform, we are building a Data + AI team to unlock the next...  ...Role We are seeking Staff and Principal Engineers who thrive in ambiguity, excel at...  ...Experience level : 8+ years in software/data engineering, with at least 3... 
    Full time
    Temporary work
    Remote work
    Work from home
    Worldwide
    Home office
    Flexible hours
    3 days per week

    Appgate Careers

    Remote
    1 day ago
  •  ...delivering an AI-powered platform that governs and...  ...access to applications, data, and business processes...  ...define the standards ML engineers and scientists build...  ...scale feature backfills, Iceberg compaction, and daily...  ...~ Demonstrated principal impact: platform standards... 
    Full time

    Saviynt

    Remote
    1 day ago
  • $295.25k - $345.04k

     ...’re building the tools and platform that empower our community...  ...experiences for everyone.Roblox's data infrastructure processes...  ...daily active users. As a Principal Software Engineer in our Data Infra org, you...  ...span Kafka, Flink, Spark, Trino, Druid, Airflow and Data Catalog... 
    Full time
    Work experience placement
    H1b
    Work at office
    Local area
    Visa sponsorship
    Monday to Friday

    Roblox

    San Mateo, CA
    2 days ago
  • $230k - $265k

     ...they need through the platforms they already sell on....  ...looking for a seasoned software engineer to join Parafin’s Infrastructure...  ...of our next-generation Data Platform. This role is...  ...platforms), Delta Lake/Iceberg, and distributed query engines like Trino/Presto. ~ Familiarity... 
    Full time
    Work from home
    Flexible hours

    Parafin

    Remote
    1 day ago
  •  ...Analytics Data Platform Lakehouse team builds and operates the foundations that power data engineers, applied AI, and product teams—managing...  ...platform, including Apache Iceberg table management (data compaction...  ...owning the integration of Trino, Spark and other query engines... 
    Full time
    Work at office

    Datadog

    Remote
    1 day ago
  • $198.24k - $272.58k

    We are seeking a Principal Software Engineer to serve as a senior technical leader responsible for defining and executing...  ...strategy for backend and AI services that power data applications and production grade data platform capabilities. This role will directly influence... 
    Full time
    Local area

    Procore Technologies

    Austin, TX
    1 day ago
  • $205.6k - $269.9k

     ...people.about this teamThe Enterprise Data & AI organization is a strategic and...  ...owning and building the data and AI platforms and services that enable the enterprise...  ...enterprise scale. core responsibilitiesAs a Principal Software Engineer, you will own the system design and... 
    Permanent employment
    Full time
    Part time
    Immediate start
    Work visa

    Lululemon Athletica

    Seattle, WA
    5 hours ago
  •  ...financial institutions, you’ve come to the right place. As a Principal Software Engineer at JPMorganChase within the Corporate Technology...  .../traceability of changes, and secure handling of sensitive data.Strong understanding of responsible AI use and control expectations... 
    Work at office
    Local area

    JP Morgan Chase

    Jersey City, NJ
    3 days ago
  • $110k - $277k

     ...Department of Defense (DoD) to transform data into actionable intelligence,...  ...world. Our mission-first software and data engineering platform modernizes data operations, utilizing...  ...Familiarity with PostgreSQL, Elasticsearch, Trino, Apache Iceberg, or similar technologies.... 
    Immediate start

    Clarity Innovations

    Herndon, VA
    5 days ago
  • $192k - $240k

     ...mission to build the best platform in the world for engineers to understand and...  ...scale—trillions of data points per day—...  ...Datadog.As a Senior Software Engineer, you will own...  ...including Spark, Airflow, Trino, and Apache...  ...experience with Apache Iceberg or Lakehouse architecturesHave... 

    Datadog

    New York, NY
    2 days ago
  • $275k - $330k

     ...is expanding, the data challenges we're solving...  ...complex, and the platform is scaling to...  ...As a Distinguished Engineer on the Data...  ...trajectory toward principal or staff-level architectureBuilt...  ...including Apache Iceberg, Delta Lake, and...  ...engines such as Trino, Presto, Spark SQL... 
    Day shift

    CloudZero

    Boston, MA
    4 days ago
  • $166k - $220k

     ...turns thousands of data streams into a realtime...  ...across product, engineering, sales, logistics,...  ...Senior Mission Data Platform Engineer to design,...  ...scientists, and software engineers to build...  ...technologies (e.g., Apache Iceberg), query engines (e.g., Trino/Presto, AWS Athena)... 
    Full time
    Work experience placement
    Immediate start
    Worldwide

    Anduril Industries

    Irvine, CA
    5 hours ago
  • $102.1k - $202.2k

     ...than 25%Profession: Software...  ..., and the Windows Data team turns the signal...  ...database systems — engineering at a scale where familiar...  ...cloud services, data platform engineering, database...  ...StarRocks, ClickHouse, Trino/Presto, Spark,...  ...(Delta Lake, Iceberg, Hudi, Paimon) and... 
    Ongoing contract
    Local area
    Worldwide
    3 days per week

    Microsoft

    Redmond, WA
    1 day ago
  • $246k - $339k

     ...thousands of content sets. Our platform is trusted by over 6,000...  ...Team: Our diverse Product & Engineering team values innovation, collaboration...  ...Our team owns the financial data agent within GenSearch —...  ...We are hiring a hands-on Principal Engineer to help us: Reduce... 
    Remote job
    Full time
    Local area

    Alphasense

    Remote
    1 day ago
  • $230k - $390k

     ...we’re creating a platform to help businesses...  ...join a full-stack data team building the...  ...pipelines, and our Iceberg-based data lakehouse...  ...Spark, Flink, Trino/Presto, and data lakehouse...  ...different storage engines, query plans, and...  ...QualitiesStrong software engineering... 
    Full time
    Flexible hours

    Sierra

    San Francisco, CA
    4 days ago
  •  ...same: to make access to data as simple and...  ...ready to query, with no engineering or maintenance required...  .... We’re seeking a Principal Software Engineer to contribute...  ..., Grafana Iceberg, Polaris, Delta Lake,...  ...mental health support platform that offers personalized... 
    Full time
    Remote work

    Fivetran

    Remote
    a month ago
  • $97.3k - $344.7k

     ...duplicating efforts. Job Category Software Engineering Job Details About...  ...behind Salesforce's cloud platform no general-purpose model...  ...unified agentic evaluation with data curation. Your work will...  ...distributed query engines (e.g. Trino), knowledge graphs, and... 
    Full time
    Local area

    Salesforce

    San Francisco, CA
    1 day ago
  • LTIMindtree is seeking a Sr. DATA Engineer to design and optimize scalable data solutions on AWS. You will implement PySpark-based ETL pipelines, manage data lakes and support analytics with Iceberg and Hive. The role requires strong AWS data services experience, scripting... 

    LTM

    Tampa, FL
    3 days ago
  • $54 per hour

    A consulting firm seeks a Data Engineer to develop modern data platforms using Apache Iceberg on AWS. This hybrid role focuses on building scalable data pipelines and emphasizes strong skills in data governance and distributed systems. Ideal candidates should have 4 to... 

    Eliassen Group

    Dallas, TX
    1 day ago
  •  ...next.The Analytics Platform and Experience (...  ...nearly 1 ExaByte of data in the Netflix...  ...underlying table format, Iceberg (an industry-...  ...platforms for Analytics Engineers and business users...  ...ML engineers, and software engineers—powering...  ..., Spark, Trino/Presto, Snowflake,... 
    Hourly pay
    Full time
    Immediate start
    Flexible hours

    Netflix

    Los Gatos, CA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Software Engineer - Data Platform (Iceberg/Trino). Be the first to apply!