Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Principal Software Engineer, Data Engineering

$261.5k - $353.5k
Full-time

Intuit Financial Services

We are seeking a Principal Software Engineer, Data Engineering to serve as a technical leader and domain expert across multiple Data Engineering teams. This role is critical for driving strategic transformation and defining foundation technology, specifically focusing on high-scale data products. The successful candidate will operate with a Builder Profile, driving velocity by identifying and executing key opportunities across the company. This role will build the data layer for a Unified Consumer Data Plane across Credit Karma and TurboTax. Building creating the unified data plane brings together unified identity and attributes, a canonical catalog of products and offers and behavioral and activity context so that AI/ML models, AI agents, personalization and marketing teams can build on one trusted, real-time data foundation. You will design for scale (from hundreds to thousands of attributes),across clouds (GCP and AWS) to control cost, faster time-to-data, and governance by design (data quality, lineage and fine-grained access control). This is an individual contributor level role with no direct reports or managerial duties. You will apply master level software engineering and industry best practices to solve hard problems end to end, working strategically, addressing complex issues, and leading technology decisions that have significant long-term impact.

Responsibilities

Technical Craft and Architectural Leadership
  • Lead the development and implementation of the Consumer Platform data strategy, aligning with the target state architecture. Drive significant technology initiatives end-to-end, including across the horizontal layers of the architecture.
  • Provide a birds-eye architecture view and give early visibility into Technical Decisions, clarifying the rationale and principles for those decisions.
  • Drive the design and implementation of durable, robust, scalable, and secure technical designs, implementing them effectively to ensure high availability and optimal performance of applications.
  • Act as a role model in full cycle engineering, demonstrating deep expertise across the software lifecycle, including design, implementation, and operationalization.
  • Engage in 70% hands-on development in all phases of the software life cycle.
  • Lead the initial phases of critical projects, such as proof of concepts or pilot implementations, and engage in live coding sessions and collaborative problem-solving.
Enterprise Data Strategy, Quality, and Efficiency
  • Drive the data strategy across the consumer platform, including defining the technical strategy for data modeling, ingestion, curation, and quality standards across consumption points and patterns.
  • Drive the consumer platform analytics pipeline and establish the target state for real-time analytics.
  • Define and enforce the technical and operational standards required for high velocity, establishing clear technical paved paths and standardizing technology direction.
  • Reduce rework and overhead by providing directions on smart execution for migration-specific initiatives and addressing infrastructure overhead (e.g., EMR Upgrades and image management for EMR serverless).
  • Ensure designs are scaled to handle future data volumes with consideration of infrastructure cost optimization.
  • Define approaches for how to avoid incidents and position for 'game day' preparedness, including addressing the lack of Data Quality (DQ) monitoring for upstream pipelines and E2E testing and quality checks.
  • Make data backed decisions and drive the right level of instrumentation and Experimentation.
AI Native Applications and Innovation
  • Possess the knowledge required for building AI native applications.
  • Guide the applicability of AI to customer problems through a deep understanding of the value and limitations of AI technologies.
  • Champion new solutions, emerging technologies, and AI to solve complex problems and create new opportunities, including leveraging AI and Agentic experiences to improve customer experiences.
  • Provide direction on managing the multiples of AI tooling silos to reduce inefficiency and inconsistency.
  • Maintain a passion for continuous learning, experimenting, and applying cutting-edge technology and software paradigms.
Leadership, Mentorship, and Collaboration
  • Influence technology and product direction, typically driving work across multiple scrum teams.
  • Act as the bridge between product and data engineering, enabling teams to work closely with Product Development teams. Partner with other groups for cross-functional design, development, and integration.
  • Provide clear business context, including a mind map of business flows, and clarify who are the consumers of the data and how the data is being consumed.
  • Provide comprehensive technical mentorship through personalized skill enhancement with clear milestones.
  • Conduct detailed architecture and code reviews, including interactive methods like paired programming, to enforce standards and share fundamental and advanced design principles.
  • Accelerate learning and growth by actively keeping engineers updated on the latest industry trends, tools, technologies, and frameworks.
  • Contribute to standards, patterns, and best practices that improve the engineering community.
Strategic and Leadership Skills
  • Strong mentoring skills and ability to influence and communicate effectively with both technical and non-technical people.
  • Excellent interpersonal and communication skills, with the ability to communicate clearly, succinctly, and persuasively to all levels.
  • Ability to operate at varying levels of abstraction from business strategy to product strategy to high level technical design to detailed technical design to implementation.
  • Demonstrated experience driving technical strategy in high scale data environments.
  • Ability to synthesize achievable solutions from diverse inputs, alternative sources (build / buy / partner) and complex data.
  • Strategic mindset: influences the team and platform’s short and long-term strategy for maximum business impact.

Qualifications

  • BS or MS in Computer Science, Data Engineering, or a related field.
  • 15+ years of software engineering experience, with a strong background in data engineering.
  • 9+ years professional working experience with various big data technologies, including Hive, Hadoop, Kafka, Columnar Databases, and Graph Databases. Strong experience with stream processing or near real-time data ingestion is important.
  • Expertise in developing Software for Java (Spring & Springboot), Scala for Spark streaming & Spark applications, or other JVM based languages.
  • Expert professional experience with SQL, XML, JSON, YML, very strong Python and Linux.
  • Strong understanding of extensible data modeling and designing for large scale data environments.
  • Strong background using cloud platforms such as AWS, Azure, or GCP (AWS expertise specifically noted). Demonstrated experience operating high scale services in the cloud, designing highly resilient services, and building recovery mechanisms.
  • Expertise with tools and frameworks such as Docker, Spark, Scala, Jupiter Notebook, Databricks Notebooks, Kubernetes, Feature Management Platforms, and SageMaker.
  • Strong background in adoption of AI skills in both traditional and Generative-AI. Knowledge of AI / ML, Generative AI, and experience with growth-focused AI/ML applications.
  • Expert knowledge of software development methodologies and practices, including Agile Development, SCRUM, and/or Extreme Programming methodologies.
Intuit provides a competitive compensation package with a strong pay for performance rewards approach. This position may be eligible for a cash bonus, equity rewards and benefits, in accordance with our applicable plans and programs (see more about our compensation and benefits at Intuit®: Careers | Benefits). Pay offered is based on factors such as job-related knowledge, skills, experience, and work location. To drive ongoing fair pay for employees, Intuit conducts regular comparisons across categories of ethnicity and gender. The expected base pay range for this position is: Oakland $261,500 - $353,500
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Principal Software Engineer, Data Engineering in Oakland, CA vacancy
  •  ...and their customers, better. And it means we prioritize a diverse F5 community where each individual can thrive.As a Senior DevOps Engineer within our cutting-edge AI Security team, you'll architect and maintain cloud infrastructure for our AI security platform. This... 
    Suggested
    Local area

    F5

    Oakland, CA
    2 days ago
  • $225.81k - $282.27k

     ...has remained the same: to make access to data as simple and reliable as electricity....  ...canonical and ready to query, with no engineering or maintenance required. We’re proud that...  .... Fivetran is seeking an exceptional Principal Software Engineer to lead our AI adoption initiative... 
    Suggested
    Full time
    Work at office
    Remote work
    Flexible hours

    Fivetran

    Oakland, CA
    2 days ago
  • $261.5k - $353.5k

     ...Come join Intuit as a Principal Software Engineer and help us power prosperity around the world! We're looking for a technical leader to own the architecture and technical direction across our iOS, Android, GraphQL, Webview, and Front End platforms for the Credit Karma... 
    Suggested
    Full time

    Intuit

    Oakland, CA
    13 days ago
  •  ...community. Join us in using data, bold thinking, and a commitment...  ...on Databricks. Our Data Engineers, Data Scientists, and Analytics...  ...builds what they build on. As a Principal Data Engineer, you'll own the...  ...About You10+ years of software or data platform engineering... 
    Suggested
    Full time
    Contract work
    Work at office
    Local area
    Remote work
    Relocation
    Flexible hours

    Lending Club

    San Francisco, CA
    1 day ago
  • $190k - $240k

     ...make it happen. Job Description The Data Platform Team is part of the Data...  ...tools (e.g., Claude Code) across the full software development lifecycle - including design...  ...push the boundaries of productivity and engineering outcomes. Bonus skills Experience... 
    Suggested
    Work at office
    Local area
    Home office
    Flexible hours

    Highnote

    San Francisco, CA
    12 hours ago
  •  ...manage risk, meet regulatory obligations, and scale enterprise AI depends on data that is reliable, governed, understandable, and available when it is needed.As a Principal Software Engineer in the Data Platform Group, you will provide hands-on technical leadership within... 
    Remote work

    SoFi

    San Francisco, CA
    4 days ago
  •  ...Senior Data EngineerThe Data Services team is responsible for technical design and end...  ...products for the enterprise. The Senior Data Engineer will report to the Sr Manager, Data...  ...automation, and reliability throughout the software development lifecycle (SDLC). The Senior... 
    Full time
    Part time
    Work at office
    Local area
    Work from home
    Home office
    2 days per week

    Blue Shield Of California

    Oakland, CA
    5 days ago
  • $150k - $180k

     ...Overview Join to apply for the Data Engineer role at PopHealth Learning Center . The Organization The PopHealth Learning Center ("PHLC") is a California Social Purpose Corporation (SPC) committed to transforming how health care is delivered and experienced across... 
    Full time

    PopHealth Learning Center

    Oakland, CA
    2 days ago
  • $171.1k - $316.58k

     ...requirements and implementation?If you answered yes, then our Principal Software Engineer role on our Xbox Media Engineering team may be the right...  ...depth in backend engineering: service architecture, APIs, data modeling, reliability engineering, and production operations... 
    Full time
    Temporary work
    Part time
    Local area
    Work from home
    Home office
    Relocation package

    King Digital Entertainment

    San Francisco, CA
    12 hours ago
  • $238k - $326k

     ...'re all in on this mission. If you are too, let's talk.The Principal Software Engineer OpportunityThe team that built Jeeva AI is building Digital...  ...other post-training methods when results justify them and data use is approved.What you will bring to the roleStrong Python... 
    Local area
    Worldwide
    Flexible hours

    Okta

    San Francisco, CA
    3 days ago
  • $209.5k - $280.9k

    Job Posting Title:Principal Software EngineerReq ID:10149987Job Description:Disney Entertainment and ESPN Product...  ...Product & Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more - all working to build and... 
    Full time

    Hulu

    San Francisco, CA
    1 day ago
  • $276k - $414k

     ...Saturn, and other digital services.Snap Engineering teams build fun and technically...  ...privacy at the forefront.We’re looking for a Principal Software Engineer to join the Ads Format team at...  ...including product management, design, data science, and other engineering teams, to... 
    Full time
    Temporary work
    Live in
    Work at office
    Local area

    Snap

    San Francisco, CA
    3 days ago
  • $285k - $335k

     ...alongside a team of experts across energy, manufacturing, data center construction, and cloud services.If you want to do the...  ...other, come build with us at Crusoe.About This RoleAs a Principal Software Engineer for Infrastructure, you will partner with teams across the... 
    Full time
    Temporary work

    Crusoe

    San Francisco, CA
    2 days ago
  • $206.4k - $276.7k

     ...Technology is a global organization of engineers, product developers, designers, technologists, data scientists, and more - all...  ...to design video algorithms and software workflows for the purposes of...  ...platform.As a domain focused Principal Engineer, you are expected to be... 

    Disney Interactive

    San Francisco, CA
    4 days ago
  • $156.4k - $253k

     ...SummaryYour CareerIn the Layer-7 Security Software team, we are responsible for at least one...  ...Identification and Content Inspection Engine runs on Hardware, Virtualized, Container...  ...prevention, URL-filtering, Cloud-delivered Data leak protection (DLP), and many more exciting... 
    Full time
    Work at office

    Palo Alto Networks

    San Francisco, CA
    3 days ago
  • SingleStore engineers build the real-time data platform powering some of the world’s most demanding applications. Our cloud-native architecture...  ...business impact.Position SummaryWe are seeking a Senior/Principal Software Engineer to join the Engineering team and play a... 

    SingleStore

    San Francisco, CA
    2 days ago
  • $285.45k

     ...solutions across Ads and Core critical products. We build unified data, training, feature, and inference infrastructure; this role...  ...decisions, migrations, and operational standards; mentor senior engineers and raise the engineering bar.Partner closely with Content, Shopping... 
    Work at office
    Local area
    Relocation
    Relocation package

    Pinterest

    San Francisco, CA
    4 days ago
  • $15k

     ...packages, technology talks by our experts, a beautiful modern office, daily catered lunches, and more.As a Senior/Staff Software Engineer on our Data Infrastructure group, you will contribute to scaling and advancing our entire data infrastructure. This includes building... 
    Work at office
    Local area

    The Voleon Group

    Berkeley, CA
    4 days ago
  •  ...fault handling, and reliability. # Drive engineering rigor: testability, code quality, review...  ...recon/ML teams to define interfaces, data contracts, timing/synchronization, and failure...  .... What we’re looking for Deep software architecture experience for real-world... 
    Full time
    Remote work

    midjourney

    San Francisco, CA
    5 days ago
  •  ...goals. Our work brings together product engineering, design, AI research, and education to...  ...around the world. About the Role As a Principal Software Engineer on the ChatGPT Learning team,...  ...in your possession (including the data contained therein) upon termination of... 
    Full time
    Work at office
    Relocation package
    3 days per week

    OpenAI

    San Francisco, CA
    13 days ago
  •  ...instructions and skills with connections to the tools and data it needs. Our work spans creation and publishing, reliable...  ...evolve. About the Role We’re looking for a product-minded Principal Software Engineer to set technical direction, build the systems behind plugins... 
    Full time
    Work at office
    Relocation package

    OpenAI

    San Francisco, CA
    13 days ago
  • $173k - $204k

     ...LaunchDarkly is seeking an experienced Analytics Engineer to join our data team. You will work with other Data Engineers, Analytics Engineers, and stakeholders across the company to deliver data insights that create material impacts to our business. Responsibilities... 

    LaunchDarkly

    Oakland, CA
    2 days ago
  • # Job Description: Data Engineer III Job ID: PCGJP00005318 Location: Oakland, CA Duration: November 16, 2026 – May 31, 2027 Work Arrangement: To be confirmed Position Overview The Data Analytics and Insights team is seeking an experienced Data Engineer... 

    TheCorporate LLC

    Oakland, CA
    15 days ago
  •  ...span teams, and grow senior engineers into technical leaders. You report...  ...or quality. Partner with Data Science, AI, and platform owners...  ...teams at Senior Staff or Principal scope, with measurable results...  ...build and operate production software. You’ve owned hard integrations... 
    Local area
    Flexible hours

    Tonal

    San Francisco, CA
    12 hours ago
  • $300k - $380k

     ...understand the world without continuous human supervision. As Principal Engineer, Perception, you will define the technical direction and...  ...connect sensing, estimation, machine learning, and production software into a coherent system deployed on real vehicles. THE RESPONSIBILITIES... 
    Local area
    Relocation package
    Flexible hours

    Saildrone

    Alameda, CA
    2 days ago
  • $198.05k - $267.95k

     ...Principal Software Engineer - Developer, Phantom Works Company: The Boeing Company The Boeing Company is currently seeking a Principal Software...  ...integration contracts (ICDs or equivalent living artifacts), data models, and message definitions in coordination with... 
    Permanent employment
    Full time
    Work experience placement
    For subcontractor
    Relocation
    Visa sponsorship
    Work visa
    Relocation package
    Flexible hours
    Shift work

    Boeing

    Berkeley, CA
    3 days ago
  • $175k

     ...infrastructure, end to end. From design through operation, our work is engineered for the performance, scale, and efficiency that advanced AI and...  ...for mechanical/BMS or electrical/EPMS applications across AI data center campuses. Implement and test sequences of operation,... 
    Full time
    For contractors
    Work at office

    Inovi, Inc.

    Oakland, CA
    2 days ago
  •  ...developing technology on the frontier of engineering and biology. Our first product is a...  ...About the role We are looking for a lead software engineer who is excited to develop technology...  ...devices, sustains high-performance data and image processing, and offers a compelling... 
    Full time

    currentsurgical

    San Francisco, CA
    5 days ago
  • $172.8k - $225.6k

     ...country where we have a legal entity.We're looking for a Principal Fullstack Software Engineer to join our team, passionately focused on delivering...  ...identity verification (which may include use of biometric data) is a condition of employment with Atlassian for employment... 
    Work at office
    Local area

    Atlassian

    San Francisco, CA
    12 hours ago
  • $401k

     ...collaborative security culture.About the RoleOpenAI is seeking a Principal Software Engineer to join the Infrastructure Security (InfraSec) team....  ...and firmware to Kubernetes clusters, service meshes, and the data pathways that carry highly sensitive model weights and user... 
    Work at office
    Local area
    Remote work
    Flexible hours

    OpenAI

    San Francisco, CA
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Principal Software Engineer, Data Engineering. Be the first to apply!