Principal Software Engineer, Data Engineering
$261.5k - $353.5kIntuit Inc
We are seeking a Principal Software Engineer, Data Engineering to serve as a technical leader and domain expert across multiple Data Engineering teams. This role is critical for driving strategic transformation and defining foundation technology, specifically focusing on high-scale data products. The successful candidate will operate with a Builder Profile, driving velocity by identifying and executing key opportunities across the company. This role will build the data layer for a Unified Consumer Data Plane across Credit Karma and TurboTax. Building creating the unified data plane brings together unified identity and attributes, a canonical catalog of products and offers and behavioral and activity context so that AI/ML models, AI agents, personalization and marketing teams can build on one trusted, real-time data foundation. You will design for scale (from hundreds to thousands of attributes),across clouds (GCP and AWS) to control cost, faster time-to-data, and governance by design (data quality, lineage and fine-grained access control). This is an individual contributor level role with no direct reports or managerial duties. You will apply master level software engineering and industry best practices to solve hard problems end to end, working strategically, addressing complex issues, and leading technology decisions that have significant long-term impact.
Responsibilities
Technical Craft and Architectural Leadership- Lead the development and implementation of the Consumer Platform data strategy, aligning with the target state architecture. Drive significant technology initiatives end-to-end, including across the horizontal layers of the architecture.
- Provide a birds-eye architecture view and give early visibility into Technical Decisions, clarifying the rationale and principles for those decisions.
- Drive the design and implementation of durable, robust, scalable, and secure technical designs, implementing them effectively to ensure high availability and optimal performance of applications.
- Act as a role model in full cycle engineering, demonstrating deep expertise across the software lifecycle, including design, implementation, and operationalization.
- Engage in 70% hands-on development in all phases of the software life cycle.
- Lead the initial phases of critical projects, such as proof of concepts or pilot implementations, and engage in live coding sessions and collaborative problem-solving.
- Drive the data strategy across the consumer platform, including defining the technical strategy for data modeling, ingestion, curation, and quality standards across consumption points and patterns.
- Drive the consumer platform analytics pipeline and establish the target state for real-time analytics.
- Define and enforce the technical and operational standards required for high velocity, establishing clear technical paved paths and standardizing technology direction.
- Reduce rework and overhead by providing directions on smart execution for migration-specific initiatives and addressing infrastructure overhead (e.g., EMR Upgrades and image management for EMR serverless).
- Ensure designs are scaled to handle future data volumes with consideration of infrastructure cost optimization.
- Define approaches for how to avoid incidents and position for 'game day' preparedness, including addressing the lack of Data Quality (DQ) monitoring for upstream pipelines and E2E testing and quality checks.
- Make data backed decisions and drive the right level of instrumentation and Experimentation.
- Possess the knowledge required for building AI native applications.
- Guide the applicability of AI to customer problems through a deep understanding of the value and limitations of AI technologies.
- Champion new solutions, emerging technologies, and AI to solve complex problems and create new opportunities, including leveraging AI and Agentic experiences to improve customer experiences.
- Provide direction on managing the multiples of AI tooling silos to reduce inefficiency and inconsistency.
- Maintain a passion for continuous learning, experimenting, and applying cutting-edge technology and software paradigms.
- Influence technology and product direction, typically driving work across multiple scrum teams.
- Act as the bridge between product and data engineering, enabling teams to work closely with Product Development teams. Partner with other groups for cross-functional design, development, and integration.
- Provide clear business context, including a mind map of business flows, and clarify who are the consumers of the data and how the data is being consumed.
- Provide comprehensive technical mentorship through personalized skill enhancement with clear milestones.
- Conduct detailed architecture and code reviews, including interactive methods like paired programming, to enforce standards and share fundamental and advanced design principles.
- Accelerate learning and growth by actively keeping engineers updated on the latest industry trends, tools, technologies, and frameworks.
- Contribute to standards, patterns, and best practices that improve the engineering community.
- Strong mentoring skills and ability to influence and communicate effectively with both technical and non-technical people.
- Excellent interpersonal and communication skills, with the ability to communicate clearly, succinctly, and persuasively to all levels.
- Ability to operate at varying levels of abstraction from business strategy to product strategy to high level technical design to detailed technical design to implementation.
- Demonstrated experience driving technical strategy in high scale data environments.
- Ability to synthesize achievable solutions from diverse inputs, alternative sources (build / buy / partner) and complex data.
- Strategic mindset: influences the team and platform’s short and long-term strategy for maximum business impact.
Qualifications
- BS or MS in Computer Science, Data Engineering, or a related field.
- 15+ years of software engineering experience, with a strong background in data engineering.
- 9+ years professional working experience with various big data technologies, including Hive, Hadoop, Kafka, Columnar Databases, and Graph Databases. Strong experience with stream processing or near real-time data ingestion is important.
- Expertise in developing Software for Java (Spring & Springboot), Scala for Spark streaming & Spark applications, or other JVM based languages.
- Expert professional experience with SQL, XML, JSON, YML, very strong Python and Linux.
- Strong understanding of extensible data modeling and designing for large scale data environments.
- Strong background using cloud platforms such as AWS, Azure, or GCP (AWS expertise specifically noted). Demonstrated experience operating high scale services in the cloud, designing highly resilient services, and building recovery mechanisms.
- Expertise with tools and frameworks such as Docker, Spark, Scala, Jupiter Notebook, Databricks Notebooks, Kubernetes, Feature Management Platforms, and SageMaker.
- Strong background in adoption of AI skills in both traditional and Generative-AI. Knowledge of AI / ML, Generative AI, and experience with growth-focused AI/ML applications.
- Expert knowledge of software development methodologies and practices, including Agile Development, SCRUM, and/or Extreme Programming methodologies.
- ...Senior/Principal Software Engineer Hybrid 3x per week in San Diego, CA; no potential for fully remote A venture-backed medical device startup... ...medical devices. You’ll think holistically about how data flows from device to app to cloud and how failures are detected...SuggestedRemote workWork visa
- ...developing advanced robotic automation systems for highly precise manufacturing applications. They're looking for a Principal Software Engineer to lead the development of sophisticated robotic systems, focusing on industrial robotic arms, collision-free motion...SuggestedRelocation package
$107.5k - $204.5k
...than 100 years of experience and renowned engineering expertise to meet the needs of today’s... ...deploy the systems to help support tactical software development, testing, and delivery for... ...intent, output requirements and input data acquisition. Ensures hardware and software...SuggestedTemporary workWork experience placementInterim roleWork at officeRemote workRelocationFlexible hours$195k - $235k
...Join our fast-paced and passionate team as a Principal Software Engineer on our Robotic Automation team. As we scale, you will be instrumental in... ...architecture and development of our fleet management, robotics data management, and manufacturing execution software (MES)...SuggestedFull timeLocal area- ...Principal Engineer, Ai/Ml & Cloud Company description A division of Publicis Groupe, Publicis... ...operate as a force multiplier across the AI/data science and platform engineering teams... ...AI and cloud architecture. Cloud & software engineering Hands-on experience designing...SuggestedWorldwideFlexible hours
$199.1k - $348.4k
...Description It all started when engineer Fred Luddy wrote code that... ...brings together any AI, any data, and any workflow— helping 85... ...The Role As a Principal Engineer in HRSD, you set the... ...You Bring ~10+ years of software engineering, with a record of...Contract workWork at officeImmediate startRemote workFlexible hours$114k - $171k
...Northrop Grumman Aeronautics Systems is looking to add a Principal Software Engineer - Java to join our team of qualified, diverse individuals... ...intermediate object-oriented programming, design patterns, Data Distribution Service (DDS) messaging, web technologies, Unified...Full timeRemote workRelocation packageShift work- ...Senior Mobile Software Engineer (iOS) San Diego, CA (Hybrid on-site 3x per week) A venture-backed medical device startup in San Diego is... ...including onboarding, device pairing, therapy features, alerts and data visualization Build reliable BLE communication between the...Local areaRemote work
- ...Senior/Principal Embedded Software Engineer San Diego, CA (Hybrid On-site 3X Per Week) A venture-backed medical device startup in San Diego is hiring a Senior Embedded Software Engineer to own firmware for its wearable insulin delivery device, from low-level drivers...Immediate startRelocation
$132.4k - $251.6k
...than 100 years of experience and renowned engineering expertise to meet the needs of today's... ...future of aerospace and defense. The Software organization develops software applications... ...superior solutions. Our Senior Principal Embedded Real-Time Software Developer/Integrator...Temporary workWork experience placementWork at officeRemote workRelocationFlexible hours$142.2k - $213.4k
...Grumman Aeronautics Systems is looking to add a Senior Principal Embedded Software Engineer to join our team of qualified, diverse individuals within... ...resolve problems on program intent, output requirements, input data acquisition, programming techniques and controls. Duties...Relocation packageShift work- ...Sr or Principal Embedded SW Engineer – Our client is a well known developer of systems to improve the connectivity, stability performance, and... ...SW Engineer will be responsible for implementing embedded software that forms part of our product line. This role will support...Work experience placementWork at officeRelocation package
$100k - $140k
...San Diego, CA, US Date Posted: 2026-11-12 Category: Software Subcategory: SW Testing Schedule: Full-Time... ..._SITE Description SAIC is seeking a Principal Software Test Engineer to support advanced submarine communication systems. Join...Full timeWork at officeRemote workShift work$132.4k - $251.6k
...than 100 years of experience and renowned engineering expertise to meet the needs of today's... ...shape the future of aerospace and defense. Software Security Sensors and Effectors (S3E) Department is looking to hire a Sr Principal Software Security Engineer in Tucson, AZ....Temporary workWork experience placementInterim roleWork at officeRemote workFlexible hours$195k - $235k
...Description Join our fast-paced and passionate team as a Senior Principal Robotics Software Engineer. As we scale, you will be instrumental in building our... ...for excellence to assure accuracy of execution schedule, data quality and integrity, conformance to company best...Full timeLocal areaImmediate start$230.77k - $323.08k
...part of Advanced Concepts and Enterprise Engineering (ACE), supporting Blue Origin’s mission... ...a satellite constellation of orbital data centers, Sunrise, designed to transform... ...infrastructure is deployed and leveraged. As a Principal Software Engineer for Compute, you will be the...Permanent employmentFull timeTemporary workLocal areaWeekend work$45.12 per hour
...Company Description It all started when engineer Fred Luddy wrote code that automated a tedious task for his coworker, Phyllis. She cried... .... Our ServiceNow AI platform brings together any AI, any data, and any workflow- helping 85% of the Fortune 500® work smarter,...Full timeInternshipWork at officeImmediate startRemote workFlexible hours- ...Responsibilities Support software engineering, development, testing, integration, and implementation of submarine communication systems. Write clean, efficient, and documented code in C, C++, and Java. Support requirements analysis, design, coding, testing, and...Full timeWork at office
- ...Description Job Description Summary: The engineer in this position should have a wealth of... ...include the complete engineering of data centers including, but not limited to, infrastructure... ...An advanced understanding of various software packages including MS Word, spreadsheet/...For contractorsWork at officeLocal area
$150k - $220k
Job description: Senior or Principal Software Engineer (Full-time, On-site, San Diego, CA)We are seeking an experienced Principal orSenior Embedded Software Engineer to design and develop embedded software for space-based systems, including computer boards. This is a hands...Full time$160k - $190k
...Senior Data Engineer (Snowflake) What would you build if you had the opportunity to help shape a new enterprise data platform from the start? Do you have deep, hands-on Snowflake experience and enjoy working across SQL, Python, data pipelines, security, CI/CD and...Work at office- ...Robert Half is partnering with a well-known brand seeking an experienced Data Engineer that’s investing heavily in building out scalable data pipelines within an Azure ecosystem (Databricks / Synapse). This is a hands-on role focused on data transformation and modeling...Full time
$61.9k - $141k
...Job Number: R0252062 Data Engineer The Opportunity: Ever-expanding technology like IoT, machine learning, and artificial intelligence... ...3+ year of experience within data engineering, data science, software engineering, or pipeline development ~ Experience with ETL...Full timeContract workPart timeLocal areaRemote work$168.1k - $227.4k
...The Role In this role, you will participate in all phases of software development from requirements through implementation and test... ...- Experience as a mentor, tech lead or leading an engineering team PREFERRED QUALIFICATIONS - 5+ years of full software...Permanent employmentInternshipLocal areaFlexible hours- ...Senior Data Engineer Luna Health created Sleep-Only Automation™: insulin delivery that works while you sleep and disappears when you... ...instrumentation specifications and data models, and work with software engineering and operations to see them implemented correctly...Work at officeWork visaNight shift3 days per week
$62.89 per hour
...Company Description It all started when engineer Fred Luddy wrote code that automated a tedious... ...AI platform brings together any AI, any data, and any workflow- helping 85% of the... ...function or industry. Working knowledge of software development, including writing, reading,...InternshipWork at officeImmediate startRemote workFlexible hours$124k - $190k
...Senior Data Engineer Job Description Overview CoStar Group (NASDAQ: CSGP) is a leading global provider of commercial and residential real estate information, analytics, and online marketplaces. Included in the S&P 500 Index, CoStar Group is on a mission to digitize...Full timeWork from home- ...focuses on your long-term career development while valuing your unique skills and experiences. Your Role And Responsibilities Data Engineer embedded with the client's teams to design and deliver hands-on solutions on the AWS/Databricks platform. The role combines...Worldwide
$109.3k - $191k
...systems used across automotive, aerospace, and life sciences industries. Their analytics team is expanding and seeking a Senior Data Engineer to help scale a cloud-based analytics platform that powers data‑driven insights for customers worldwide. About the Role...Full timeWorldwide- ...IT Support Engineer | San Diego, CA | 3 month contract Do not reach out if you are c2c I'm working with an established IT services provider looking to hire an IT Support Engineer to support clients across the financial services industry. This is a hands-on...Contract workRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Principal Software Engineer, Data Engineering. Be the first to apply!
- principal software engineer San Diego, CA
- junior data engineer remote San Diego, CA
- data platform engineer San Diego, CA
- principal data engineer San Diego, CA
- data engineer analytics San Diego, CA
- data science developer San Diego, CA
- data engineer manager San Diego, CA
- big data developer San Diego, CA
- big data devops engineer San Diego, CA
- data center engineer San Diego, CA








