Principal IT Data Engineer - Data & Analytics

Principal It Data Engineer

Our Data & Analytics group is responsible for working with various business owners/stakeholders from Sales, Marketing, People, GCS, Infosec, Operations, and Finance to solve complex business problems which will have a direct impact on the metrics defined to showcase the progress of Palo Alto Networks. We leverage the latest technologies from the Cloud & Big Data ecosystem to improve business outcomes and create through prototyping, Proof-of-Concept projects and application development. We are looking for a Principal IT Data Engineer with extensive experience in Data engineering, SQL, Cloud engineering and business intelligence (BI) tools. The ideal candidate will be responsible for architecting, designing, implementing, and maintaining scalable data transformations and analytical solutions that support our business objectives. This role requires a strong understanding of data engineering principles, as well as the ability to collaborate with cross-functional teams to deliver high-quality data solutions.

Key Responsibilities

• Design, develop, and maintain data pipelines to extract, transform, and load (ETL) data from various sources into our data warehouse or data lake environment.
• Aptitude for proactively identifying and implementing GenAI-driven solutions to achieve measurable improvements in the reliability and performance of data pipelines or to optimize key processes like data quality validation and root cause analysis for data issues, is a nice-to-have.
• Collaborate with stakeholders to gather requirements and translate business needs into technical solutions.
• Optimize and tune existing data pipelines and transformations for performance, reliability, and scalability.
• Implement data quality and governance processes to ensure data accuracy, consistency, and compliance with regulatory standards.
• Work closely with the BI team to design and develop dashboards, reports, and analytical tools that provide actionable insights to stakeholders.
• Mentor junior members of the team and provide guidance on best practices for data engineering and BI development.
• Drive new and improved processes to increase engineer productivity.
• Good to have a trusted technical advisor / thought leader, identifying and integrating emerging technologies (e.g., AI/ML, agentic frameworks, AI-first architectures, cloud-native platforms) and guiding teams to adopt innovative best practices that ensure systems remain adaptable and future-ready.

Qualifications

Required Qualifications

• Minimum of 12 years of related experience with a Bachelor's degree in Computer Science, Engineering, or a related field or 8 years and a Master's degree; or a PhD with 5 years experience.
• 5+ years of experience in data engineering, with a focus on building and maintaining data pipelines and analytical solutions.
• Expertise in SQL programming and database management systems.
• Hands-on experience with ETL tools and technologies such as Apache Spark and Apache Airflow.
• Experience with cloud platforms (preferably GCP) and services like Dataflow, DataProc, BigQuery, and Cloud Composer.
• Experience in AI Tools and good understanding of implementing AI in development lifecycle is mandatory
• Demonstrated readiness to leverage GenAI tools to enhance efficiency within the typical stages of the data engineering lifecycle, for example by generating complex SQL queries, creating initial Python/Spark script structures, or auto-generating pipeline documentation, is a nice-to-have.

Preferred Qualifications

• Experience with Big Data tools like Kafka.
• Proficiency in object-oriented or object-functional scripting languages such as Python or Scala.
• Experience with BI visualization platforms like Tableau.
• Familiarity with SFDC Data Objects (e.g., Opportunity, Quote, Accounts).
• Aptitude for leveraging GenAI tools to enhance efficiency in the data engineering lifecycle.

Compensation Disclosure

The compensation offered for this position will depend on qualifications, experience, and work location. For candidates who receive an offer at the posted level, the starting base salary (for non-sales roles) or base salary + commission target (for sales/com-missioned roles) is expected to be the annual range listed below. The offered compensation may also include restricted stock units and a bonus. A description of our employee benefits may be found here.

$167,000.00 - $270,500.00/yr

Our Commitment

We're trailblazers that dream big, take risks, and challenge cybersecurity's status quo. It's simple: we can't accomplish our mission without diverse teams innovating, together.

We are committed to providing reasonable accommodations for all qualified individuals with a disability. If you require assistance or accommodation due to a disability or special need, please contact us at View email address on click.appcast.io.

Palo Alto Networks is an equal opportunity employer. We celebrate diversity in our workplace, and all qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or other legally protected characteristics.

All your information will be kept confidential according to EEO guidelines.

Is role eligible for Immigration Sponsorship? No. Please note that we will not sponsor applicants for work visas for this position.