Senior Data Platform Engineer

Kestra Financial

Lead with Purpose. Partner with Impact.

We are seeking a seasoned Databricks Data Engineer with expertise in Azure cloud services and the Databricks Lakehouse platform. The role involves designing and optimizing large-scale data pipelines, modernizing cloud-based data ecosystems, and enabling secure, governed data solutions. Strong skills in SQL, Python, PySpark, ETL/ELT frameworks, and experience with Delta Lake, Unity Catalog, and CI/CD automation are essential.

What you’ll Do:

Design, build, and optimize large-scale data pipelines on the Databricks Lakehouse platform, ensuring reliability, scalability, and governance.
Modernize the Azure-based data ecosystem, contributing to cloud architecture, distributed data engineering, data modeling, security, and CI/CD automation.
Utilize Apache Airflow and similar tools for orchestration and workflow automation.
Work with financial or regulated datasets, applying strong compliance and governance practices.
Develop and optimize ETL/ELT pipelines using Python, PySpark, Spark SQL, and Databricks notebooks.
Design and optimize Delta Lake data models for reliability, performance, and scalability.
Implement and manage Unity Catalog for RBAC, lineage, governance, and secure data sharing.
Build reusable frameworks using Databricks Workflows, Repos, and Delta Live Tables.
Create scalable ingestion pipelines for APIs, databases, files, streaming sources, and MDM systems.
Automate API ingestion and workflows using Python and REST APIs.
Support data governance, lineage, cataloging, and metadata initiatives.
Enable downstream consumption for BI, data science, and application workloads.
Write optimized SQL/T-SQL queries, stored procedures, and curated datasets for reporting.
Automate deployments, DevOps workflows, testing pipelines, and workspace configuration.

What You Bring:

8+ years of experience designing and developing scalable data pipelines in modern data warehousing environments, with full ownership of end-to-end delivery.
Expertise in data engineering and data warehousing, consistently delivering enterprise-grade solutions.
Proven ability to lead and coordinate data initiatives across cross-functional and matrixed organizations.
Advanced proficiency in SQL, Python, and ETL/ELT frameworks, including performance tuning and optimization.
Hands‑on experience with Azure, Snowflake, and Databricks, and integration with enterprise systems.

#J-18808-Ljbffr

Apply

Vacancy posted 5 days ago

Similar jobs that could be interesting for youBased on the Senior Data Platform Engineer in Tempe, AZ vacancy

Senior Data Engineer
TBDGen is proud to be an equal-opportunity employer, committed to diversity and inclusivity. We base employment decisions on merit, experience, and business needs, without considering race, color, national origin, age, religion, sex, pregnancy, genetic information, disability...
Senior
Full time
Gen Digital
Tempe, AZ
2 days ago
Senior Databricks Platform Engineer - Azure
...Kestra Financial, Inc. is seeking a seasoned Databricks Data Engineer to design and optimize large-scale data pipelines on the Databricks Lakehouse platform within an Azure environment. The role emphasizes governance, security, and scalable data solutions for regulated...
Senior
Jobleads-US
Tempe, AZ
5 days ago
Sr. Data Engineer
...ITC Infotech is Sr. Data Engineer to join our team in Tempe, AZ. Work Set up: You'll have to be there in office for 4 business days in... ...working in Agile product delivery teams Exposure to modern data platform modernization initiatives What We're Looking For...
Senior
Full time
Work at office
Local area
Day shift
Early shift
ITC Infotech
Tempe, AZ
4 days ago
Senior Data Engineer
...Senior Data Engineer Duration: 12-month contract that may extend Location: Hybrid onsite 3 days a week in one of the following areas... ...through Friday MUST HAVE ~ Google Cloud Platform - 5 to 6 yrs. ~ AI exposure - 6 months to a year ~ Demonstrable...
Senior
Contract work
Monday to Friday
3 days per week
Anveta
Chandler, AZ
3 days ago
Senior AI Mobile Engineer - Tulip Platform
...sustainable partner. \n \n About Role: \n The Senior AI Mobile Engineer - Tulip Platform is a hands-on role responsible for designing, building,... ...mobile-first digital processes, including offline-first data capture, sync and conflict resolution, push notifications...
Senior
Local area
Remote work
Shift work
ITC Infotech
Tempe, AZ
3 days ago
Senior AI Desktop Engineer - Tulip Platform
...sustainable partner. \n \n About Role: \n The Senior AI Desktop Engineer - Tulip Platform is a hands-on role responsible for designing, building,... ...enterprise SSO on managed Mac and Windows endpoints, local data protection using the OS keychain and credential vault,...
Senior
Local area
Remote work
ITC Infotech
Tempe, AZ
3 days ago
Senior Mechanical Engineer (Mission Critical/Data Center)
...places. Great projects. kW Mission Critical Engineering, a WSP company, is a high-performance,... ...paced consulting engineering firm designing data centers and mission critical environments... ..., is currently initiating a search for a Senior Mechanical Engineer for our Tempe, AZ...
Senior
For contractors
Work at office
Local area
Flexible hours
WSP Group
Tempe, AZ
5 days ago
Senior PostgreSQL Engineer — High-Volume Data Platform
...Verra Mobility Corporation seeks an experienced Senior Database Engineer to own the design, performance, and reliability of our relational data platform on AWS. This hands-on, multi-tenant role focuses on zero-downtime schema changes, durable data storage, and scalable...
Senior
Jobleads-US
Mesa, AZ
3 days ago
Senior Field Engineer - Data Center Services
$34 - $42 per hour
Job Summary:The Senior Field Engineer - Data Center Services will be able to install and operate most types of low-voltage/structured cabling systems and equipment. General Job Duties and Responsibilities:The Senior Field Engineer - Data Center Services will be able to...
Senior
Contract work
Temporary work
For contractors
For subcontractor
Work at office
IES Holdings
Tempe, AZ
17 hours ago
Junior Data Platform Engineer
...we are looking for entry-level software programmers, Java Full stack developers, Python/Java developers, Data analysts/Data Scientists, and Machine Learning engineers. Who Should Apply: Recent Computer science/Engineering/Mathematics/Statistics or Science graduates...
H1b
SynergisticIT
Gilbert, AZ
2 days ago
Senior Data Engineer (Remote)
$89.3k - $148.8k
...Senior Data Engineer role on the Customer Intelligence Data Engineering team focused on designing and delivering scalable data solutions.... ...Gather, document, and refine requirements for data products and platforms Create and maintain technical documentation for data...
Senior
Remote work
Stryker
Tempe, AZ
2 days ago
Senior Data Engineer (Remote)
$89.3k - $178.6k
...As a Senior Data Engineer on Stryker’s Customer Intelligence Data Engineering team, you will provide tactical execution and delivery of projects... ...business and technical requirements for data products, platforms, and solutions. Create and maintain technical...
Senior
Full time
Temporary work
Remote work
Flexible hours
Stryker
Tempe, AZ
1 day ago
Senior Engineer, ADL Platform Admin
...future as we are, join our team.KPMG is currently seeking a Senior Engineer, ADL Platform Administrator to join our Digital Nexus technology... ...comprehensive administration and operational support for the Azure Data Lake platform, specifically managing Azure Databricks,...
Senior
Work experience placement
H1b
Local area
KPMG
Tempe, AZ
17 hours ago
Data engineer
...Purple DriveData engineer Share Contractual Tempe, AZRole Description:Strong understanding... ...into functional Varicent models, including data models, workflows, calculations, and... ...incentive structures within the Varicent platform. Develop and maintain ETL processes and data...
Purple Drive
Tempe, AZ
4 days ago
Junior Data Scientist with Data Engineering Skills
$95k - $150k
...Junior Data Scientist With Data Engineering SkillsSeeking a motivated Junior Data Scientist with Data Engineering skills to join our tech clients... ...tools such as Spark, Hadoop, or KafkaExposure to cloud platforms (AWS, Azure, or GCP)Understanding of DevOps practices for...
Work experience placement
Internship
SynergisticIT
Tempe, AZ
2 days ago
Data Engineer
$140.5k - $221.5k
...impact to join our team. What you'll do As a member of our Data Platform team, you'll help build infrastructure and tools for... ...order to fuel Viasat growth. The day-to-day In this Software Engineer role, you will own core components of data ingestion and integration...
Hourly pay
Work experience placement
ViaSat
Tempe, AZ
4 days ago
Data Engineer
$55 - $65 per hour
...Data Engineer Location: Tempe, AZ (Onsite) Contract: 12 month Schedule: Monday-Friday | 8:00 AM-5:00 PM Benefits: This position is eligible for medical, dental, vision, and 401(k). Pay: 55$ - 65$ an hour Position Summary The Data Engineer will build...
Contract work
Local area
Monday to Friday
Addison Group
Tempe, AZ
3 days ago
Technology and Data - Network Engineer 2 - Contingent
..., you may: Participate in low to moderately complex initiatives and identify opportunity for process improvements within Network Engineering. Review and analyze basic or tactical Network Engineering assignments or challenges that require research, evaluation, and selection...
Mindlance
Tempe, AZ
1 day ago
Principal - GitHub & Azure DevOps Platform Engineering
...Principal Architect - GitHub & Azure DevOps Platform EngineeringPosition Summary:We are... ...Architect - GitHub & Azure DevOps Platform Engineering to lead the strategy, architecture,... ...productivity services across the organization.As a senior technical leader, you will help drive...
Full time
H1b
Work at office
Worldwide
Flexible hours
Northern Trust
Tempe, AZ
2 days ago
Data Test Engineer
$120k - $140k
...financial solutions. By leveraging proprietary data and analytics, our solutions are tailored... ...Job Description As a Data Test Engineer , you'll impact on the lives of everyday... ...Working knowledge of Google Cloud Platform (GCP), especially in environments leveraging...
Contract work
Remote work
Work from home
ACHIEVE
Tempe, AZ
1 day ago
Advisory Seasonal Intern, Federal Technology Enablement - PhD Data Science/Data Engineer | Summer 2027
$86k - $100k
...digital innovation, we deliver intelligent, data-driven solutions to help our clients... ...Technology Enablement - PhD Data Science/Data Engineer for our Advisory practice.... ...Dash, Plotly, Shiny); experience with cloud platforms (AWS, Azure, GCP) and containerization technologies...
Summer work
Internship
Seasonal work
H1b
Work at office
Local area
Remote work
Night shift
KPMG LLP
Tempe, AZ
2 days ago
Advisory Seasonal Intern, Federal Technology Enablement - PhD Data Science/Data Engineer | Winter 2027
$86k - $100k
...digital innovation, we deliver intelligent, data-driven solutions to help our clients... ...Technology Enablement - PhD Data Science/Data Engineer for our Advisory practice.... ...Dash, Plotly, Shiny); experience with cloud platforms (AWS, Azure, GCP) and containerization technologies...
Internship
Seasonal work
H1b
Work at office
Local area
Remote work
Night shift
KPMG LLP
Tempe, AZ
2 days ago
Senior Quantitative Analyst
$105k - $155k
...Senior Quantitative Analyst Apply Now Remote or Hybrid at Glen Mills ,... ...substantial, ongoing investment in technology, data, and analytics, we are expanding our... ...Bachelor's degree in Statistics, Mathematics, Engineering, Finance, Economics, Data Science, or a...
Senior
Full time
Work at office
Remote work
Flagship Financial Group
Tempe, AZ
2 days ago
Sr. Controls Engineer, Data Center, Colocation Regional Engineering - AMER
$136.6k - $184.8k
...keep the cloud running. We support all AWS data centers and all of the servers, storage,... ...team of software, hardware, and network engineers, supply chain specialists, security experts... ...comprehensive and broadly adopted cloud platform. We pioneered cloud computing and never...
Senior
Local area
Remote work
Flexible hours
Amazon
Mesa, AZ
1 day ago
Senior Principal AI Security Architect - Enterprise AI Security
Northern Trust is seeking a Senior Principal AI Security Architect in Tempe, AZ to lead... ...design with strategic governance, guiding AI platforms, agentic systems, and emerging... ...Security, Enterprise Architecture, and Engineering. You will develop reusable reference architectures...
Senior
Jobleads-US
Tempe, AZ
3 days ago
Azure Databricks Data Engineer
...Azure Databricks Data EngineerOur client, an IT Services and Consultant company, is looking for an Azure Databricks Data Engineer for their Fort Worth, TX / Tempe, AZ / Hybrid location.... ...Data Lake Storage (ADLS Gen2)SQLAzure Platform SkillsAzure DatabricksAzure Data Factory...
ICONMA
Tempe, AZ
1 day ago
Data Engineer Sr. Consultant
$127k - $150k
Position Summary Healthcare Data Engineer Sr. Consultant Deloitte Consulting's technology... ...scalable healthcare data platforms and integration pipelines across claims... ...eligibility, medical, and pharmacy domains. Senior Data Engineer responsible for designing...
Senior
Local area
Visa sponsorship
Deloitte
Gilbert, AZ
2 days ago
Senior AWS DevOps Engineer
...specialize in leveraging advanced technologies such as AI, cloud, and data-led innovation to help our clients accelerate growth and unlock... ...Skill and ExperienceExperience inGitLab AdministrationGitLab Platform OperationsAWS (EC2, RDS, S3, CloudFormation, EKS)CI/CD Pipeline...
Senior
Full time
Temporary work
Relocation
Infosys Technologies
Tempe, AZ
5 days ago
Senior Principal Software Engineer
$159.75k - $225.5k
...who they uniquely are.We are seeking a Senior Principal Software Engineer to lead the design and development of next-generation Agentic AI platforms and applications that power... ...business KPIsPartner with Product, UX, and Data teams to translate AI capabilities into...
Senior
Remote work
Shutterfly
Tempe, AZ
1 day ago
Senior Information Security Analyst / Engineer
...has been propelled by the top engineers in mixed-signal processing.... ...security solutions that protect our data and technology ecosystem.... ...configuration across mixed platform, on-prem, hybrid, ecosystem,... ...posture for stakeholders and senior leadership.Required Skills and...
Senior
Full time
Work at office
Remote work
Work visa
2 days per week
Cirrus Logic
Chandler, AZ
3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Platform Engineer. Be the first to apply!