Sr Data Engineer
ClifyX
Big Data Engineer
Experience Required - 6+ Years Must Have Technical/Functional Skills
Strong hands-on experience in Big Data technologies and distributed data processing frameworks.
Proficiency in Python for data engineering, scripting, and performance optimization.
Extensive experience with Apache Spark (PySpark/Spark SQL) for large-scale data transformation and processing.
Solid experience in designing and developing ETL/ELT pipelines for batch and real-time data processing.
Experience working with Google Cloud Platform (GCP) services such as BigQuery, Cloud Storage, Dataflow, Dataproc, Composer, and Pub/Sub.
Strong understanding of data warehousing concepts, dimensional modeling, and data lake architectures.
Experience with CI/CD pipelines and DevOps practices for data engineering workflows.
Proficiency in version control systems (Git) and build/release management.
Experience with workflow orchestration tools such as Apache Airflow or Cloud Composer.
Experience working in Agile/Scrum environments with cross-functional teams.
Strong analytical and problem-solving skills.
Strong collaboration and stakeholder communication skills.
Roles & Responsibilities
Design, develop, and maintain scalable Big Data pipelines using Spark (PySpark/Spark SQL) for batch and real-time processing.
Build and optimize robust ETL/ELT workflows to ingest, transform, and load data from multiple structured and unstructured sources.
Develop high-performance SQL queries and implement efficient data models to support analytics and reporting needs.
Architect and implement data solutions on Google Cloud Platform (GCP) using services such as BigQuery, Dataproc, Dataflow, Cloud Storage, Pub/Sub, and Composer.
Monitor, troubleshoot, and resolve production issues in distributed and cloud environments.
Automate operational processes and enforce coding standards, version control, and documentation practices.
Collaborate with cross-functional teams including business stakeholders, data engineers, and product teams.
Drive analytics initiatives to provide actionable insights.
Participate in Agile ceremonies including sprint planning, design reviews, and retrospectives.
Continuously improve reporting frameworks and data processes in alignment with Agile delivery practices.
- Required Skills: • Strong Proficiency (9+ years' experience) in Python (Programming Language), Apache Airflow and Google Cloud Data Services. • 7+ years' experience in Python libraires. • 7+ Strong SQL programming experience in Mid/Advance functions.Senior
$75 per hour
***Onsite in Phoenix - AZ- 32337-1 ***Max rate $75 SR DATA ENGINEER with Java, Spark - Look for Core Java with SPARK Job summary Required Skills : Core Java Experience : 4to8Yrs We are seeking a senior data engineer with 4-8 years of experience, specializing...Senior$150k - $190k
...for our internal users, customers and partners. The Senior Data Engineer will be responsible for the analysis, design, and development of... ...solutions focused on data engineering and ETL workflows. As a Sr. Software Engineer - Data, you will work with customers and internal...SeniorWork experience placementWorldwideFlexible hoursShift work$78.18 per hour
...Sr Data Engineer Genesis10 is currently seeking a Sr Data Engineer for a hybrid position with a Major Financial Institution located in Scottsdale, AZ. This is a 12+ month contract opportunity. Summary: This role focuses on designing, developing, and maintaining robust...SeniorHourly payPermanent employmentContract workWork experience placement$126.2k - $264.1k
...days from the posting date or as long as the job remains posted. Career Level - IC5 About Us Only Oracle brings together the data, infrastructure, applications, and expertise to power everything from industry innovations to life-saving care. And with AI embedded...SeniorTemporary workFlexible hours$1,000 per month
...connect viewers to the right content and ads. Our technology and data-driven solutions help companies reach new audiences, engage high... ...024. Wurl is seeking an experienced, detail-oriented data engineer with experience in big data and an understanding of ETL...SeniorWork at officeRemote workWork from homeFlexible hoursShift work$115k - $130k
...of the "Best Banks to Work For" in the U.S. by American Banker. Position Purpose As part of the Technology team, the Senior Data Engineer will act as a subject matter expert (SME) responsible for managing, designing, and optimizing enterprise data pipelines and database...SeniorCurrently hiringRemote work- ...Virtuous Software, Inc. is looking for a Data Migration Engineer in Phoenix, AZ. The role involves extracting, mapping, and importing client data to Virtuous for sophisticated nonprofit customers. Requires strong SQL skills and experience with data migration. Ideal candidates...Senior
- ...Senior Data Engineer – GCP, Scala, Spark & Python Location: Phoenix, AZ (Hybrid) Mandatory Skills: ANSI-SQL, GCP Big Query, Scala Job Description Role Focus: Hands-on data engineering with Spark, Scala, Python, and cloud platforms such as GCP; AWS knowledge...Senior
- Job Post Working knowledge on Big Query Hands on experience on Dataproc Javapython programming language Good Experience on Bigtable Good to have ComposerAirflow experience Good team player communicator can operate independently with minimal guidanceSenior
- ...JOB DESCRIPTION Roles/Responsibilities LOCATION: Phoenix, AZ Design Data Engineering capabilities that cater to the enterprise and span multiple functions such as data ingestion data transformation and define data pipeline standards and documentation...Senior
- ...is seeking an Analytics Developer in Phoenix, Arizona, to enhance analytics for digital and marketing initiatives. You will analyze data requirements, develop solutions, and ensure data integrity across analytics products. This position involves extensive collaboration...Senior
- ...Our client, a leading organization in the financial services industry, is seeking a Senior Data Engineer to join their team. As a Senior Data Engineer, you will be part of the Data Analytics Department supporting cross-functional teams. The ideal candidate will demonstrate...SeniorWeekly payContract workTemporary workFlexible hours
$8,500 per month
...SENIOR DATA ENGINEER Job Code: SRDATENG Reports To: Director, Data Operations & Engineering Base Location: AZ or CO Work Status: Virtual Office Minimum Starting Monthly Range: $8,500 Hiring Range (Monthly Pay): $8,...SeniorFull timePart timeWork at officeLocal areaWork from home- ...Overview Axon is seeking a Data Analytics Engineer to configure system databases, design and maintain scalable analytics solutions, and develop custom reports and dashboards for our software applications. Your Impact We expect you to work with data engineers, business...SeniorWork at office
$106.9k - $176.5k
...wherever you want it to go. Join EY and help to build a better working world. We are seeking a highly skilled Senior Consultant Data Engineer with expertise in cloud data engineering, specifically Databricks. The ideal candidate will have strong client management and...SeniorSummer holidayFlexible hours$113k
...Job Summary Consumer Cellular is seeking skilled Senior Data Engineers who thrive in a highly collaborative, agile team environment. Engineers at Consumer Cellular design elegant technical solutions for complex product requirements, deliver high quality code as part...SeniorHourly pay16 hoursFull timeFlexible hoursShift work$84.63k - $112.84k
...the trusted network for the AI-powered world, connecting people, data, and applications through our expansive fiber network and... ...future of AI-ready connectivity, join us today. The Role Engineers are expected to identify and design solutions for issues involving...SeniorTemporary workRemote work$77k - $202k
...Specialty/Competency: Data, Analytics & AI Industry/Sector: Not Applicable Time Type: Full time Travel Requirements: Up to 60% At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop...SeniorFull timeH1b$140k - $150k
Senior Data Modeler / Analytics Engineer - Phoenix, AZ We’re hiring a Senior Data Modeler / Analytics Engineer to help lead a greenfield data transformation within a large, modern data organization. This is a high-impact, highly visible role focused on building enterprise...SeniorFull time$84.63k - $112.84k
...the trusted network for the AI-powered world, connecting people, data, and applications through our expansive fiber network and... ...today. The Role Cybersecurity Incident Response Team (CIRT) Engineers at Lumen are on the front lines of protecting the systems that...SeniorTemporary workRemote workShift work- A leading IT consulting firm in Phoenix, Arizona is seeking a skilled professional experienced in Hadoop cluster management. Key responsibilities include managing large scale Hadoop clusters, tuning performance, and excellent Linux administration skills. The ideal candidate...Senior
- ...Constantly grow as you work hard for a mission that matters at a company where you matter. Your Impact We are seeking a Senior Data Engineer II to play a pivotal role in building and advancing Axon’s Corporate Data Platform - a best‑in‑class, cloud‑native data warehouse...SeniorWork at officeRemote work
$124k - $280k
...Specialty/Competency: Data, Analytics & AI Industry/Sector: Not Applicable Time Type: Full time Travel Requirements: Up to 60% At PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques to design and develop...SeniorFull timeH1b- A leading engineering firm in Phoenix seeks a Principal Engineer Mechanical to oversee data center infrastructure. This position demands expertise in mechanical and electrical systems, with responsibilities including design reviews, incident analysis, and mentoring. The...Senior
$155k - $235k
...and into insight, application, and expertise. About the Team The Data Platform team sits within Scribd's Infrastructure organization... ..., moving fast, setting standards, and ensuring data works for engineers, analysts, and business users alike. About the Role We're looking...SeniorHome officeFlexible hours- ...benefit program. Generous Paid Time Off. Flexible schedules for work/life balance. Position Profile The Senior Data & AI Engineer will need to have deep hands'on experience in Snowflake, Microsoft Fabric (incl. OneLake), and healthcare data ecosystems. The...SeniorFlexible hours
$140k - $155k
...and location. The position is accountable for ownership of key data technologies including Snowflake, Power BI, Informatica, and related... ...& Team Management Lead, mentor, and develop a team of data engineers and BI developers Establish delivery standards, performance...SeniorFull timeTemporary workLocal areaRemote workWorldwide$102.3k - $209.5k
...Job Description Tracks and monitors ongoing Data Center critical infrastructure maintenance and repair for all service lines to... ...assessments to evaluate suitability for data center builds. Acts as the engineering representative on a wide range of moderately complex on-site...SeniorContract workTemporary workFor contractorsFlexible hoursShift work- Axon Enterprise is seeking a Data Analytics Engineer to develop and support analytics for software applications. The role requires expertise in SQL Server Management Studio and Power BI, and offers a hybrid work model with travel to client locations. You will maintain data...Senior
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Sr Data Engineer. Be the first to apply!
- senior data center engineer Phoenix, AZ
- data engineer machine learning Phoenix, AZ
- remote data engineer Phoenix, AZ
- data science developer Phoenix, AZ
- big data engineer Phoenix, AZ
- data engineering intern summer Phoenix, AZ
- senior data engineer Phoenix, AZ
- data engineer Phoenix, AZ
- hadoop big data developer Phoenix, AZ
- director data engineering Phoenix, AZ

