Big Data Engineer with PySpark

$154k - $194k

Full-time

VITS US

Irving, TX

Salary: $154,000 - 194,000 per year Requirements:

7+ years of professional experience in Big Data Engineering
Hands-on experience with Apache Spark and PySpark
Programming experience with Python and/or Scala
Strong SQL skills and experience with relational databases
Hands-on experience with Hadoop, HDFS, Hive, and MapReduce
Experience with Apache Kafka and real-time data processing
Experience building ETL/ELT pipelines and processing large datasets
Knowledge of distributed computing, Big Data architecture, and data warehouse or data lake concepts
Experience with Git and CI/CD
Strong troubleshooting and performance-tuning skills
Experience with one or more of these cloud and modern data technologies is highly preferred: AWS (S3, EMR, Glue, Redshift, Lambda), Azure (ADLS, Databricks, Azure Data Factory, Synapse), GCP (BigQuery, Dataproc, Cloud Storage), Databricks, or Snowflake
Preferred: Experience developing batch and streaming pipelines, Apache Airflow or similar orchestration tools, data modeling, Docker/Kubernetes, data governance, security, data quality frameworks, and Agile/Scrum practices
Strong communication and analytical problem-solving skills

Responsibilities:

Design, develop, and maintain scalable Big Data pipelines and data-processing solutions
Build batch and real-time applications using Apache Spark and PySpark
Develop and optimize ETL/ELT pipelines for large-scale processing
Use Hadoop, HDFS, Hive, Spark, Kafka, and other Big Data technologies
Write complex SQL queries and optimize processing jobs for performance
Create data ingestion and transformation processes for structured and unstructured sources
Develop real-time streaming pipelines using Kafka and Spark Streaming
Perform data cleansing, transformation, validation, and quality checks
Troubleshoot pipeline failures and improve scalability and reliability
Work with cloud-based data platforms and storage services
Collaborate with data architects, data scientists, analysts, application developers, and engineering teams
Apply data security, governance, and access-control best practices
Participate in code reviews, testing, deployment, and production support
Contribute to Agile/Scrum activities and technical documentation

Technologies:

Airflow
AWS
Lambda
Redshift
Azure
Big Data
BigQuery
CI/CD
Cloud
Data Warehouse
Databricks
Docker
ETL
GCP
Git
Hadoop
Hive
Support
Kafka
Kubernetes
Python
PySpark
SQL
Scala
Security
Snowflake
Spark

More:

We are hiring a Big Data Engineer for a full-time hybrid role in Irving, Texas. The position involves working closely with data scientists, analysts, application developers, and business stakeholders to deliver scalable data solutions. The interview process includes a face-to-face interview.

last updated 42 week of 2026

Apply

Vacancy posted 2 days ago

Similar jobs that could be interesting for youBased on the Big Data Engineer with PySpark in Irving, TX vacancy

Senior Data Engineer
Job Title: Sr. DATA Engineer Work LocationTampa FLJob Description:Mandatory Karat InterviewRole... ...will have strong expertise in big data processing using PySpark and a deep understanding of data... ...datasets efficiently and integrating with Iceberg table formatsData Warehousing...
Big data
LTM
Irving, TX
5 days ago
Data Engineer
...Data EngineerGlobal Financial Firm located in Irving, TX... ...opportunity for an experienced Data Engineer.Responsibilities:Partner with project managers, business... ...data pipelines using PySpark.Collaborate with data... ...programming skills.Experience with Big Data ecosystems, including...
Big data
Contract work
Immediate start
Axelon
Irving, TX
3 days ago
Sr. Data Engineer
...Sr. Data Engineer Opportunity At Orion180At Orion180, we don't just stand... .... You will collaborate with data scientists, analysts, and... ...scripting proficiency in Python (or PySpark).Orchestration & ETL:... ...pipelines in Azure Data Factory.Big Data Compute: Proven experience...
Big data
Work at office
Orion180
Irving, TX
1 day ago
Senior Data Platform Engineer
$107.12k - $160.68k
...highly skilled and motivated Senior Data Platform Engineer, AVP (Python/PySpark, Microsoft SSIS, SQL Server, ETL & Database... ..., and large-scale data platforms, with experience troubleshooting... ...orchestration platforms such as AutoSys.Big Data Platforms: Work with Hadoop ecosystem...
Big data
Full time
Citigroup
Irving, TX
5 days ago
Sr Data Engineer
• Analyze and understand data sources & APIs• Design and Develop... ...from the store• Work closely with data Scientists to ensure the... ...Payments Required Technical Skills • Big Data-Hadoop, NoSQL, Hive,... ...Exposure to machine learning engineering• Exposure to NLP and text processing...
Big data
NTT DATA
Irving, TX
3 days ago
Data Engineer - Lakehouse (PySpark / Databricks / Airflow / AWS)
...WiproContact: Meghana GorusuCompany: SRI Tech SolutionsRole: Data Engineer - Lakehouse (PySpark / Databricks / Airflow / AWS)Location: Dallas, TX (Day 1... ..., reporting, and regulatory needs. Works extensively with PySpark on Databricks, orchestrates workflows with Apache...
SRI Tech
Dallas, TX
2 days ago
Sr Databricks Data Engineer
$116.2k - $229.1k
...Join Deloitte’s AI & Engineering practice and help organizations... ...platforms, modernize data environments, and... ...transformation. You will work with business and technology... ..., and integrate new big data and analytics... ...quality frameworks using PySpark • 1+ year leading complex...
Big data
Local area
Visa sponsorship
Deloitte
Dallas, TX
4 days ago
Principal Data Engineer
...and would like to start a promising career with a global leader, take a look at the... ...highly skilled and experienced Principal Data Engineer to join our team. As a Principal Data Engineer... ...performance and scalability. Leverage big data technologies and frameworks (e.g., Hadoop...
Big data
Full time
Local area
TXU Energy
Irving, TX
2 days ago
Data Engineer II
...Data Solutions EngineerAs a part of our Big Data Product team, the Data Solutions Engineer will be responsible for developing and validating Big data products and applications... ...data modeling and ETL standards, collaborate with Product Managers, Architects and Senior Developers...
Big data
Work experience placement
Samprasoft
Irving, TX
1 day ago
Sr. Associate, Data Engineer - PySpark
...to advance their careers and expertise with KPMG. Looking ahead, we anticipate continued... ...is currently seeking a Sr. Associate, Data Science Engineer to join our Consulting practice.... ...MLOps, with hands-on expertise in Python, PySpark, SQL, Databricks, and Snowflake, while...
H1b
Local area
KPMG
Dallas, TX
2 days ago
AWS Data Engineer
$150k - $170k
...submitted Role: Senior Data Engineer Salary: $150,000-170,000... ...our data systems and services with other data engineers to deliver... .../ELT pipelines using Python, PySpark, and AWS Glue. Build robust... ...Tableau, Quicksight, Looker, big data and Realtime BI...
Big data
Local area
Remote work
LHH
Dallas, TX
4 days ago
Data Engineer
...Expression is seeking an experienced Data Engineer to support the design,... ...candidate will collaborate with product managers, full-stack... ...such as Spark, Databricks, and PySpark. Experience developing machine... ...contractors and a Top 20 Big Data Solutions Provider by CIO...
Big data
Full time
For contractors
Work at office
Immediate start
Expression Networks
Arlington, TX
1 day ago
Lead Data Engineer
...Lead Data EngineerLennar is one of the nation's leading homebuilders... ...mission of the Lead Data Engineer role is to help our business evolve... ...engineering solutions along with the team. In addition, this... ...Cloudwatch etc.AWS certification is big plusSnowflake Data...
Big data
Live in
Lennar
Irving, TX
1 day ago
Data Engineer with DevOps
...Job Description Job Title: Senior Data Engineer with DevOps Duration : Full Time Location... ...of experience in data engineering and big data processing ~ Strong expertise in... ...Apache Spark (Spark Core, Spark SQL) and PySpark for large scale batch processing ~ Experience...
Big data
Hourly pay
Full time
System One
Dallas, TX
8 days ago
Pyspark Engineer
OverviewThe Infosys Data and Analytics (DNA) unit is at the forefront of transforming... ..., you'll have the opportunity to work with cutting-edge technologies, collaborate... ...ExperienceExperience in programming languages: Big Data, Spark/PySpark, SQL, Python, and Shell scripting....
Big data
Full time
Temporary work
Relocation
Infosys Technologies
Irving, TX
3 days ago
Director, Data Engineering
...way healthcare brands engage with people. Driven by insight, we... ...The Role: The Director of Data Engineering, owns the data strategy, architecting... ...format. Proficient in big data technologies such as... ...pipelines for AI/ ML models using PySpark or Python. ~4+ years of...
Big data
Odd job
Temporary work
Live in
Remote work
Work from home
Brado
Dallas, TX
1 day ago
GCP Data Engineer
...GCP Senior Big Data Engineer/ArchitectLooking for a Senior Big Data Engineer/Architect on Google Cloud Platform to help strategize, architect... ...communication skills exhibiting right negotiating posture with customer and program teams to make the right decisions.Experience...
Big data
Samprasoft
Irving, TX
3 days ago
Hadoop Developer / Big Data Developer
...MySQL, PostgreSQL, RDBMS)2+ years in Hadoop - HDFS, Hive, MapReduce, HBase2+ years of experience with NOSQL database - HBase1+ years of working knowledge in Kafka/Storm data pipelines6+ years of experience in working in a Data warehouse environment4+ years of Linux...
Big data
LanceSoft
Irving, TX
2 days ago
Data Engineer - Hybrid
$75.17k - $130.5k
Req ID:376258NTT DATA strives to hire exceptional, innovative and... ...individuals who want to grow with us. If you want to be part of... ...are currently seeking a Data Engineer - Hybrid to join our team in Irving... ...building data pipelines using PySpark, Django, or similar frameworks...
Temporary work
Work at office
Remote work
Flexible hours
NTT DATA
Irving, TX
5 days ago
Data Engineer MS Fabric
Overview We are looking for a Senior Data Engineer with strong 7-10 year hands-on experience in Azure and Microsoft Fabric to help modernize... ...have experience with Azure Data Factory, notebooks, Spark/PySpark, and building scalable data pipelines that support analytics...
Full time
Flowserve
Irving, TX
3 days ago
Senior Data Engineer
...is an iconic family of brands with over 86,000 locations, surpassing... ...deploy, and support reliable data pipelines, data products, and... ....KEY RESPONSIBILITIES1. Data Engineering· Build, test, deploy, and support... ..., Spark, SQL, Python/PySpark, dbt, Airflow, or similar tools...
Hourly pay
7 eleven
Irving, TX
6 days ago
Senior Data Engineer - Periscope
$195.3k - $199.2k
...building long-term capabilities with our clients is not easy work.... ..., and maintain scalable data pipelines and systems using Databricks... ...be leading and executing data engineering projects from inception to... ..., with a strong background in big data technologiesProficiency in...
Big data
Apprenticeship
Easy work
McKinsey & Company
Dallas, TX
4 days ago
Google Data Engineer
$100k - $115k
Role: Data EngineerWho You’ll Work WithAt Slalom we co-create custom... ...data, AI, and cloud products with clients who are ready to... ...injecting intelligence into products, engineering systems that support learning... ..., cloud-native platforms.* Big Data Platforms (Dataproc, Apache...
Big data
Temporary work
Work at office
Local area
Flexible hours
Slalom
Dallas, TX
4 days ago
Data Engineer
..."Responsibilities Apply engineering science and technology, including... ...design and implementation of data warehouse and advanced... ...engineering needs associated with advanced analytical capabilities... ...) and SQL. Experience with big data platforms and tools (Spark...
Big data
Qualis1 Inc.
Dallas, TX
1 day ago
Data Engineer
...Purple DriveJob Title: Data EngineerLocation: Dallas, TX / Plano, TX (Onsite)Job SummaryWe are seeking a Data Engineer with strong experience in designing, building, and maintaining... ...Kimball, star schema, SCD).Hands-on with big data frameworks (Spark, Hadoop) and NoSQL...
Big data
Purple Drive
Dallas, TX
4 days ago
Sr Data Engineer
...Sr. Data Engineer As our Sr Data Engineer, you will function as a consultant between our technology... ...enable them to solve those data problems with code. To thrive in this role, you must... ...integration from different sources into Big Data systems is preferable. That...
Big data
AAA - Automobile Club of Southern California
Coppell, TX
1 day ago
Hadoop / ETL Developer and PySpark
...candidatesEmployment Type - FTEJob Description:We are seeking a highly experienced Senior Big Data & DevOps Engineer with 8+ years of professional experience in HDFS, Hive, Impala, PySpark, Python, and DevOps automation tools such as uDeploy and Jenkins. This role is...
Big data
Full time
SRI Tech
Dallas, TX
2 days ago
Senior Architect, Data Engineering
$215.2k - $244.7k
...Experience Practice. This is an excellent opportunity to work with clients developing Big Data strategy and roadmaps, while gaining exposure to a... ...on experience with Large Language Models (LLMs), prompt engineering, embeddings, vector databases, and Retrieval-Augmented Generation...
Big data
Local area
Immediate start
Flexible hours
West Monroe Partners
Dallas, TX
4 days ago
Data Engineer
...Remote We are seeking an experienced Data Engineer to support challenging data engineering,... ...science capabilities. You will work closely with data scientists and other technical... ...6! We specialize in everything data from big data to data science, data engineering, software...
Big data
Temporary work
Local area
Remote work
Illumination Works
Dallas, TX
2 days ago
GCP Data Engineer
...GCP Data EngineerStrong skills in Python ProgrammingStrong Experience in SQLExperience with data pipeline and workflow management tool: GCP Data Proc, Composser and GCSStrong... ...variety of data sources using SQL, and GCP 'big data' technologies.Work with data and analytics...
Big data
Syntricate Technologies
Dallas, TX
3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Big Data Engineer with PySpark. Be the first to apply!