Big Data Engineer with PySpark
$154k - $194kFull-time
VITS US
Salary: $154,000 - 194,000 per year Requirements:
- 7+ years of professional experience in Big Data Engineering
- Hands-on experience with Apache Spark and PySpark
- Programming experience with Python and/or Scala
- Strong SQL skills and experience with relational databases
- Hands-on experience with Hadoop, HDFS, Hive, and MapReduce
- Experience with Apache Kafka and real-time data processing
- Experience building ETL/ELT pipelines and processing large datasets
- Knowledge of distributed computing, Big Data architecture, and data warehouse or data lake concepts
- Experience with Git and CI/CD
- Strong troubleshooting and performance-tuning skills
- Experience with one or more of these cloud and modern data technologies is highly preferred: AWS (S3, EMR, Glue, Redshift, Lambda), Azure (ADLS, Databricks, Azure Data Factory, Synapse), GCP (BigQuery, Dataproc, Cloud Storage), Databricks, or Snowflake
- Preferred: Experience developing batch and streaming pipelines, Apache Airflow or similar orchestration tools, data modeling, Docker/Kubernetes, data governance, security, data quality frameworks, and Agile/Scrum practices
- Strong communication and analytical problem-solving skills
- Design, develop, and maintain scalable Big Data pipelines and data-processing solutions
- Build batch and real-time applications using Apache Spark and PySpark
- Develop and optimize ETL/ELT pipelines for large-scale processing
- Use Hadoop, HDFS, Hive, Spark, Kafka, and other Big Data technologies
- Write complex SQL queries and optimize processing jobs for performance
- Create data ingestion and transformation processes for structured and unstructured sources
- Develop real-time streaming pipelines using Kafka and Spark Streaming
- Perform data cleansing, transformation, validation, and quality checks
- Troubleshoot pipeline failures and improve scalability and reliability
- Work with cloud-based data platforms and storage services
- Collaborate with data architects, data scientists, analysts, application developers, and engineering teams
- Apply data security, governance, and access-control best practices
- Participate in code reviews, testing, deployment, and production support
- Contribute to Agile/Scrum activities and technical documentation
- Airflow
- AWS
- Lambda
- Redshift
- Azure
- Big Data
- BigQuery
- CI/CD
- Cloud
- Data Warehouse
- Databricks
- Docker
- ETL
- GCP
- Git
- Hadoop
- Hive
- Support
- Kafka
- Kubernetes
- Python
- PySpark
- SQL
- Scala
- Security
- Snowflake
- Spark
More:
We are hiring a Big Data Engineer for a full-time hybrid role in Irving, Texas. The position involves working closely with data scientists, analysts, application developers, and business stakeholders to deliver scalable data solutions. The interview process includes a face-to-face interview.
last updated 41 week of 2026
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Big Data Engineer with PySpark in Irving, TX vacancy
- ...Position: Big Data Engineer Location: Remote Role Summary Excellent Scala, PySpark, Java coding experience for REST API and SOAP webservices Excellent AWS experience (Batch and API microservices) using EMR/EC2/ECS/S3/Airflow/Step Functions, AWS...Big dataRemote work
United IT Solutions
Irving, TX3 days ago - Job Title: Sr. DATA Engineer Work LocationTampa FLJob Description:Mandatory Karat InterviewRole... ...will have strong expertise in big data processing using PySpark and a deep understanding of data... ...datasets efficiently and integrating with Iceberg table formatsData Warehousing...Big data
LTM
Irving, TX4 days ago - ...Big Data Engineer Location: Irving, TX (Day 1 Onsite-Hybrid) Company: Hexaware Primary... ...Responsibilities: Experience with big data processing and distributed computing... ...and resolve issues related to PySpark applications and workflows. Understand...Big data
InterSources
Irving, TX5 days ago - ...Job Title: ML Data Engineer Location: Irving, TX Full Time Job... ...skilled and passionate Data Engineer with strong Python/PySpark experience and understanding... ...distributed systems. Experience with Big Data platform like Cloudera Hadoop...Big dataFull time
AceStack LLC
Irving, TX3 days ago $90k - $110k
...Data Engineer We are seeking a highly skilled and motivated Data Engineer... ...like Apache Spark, PySpark, and Hive within Cloudera Platform... ...Collaboration: Partner closely with data scientists, business... .... Qualifications: Big Data Frameworks Expertise: Demonstrated...Big dataTata Consultancy Services
Irving, TX1 day ago$107.12k - $160.68k
...highly skilled and motivated Senior Data Platform Engineer, AVP (Python/PySpark, Microsoft SSIS, SQL Server, ETL & Database... ..., and large-scale data platforms, with experience troubleshooting... ...orchestration platforms such as AutoSys.Big Data Platforms: Work with Hadoop ecosystem...Big dataFull timeCitigroup
Irving, TX4 days ago- • Analyze and understand data sources & APIs• Design and Develop... ...from the store• Work closely with data Scientists to ensure the... ...Payments Required Technical Skills • Big Data-Hadoop, NoSQL, Hive,... ...Exposure to machine learning engineering• Exposure to NLP and text processing...Big data
NTT DATA
Irving, TX2 days ago - ...WiproContact: Meghana GorusuCompany: SRI Tech SolutionsRole: Data Engineer - Lakehouse (PySpark / Databricks / Airflow / AWS)Location: Dallas, TX (Day 1... ..., reporting, and regulatory needs. Works extensively with PySpark on Databricks, orchestrates workflows with Apache...
SRI Tech
Dallas, TX1 day ago - ...Job Titile: Data Engineer Work Location; Irving, Texas Duration: 8+ Months Job Description... ..., Argo. Experience or knowledge of big data tools: i.e., Hadoop, Spark, Kafka.... ...You are an experienced engineering with 5+ years of experience You have a passion...Big data
Ruri Software Technologies LLC
Irving, TX4 days ago $116.2k - $229.1k
...Join Deloitte’s AI & Engineering practice and help organizations... ...platforms, modernize data environments, and... ...transformation. You will work with business and technology... ..., and integrate new big data and analytics... ...quality frameworks using PySpark • 1+ year leading complex...Big dataLocal areaVisa sponsorshipDeloitte
Dallas, TX3 days ago- ...and would like to start a promising career with a global leader, take a look at the... ...highly skilled and experienced Principal Data Engineer to join our team. As a Principal Data Engineer... ...performance and scalability. Leverage big data technologies and frameworks (e.g., Hadoop...Big dataFull timeLocal area
TXU Energy
Irving, TX1 day ago - ...Healthcare Data Engineer Category: Analytics and Emerging Digital Technologies... ...consulting services firm with professionals around the... ...analytics solutions using cloud and big data platforms such as AWS,... ...as Pandas, Scikit-learn, and PySpark• Advanced SQL skills with...Big dataFull timeWork at office
CGI
Dallas, TX2 days ago - ...to advance their careers and expertise with KPMG. Looking ahead, we anticipate continued... ...is currently seeking a Sr. Associate, Data Science Engineer to join our Consulting practice.... ...MLOps, with hands-on expertise in Python, PySpark, SQL, Databricks, and Snowflake, while...H1bLocal area
KPMG
Dallas, TX1 day ago - ...Job Title: Senior Java PySpark Developer Location: Irving, TX (ONSITE)... ...We are seeking a seasoned Senior Lead Data Engineer with a dual-threat background in robust backend... ...structures. • Hands-on experience with Big Data Environment. • Familiarity with...Big dataFull time
AceStack LLC
Irving, TX2 days ago - ...Description Seeking Senior Data Engineer - Big Data to join our Information Technology team in Irving. This full-time on-site position offers... ...infrastructure that handle massive volumes of data. You will work closely with data scientists analysts and engineering teams to deliver...Big dataFull time
Raag Solutions
Irving, TX8 days ago $55 - $60 per hour
...Data Engineer II Hybrid (Miami, FL or Dallas, TX) Contract to Hire Compensation: $55 -... ...position based in Miami, FL or Dallas, TX, with a hybrid work schedule. As a key member... ...Sync, Appflow, Databricks) ~ Knowledge of big data technologies (Hadoop, Spark, Kafka,...Big dataHourly payContract workWork at officeLocal areaBrooksource
Irving, TX5 days ago- ...Data Platform Engineer We are seeking a world-class Data Platform Engineer to take complete operational... ...administration, and distributed big data platforms. You will design, scale,... ..., join us to redefine what is possible with real-time analytics. Job Responsibilities...Big data
Saxon Global
Irving, TX5 days ago - ...and would like to start a promising career with a global leader, take a look at the... ...apply online. Job Summary As a Lead Data Engineer, you will be responsible for leading the... ...Tableau or Power BI. •Experience with big data technologies such as Hadoop, Spark,...Big dataFull timeLocal area
Vistra
Irving, TX3 days ago - ...Position: Big Data Developer Location: Irving, TX Duration: Long Term Responsibilities: 1). Develop software... ...and resolve data processing issues 4). Engage with various team for software delivery 5). Build, maintain and...Big data
3B Staffing LLC
Irving, TX3 days ago - OverviewThe Infosys Data and Analytics (DNA) unit is at the forefront of transforming... ..., you'll have the opportunity to work with cutting-edge technologies, collaborate... ...ExperienceExperience in programming languages: Big Data, Spark/PySpark, SQL, Python, and Shell scripting....Big dataFull timeTemporary workRelocation
Infosys Technologies
Irving, TX2 days ago - ...Job Description Job Title: Senior Data Engineer with DevOps Duration : Full Time Location... ...of experience in data engineering and big data processing ~ Strong expertise in... ...Apache Spark (Spark Core, Spark SQL) and PySpark for large scale batch processing ~ Experience...Big dataHourly payFull time
System One
Dallas, TX16 days ago - ...Big Data Developer Location: Strongsville OH, Pittsburgh, PA, Dallas, TX Duration: Fulltime Skill: Big Data Must Have Technical... ...Skills: Bigdata Hadoop & ecosystem, Scala/Python, PySpark. Oracle PL/SQL, CI/CD, Excellent communication, Data Lake, Informatica...Big dataFull time
JConnect Infotech
Dallas, TX5 days ago $145k - $165k
...driven company delivering data insights and technology... ...solutions to customers with missions critical to U.... ...Computer Science Data Engineering Information Systems or... ...large-scale data using big data frameworks such as... ...Lakehouse architecture PySpark). Experience...Big dataFull timeContract workWork at officeRedhorse Corporation
Arlington, TX8 days ago- ...Data Scientist Location: Irving/Dallas area, Basking... ..., who is familiar with AI technology and its business... ...and handy at analyzing big data, preparing data... ...experience in Python, PySpark, machine learning... ...Statistics, Math, Economics, Engineering, Data Science or...Big dataWork experience placement
Samprasoft
Irving, TX5 days ago - ...Role : Data Scientist Location : Irving, TX (ONSITE... ..., NumPy, Scikit-learn, PySpark) • Experience with time-series data and event/... ...detection • Experience with SQL, big data platforms (Spark,... ...series analysis) Data Engineering & Automation • Clean,...Big dataNight shift
AceStack LLC
Irving, TX1 day ago - ...MySQL, PostgreSQL, RDBMS)2+ years in Hadoop - HDFS, Hive, MapReduce, HBase2+ years of experience with NOSQL database - HBase1+ years of working knowledge in Kafka/Storm data pipelines6+ years of experience in working in a Data warehouse environment4+ years of Linux...Big data
LanceSoft
Irving, TX1 day ago $75.17k - $130.5k
Req ID:376258NTT DATA strives to hire exceptional, innovative and... ...individuals who want to grow with us. If you want to be part of... ...are currently seeking a Data Engineer - Hybrid to join our team in Irving... ...building data pipelines using PySpark, Django, or similar frameworks...Temporary workWork at officeRemote workFlexible hoursNTT DATA
Irving, TX4 days ago- Overview We are looking for a Senior Data Engineer with strong 7-10 year hands-on experience in Azure and Microsoft Fabric to help modernize... ...have experience with Azure Data Factory, notebooks, Spark/PySpark, and building scalable data pipelines that support analytics...Full time
Flowserve
Irving, TX2 days ago - ...is an iconic family of brands with over 86,000 locations, surpassing... ...deploy, and support reliable data pipelines, data products, and... ....KEY RESPONSIBILITIES1. Data Engineering· Build, test, deploy, and support... ..., Spark, SQL, Python/PySpark, dbt, Airflow, or similar tools...Hourly pay
7 eleven
Irving, TX4 days ago $195.3k - $199.2k
...building long-term capabilities with our clients is not easy work.... ..., and maintain scalable data pipelines and systems using Databricks... ...be leading and executing data engineering projects from inception to... ..., with a strong background in big data technologiesProficiency in...Big dataApprenticeshipEasy workMcKinsey & Company
Dallas, TX3 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer with PySpark. Be the first to apply!
Related searches
- big data cloud engineer Irving, TX
- entry level big data engineer Irving, TX
- senior data quality engineer Irving, TX
- senior cloud data engineer Irving, TX
- software data engineer Irving, TX
- data infrastructure engineer Irving, TX
- senior data center engineer Irving, TX
- data center engineer Irving, TX
- senior data engineer Irving, TX
- finance data engineer Irving, TX