Sr. Pyspark Data Engineer

SARIAN Co

Role: Sr. PySpark Data Engineer - Fulltime

Location: Irving, TX

Job Description:

We are seeking a skilled PySpark Data Engineer to join our team. The ideal candidate will have expertise in big data processing, ETL pipeline development, and cloud-based data engineering solutions. You will work closely with data analysts, data scientists, and software engineers to design, develop, and optimize scalable data processing solutions using PySpark, Apache Spark, and other big data technologies .

Key Responsibilities:

Develop, optimize, and maintain ETL pipelines using PySpark and Apache Spark .
Design and implement big data solutions for processing large datasets efficiently.
Work with structured and unstructured data sources to transform, clean, and enrich data.
Optimize Spark jobs for performance tuning and cost efficiency .
Collaborate with data scientists and analysts to ensure smooth data integration and availability.
Implement data quality checks, validation, and governance best practices.
Deploy and manage data workflows in cloud platforms (AWS, Azure, GCP).
Utilize SQL and NoSQL databases for data storage and retrieval.
Automate data ingestion and transformation processes.
Work in an Agile environment , actively participating in sprint planning and reviews.
Troubleshoot and resolve performance and scalability issues .

Required Skills & Qualifications:

Extensive years of experience in Big Data Engineering with a focus on PySpark and Apache Spark .
Strong knowledge of Python and distributed computing frameworks.
Experience working with Hadoop, Hive, HDFS, Kafka, and other big data technologies .
Proficiency in SQL, NoSQL, and relational databases (PostgreSQL, MySQL, Cassandra, MongoDB, etc.) .
Experience with cloud platforms (AWS, Azure, or GCP) and services like S3, EMR, Databricks, Glue, or Big Query .
Knowledge of data warehousing concepts and ETL development .
Hands-on experience with CI/CD pipelines, Docker, and Kubernetes is a plus.
Strong problem-solving and analytical skills with attention to detail.
Excellent communication and teamwork skills.

Muralikrishna

Sarian Solutions, Inc.

Ph: View phone number on click.appcast.io

View email address on click.appcast.io |

Apply

Vacancy posted 5 days ago

Similar jobs that could be interesting for youBased on the Sr. Pyspark Data Engineer in Irving, TX vacancy

Senior PySpark Data Engineer
...In-person Interview for Irving, TX 8+ year min Job Description Roles & Responsibilities Job Title: Senior PySpark Data Engineer Job Description: As a Data Engineer, you will be responsible for designing, developing, and maintaining data solutions for...
Senior
Work experience placement
Covetus
Irving, TX
1 day ago
Pyspark/Python Data Engineer
$100k - $120k
...Must Have Technical/Functional Skills We are looking for a skilled PySpark Data Engineer with strong hands-on experience in PySpark and Python to design, build, and optimize scalable data processing pipelines. The ideal candidate will have practical experience...
Suggested
Tata Consultancy Services
Irving, TX
1 day ago
Sr Data Engineer
...Job Description Resource Informatics Group, Inc. is actively seeking a skilled Senior Data Engineer to join our team in Irving, Texas. This role involves contributing significantly to data processes, collaborating within our team, and innovating technically in...
Senior
Resource Informatics Group
Irving, TX
1 day ago
Senior Data Engineer
...Data Engineer We are seeking a skilled and detail-oriented Data Engineer to join our growing data team. The ideal candidate will be responsible... .... Strong programming skills in languages such as Python, PySpark, SQL etc. Experience in Build and optimize ETL workflows...
Senior
Contract work
Publicis Groupe Holdings B.V
Irving, TX
4 days ago
Sr. Data Engineer
...This is an opportunity to join a high growth business as the Data Engineer. The position will work with the Analytics & Insights team at... ...RESPONSIBILITIES: Design, build, and optimize data pipelines using PySpark, Delta Lake, SQL, and cloud-based data engineering tools....
Senior
Full time
Contract work
Temporary work
Part time
Internship
Work at office
Flexible hours
Allworth Financial
Dallas, TX
5 days ago
Sr. Principal Data Engineer / Data Architect
$131.25k - $175k
...United States (Remote) Reports to: SVP of Tech As the Sr. Principal Data Engineer, you will be the primary architect of Digital Remedy’s... ...Catalog, Photon). The Stack: Deep proficiency in Spark (PySpark/Scala), Python, and SQL. Experience with GCP (BigQuery) is...
Senior
Full time
Work experience placement
H1b
Local area
Immediate start
Remote work
Flexible hours
Sinclair Broadcast Group
Dallas, TX
5 days ago
Senior Artificial Intelligence Data Engineer
$102.4k - $179k
...help build and enhance a modern, AI-ready data enablement platform that supports cross-... ..., governed data products, and reusable engineering patterns across the enterprise. You will... ...solutions using Azure Databricks, PySpark, SQL, Delta Lake, Azure Data Factory, dbt...
Senior
Vizient
Irving, TX
1 day ago
AWS Data Engineer
...Description Roles & Responsibilities Job Title: AWS Certified Data Engineer Job Description: We are seeking a highly skilled and... ...candidate will have strong expertise in big data processing using PySpark and a deep understanding of data warehousing concepts,...
Saransh Inc
Irving, TX
1 day ago
Databricks Data Engineer
...Description Roles & Responsibilities Job Title: Databricks Data Engineer Job Description: We are seeking a highly skilled and... ..., build, and maintain scalable ETL/ELT data pipelines using PySpark, Delta Lake, Auto Loader, and Databricks Workflows. • Data Transformation...
Saransh Inc
Irving, TX
1 day ago
Databricks Data Engineer
$125k - $140k
...Roles & Responsibilities Job Title: Databricks Data Engineer Job Description: As a Databricks Data Engineer, you will be responsible... ..., and processing in Big Data environment using predominantly PySpark/Python. Your typical day will involve creating data pipelines,...
Tata Consultancy Services
Irving, TX
1 day ago
Data Engineer - IAM
...Data Engineer – IAM Data Lake (Google Cloud Platform) Location: Irving, TX (Preferred) or Ohio (Hybrid) Duration: 12 Month Contract W2... ...frameworks, and data transformation processes. Develop and maintain PySpark-based data processing applications. Utilize Apache Airflow...
Contract work
Leading Utilities Organization
Irving, TX
5 days ago
Senior Data Engineer
...Role description Job Title: Big DATA Developer with Python Work Location : Tampa,FL Job Description: Seeking a Senior Python Data Engineer with 3 to 5 years of experience skilled in Apache Spark and Python to design and implement scalable data processing...
Senior
LTM
Irving, TX
3 days ago
IAM Data Engineer
$53.56 - $58.7 per hour
...IAM Data Engineer Irving, TX Hybrid Contract $53.56/hr - $58.7/hr Outstanding long-term contract opportunity! A well-known Financial... ...(4 - 6 Years) ~ Google Cloud Platform (4 - 6 Years) ~ Pyspark (4 - 6 Years) ~ Strong understanding of Google Cloud...
Long term contract
Full time
Contract work
Temporary work
Flexible hours
Motion Recruitment
Irving, TX
4 days ago
Sr Data Engineer
...challenges. Our services span AI, IT staffing, cloud computing, engineering, mobility, testing, and more. Certified with CMMI Level 3 and... ...communication. Nice to Have Skills: Exadata experience Data Guard experience (HA/DR, role transitions, validation of...
Senior
Local area
Worldwide
V2soft
Farmers Branch, TX
4 days ago
Senior Data Engineer
...hermitageinfotech.com Role: Senior Data Engineer Location: Dallas, TX or Mountain View... ..., Oozie) with deep expertise in SQL, PySpark, or scala. ~5+ years leading data... ...science partners Varma | Sr. IT Recruiting Manager l (***) ***-****(D)...
Senior
Hourly pay
Long term contract
Hermitage Infotech
Dallas, TX
4 days ago
Principal Engineer I - Senior Data Engineer
...Job Title: Principal Engineer I - Senior Data Engineer Location: Block 23 What you'll do: As the Principal Data Engineer,... ...Western Alliance Bank and our partner systems. Expert-level PySpark development experience, including: Writing dynamic,...
Senior
Western Alliance Bank
Dallas, TX
6 days ago
Information Security Engineer - IAM Data Lake / Data Engineering
$53.56 - $58.7 per hour
...Information Security Engineer - IAM Data Lake / Data Engineering Irving, TX Hybrid Contract $53.56/hr - $58.7/hr Work with the... ...years of Google Cloud Platform (GCP) experience ~4+ years of PySpark experience ~4+ years of Data Pipeline development...
Long term contract
Full time
Contract work
Temporary work
Flexible hours
Motion Recruitment
Irving, TX
4 days ago
Senior Data Engineer
...following job description: We are seeking a highly skilled Data Engineer to design, build, and optimize enterprise-grade data solutions... ...Strong hands-on expertise with Databricks, including: Spark (PySpark or Spark SQL) Delta Lake Data Lakehouse architecture...
Senior
Full time
Temporary work
Shift work
Day shift
CRC Insurance Services, Inc.
Dallas, TX
5 days ago
Senior AWS Data Engineer
$50 - $58 per hour
...salary Opportunity for advancement Job Title: Data Quality Engineer Location: Dallas, TX (Hybrid - 3 days onsite) Job Type... ...engineering. The ideal candidate is hands-on with AWS, Python/PySpark, and SQL, and can design, optimize, and manage complex data...
Senior
Hourly pay
Long term contract
Work from home
Flexible hours
SelectMinds
Dallas, TX
5 days ago
Snowflake Sr Data Engineer
...Data Engineer We are seeking a talented Data Engineer with 3+ years of experience to join our team in the telecom industry. The ideal candidate will have a strong background in data engineering, with specific experience in telecom data processing, ETL development, and...
Senior
Damco
Dallas, TX
4 days ago
Senior Data Scientist Engineer
$144.8k - $170.35k
...Job Title Senior Data Scientist Engineer Job Description Summary Location: 2021 McKinney Avenue, Suite 900, Dallas, TX 75201;... ...maintain data models that support business needs, leveraging PySpark for data manipulation and transformation. Support business...
Senior
Minimum wage
Work at office
Remote work
Flexible hours
Cushman & Wakefield
Dallas, TX
2 days ago
SR Data Engineer
...Summary/Objective Alliance Technical Group is seeking an experienced Senior Data Engineer to design, build, and optimize the databases and data systems that power our business intelligence and analytics platforms. In this role, you will lead the creation of scalable...
Senior
Daily paid
Work at office
Remote work
Flexible hours
Alliance Technical Group
Dallas, TX
7 days ago
Senior Data Engineer
...Senior Data Engineer Hilltop Holdings is looking for a Senior Data Engineer! The Senior Data Engineer is a key technical leader responsible for the design, maintenance, and optimization of enterprise data systems across on-premises and cloud environments. This hybrid...
Senior
Full time
Work experience placement
Hilltop Holdings
Irving, TX
3 days ago
Sr Data Analyst/Data Engineer
...Sr Data Analyst/Data Engineer Location: Dallas, TX Client: Retail Domain Duration: Long Term We are targeting a Senior Engineer with proven expertise in AtScale semantic layers, cloud data engineering, and analytics performance optimization, with preferred...
Senior
Covetit
Dallas, TX
4 days ago
Applied Analytics Engineer
...to join our team as an Applied Analytics Engineer . The successful candidate will be... ...building, optimizing, and maintaining robust data pipelines that ingest, clean, and transform... ...technologies such as Python, SQL, and PySpark. Undertake meticulous preprocessing, cleansing...
Full time
Vulcan Materials
Irving, TX
3 days ago
Sr. Analytics Engineer (Snowflake, MS Fabric)
...Senior Analytics Engineer Hybrid - Dallas, TX Summary SafetyChain is building the next generation of enterprise software for the... ...faster, better decisions. This role sits at the intersection of data engineering, BI, and applied AI-and you'll help define what "great...
Senior
Work at office
SafetyChain Software
Grapevine, TX
4 days ago
Job Posting Sr. Specialist, Data Engineer
...democratize access to investing and financial planning. Join a high-impact QA organization where you will lead quality engineering efforts across a portfolio of data engineering initiatives. In this role, you will partner closely with Product Owners and development teams from...
Senior
Work at office
Charles Schwab
Southlake, TX
1 day ago
Senior Data Engineer
$120k - $140k
...Job Description Job Description Title: Senior Data Engineer Location: Coppell, TX Salary Range: $120K-$140K We are looking... ...and/or AWS), Azure DevOps (ADO), SQL (ETL, SSIS packages), and PySpark or Scala automation. Architecture experience in building pipelines...
Senior
Addison Group
Dallas, TX
11 days ago
Architect (Sr. Data Engineer/Architect Skillset)
...Architect (Sr. Data Engineer/Architect Skillset) Do you want to support innovative clients at the intersection of cutting-edge technologies and impactful relationships? evolv's culture of integrity, humility, passion, and drive and have been named "Best Places to Work...
Senior
Local area
Day shift
1 day per week
evolv consulting
Dallas, TX
1 day ago
Principal Data Engineer | Irving, TX
$135k - $150k
...Principal Data Engineer Irving, Texas Hybrid Full Time $135k - $150k We are searching for a Principal Data Engineer to join a small Data Engineering & platform team supporting research, ML, and sophisticated analytics. In this position you will be working...
Full time
Motion Recruitment
Irving, TX
5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Sr. Pyspark Data Engineer. Be the first to apply!