Spark ETL Engineer - Big Data Pipelines & Validation
LTM
LTM is seeking a Big Data Pyspark Developer in Irving, Texas, to design and develop scalable Apache Spark ETL pipelines, while managing complex Airflow workflows. The ideal candidate will have over 6 years of relevant technical experience. You will be responsible for implementing data validation frameworks and developing automation testing frameworks. Comprehensive medical coverage and a 401(k) plan with company match are among the benefits offered. #J-18808-Ljbffr
Vacancy posted 14 hours ago
Similar jobs that could be interesting for youBased on the Spark ETL Engineer - Big Data Pipelines & Validation in Irving, TX vacancy
$69 - $74 per hour
...Software Engineer 4 / Data Engineer (ETL & Big Data) Client: Financial Services Location: Phoenix, AZ /... ...with Big Data technologies (Hadoop, Spark, Hive) # Strong experience with ETL... ...Experience building scalable data processing pipelines # Strong documentation and system...PipelineBig dataContract workApex Systems
Irving, TX2 days ago$69 - $74 per hour
...Software Engineer 4 / Senior Data Engineer (SQL, ETL, Big Data) Client: Financial Services Team: tba Location... ...Big Data technologies (Hadoop, Spark, Hive) # Strong experience with... ...Strong experience with data processing pipelines and reporting solutions #...PipelineBig dataContract workApex Systems
Irving, TX2 days ago- ...Big Data Pyspark Developer Irving, Texas Fulltime... ...developing scalable Apache spark ETL based Data processing pipelines Strong commandline... ...comprehensive Spark based Data validation frameworks transforming... ...monitoring Quality Engineering team where 70percent of...PipelineBig dataFull time
Futran Tech Solutions Pvt. Ltd.
Irving, TX13 hours ago - ...PySpark Data Engineer We are seeking a skilled PySpark Data... ..., experience with big data technologies, and... ...system resilience within Spark jobs. Optimize PySpark... ...Data Integration and ETL: Design and implement... ...development and data pipeline orchestration tools (e....PipelineBig data
Photon
Dallas, TX1 day ago - ...Data Engineer – Neo4j, Spark & SQL Location: Charlotte, NC / Dallas, TX (Hybrid Work Model) Employment... ...in Neo4j, SQL, and Spark-based ETL pipelines. The ideal candidate will be responsible... ...governance frameworks Familiarity with big data ecosystems (Hadoop, Kafka, etc.)...PipelineBig dataContract work
Argyle Infotech
Dallas, TX1 day ago - ...Role: Sr. PySpark Data Engineer - Fulltime Location: Irving... ...will have expertise in big data processing, ETL pipeline development, and cloud-... ...solutions using PySpark, Apache Spark, and other big data... ...data quality checks, validation, and governance best practices...PipelineBig dataFull time
SARIAN Co
Irving, TX2 days ago - ...Overview: Job Title : Big Data Engineer Location : Irving TX (hybrid role)... ...development and testing of data ingestion pipelines, perform end to end validation of ETL process for various datasets that... ...Working experience on tools like Spark, HBase, Hive, Sqoop, Impala,...PipelineBig dataWork experience placementLocal area
Guru Schools
Irving, TX3 days ago - A leading data solutions company is seeking a Remote Lead Data Engineer with over 7 years of experience in consumer finance or equivalent... ...advanced technologies such as Spark and Kafka. The ideal candidate... ...like Python and knowledge of Big Data tools. This position offers...PipelineBig dataRemote work
Global Channel Management
Dallas, TX1 day ago - ...Big Data Engineer As a Big Data Engineer on the Google Cloud... ...on tools like Spark, HBase, Sqoop, Impala,... ...developing and deploying ETL / ELT processes and documentation... ...of GIT/Jenkins and pipeline automation is a must.... ..., cleaning, and validating data using cloud ETL/ELT...PipelineBig dataWork experience placement
Samprasoft
Irving, TX2 days ago - ...GCP Data Engineer Looking for a Big Data Engineer on Google Cloud Platform... ...compute and data pipelines. Enable mining and... ...developing and deploying ETL / ELT processes and... ..., Fivetran, Spark, Google Data Fusion,... ...Transforming, cleaning, and validating data using cloud ETL...PipelineBig data
Samprasoft
Irving, TX2 days ago - ...Big Data Engineer Location: Irving, TX (Day 1 Onsite-Hybrid) Hexaware Primary Skills: Hadoop, Hive & Spark Framework Responsibilities: Experience with big data processing... ...systems like Spark. Implement ETL pipelines and data transformation processes....PipelineBig data
InterSources
Irving, TX1 day ago - ...Job Title: Data Engineer – MEM SQL Location: New Jersey / Irving... ...optimizing scalable data pipelines and high-performance data... ...scalable data pipelines and ETL processes Work extensively... .../ GCP) Knowledge of Big Data technologies (Spark, Kafka, etc.) Telecom domain...PipelineBig data
Qode
Irving, TX2 days ago $100k - $154k
...skilledSenior Software Engineer to be a core technical pillar of our Data Management team. Reporting... ...Management (MDM) and ETL ecosystems. You will take... ...deployment of complex data pipelines usingAWS Glue, Python,... ...Expertise in AWS Glue (Spark), SQS, and Lambda....PipelineApprenticeshipImmediate startWork from homeWorldwideGartner
Irving, TX1 day ago- ...Data Engineer With MemSQL Long Term Contract Irving, TX... ...develop, and maintain data pipelines and architectures that support... ...data models and ETL processes using MemSQL.... ...design. Knowledge of big data technologies (Hadoop, Spark, etc.) is a plus. Strong...PipelineBig dataLong term contract
Abode Techzone LLC
Irving, TX3 days ago - ...experience in software engineering or related field. Option... ...3 years' experience in data engineering, database... ...with 3+ years of Big data development experience... ...UDF’s, MapReduce, Druid, Spark, Python, Hue, Shell... ...analytical systems. Design pipelines from a wide variety of...PipelineBig data
Samprasoft
Dallas, TX2 days ago $125k - $135k
...Data Engineer - Python/PySpark Location: Dallas/Irving... ...building large-scale ETL/ELT pipelines for structured and... ...Deep understanding of Spark and distributed computing... .... Experience with big data frameworks such... .... Implement data validation, cleansing,...PipelineBig dataFull time3 days per weekDiverse Lynx
Dallas, TX4 days ago- A global data technology firm is seeking a Senior Software Engineer to lead the design and development of software systems and ETL pipelines. This role demands a Master's degree in a relevant field... ...experience. The candidate will work with big data technologies and collaborate...PipelineBig dataRemote workFlexible hours
Publicis Groupe Holdings B.V
Irving, TX4 days ago - ...Principal Data Engineer We are seeking a highly skilled... ...scalable and reliable data pipelines, including data... ...scalability. Leverage big data technologies and frameworks... ...(e.g., Hadoop, Spark, Hive) to process and analyze... ...technologies, such as ETL frameworks, big data...PipelineBig dataLocal area
TXU Energy
Irving, TX1 day ago - ...Data Engineer We are seeking a talented Data Engineer... ...telecom data processing, ETL development, and data pipeline optimization. You... ...through robust monitoring, validation, and troubleshooting... ...~ Familiarity with big data frameworks such as Apache Spark, Hadoop, or similar....PipelineBig data
Omni Inclusive
Dallas, TX1 day ago - ...Role- Azure Data Engineer (Data-bricks) Location: Dallas, TX-... ...and maintaining scalable data pipelines, ETL processes, and data... ...platform (Lake house Architecture, Spark, Delta Lake) on cloud services... ...(like Unity Catalog) for big data analytics and AIML initiatives...PipelineBig dataContract work
AceStack LLC
Dallas, TX1 day ago - ...Senior Data Engineer - Vice President Citi is seeking a highly skilled and experienced... ..., build, and maintain scalable ETL/ELT pipelines using PySpark, Spark SQL, and Delta Lake on Databricks,... ...storage, processing, and analytics. Big Data Technologies: Work extensively...PipelineBig data
Citi
Irving, TX5 days ago - ...within their Chief Data Office for a... .../ Snowflake Data Engineer for a contract?to?... ...on AWS?native data pipelines, Apache Iceberg lakehouse... ...building ETL / ELT pipelines using... ...Nice-to-have: Apache Spark and big?data ecosystem experience... ...quality checks, validation, and observability...PipelineBig dataContract workWork at office
- ...your Future As a Data Engineer, you are responsible for... ...datasets, implement new data pipelines that feed into or from... ...data pipelines and ETL processes to process... ...sources using SQL and AWS big data technologies... ...frameworks (e.g., Apache Spark, Hadoop). • Experience...PipelineBig dataLive inWork at officeLocal area
Lennar
Irving, TX8 days ago $87.1k - $154k
...passionate about enabling Data & AI teams to solve the world... ...business. Founded by engineers, we leap at every opportunity... ...deep‑dive forensics into Spark core internals and the broader... ...Expertise in large‑scale big data solutions and ETL pipelines using Spark, Delta Lake,...PipelineBig dataLocal area- ...Job Title: Principal Engineer I - Senior Data Engineer Location:... ...strategy and roadmap. Develop ETL and data pipeline capabilities considering... ...tuning and optimization of Spark workloads Implement... ...unstructured data and big data. What you'll need:...PipelineBig data
Western Alliance Bank
Dallas, TX8 days ago - ...into complementary data technologies for decision... ...support search engine-based analytics.... ..., data architects, ETL developers, other IT... ...using Hadoop, HDFS, Spark, Kafka, Flume or... ...Understanding of big data platforms and... ...stream processing pipeline/platform, data lake...PipelineBig dataWork at officeFlexible hours2 days per week
GM Financial
Irving, TX4 days ago $73.01k - $170.64k
...Databricks Lead Data Engineer As a Databricks... ...Architecture, CI/CD, and ETL platforms... ...develop data ingestion, validation, transformation,... ...batch/streaming data pipelines using Databricks.... ...optimization of spark job performance.... ...working with a complex Big Data/Lakehouse...PipelineBig dataWork at officeLocal areaFlexible hoursPerficient
Dallas, TX13 hours ago- ...an Applied Analytics Engineer . The successful candidate... ...and maintaining robust data pipelines that ingest, clean, and... ...build, and rigorously validate machine learning and... ...Practical experience with big data processing frameworks such as Spark or similar distributed...PipelineBig dataFull time
Vulcan Materials
Irving, TX5 days ago - ...WM Data Engineering – Senior Cloud Data Engineer - Vice... ...-ready data pipelines, containerizing microservices... ...of legacy ETL and microservices... ...to streamline data validation and schema conversion... ...Directly optimize Spark job configurations... ..., and SQL. Big Data & Orchestration...PipelineBig data
The Goldman Sachs Group, Inc.
Dallas, TX1 day ago - ...Senior Data Developer Tech Lead - Vice President... ...expertise in big data technologies,... ...time streaming data pipelines, demonstrating high... ...requirements from engineers and scientists into... ...members. Develop Spark-based solutions to... ...implementing complex ETL/ELT processes for both...PipelineBig data
Citi
Irving, TX5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Spark ETL Engineer - Big Data Pipelines & Validation. Be the first to apply!
Related searches
- data visualization developer Irving, TX
- data science developer Irving, TX
- senior data center engineer Irving, TX
- sr information security engineer Irving, TX
- junior big data engineer Irving, TX
- entry level big data engineer Irving, TX
- data engineer contract Irving, TX
- aws data engineer Irving, TX
- senior data engineer Irving, TX
- data engineer analytics Irving, TX