Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Engineer - Python, PySpark & AWS

SCI SOLUTIONS GLOBAL

Job Description

Job Description

Senior Data Engineer – Python, PySpark & AWS

Location: Plano, TX

Relocation : Open

Open for W2 only- No c2c/1099 or third party resumes

Due to the nature of the roles client is only accepting USC/GC /GC EAD only no other visas accepted.

 

Role Overview

We are seeking a hands-on Senior Data Engineer with strong Python, PySpark, and AWS experience to develop and maintain scalable data pipelines and distributed data processing solutions. The ideal candidate will have experience supporting production data engineering workloads, cloud infrastructure, and data orchestration.

Key Responsibilities

  • Develop, test, and maintain ETL/ELT data pipelines using Python and PySpark.
  • Build and support big-data processing solutions on AWS using S3, EMR, and Lambda.
  • Implement infrastructure automation using Terraform.
  • Develop data integrations using REST APIs, Kafka, and MQ messaging.
  • Support data storage and retrieval using Cassandra.
  • Orchestrate and monitor workflows using Airflow, Control-M, and native schedulers.
  • Troubleshoot pipeline failures and optimize performance, reliability, and data quality.

Required Skills

  • Strong hands-on Python and PySpark experience.
  • Experience with big-data processing and production data pipelines.
  • AWS experience with S3, EMR, and Lambda.
  • Working knowledge of Terraform.
  • Familiarity with Kafka, MQ messaging, REST APIs, Java, and Cassandra.
  • Experience with Airflow, Control-M, or other workflow scheduling tools.

Preferred: Databricks experience and exposure to machine-learning workflows.


Vacancy posted 18 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer - Python, PySpark & AWS in Plano, TX vacancy
  • $52.73 - $80 per hour

    Title: Senior Data Engineer Location: McLean, VA; NYC; Wilmington; Boston; Plano; Chicago; or RichmondWork...  ...will have strong experience with Python, Scala, AWS data services, distributed processing...  ...techniques.Experience with Spark, PySpark, or similar big data frameworks.... 
    Amazon Web Service
    Senior
    Contract work
    3 days per week

    Yoh

    Plano, TX
    2 days ago
  •  ...top-tier projects. Job DescriptionThe Data Solutions Engineer IV works in close collaboration to...  ...resource governanceDefine and drive Python, PySpark, and SQL standards for data engineering...  ...Fivetran, dbt, Snowflake, Kafka ecosystem, AWS services) with a focus on scalability... 
    Amazon Web Service
    Senior

    Bank of Oklahoma

    Richardson, TX
    4 days ago
  •  ...Description Job Description Job Title: Technical Lead – Data Engineering (Palantir, Spark, PySpark, Python) Please dont apply if you dont have PALANTIR...  ...)  ~Experience with cloud platforms (Azure, AWS, or GCP)  ~Familiarity with orchestration tools (Airflow... 
    Amazon Web Service
    Work from home
    Flexible hours

    CLOUDSCOUTS SOFTWARE SOLUTIONS LLC

    Frisco, TX
    27 days ago
  • Senior Data Engineer / Full Stack Engineer Location: Remote (EST preferred) | Duration: 12 months (...  ...data solutions, leveraging cutting-edge AWS and big data technologies. This...  ...ECS, and Glue - Strong experience with PySpark, Apache Spark, Snowflake, AWS Glue, and... 
    Amazon Web Service
    Senior
    Full time
    Contract work
    Remote work

    Indotronix International Corporation

    Plano, TX
    1 day ago
  • Senior Lead Software Engineer Be an integral part of an agile team that's constantly...  ...from large, diverse data sets in service of continuous...  ...) and framework(s) (i.e., Python, PySpark, Big Data, Data pipeline,...  ...on experience working with AWS services including EMR, EC... 
    Amazon Web Service

    Chase

    Plano, TX
    1 day ago
  • Seasoned Data engineer need to migrate data pipelines to modernize pipelines the enterprise team has implemented - Once...  ...Exchange team that the contractors will work on AWS - Must have worked with EMR specifically Python and framework like spark is helpful Debugging skills... 
    Amazon Web Service
    For contractors

    Exaways Corporation

    Murphy, TX
    1 day ago
  •  ...Job Description Job Description Data Engineer – Python & AWS Glue Data Platforms Location: Plano, TX Relocation : Open Open for...  ..., and Apache Iceberg. AWS Bedrock and exposure to AI agentic workflows. Terraform, PySpark, or Apache Spark.... 
    Amazon Web Service
    Relocation

    SCI SOLUTIONS GLOBAL

    Plano, TX
    18 days ago
  • $104.24k - $130.3k

    Job ID: 393405Company: NTT DATA Americas, Inc.Location: Plano,...  ...We are currently seeking a Senior Data Engineer (w/ Oracle & OLTP) - On-Site...  ...data engineering practices, and AWS and Snowflake capabilities to...  ...experience using Java and/or Python, with Java strongly preferred... 
    Amazon Web Service
    Senior
    Temporary work
    Work at office
    Remote work
    Flexible hours

    NTT DATA

    Plano, TX
    12 hours ago
  • Backend Data Engineer We are seeking a Backend Data Engineer with strong API development experience in Java or Python, with full-stack capabilities as a plus. The ideal candidate brings hands-on expertise in cloud platforms (AWS preferred), Databricks, and Spark, with... 
    Amazon Web Service
    Senior

    Hackajob

    Plano, TX
    1 day ago
  •  ...Description Job Description Job Title : Senior Lead Data Engineer Client's Location: Scottsdale,...  ...its data platform from Azure to AWS. Lead the design and implementation of...  ...Delta Lake. Proficiency in SQL and Python. Experience designing and implementing... 
    Amazon Web Service
    Senior
    Contract work

    Abode Techzone LLC

    Richardson, TX
    3 days ago
  •  ...with possible contract to hire Linkedin Must Onsite **** Job Description Looking for a Java-focused Software Engineer with working experience in Python, AWS, Terraform, and CI/CD. The candidate will work on cloud-based logging and infrastructure engineering platforms... 
    Amazon Web Service
    Senior
    Long term contract
    Work experience placement

    MSys Inc

    Plano, TX
    1 day ago
  •  ...RCHRD   Areas of Interest:  Enterprise Data; Data   Pay Transparency Salary...  ...enterprise‑wide. Job Description The Senior Manager, Data Engineering provides leadership and oversight for...  ...on cloud platforms such as AWS, Azure, GCP, Snowflake, Databricks, or... 
    Amazon Web Service
    Senior

    BOK Financial

    Richardson, TX
    3 days ago
  • $92.16k - $138.24k

    Req ID:394117NTT DATA strives to hire exceptional...  ...are currently seeking a Senior Data Engineering Support Engineer to...  ...proficiency in Databricks and PySpark. In this role, you...  ...and scripts in Python/PySpark to automate data...  ...major cloud networks (AWS, Azure, or GCP).Robust... 
    Amazon Web Service
    Senior
    Temporary work
    Work at office
    Remote work
    Flexible hours

    NTT DATA

    Addison, TX
    1 day ago
  • Description: We are seeking a Senior Data Engineer to support the evolution of an enterprise customer...  ...modern data engineering practices, and AWS and Snowflake capabilities to deliver...  ...experience using Java and/or Python, with Java strongly preferred 1+ year... 
    Amazon Web Service
    Senior
    Contract work

    United Software Group

    Plano, TX
    1 day ago
  • We need: Three Senior (10+ years) Data Engineers with extensive experience working with SQL/NoSQL, Big Data/Spark as well as Java or Python. CANDIDATES MUST HAVE RECENT EXPERIENCE IN BANKING OR FINANCIAL...  .../data management processes on AWS Financial Services and Commercial... 
    Amazon Web Service
    Work at office
    Local area
    Relocation

    3B Staffing LLC

    Murphy, TX
    1 day ago
  • $118.88k

     ...will... Serve as a hands-on Senior Data Engineer and architect owning the design and...  ...grade pipelines and applications in Python and SQL using Spark/PySpark and open table formats such as...  ...compute security and identity within AWS or a comparable cloud environment.... 
    Amazon Web Service
    Senior
    Full time
    Flexible hours

    Mariner Finance

    Plano, TX
    3 hours ago
  • $209k - $238.5k

    Senior Manager, Full-stack Engineer (Java, Python, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive and iterative delivery environment? At Capital One, you'll be... 
    Amazon Web Service
    Senior
    Full time
    Part time
    Internship
    Local area

    Capital One

    Plano, TX
    1 day ago
  •  ...group is seeking multiple talented Senior Data Engineers to join our development team....  ...scalable data pipelines using Python Databricks and Apache Airflow / AWS Step Functions. Implementing...  ...Python and SQL. ~ Proficiency in PySpark Scala-Spark and scripting... 
    Amazon Web Service
    Senior
    Full time
    H1b
    Relocation package
    Shift work

    Toyota

    Plano, TX
    6 days ago
  • $85.5k - $135k

     ...Responsibilities Our Property & Casualty Data Pipeline team is hiring a Data Engineer to help advance one of the company's...  ...Proficiency in programming languages such as Python, Scala, Java, Bash, etc. Hands-on experience with AWS services including ETL tools (Glue, EMR Serverless... 
    Amazon Web Service
    H1b
    Work at office
    Immediate start

    State Farm

    Richardson, TX
    1 day ago
  • $82.42k - $126.6k

     ...advanced technologies such as AI, cloud, and data-led innovation to help our clients...  ...Data technologies like Hadoop, Hive, Spark, python, etc. Experience in python and Unix shell...  ...Skill 1Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 2Technology|Big... 
    Full time
    Temporary work
    Relocation

    Infosys Technologies

    Plano, TX
    2 days ago
  •  ...Description Job Description Job Title: Senior Data Engineer Work Location: Richardson TX 75082 *...  ..., Apache Spark, Scala, Advanced Python, and SQL, with extensive hands-on development...  ...Databricks, pypark, Spark,Scala, Aws, Hive,GCP, Snowflake. Nice to have skills... 
    Amazon Web Service
    Senior
    Contract work

    eTeam Inc.

    Richardson, TX
    24 days ago
  •  ...in Snowflake, ETL/ELT development, AWS and Azure cloud platforms, big data technologies (Spark, Hadoop, PySpark), data warehousing and databases, Python/SQL programming, and data security...  ...Insurance Background A Data Engineer specializes in designing,... 
    Amazon Web Service

    eCom Solutions Inc

    Plano, TX
    3 days ago
  •  ...Cheil USA/CRM Data & Analytics Position Title: Senior Data Engineer CRM Client account: Samsung Location: Plano TX...  ...Cheil data server on Google Cloud or AWS with secure API access so the...  ...marketing or customer data. ~ Advanced Python and SQL. ~ Hands-on experience... 
    Amazon Web Service
    Senior
    Full time
    Immediate start

    Cheil

    Plano, TX
    6 days ago
  •  ...our customers.Brown & Brown is seeking a Data Engineer to join our growing team in Plano, TX!...  ..., and data-processing pipelines using Python, PySpark, Apache Spark, and SQL.Build reliable and...  ...platforms such as Microsoft Azure, AWS, or Google Cloud.Experience with cloud... 
    Amazon Web Service
    Full time

    Brown & Brown Insurance Services

    Plano, TX
    2 days ago
  •  ...experiences. Role Summary: The Senior Data Engineer is a hands-on technical role...  ...solutions using Microsoft Fabric, Azure, SQL, Python, Spark, and related technologies. Build...  ...and experience with Python and/or PySpark for data engineering workloads. ~ Experience... 
    Senior
    Hourly pay
    Daily paid
    Permanent employment
    Full time
    Contract work

    Cinemark USA, Inc

    Plano, TX
    a month ago
  •  ...Job Description Position - Senior Developer (Java Python) Location - Plano Texas...  ...application development, automation, data processing, and integration...  ..., and modern software engineering methodologies....  ...Experience with cloud technologies (AWS/Azure), containerization (Docker... 
    Amazon Web Service
    Senior

    Yantran LLC

    Plano, TX
    24 days ago
  •  ...Brown & Brown is seeking a Lead Data Engineer to join our growing team in...  ...-processing pipelines using Python, PySpark, Apache Spark, and SQL....  ...technical lead, lead engineer, or senior engineer with responsibility...  ...such as Microsoft Azure, AWS, or Google Cloud.Experience... 
    Amazon Web Service
    Full time

    Brown & Brown Insurance Services

    Plano, TX
    2 days ago
  • $161.5k - $299.7k

     ...recruiting for a leader in our Data Science Engineering function. The team is...  ...monitoring, and reliability. The Senior Director will lead a team of...  ...programming language (e.g., Python)5) generative and agentic AI...  ...with cloud platforms (AWS, Azure, or GCP) and cloud-native... 
    Amazon Web Service
    Senior
    Full time
    Work experience placement
    Work at office
    3 days per week

    Health Care Service

    Richardson, TX
    3 days ago
  •  ...have a strong background in data engineering and software development, with...  ...Airflow and Spark. • Leverage AWS services (e.g., S3, Glue,...  ...modular, and testable code in Python to support data engineering use...  ...Snowflake~Digital : Databricks~Digital : PySpark PROLIM Corporation
    Amazon Web Service

    PROLIM Corporation

    Murphy, TX
    1 day ago
  •  ...Role: Senior Data, AI & Reliability Engineer Location: Plano, TX (Onsite) Experience Required: 10+ years Skills: Advanced Java, Python for Data Science, AI Agents Must Have Technical/Functional...  ...experience, particularly AWS CI/CD pipelines and production... 
    Amazon Web Service
    Senior
    Full time

    ReqRoute,Inc

    Plano, TX
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer - Python, PySpark & AWS. Be the first to apply!