Senior Data Engineer - Python, PySpark & AWS
SCI SOLUTIONS GLOBAL
Job Description
Job Description
Senior Data Engineer – Python, PySpark & AWS
Location: Plano, TX
Relocation : Open
Open for W2 only- No c2c/1099 or third party resumes
Due to the nature of the roles client is only accepting USC/GC /GC EAD only no other visas accepted.
Role Overview
We are seeking a hands-on Senior Data Engineer with strong Python, PySpark, and AWS experience to develop and maintain scalable data pipelines and distributed data processing solutions. The ideal candidate will have experience supporting production data engineering workloads, cloud infrastructure, and data orchestration.
Key Responsibilities
- Develop, test, and maintain ETL/ELT data pipelines using Python and PySpark.
- Build and support big-data processing solutions on AWS using S3, EMR, and Lambda.
- Implement infrastructure automation using Terraform.
- Develop data integrations using REST APIs, Kafka, and MQ messaging.
- Support data storage and retrieval using Cassandra.
- Orchestrate and monitor workflows using Airflow, Control-M, and native schedulers.
- Troubleshoot pipeline failures and optimize performance, reliability, and data quality.
Required Skills
- Strong hands-on Python and PySpark experience.
- Experience with big-data processing and production data pipelines.
- AWS experience with S3, EMR, and Lambda.
- Working knowledge of Terraform.
- Familiarity with Kafka, MQ messaging, REST APIs, Java, and Cassandra.
- Experience with Airflow, Control-M, or other workflow scheduling tools.
Preferred: Databricks experience and exposure to machine-learning workflows.
$52.73 - $80 per hour
Title: Senior Data Engineer Location: McLean, VA; NYC; Wilmington; Boston; Plano; Chicago; or RichmondWork... ...will have strong experience with Python, Scala, AWS data services, distributed processing... ...techniques.Experience with Spark, PySpark, or similar big data frameworks....Amazon Web ServiceSeniorContract work3 days per week- ...top-tier projects. Job DescriptionThe Data Solutions Engineer IV works in close collaboration to... ...resource governanceDefine and drive Python, PySpark, and SQL standards for data engineering... ...Fivetran, dbt, Snowflake, Kafka ecosystem, AWS services) with a focus on scalability...Amazon Web ServiceSenior
- ...Description Job Description Job Title: Technical Lead – Data Engineering (Palantir, Spark, PySpark, Python) Please dont apply if you dont have PALANTIR... ...) ~Experience with cloud platforms (Azure, AWS, or GCP) ~Familiarity with orchestration tools (Airflow...Amazon Web ServiceWork from homeFlexible hours
- Senior Data Engineer / Full Stack Engineer Location: Remote (EST preferred) | Duration: 12 months (... ...data solutions, leveraging cutting-edge AWS and big data technologies. This... ...ECS, and Glue - Strong experience with PySpark, Apache Spark, Snowflake, AWS Glue, and...Amazon Web ServiceSeniorFull timeContract workRemote work
- Senior Lead Software Engineer Be an integral part of an agile team that's constantly... ...from large, diverse data sets in service of continuous... ...) and framework(s) (i.e., Python, PySpark, Big Data, Data pipeline,... ...on experience working with AWS services including EMR, EC...Amazon Web Service
- Seasoned Data engineer need to migrate data pipelines to modernize pipelines the enterprise team has implemented - Once... ...Exchange team that the contractors will work on AWS - Must have worked with EMR specifically Python and framework like spark is helpful Debugging skills...Amazon Web ServiceFor contractors
- ...Job Description Job Description Data Engineer – Python & AWS Glue Data Platforms Location: Plano, TX Relocation : Open Open for... ..., and Apache Iceberg. AWS Bedrock and exposure to AI agentic workflows. Terraform, PySpark, or Apache Spark....Amazon Web ServiceRelocation
$104.24k - $130.3k
Job ID: 393405Company: NTT DATA Americas, Inc.Location: Plano,... ...We are currently seeking a Senior Data Engineer (w/ Oracle & OLTP) - On-Site... ...data engineering practices, and AWS and Snowflake capabilities to... ...experience using Java and/or Python, with Java strongly preferred...Amazon Web ServiceSeniorTemporary workWork at officeRemote workFlexible hours- Backend Data Engineer We are seeking a Backend Data Engineer with strong API development experience in Java or Python, with full-stack capabilities as a plus. The ideal candidate brings hands-on expertise in cloud platforms (AWS preferred), Databricks, and Spark, with...Amazon Web ServiceSenior
- ...Description Job Description Job Title : Senior Lead Data Engineer Client's Location: Scottsdale,... ...its data platform from Azure to AWS. Lead the design and implementation of... ...Delta Lake. Proficiency in SQL and Python. Experience designing and implementing...Amazon Web ServiceSeniorContract work
- ...with possible contract to hire Linkedin Must Onsite **** Job Description Looking for a Java-focused Software Engineer with working experience in Python, AWS, Terraform, and CI/CD. The candidate will work on cloud-based logging and infrastructure engineering platforms...Amazon Web ServiceSeniorLong term contractWork experience placement
- ...RCHRD Areas of Interest: Enterprise Data; Data Pay Transparency Salary... ...enterprise‑wide. Job Description The Senior Manager, Data Engineering provides leadership and oversight for... ...on cloud platforms such as AWS, Azure, GCP, Snowflake, Databricks, or...Amazon Web ServiceSenior
$92.16k - $138.24k
Req ID:394117NTT DATA strives to hire exceptional... ...are currently seeking a Senior Data Engineering Support Engineer to... ...proficiency in Databricks and PySpark. In this role, you... ...and scripts in Python/PySpark to automate data... ...major cloud networks (AWS, Azure, or GCP).Robust...Amazon Web ServiceSeniorTemporary workWork at officeRemote workFlexible hours- Description: We are seeking a Senior Data Engineer to support the evolution of an enterprise customer... ...modern data engineering practices, and AWS and Snowflake capabilities to deliver... ...experience using Java and/or Python, with Java strongly preferred 1+ year...Amazon Web ServiceSeniorContract work
- We need: Three Senior (10+ years) Data Engineers with extensive experience working with SQL/NoSQL, Big Data/Spark as well as Java or Python. CANDIDATES MUST HAVE RECENT EXPERIENCE IN BANKING OR FINANCIAL... .../data management processes on AWS Financial Services and Commercial...Amazon Web ServiceWork at officeLocal areaRelocation
$118.88k
...will... Serve as a hands-on Senior Data Engineer and architect owning the design and... ...grade pipelines and applications in Python and SQL using Spark/PySpark and open table formats such as... ...compute security and identity within AWS or a comparable cloud environment....Amazon Web ServiceSeniorFull timeFlexible hours$209k - $238.5k
Senior Manager, Full-stack Engineer (Java, Python, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive and iterative delivery environment? At Capital One, you'll be...Amazon Web ServiceSeniorFull timePart timeInternshipLocal area- ...group is seeking multiple talented Senior Data Engineers to join our development team.... ...scalable data pipelines using Python Databricks and Apache Airflow / AWS Step Functions. Implementing... ...Python and SQL. ~ Proficiency in PySpark Scala-Spark and scripting...Amazon Web ServiceSeniorFull timeH1bRelocation packageShift work
$85.5k - $135k
...Responsibilities Our Property & Casualty Data Pipeline team is hiring a Data Engineer to help advance one of the company's... ...Proficiency in programming languages such as Python, Scala, Java, Bash, etc. Hands-on experience with AWS services including ETL tools (Glue, EMR Serverless...Amazon Web ServiceH1bWork at officeImmediate start$82.42k - $126.6k
...advanced technologies such as AI, cloud, and data-led innovation to help our clients... ...Data technologies like Hadoop, Hive, Spark, python, etc. Experience in python and Unix shell... ...Skill 1Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 2Technology|Big...Full timeTemporary workRelocation- ...Description Job Description Job Title: Senior Data Engineer Work Location: Richardson TX 75082 *... ..., Apache Spark, Scala, Advanced Python, and SQL, with extensive hands-on development... ...Databricks, pypark, Spark,Scala, Aws, Hive,GCP, Snowflake. Nice to have skills...Amazon Web ServiceSeniorContract work
- ...in Snowflake, ETL/ELT development, AWS and Azure cloud platforms, big data technologies (Spark, Hadoop, PySpark), data warehousing and databases, Python/SQL programming, and data security... ...Insurance Background A Data Engineer specializes in designing,...Amazon Web Service
- ...Cheil USA/CRM Data & Analytics Position Title: Senior Data Engineer CRM Client account: Samsung Location: Plano TX... ...Cheil data server on Google Cloud or AWS with secure API access so the... ...marketing or customer data. ~ Advanced Python and SQL. ~ Hands-on experience...Amazon Web ServiceSeniorFull timeImmediate start
- ...our customers.Brown & Brown is seeking a Data Engineer to join our growing team in Plano, TX!... ..., and data-processing pipelines using Python, PySpark, Apache Spark, and SQL.Build reliable and... ...platforms such as Microsoft Azure, AWS, or Google Cloud.Experience with cloud...Amazon Web ServiceFull time
- ...experiences. Role Summary: The Senior Data Engineer is a hands-on technical role... ...solutions using Microsoft Fabric, Azure, SQL, Python, Spark, and related technologies. Build... ...and experience with Python and/or PySpark for data engineering workloads. ~ Experience...SeniorHourly payDaily paidPermanent employmentFull timeContract work
- ...Job Description Position - Senior Developer (Java Python) Location - Plano Texas... ...application development, automation, data processing, and integration... ..., and modern software engineering methodologies.... ...Experience with cloud technologies (AWS/Azure), containerization (Docker...Amazon Web ServiceSenior
- ...Brown & Brown is seeking a Lead Data Engineer to join our growing team in... ...-processing pipelines using Python, PySpark, Apache Spark, and SQL.... ...technical lead, lead engineer, or senior engineer with responsibility... ...such as Microsoft Azure, AWS, or Google Cloud.Experience...Amazon Web ServiceFull time
$161.5k - $299.7k
...recruiting for a leader in our Data Science Engineering function. The team is... ...monitoring, and reliability. The Senior Director will lead a team of... ...programming language (e.g., Python)5) generative and agentic AI... ...with cloud platforms (AWS, Azure, or GCP) and cloud-native...Amazon Web ServiceSeniorFull timeWork experience placementWork at office3 days per week- ...have a strong background in data engineering and software development, with... ...Airflow and Spark. • Leverage AWS services (e.g., S3, Glue,... ...modular, and testable code in Python to support data engineering use... ...Snowflake~Digital : Databricks~Digital : PySpark PROLIM CorporationAmazon Web Service
- ...Role: Senior Data, AI & Reliability Engineer Location: Plano, TX (Onsite) Experience Required: 10+ years Skills: Advanced Java, Python for Data Science, AI Agents Must Have Technical/Functional... ...experience, particularly AWS CI/CD pipelines and production...Amazon Web ServiceSeniorFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer - Python, PySpark & AWS. Be the first to apply!
- junior data engineer remote Plano, TX
- data engineer analytics Plano, TX
- data science developer Plano, TX
- big data developer Plano, TX
- big data devops engineer Plano, TX
- data center engineer Plano, TX
- big data cloud engineer Plano, TX
- big data engineer Plano, TX
- junior big data engineer Plano, TX
- remote data engineer Plano, TX




