Senior Data Engineer - Python, PySpark & AWS
Full-time
SCI SOLUTIONS GLOBAL
Senior Data Engineer Python PySpark & AWS
Location: Plano TX
Relocation : Open
Open for W2 only- No c2c/1099 or third party resumes
Due to the nature of the roles client is only accepting USC/GC /GC EAD only no other visas accepted .
Role Overview
We are seeking a hands-on Senior Data Engineer with strong Python PySpark and AWS experience to develop and maintain scalable data pipelines and distributed data processing solutions. The ideal candidate will have experience supporting production data engineering workloads cloud infrastructure and data orchestration.
Key Responsibilities
- Develop test and maintain ETL/ELT data pipelines using Python and PySpark.
- Build and support big-data processing solutions on AWS using S3 EMR and Lambda.
- Implement infrastructure automation using Terraform.
- Develop data integrations using REST APIs Kafka and MQ messaging.
- Support data storage and retrieval using Cassandra.
- Orchestrate and monitor workflows using Airflow Control-M and native schedulers.
- Troubleshoot pipeline failures and optimize performance reliability and data quality.
Required Skills
- Strong hands-on Python and PySpark experience.
- Experience with big-data processing and production data pipelines.
- AWS experience with S3 EMR and Lambda.
- Working knowledge of Terraform.
- Familiarity with Kafka MQ messaging REST APIs Java and Cassandra.
- Experience with Airflow Control-M or other workflow scheduling tools.
Preferred: Databricks experience and exposure to machine-learning workflows.
Required Skills:
Senior Data Engineer Python PySpark & AWS Location: Plano TX Relocation : Open Open for W2 only- No c2c/1099 or third party resumes Due to the nature of the roles client is only accepting USC/GC /GC EAD only no other visas accepted. Role Overview We are seeking a hands-on Senior Data Engineer with strong Python PySpark and AWS experience to develop and maintain scalable data pipelines and distributed data processing solutions. The ideal candidate will have experience supporting production data engineering workloads cloud infrastructure and data orchestration. Key Responsibilities Develop test and maintain ETL/ELT data pipelines using Python and PySpark. Build and support big-data processing solutions on AWS using S3 EMR and Lambda. Implement infrastructure automation using Terraform. Develop data integrations using REST APIs Kafka and MQ messaging. Support data storage and retrieval using Cassandra. Orchestrate and monitor workflows using Airflow Control-M and native schedulers. Troubleshoot pipeline failures and optimize performance reliability and data quality. Required Skills Strong hands-on Python and PySpark experience. Experience with big-data processing and production data pipelines. AWS experience with S3 EMR and Lambda. Working knowledge of Terraform. Familiarity with Kafka MQ messaging REST APIs Java and Cassandra. Experience with Airflow Control-M or other workflow scheduling tools. Preferred: Databricks experience and exposure to machine-learning workflows.
Vacancy posted 10 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer - Python, PySpark & AWS in Plano, TX vacancy
- Yoh is seeking a Senior Data Engineer to design and implement scalable data engineering and ML solutions in a hybrid, multi-location... ..., Plano, Chicago, and Richmond. The role emphasizes Python/Scala development, AWS services, and real-time data pipelines. Key...Amazon Web ServiceSenior
- Yoh, a Day & Zimmermann Company, seeks a Senior Big Data/Machine Learning Engineer to design and implement scalable data platforms and ML-ready pipelines... ...locations including Plano, NY, DC, and more. Strong Python/Scala, AWS EMR/Glue, Kafka, and SQL required. The role focuses...Amazon Web ServiceSenior
$52.73 - $80 per hour
Senior Data Engineer Location: McLean, VA; NYC, Wilmington, Boston, Plano, Chicago, or Richmond... ...candidate will have strong experience with Python, Scala, AWS data services, distributed processing... ...techniques.Experience with Spark, PySpark, or similar big data frameworks....Amazon Web ServiceSeniorYoh
Plano, TX3 days ago$52.73 per hour
Senior Data Engineer Location: McLean, VA; NYC, Wilmington, Boston, Plano, Chicago, or Richmond... ...candidate will have strong experience with Python, Scala, AWS data services, distributed processing... ...techniques. Experience with Spark, PySpark, or similar big data frameworks....Amazon Web ServiceSeniorContract work- A technology firm in Plano, TX is looking for a Senior Big Data/Machine Learning Engineer with a minimum of 8 years of experience. The position requires proficiency in data engineering, Python, SQL, pyspark, and AWS. The role entails developing data models and implementing...Amazon Web ServiceSeniorRemote jobContract workWork visa
- ...top-tier projects. Job DescriptionThe Data Solutions Engineer IV works in close collaboration to... ...resource governanceDefine and drive Python, PySpark, and SQL standards for data engineering... ...Fivetran, dbt, Snowflake, Kafka ecosystem, AWS services) with a focus on scalability...Amazon Web ServiceSenior
Bank of Oklahoma
Richardson, TX2 days ago - ...Job DescriptionJob DescriptionHiring: Python Data Engineer Location: Plano, TX-Onsite Type: W2 Only... ...• Strong hands-on experience in Python, PySpark and Bigdata technologies for data engineering. • Practical experience with AWS, specifically S3, EMR, and Lambda. • Working...Amazon Web ServiceLocal area
SCI SOLUTIONS GLOBAL
Plano, TX4 days ago - About the job Big Data/Machine Learning Engineer - Sr Note: Need Only US Citizen, Green Card, EAD-GC, J2 EAD, H4 EAD, L2 EAD, and TN Visa... ...Need minimum 08+ years of experience Data Engineer Python, pyspark, SQL, AWS Experience with Data Modeling #J-18808-Ljbffr Rapinno...Amazon Web ServiceSeniorContract workRemote work
- ...Job Info: Senior Data Engineer to support the evolution of an enterprise customer profile platform... ...modern data engineering practices, and AWS and Snowflake capabilities to deliver scalable... ...experience using Java and/or Python, with Java strongly preferred. 1+ year...Amazon Web ServiceSeniorRemote workFlexible hours
NTT DATA North America
Plano, TX12 hours ago - NTT DATA North America is seeking a Senior Data Engineer to evolve an enterprise customer profile platform and integrate it with a broad ecosystem of applications... ...assets. You will leverage cloud-native practices, AWS, and Snowflake capabilities to deliver scalable, reliable...Amazon Web ServiceSeniorRemote job
- ...Data Engineer Python & AWS Glue Data Platforms Location: Plano TX Relocation : Open Open for W2 only- No c2c/1099 or third party... ...Bedrock and exposure to AI agentic workflows. Terraform PySpark or Apache Spark. Required Skills: Data Engineer...Amazon Web ServiceFull timeRelocation
- ...Richardson -RCHRDAreas of Interest:Enterprise Data; DataPay Transparency Salary Range:Not... ...enterprise‑wide.Job DescriptionThe Senior Manager, Data Engineering provides leadership and oversight for... ...on cloud platforms such as AWS, Azure, GCP, Snowflake, Databricks, or...Amazon Web ServiceSenior
Bank of Oklahoma
Richardson, TX2 days ago - Innova Solutions is seeking a Cloud Data Engineer (Intermediate) for a Plano, TX engagement. This contract-to-hire role requires hands-on AWS data lake expertise, Python development, and strong CI/CD skills to build scalable data pipelines. Responsibilities include implementing...Amazon Web ServiceHourly payContract work
$92.16k - $138.24k
Req ID:394117NTT DATA strives to hire exceptional... ...are currently seeking a Senior Data Engineering Support Engineer to... ...proficiency in Databricks and PySpark. In this role, you... ...and scripts in Python/PySpark to automate data... ...major cloud networks (AWS, Azure, or GCP).Robust...Amazon Web ServiceSeniorTemporary workWork at officeRemote workFlexible hoursNTT DATA
Addison, TX3 days ago$209k - $238.5k
Senior Manager, Full-stack Engineer (Java, Python, AWS) Do you love building and pioneering in the technology space? Do you enjoy solving complex business problems in a fast-paced, collaborative, inclusive and iterative delivery environment? At Capital One, you'll be...Amazon Web ServiceSeniorFull timePart timeInternshipLocal area- ...DescriptionPosition OverviewWe are seeking a Senior Python Developer to write, test, and document... ...implementations that less experienced engineers can build and maintain· Anticipate... ...Qualifications· Experience with HashiCorp Vault, AWS Secrets Management, or Azure Key Vault·...Amazon Web ServiceSenior
HeartCentrix Solutions
Plano, TX2 days ago - ...Description Job Description Job Title: Senior Data Engineer Work Location: Richardson TX 75082 *... ..., Apache Spark, Scala, Advanced Python, and SQL, with extensive hands-on development... ...Databricks, pypark, Spark,Scala, Aws, Hive,GCP, Snowflake. Nice to have skills...Amazon Web ServiceSeniorContract work
$82.42k - $126.6k
...advanced technologies such as AI, cloud, and data-led innovation to help our clients... ...Data technologies like Hadoop, Hive, Spark, python, etc. Experience in python and Unix shell... ...Skill 1Technology|Big Data - Data Processing|PySpark Technical/Domain Skill 2Technology|Big...Full timeTemporary workRelocationInfosys Technologies
Plano, TX4 days ago- ...DescriptionJob DescriptionTitle : Lead Data Platform Engineer Location: PLANO, TX- 75024 Duration:... ...and platform services across AWS, Datameer, Tableau, MicroStrategy, Snowflake... ...Experience with scripting languages such as PySpark, Python, Bash, or similar.Familiarity with...Amazon Web ServiceShift work
LanceSoft
Plano, TX12 hours ago - ...are looking for a passionate certified Data Engineer. The successful candidate will turn data... ...improvements.Primary skillset: Python/Pyspark & Azure, ADF, SQL, SQL Server, Data Warehousing... ...object-oriented programmingSkilled in AWS Compute such as EC2, Lambda, Beanstalk,...Amazon Web ServiceWork experience placement
forhyre.com
Plano, TX4 days ago - ...Data EngineerBuilt on meritocracy, our unique company culture... ...Brown & Brown is seeking a Data Engineer to join our growing team in... ...data-processing pipelines using Python, PySpark, Apache Spark, and SQL.Build... ...such as Microsoft Azure, AWS, or Google Cloud.Experience with...Amazon Web Service
Brown & Brown
Plano, TX5 days ago - ...Job DescriptionJob DescriptionSenior Data Engineer – Plano, TX | Full-Time / HybridPosition Overview We are seeking a highly skilled and... ...data platform. This role will focus heavily onAzure Databricks, PySpark, Spark SQL, scalable ETL/ELT pipelines, and data lakehouse architecture...SeniorFull timeLocal area
HumCap
Plano, TX4 days ago $104.24k - $130.3k
...Req ID: 393405 NTT DATA strives to hire exceptional, innovative... ...We are currently seeking a Senior Data Engineer (w/ Oracle & OLTP) - On-Site... ...engineering practices, and AWS and Snowflake capabilities to... ...experience using Java and/or Python, with Java strongly preferred...Amazon Web ServiceSeniorTemporary workWork at officeRemote workFlexible hours$161.5k - $299.7k
...recruiting for a leader in our Data Science Engineering function. The team is... ...monitoring, and reliability. The Senior Director will lead a team of... ...programming language (e.g., Python)5) generative and agentic AI... ...with cloud platforms (AWS, Azure, or GCP) and cloud-native...Amazon Web ServiceSeniorFull timeWork experience placementWork at office3 days per weekHealth Care Service
Richardson, TX1 day ago- ...Brown & Brown is seeking a Lead Data Engineer to join our growing team in... ...-processing pipelines using Python, PySpark, Apache Spark, and SQL.... ...technical lead, lead engineer, or senior engineer with responsibility... ...such as Microsoft Azure, AWS, or Google Cloud.Experience...Amazon Web ServiceFull time
Brown & Brown Insurance Services
Plano, TX4 days ago - ...experiences. Role Summary: The Senior Data Engineer is a hands-on technical role... ...solutions using Microsoft Fabric, Azure, SQL, Python, Spark, and related technologies. Build... ...and experience with Python and/or PySpark for data engineering workloads. ~ Experience...SeniorHourly payDaily paidPermanent employmentFull timeContract work
Cinemark USA, Inc
Plano, TXa month ago - ...DescriptionJob Description Job Details: Job title:Senior Azure Data Engineer Work Location with Zip code: Richardson... ...7-9 Years Must have skills: Databricks Python AI/ML Detailed Job Description: Agile development/5 years, Databricks, PySpark, Python/3-5 yrs, Azure cloud Data...Senior
eTeam
Richardson, TX5 days ago $229.9k - $262.4k
...Data Engineer 5 (Senior Manager, IC) (CaCe) Do you love building and pioneering in the technology space... ...Utilize programming languages such as Python and Spark, along with open-source relational... ...at least one public cloud environment (AWS, Microsoft Azure, or Google Cloud) ~5+...Amazon Web ServiceSeniorFull timePart timeInternshipWork at officeLocal areaCapital One
Plano, TX2 hours ago- We're looking for a Lead Data Platform Engineer to play a critical role in designing, optimizing,... ...infrastructure and platform services across AWS, Snowflake, Tableau, MicroStrategy,... ...scripting skills using Python, PySpark, Bash, or similar technologiesPassion...Amazon Web ServiceHourly payFreelance
Solomon Page
Plano, TX1 day ago $314.8k - $359.3k
...Senior Director, Data Engineer As a Senior Director, Data Engineer at Capital One, you will lead high-performing... ...least one of the following languages: Python, Java, or Scala At least 5 years of... ...least one public cloud environment (AWS, Microsoft Azure, or Google Cloud) ~8...Amazon Web ServiceSeniorFull timePart timeLocal areaDay shiftCapital One
Plano, TX2 hours ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer - Python, PySpark & AWS. Be the first to apply!
Related searches
- senior cloud data engineer Plano, TX
- big data cloud engineer Plano, TX
- junior big data engineer Plano, TX
- data engineering intern summer Plano, TX
- data engineer analytics Plano, TX
- sr data engineer Plano, TX
- big data developer Plano, TX
- data developer Plano, TX
- sr information security engineer Plano, TX
- etl data engineer Plano, TX