Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior AWS Python Developer / Pyspark Data Engineer

Full-time

System One

Job Title: Senior AWS Python Developer / PySpark Data Engineer
Location: Lafayette, LA · Knoxville, TN · Columbia, SC · Birmingham, AL
Type: Direct Hire
Work Model: Hybrid

Overview

We are looking for a Senior Python + PySpark Data Engineer with strong AWS big data experience — ideally someone who has worked in cybersecurity or security data environments.
This is primarily a hands-on data engineering role, not a traditional Python application developer role.

Responsibilities
  • Developing scalable Python applications and data processing solutions
  • Integrating APIs
  • Writing and optimizing complex SQL queries
  • Processing large datasets using Spark and AWS services
  • Troubleshooting application and data processing performance
  • Contributing to CI/CD automation
  • Working closely with technical and business teams across the organization

Requirements

  • 8+ years of hands on Python development, including development of data intensive and big data applications.
  • Strong Python programming fundamentals and experience developing scalable, production grade applications.
  • 5+ years of experience working with Apache Spark/PySpark, including troubleshooting and optimizing Spark jobs.
  • 5+ years of hands on development experience with AWS, including EMR, Lambda, EventBridge, Step Functions, Redshift, S3, and Glue.
  • Advanced SQL skills, including complex queries, data transformations, joins, and recursive CTEs.
  • Experience developing and consuming REST APIs and integrating applications with external services and data sources.
  • Strong background working with large datasets, including data manipulation, transformation, analysis, and processing.
  • Experience with big data technologies such as Hadoop/EMR, Spark, and Hive.
  • 4+ years of experience working with AI related technologies or applications.
  • Hands on CI/CD and infrastructure automation experience using GitLab and Terraform.
  • Strong debugging, performance tuning, analytical, and problem solving skills.
  • Ability to collaborate effectively across development teams and a matrixed organization.
  • Bachelor's degree in Computer Science, Information Systems, or a related field.?


System One, and its subsidiaries including Mountain Ltd., are leaders in delivering outsourced services and workforce solutions across North America. We help clients get work done more efficiently and economically, without compromising quality. System One not only serves as a valued partner for our clients, but we offer eligible employees health and welfare benefits coverage options including medical, dental, vision, spending accounts, life insurance, voluntary plans, as well as participation in a 401(k) plan.

System One is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, age, national origin, disability, family care or medical leave status, genetic information, veteran status, marital status, or any other characteristic protected by applicable federal, state, or local law.

#LI-
Ref: #404-IT Pittsburgh

System One, and its subsidiaries including Joulé, ALTA IT Services, TeamPeople, and Mountain Ltd., are leaders in delivering outsourced services and workforce solutions across North America. We help clients get work done more efficiently and economically, without compromising quality. System One not only serves as a valued partner for our clients, but we offer eligible employees health and welfare benefits coverage options including medical, dental, vision, spending accounts, life insurance, voluntary plans, as well as participation in a 401(k) plan.

System One is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex (including pregnancy, childbirth, or related medical conditions), sexual orientation, gender identity, age, national origin, disability, family care or medical leave status, genetic information, veteran status, marital status, or any other characteristic protected by applicable federal, state, or local law.

Vacancy posted 16 days ago
Similar jobs that could be interesting for youBased on the Senior AWS Python Developer / Pyspark Data Engineer in Knoxville, TN vacancy
  •  ...Job Title: Senior AWS Python Developer / PySpark Data Engineer Location: Lafayette, LA · Knoxville, TN · Columbia, SC · Birmingham, AL Type: Direct Hire Work Model: Hybrid Overview We are looking for a Senior Python + PySpark Data Engineer with strong... 
    Amazon Web Service
    Senior
    Local area

    System One

    Knoxville, TN
    15 days ago
  • $89.6k - $123.2k

     ...Description:CGI is seeking a Senior Data Engineer with deep expertise in...  ...and maintain data pipelines, develop ontology models, and create...  ...business workflows within an AWS centric environment.This...  ...modeling. Solid coding chops in Python, PySpark, and SQL — comfortable... 
    Amazon Web Service
    Senior
    Local area

    CGI

    Knoxville, TN
    3 days ago
  • $98k

     ...Job Description Job Title: Senior AWS Java/Python Developer with Microservices & API...  ...cloud native applications and data solutions within a large...  ...Generation (RAG), prompt engineering, and agentic workflows....  ...engineering teams. ~ Apache Spark/PySpark or Scala Spark experience... 
    Amazon Web Service
    Senior
    Local area

    System One

    Knoxville, TN
    28 days ago
  • $60k - $120k

     ...Description Job Description Job Title: Senior AWS Python Developer Location: Knoxville, TN Type:...  ...Python-based applications and data solutions supporting the Financial Crimes...  ...activities. Collaborate with engineering, data, and business teams in a financial... 
    Amazon Web Service
    Senior
    Contract work
    Local area

    System One

    Knoxville, TN
    29 days ago
  •  ...Job Title: Senior AWS IAM Engineer Location: Lafayette, LA, Knoxville, TN...  ...identity services and AWS based data and analytics capabilities...  ...integrations while also developing and maintaining data...  ...needs. . Experience with Python and/or Shell scripting for... 
    Amazon Web Service
    Senior
    Permanent employment
    Full time
    Local area

    System One

    Knoxville, TN
    a month ago
  •  ...Job Title: Senior Data Engineer Location: Knoxville, TN Type : Permanent...  ...data platforms. • Develop ontology models and create...  ...business workflows within an AWS-centric environment. • Collaborate...  .... • Proficiency in Python, PySpark, and SQL — capable of... 
    Amazon Web Service
    Senior
    Permanent employment
    Full time
    Local area
    Remote work

    System One

    Knoxville, TN
    a month ago
  •  ...Job Description Job Title: Senior AWS IAM Engineer Location: Lafayette, LA,...  ...services and AWS based data and analytics capabilities...  ...identity integrations while also developing and maintaining data...  ...needs. . Experience with Python and/or Shell scripting for... 
    Amazon Web Service
    Senior
    Permanent employment
    Full time

    System One

    Knoxville, TN
    10 days ago
  • $95.7k - $123.2k

     ...Description: ​CGI is seeking a Senior Java Full Stack Developer with 5+ years of...  ...Java, Spring Boot, Angular, Python, and AWS. This role leads the development...  ...Python services and data processing workflows, and...  ...processing, with familiarity using PySpark, Pandas, or Boto3. .... 
    Amazon Web Service
    Senior
    Full time
    Local area

    CGI

    Knoxville, TN
    20 hours ago
  •  ...Job Title: AWS Data Engineer Location: Knoxville, TN, Columbia SC or Lafayette, LA or Birmingham...  ...with technical and business teams to develop and enhance data pipelines and ETL...  ...workflows. • Strong programming skills in Python for data processing, scripting, and... 
    Amazon Web Service
    Local area

    System One Holdings, LLC

    Knoxville, TN
    1 day ago
  • $120k - $155k

    The Senior Consultant I - Data Engineer provides technical expertise on project tasks under...  ...and AI/ML initiatives.Develop, implement, and maintain scalable...  ...cloud platforms such as AWS, Azure, or Google Cloud....  ...skills.Proficient in Python and SQL, with familiarity... 
    Amazon Web Service
    Work experience placement
    Remote work
    Flexible hours

    ABS Group

    Knoxville, TN
    4 days ago
  •  ...Description Job Description Senior DevSecOps Engineer Permanent Full-Time...  ...quarantine and waiver processes. Develop and maintain repository...  ...also acceptable Strong AWS experience with: IAM...  ...Strong scripting skills in: Python Bash Go Experience... 
    Amazon Web Service
    Senior
    Permanent employment
    Full time

    System One

    Knoxville, TN
    26 days ago
  •  ...Materials Testing (CMT) Senior Field Technician I to...  ...continue to collaborate and develop with experienced...  ...standards and compliance. Data Collection: Perform calculations...  ...with accepted engineering practices. Career Development...  ...such as ACI, ASNT, AWS, ICC, NICET, NRCA, RCI,... 
    Amazon Web Service
    Senior
    For contractors

    ECS Limited

    Knoxville, TN
    4 days ago
  •  ...Description Job Description Senior CyberArk PAM Engineer Job Type: Permanent Full-...  ...team supporting a large-scale, AWS-based financial services...  ...security, and operational health. Develop automation and operational tooling using Python . Support CyberArk-related... 
    Amazon Web Service
    Senior
    Permanent employment
    Full time

    System One

    Knoxville, TN
    29 days ago
  •  ...Job Title: Senior Cloud Security Architect Location...  ...architecture, engineering, and security teams to protect sensitive data, strengthen identity and...  ...The role requires strong AWS expertise and the ability...  ..., SaaS, and internally developed applications.... 
    Amazon Web Service
    Senior
    Full time

    System One Holdings, LLC

    Knoxville, TN
    3 days ago
  •  ...Description Job Title: Senior Splunk & Observability Engineer Job Type: Permanent...  ...within a complex, AWS based production...  ...working across the full data lifecycle from...  ...Responsibilities include developing and optimizing SPL...  ...OpenTelemetry, and Python based automation to... 
    Amazon Web Service
    Senior
    Permanent employment
    Full time

    System One

    Knoxville, TN
    3 days ago
  •  ...Description Job Description Job Title: Senior DevSecOps Engineer Locations: Lafayette, LA |...  ...GitHub Actions also welcome). ~ Strong AWS skills across IAM, ECS/EKS, EC2, S3, Lambda...  .... ~ Solid scripting ability in Python, Bash, or Go. ~ Experience maintaining... 
    Amazon Web Service
    Senior
    Local area

    System One

    Knoxville, TN
    10 days ago
  •  ...Description Job Description Job Title: Senior Incident Manager Duration: Full Time /...  ...and business perspectives across AWS, enterprise applications, networks, infrastructure...  ...remediation actions to the responsible engineering teams. Ensure incidents progress... 
    Amazon Web Service
    Senior
    Permanent employment
    Full time

    System One

    Knoxville, TN
    13 days ago
  •  ...Description Job Description Job Title: DevOps Engineer Job Category: Software Development/...  ...and optimize delivery workflows, develop reusable pipeline templates, and help modernize...  ...infrastructure experience, preferably in AWS environments. . Experience developing... 
    Amazon Web Service
    Senior
    Permanent employment
    Full time

    System One

    Knoxville, TN
    14 days ago
  •  ...Senior DevOps Engineer CGI is seeking a strong Senior DevOps Engineer to support...  ...automated GitLab pipelines, develop Terraform modules, validate...  ...scripting experience using Python, Bash, PowerShell, or Groovy...  ..., preferably on AWS. Experience with Git based... 
    Amazon Web Service
    Senior
    Local area

    LED FastStart

    Knoxville, TN
    4 days ago
  •  ...Description Job Description Job Title: Senior Informatica ETL Developer (AWS) Location: Multiple Locations...  ...You'll work with data engineering and operations teams Help manage...  ...Lambda, and CloudWatch ~ Strong Python and SQL skills, including work with... 
    Amazon Web Service
    Senior
    Local area

    System One

    Knoxville, TN
    25 days ago
  •  ...Description Job Title: Senior Salesforce Developer Location: Lafayette,...  ...stakeholders and engineering teams to translate requirements...  ...ecosystems such as AWS. Utilize CI/CD...  ...languages like Java, Python, or Node.js. Apply...  ...of SOQL/SOSL for data querying and manipulation... 
    Amazon Web Service
    Senior
    Permanent employment
    Full time

    System One

    Knoxville, TN
    10 days ago
  •  ...Senior Account ManagerThe Senior Account Manager serves as the primary liaison between the...  ...to perform the essential functions.Develop and nurture long-term relationships with...  ...certifications (e.g., CompTIA, ITIL, Microsoft, AWS, Cisco).Hands-on experience with MSP... 
    Amazon Web Service
    Senior
    Contract work
    Work at office
    Local area
    Remote work
    Monday to Friday
    Afternoon shift

    RJ Young

    Knoxville, TN
    5 days ago
  •  ...Job Description Job Description Job Title: Senior AWS Security Architect - Threat Modeling Location: Birmingham...  ...services, Infrastructure as Code, containers, APIs, data, and AI platforms. You will also develop reusable security patterns and automate policy... 
    Amazon Web Service
    Senior
    Full time

    System One

    Knoxville, TN
    29 days ago
  •  ...Description Job Description Job Title: Senior Incident Manager Location: Knoxville,...  ...impacting incidents involving applications, AWS/cloud services, networks, and enterprise...  ...remediation actions to the responsible engineering teams. Ensure incidents progress within... 
    Amazon Web Service
    Senior
    Local area

    System One

    Knoxville, TN
    28 days ago
  •  ...Description Job Title: Senior Vulnerability...  ...analyze vulnerability data, monitor remediation progress...  ...domains, including cloud and AWS based environments....  ...analysis. ~ Experience developing executive or leadership...  ...Science, Computer Engineering, Cybersecurity, Information... 
    Amazon Web Service
    Senior
    Permanent employment
    Full time

    System One

    Knoxville, TN
    3 days ago
  •  ...Job Description Job Title: Senior Product Analyst/System Analyst...  ...processes, system interactions, and data flows within a financial...  ...UAT, and end-to-end testing by developing test cases and managing defect...  ...preferred. ~ Understanding of AWS-based application environments... 
    Amazon Web Service
    Senior
    Permanent employment
    Full time

    System One

    Knoxville, TN
    23 days ago
  •  ...Job Description Job Description Senior AWS Full Stack Engineer Locations: Knoxville, TN | Columbia...  ...Senior AWS Full Stack Engineer to develop and enhance cloud-based applications...  ...using Java and Spring Boot, Node.js, or Python. Build and integrate RESTful... 
    Amazon Web Service
    Senior

    System One

    Knoxville, TN
    8 days ago
  •  ...Description Job Description Job Title: Senior AWS Full Stack Software Engineer Location: Plano, TX/Reston, VA/...  ...Full Time Responsibilities • Develop and maintain full stack applications using Java/Spring Boot, Python, and Angular. • Build and support cloud... 
    Amazon Web Service
    Senior
    Permanent employment
    Full time
    Local area

    System One

    Knoxville, TN
    21 days ago
  •  ...skilled Deskside Support with 3–5 years of experience in IT infrastructure support. The role involves handling basic networking, data center operations, monitoring tools, hardware troubleshooting, and ITSM tools . You will act as the on-site support partner, assisting... 
    Senior
    Remote work

    TECEZE

    Knoxville, TN
    9 days ago
  •  ...build what comes next. As a Solutions Engineer, you will serve as a senior technical expert supporting C Spire...  ...complex multi-site environments. • Develop advanced network designs incorporating...  ..., VMware Certified Professional, AWS, Azure, Dell Technologies, Fortinet,... 
    Amazon Web Service
    Senior
    Full time

    C Spire

    Knoxville, TN
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior AWS Python Developer / Pyspark Data Engineer. Be the first to apply!