Senior Pyspark developer
Full-time
Texas State Library and Archives Commision
Role Description
10+ years experience with AWS services, Lambda, PySpark, and API Gateway, RDS, Python, and building high performance REST APIs on AWS cloud platform.
- Deep hands-on expertise with AWS services: Lambda, API Gateway, RDS, Elastic Cache, and others.
- Experience with AWS data services: Glue, Kinesis, Python pipelines.
- Experience in writing complex SQL queries.
- Experience with CI/CD workflows using GitHub, GitActions, Terraform, and Octopus.
Qualifications
- Personnel Development
- PySpark
- AWS
- AWS Services
- AWS Lambda
- AWS Glue
- SQL Server
Requirements
- Experience with AWS services, Lambda, PySpark, and REST API Gateway.
- Deep hands-on expertise with AWS services: Lambda, API Gateway, RDS, Elastic Cache, and others.
- Experience with AWS data services: Glue, Kinesis, PySpark ETL pipelines.
- Experience with CI/CD workflows using GitHub, GitActions, Terraform, and Octopus.
- Exceptional analytical and problem-solving aptitude.
Vacancy posted 10 hours ago
Similar jobs that could be interesting for youBased on the Senior Pyspark developer in Remote vacancy
$89k - $121.4k
BECOME A PART OF OUR CARING COMMUNITY The Senior Business Intelligence Engineer builds and manages ETL (Extract, Transform, Load... ...experience with Azure Databricks, including notebook development using PySpark * Experience tuning Spark jobs and SQL queries for performance...SeniorFull timeTemporary workApprenticeshipRemote workWork from homeHome office$60k - $120k
...clean, scalable data solutions. What You’ll Do Join the team as a Senior-Level Data Engineer Build and maintain robust ETL pipelines... ...large, complex datasets using Python and raw SQL Use tools like PySpark, AWS, and Databricks daily Design, build, and optimize high-performance...SeniorFull timeWork at officeRemote workMonday to FridayFlexible hours$100k - $150k
...opportunity to join an established and well-respected organization offering tremendous career growth potential. Job Title: Senior API Developer Location: 100% Remote (U.S.) Position Type: Full-time, Direct W2 Salary Range: $100,000–$150,000 Annually...SeniorFull timeH1bLocal areaImmediate startRemote workVisa sponsorship- ...'d love to hear from you. SYSCOM is seeking an experienced Senior Database Developer to join a large-scale modernization initiative supporting a... ...performance tuning. ~Experience with ETL tools (SSIS), Python, or PySpark. ~Strong background in data modeling and data...SeniorFull timeContract workRemote work
$125k - $150k
...prebuilt, mission-critical integrations, Celigo is redefining how businesses connect their world. The Professional Services Senior Developer is responsible for designing and delivering scalable integration solutions using the Celigo integrator.io platform. This role...SeniorFull timeRemote work- ...Hoplite Solutions seeking an experienced senior developer to create custom analytics to perform at scale. The software engineer will work... ...Strong experience with Jupyter Notebooks, Java MapReduce, Python PySpark Strong experience with statistical analysis and machine...SeniorFull timeTemporary work
$80k - $120k
...(nice to have) ~Experience building data integrations between products (nice to have) ~Understanding of ETL/ELT workflows on PySpark (nice to have) Benefits ~️ Unlimited vacation time - we strongly encourage all employees to take at least 3 weeks per year...SeniorFull timeRemote workWork from homeHome office$100k - $135k
Role Description We're looking for a Senior Backend Engineer to join our CMS team, building... ...third party enrollment platforms. ~Develop, enhance, and maintain backend services and... ...workflows ~Familiarity with Pandas and/or PySpark is a strong plus ~Familiarity with...SeniorFull timeContract workRemote workFlexible hours- ...insights for our customers. Position: Senior Software Engineer, Intelligence Services... ...team. Be a back-end engineer developing Kubernetes services for streaming data pipelines... ...: Clojure, Go, Python Databricks, PySPark Kafka, Kafka Streams, Warpstream...SeniorRemote jobFull timeContract workShift work
- About the Role We are looking for a Senior EDI Developer to join a US-based IT services and technology consultancy on a 10-month W-2 contract engagement. In this fully remote role, you will perform solution-level technical analysis, design, and implementation of EDI integrations...SeniorFull timeContract workRemote work
- ...including systems written in Rust, Python, and data platforms like PySpark ~Familiarity with Kafka or other high-throughput messaging... ...or AWS ~Strong understanding of Linux/UNIX environments and developer tooling (e.g., Git, CI/CD) ~A product mindset, with...SeniorFull timeLive inRemote workFlexible hoursWeekend work
$175k - $200k
...Bailo (or similar), object-oriented languages (Python and Java), PySpark, Jupyter Notebooks, Kubernetes, docker, Elasticsearch,... ...Collaborate closely with customers to build AI workflows and develop analytics based off artifacts to use AI to flag data of interest...SeniorFull timeContract workTemporary workImmediate start- Role Description Este é um cargo remoto. Curte tecnologia, inovação e tem agilidade no DNA? Então talvez você tenha acabado de encontrar o seu próximo desafio! Na Spassu, estamos com um projeto incrível no ar — e ele está prontíssimo para receber profissionais com aquele...SeniorFull timeLocal areaRemote work
$140k - $165k
...rated job search app on iOS & Android. Summary As a Senior BI Engineer on our Business Intelligence team, you'll... ...extending internal AI/LLM-powered tooling for analytics or developer workflows. Expertise with Spark (PySpark or Scala) and big data environments such as Delta...SeniorFull timeRemote workFlexible hours- Role Description Este é um cargo remoto. Curte tecnologia, inovação e tem agilidade no DNA? Então talvez você tenha acabado de encontrar o seu próximo desafio! Na Spassu, estamos com um projeto incrível no ar — e ele está prontíssimo para receber profissionais com aquele...SeniorFull timeLocal areaRemote work
- ...languages and tools, including Java, Spring Boot, AWS and RESTful services, spanning horizontal and vertical packages. ~Experience developing solutions in Guidewire SaaS, ideally participating in migrations to SaaS. ~A history of translating business requirements into...SeniorFull time
$50 - $60 per hour
Role Description We are looking for a Senior RPA Developer with strong UiPath experience to support platform setup, configuration, and development. The ideal candidate should have hands-on experience working with UiPath ecosystem components and be capable of both technical...SeniorContract work- Role Description I have an opportunity for a "Infosphere MDM" - (REMOTE). I am looking for a candidate who can join immediately. If you are interested, please reply with your updated resume or refer someone. Job Title: Infosphere MDM Job Location: Remote Duration:...SeniorFull timeContract workImmediate startRemote work
- Role Description Oportunidade: Desenvolvedor AS400 | Snowflake | ETL - Sênior ~Desenvolver, manter e evoluir aplicações em ambiente AS400 (IBM i). ~Desenvolver consultas e rotinas utilizando DB2/400. ~Atuar na manutenção de programas em RPGLE e CL. ~Apoiar a ...SeniorFull timeRemote work
$500 per month
Role Description As a Senior Software Engineer specializing in JVM-based frameworks, you... ...-performance database engineering and developer experience, where you'll craft tools that... ...data engineering contexts (e.g., Pandas, PySpark, Airflow), and ability to contribute to...SeniorFull timeLocal areaRemote workHome officeFlexible hours- ...build, not just how we build it. ~Share work early, learn out loud, and move on when the evidence says to. Qualifications ~Senior-level engineering experience with broad technical range. ~Comfortable working from a hypothesis rather than a detailed spec....SeniorFull timeFlexible hours
- Role Description We are looking for a Go Developer to join a team working on regulatory, fiscal, and compliance projects. The role requires a self-sufficient engineer who can understand business requirements, collaborate with analysts and teammates, and deliver stable,...SeniorContract work
$128k - $200k
Role Description Hi, I'm Devlon. I lead Developer Acceleration at Jane, joining back in February. My team's job is simple to say and hard to do well: give Jane's developers measurable leverage to ship faster. Sometimes that's a tool someone invokes, sometimes it's a foundation...SeniorFull timeRemote work- Role Description The Senior Windchill Developer will join our Extended Product LifeCycle Management (EPLM) Team. The developer will be involved in all phases of projects, from analysis of client needs to implementation, customization, and reporting on a variety of solutions...SeniorContract work
$65 per hour
Role Description The Senior CorVision Developer will serve as the primary developer for critical legacy platforms built on OpenVMS, CorVision, RDB, and associated operational tools. The position requires deep technical skills in legacy systems, strong operational reliability...SeniorFull time- A technology solutions company is seeking a Remote Senior Developer with a background in agile engineering practices. The ideal candidate will have at least 2 years of professional experience, knowledge of automated decision engines, and strong communication skills. Responsibilities...SeniorRemote work
- ...CRM, marketing automation, and digital transformation solutions for regulated industries. We're looking for an experienced Senior OFS Developer to join our fully remote development team and play a key role in delivering high-quality, scalable enterprise applications....SeniorFull timeContract workRemote work
- ...Senior Data Engineer – SQL Pipelines Other Area(s) Remote Full-Time Apr 6, 2026 Inserso... ...and performance tuning techniques. Design, develop, and maintain SQL Server 2016+ databases... ...pipeline work. Experience with Python or PySpark for data processing tasks. Future‑Relevance...SeniorFull timeRemote work
$120k - $160k
...engineer who will collaborate closely with cross-functional teams to develop and deploy AI-powered features and tools that optimize employee... ...writing and working in Python or Spark (ScalaSpark or PySpark) and with popular machine learning libraries such as TensorFlow...SeniorFull timeFor contractorsFlexible hours$130k - $140k
Role Description API developer for .NET APIs on an Azure integration platform that sits between CRM apps and back-end DBs with data exposed via APIs. APIs are written in .NET Framework currently, with future migration to .NET Core. Develop and test new and updated APIs...SeniorFull time
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Pyspark developer. Be the first to apply!




















