Senior Pyspark developer
Full-time
Texas State Library and Archives Commision
Role Description
10+ years experience with AWS services, Lambda, PySpark, and API Gateway, RDS, Python, and building high-performance REST APIs on the AWS cloud platform.
- Deep hands-on expertise with AWS services: Lambda, API Gateway, RDS, Elastic Cache, and others.
- Experience with AWS data services: Glue, Kinesis, Python pipelines.
- Experience in writing complex SQL queries.
- Experience with CI/CD workflows using GitHub, GitActions, Terraform, and Octopus.
Qualifications
- Personnel Development
- PySpark
- AWS
- AWS Services
- AWS Lambda
- AWS Glue
- SQL Server
Requirements
- Experience with AWS services: Lambda, PySpark, and REST API Gateway.
- Deep hands-on expertise with AWS services: Lambda, API Gateway, RDS, Elastic Cache, and others.
- Experience with AWS data services: Glue, Kinesis, PySpark ETL pipelines.
- Experience with CI/CD workflows using GitHub, GitActions, Terraform, and Octopus.
- Exceptional analytical and problem-solving aptitude.
Vacancy posted 8 hours ago
Similar jobs that could be interesting for youBased on the Senior Pyspark developer in Remote vacancy
- ...Hoplite Solutions seeking an experienced senior developer to create custom analytics to perform at scale. The software engineer will work... ...Strong experience with Jupyter Notebooks, Java MapReduce, Python PySpark Strong experience with statistical analysis and machine...SeniorFull timeTemporary work
Hoplite Solutions
Remote1 day ago $110k - $150k
Senior Database Developer Job #1081Clearance: Active Public Trust in DHS or a component of DHS Hybrid role, in Ashburn, VA 1-2 days per weekWhat... ...Oracle/DB2/SQLServer/MySQl/TerradataExperience with Databricks, PySpark, Liquibase, DMSExperience in database...SeniorRemote workFlexible hours- ...insights for our customers. Position: Senior Software Engineer, Intelligence Services... ...team. Be a back-end engineer developing Kubernetes services for streaming data pipelines... ...: Clojure, Go, Python Databricks, PySPark Kafka, Kafka Streams, Warpstream...SeniorRemote jobFull timeContract workShift work
Centripetal Networks
Remote1 day ago $175k - $200k
...Bailo (or similar), object-oriented languages (Python and Java), PySpark, Jupyter Notebooks, Kubernetes, docker, Elasticsearch,... ...Collaborate closely with customers to build AI workflows and develop analytics based off artifacts to use AI to flag data of interest...SeniorFull timeContract workTemporary workImmediate startConstellation Technologies
Remote1 day ago$170k - $200k
...team.Position detailsTitle of position: Senior Software EngineerPosition type: Full timeLocation... ...company.Our group is responsible for developing core platforms and services spanning... ...such as Kafka, Spark, Flink, PySpark, MapReduce, or comparable technologies.Experience...SeniorFull timeH1bLocal areaWork from homeWork visaShift work- ...Managerial Skills : Ability to take business requirements and develop functional design and help in technical design. Ability to work... ...SummaryType: Full-timeFunction: Information TechnologyExperience level: Mid-Senior LevelIndustry: Information Technology And ServicesSeniorFull timeRemote work
$190k - $220k
...IS ROLE!This is a hybrid role (three days in the office/two days remote).About your team:The successful candidate will help design, develop and maintain our Web API platform, which currently provides third Parties, clients and the Company's client-facing applications...SeniorFor contractorsWork at officeRemote work- ...diverse F5 community where each individual can thrive.Remote or Onsite | Full-TimeAbout the Role: We are seeking a highly skilled Senior Rust Developer to join our team in designing and developing an enterprise-grade, high-performance proxy solution using Rust. This project...SeniorFull timeLocal areaRemote work
$60k - $120k
Overview Join to apply for the Senior DataBricks Developer (Healthcare) role at Lumenalta . Base pay range $60,000.00/yr - $120,000.00/yr What we... ...complex datasets using Python and raw SQL Use tools like PySpark, AWS, and Databricks daily Design, build, and optimize high...SeniorFull timeWork at officeRemote workFlexible hours$60k - $120k
..., scalable data solutions. What You’ll Do Join the team as a Senior-Level Data Engineer Build and maintain robust ETL pipelines from... ..., complex datasets using Python and raw SQL Use tools like PySpark, AWS, and Databricks daily Design, build, and optimize high-performance...SeniorFull timeWork at officeRemote workMonday to FridayFlexible hours$182k - $226k
...prices below fossil fuels. We are seeking a Senior Software Engineer to join Electric Hydrogen's Digital Team, where you will develop mission-critical software that powers the... ...data analysis libraries such as Pandas, PySpark, or similar frameworks Experience designing...SeniorFull timeTemporary workElectric Hydrogen
Remote1 day ago- ...Engineer with solid experience in designing, developing and deploying large and complex software... ....What you will be responsible forAs Senior Software Engineer you willDevelop/... ...Migrate legacy Spark/Scala Hadoop jobs to PySpark on Azure Databricks.Design and develop event...SeniorFull timeTemporary workWork experience placementWork at officeWork from homeFlexible hours
- ...sustainable processes that minimize environmental impact and foster vibrant and diverse communities around the globe.JOB SUMMARYThe BMC Developer is responsible for supporting the development, integration, and validation of Baseboard Management Controller firmware for server...SeniorFull timeWork at officeLocal areaRemote workWorldwide
$120k
Job DescriptionUW Medicine IT Services has an outstanding opportunity for a Senior Cogito Developer 3 (Access).WORK SCHEDULE100% FTEMonday - Friday; Core hours for UW Medicine IT Services are 8:00 - 5:00 (PST)Day ShiftDEPARTMENT DESCRIPTIONUW Medicine IT Services (ITS)...SeniorFull timeTemporary workWork at officeImmediate startRemote workShift work$86k - $126k
Eaton’s fast-growing Power Delivery & Regulation Business Unit is currently seeking a Senior Optimization Developer.Are you passionate about programming, automation, and solving complex technical challenges? This is more than a traditional software development role. You...SeniorH1bLocal areaRemote workVisa sponsorship$230k - $265k
...Platform. This role is critical to building reliable, scalable, and developer-friendly systems for model experimentation, training,... ...and testing fundamentals. Proficiency with SQL; hands-on Spark/PySpark experience. ~ Knowledge of ML fundamentals—probability & statistics...SeniorFull timeWork from homeFlexible hoursParafin
San Francisco, CA1 day ago$145.02k - $180k
...security operations, Arctic Wolf is the right place for you! Our mission is simple: End Cyber Risk. We’re looking for a Senior Reliability Developer to be part of making this happen. LOCATION: 8939 Columbine Road, Eden Prairie, MN 55347; Telecommuting permissible from...SeniorFull timeLocal areaRemote workWorldwideFlexible hours- Role Description We are looking for a Senior Backend Engineer to join our Data Export Team. In this role, you will lead the architecture... ...into testable Python packages. ~Distributed Processing with PySpark: Hands-on experience writing PySpark batch and streaming jobs...SeniorFull timeRemote work
Placer.ai
Remote1 day ago $172k
...About the role We’re hiring for a Senior AI/ML Engineer, Growth & Marketing AI to help... ...at Chime. In this role, you’ll develop foundational transformer models that convert... ...training frameworks such as PyTorch and PySpark for scalable ML development A strong MLOps...SeniorFull timeWork at officeLocal areaRemote workNight shiftChime Financial
Remote1 day ago$80k - $120k
...(nice to have) ~Experience building data integrations between products (nice to have) ~Understanding of ETL/ELT workflows on PySpark (nice to have) Benefits ~️ Unlimited vacation time - we strongly encourage all employees to take at least 3 weeks per year...SeniorFull timeRemote workWork from homeHome officeConstructor
Remote1 day ago$91.7k - $163.7k
...Senior Software Engineer Optum is a global organization that delivers care, aided by... ...and project status effectively Design, develop, test, and deploy resilient microservices... ...capabilities Experience with Azure Databricks, PySpark, or big data processing workflows...SeniorMinimum wageFull timeWork experience placementLocal areaRemote workUnitedHealthcare
United States2 days ago- Role Description We are seeking a highly experienced Senior Forward Deployed Engineer (FDE) to lead the architecture, design, and execution... ...management and high-throughput caching. ~Experience with PySpark (implementing Medallion architecture / ETL pipelines) and...SeniorFull time
Quantiphi
Remote1 day ago $157k - $208.4k
...What We Need: COMPANY: McKesson Corporation POSITION: Senior Software Engineer LOCATION: 6555 State Highway 161, Irving,... ...Laravel, Codelgniter, Flask, Cypress, Jest, Mocha, VueJS, ReactJS, PySpark, AWS, Docker, and Databricks). Manual and Automation Tools...SeniorRemote workMcKesson
Irving, TX1 day ago- ...Senior Developer We are looking for someone who can integrate Tessian data with Google Chronicle SIEM. The project involves exploring and implementing the best solution, as we currently have integrations with a custom API, but not Google Chronicle. Ideal candidates...SeniorRemote work
Rootshell Inc
United States2 days ago $150k - $170k
...the research community worldwide. Globus develops and provides critical services that support... ...scientific discoveries.Job SummaryAs a senior member of the Globus product team, you will... ...modern data stack tooling, including PySpark, Iceberg/Delta Lake, Parquet, S3 Tables,...SeniorFull timeWork experience placementRemote workWork from homeWorldwideWeekend workAfternoon shift- GliaCell Technologies seeks a Senior Software Engineer to support a U.S. Government contract from Maryland. The role requires an active... ...experience and a BS in CS or related field, with hands-on Python, PySpark, and AWS experience. #J-18808-Ljbffr GliaCell TechnologiesSeniorRemote jobFull timeContract work
$100k - $135k
Role Description We're looking for a Senior Backend Engineer to join our CMS team, building... ...third party enrollment platforms. ~Develop, enhance, and maintain backend services and... ...workflows ~Familiarity with Pandas and/or PySpark is a strong plus ~Familiarity with...SeniorFull timeContract workRemote workFlexible hoursOddball
Remote8 hours ago- ...Senior RPA Developer Location: Remote Client: NAVY Clearance: Secret Target Salary: $95-115K on W2 Role Summary: The Senior RPA Developer leads the development of complex, enterprise-grade automation solutions, providing technical direction, advanced development...SeniorRemote work
MAGNUS Management Group LLC
United States4 days ago - ...: Epsilon Data Management LLC Job Title: Senior Software Engineer Job Requisition: 6630.7... ...Responsibilities Duties: Research, design, and develop computer and network software or... ...analysis using Spark, Scala, Java, Python, Pyspark, SQL, databricks, shell scripting, SAS, and...SeniorFull timeLocal areaRemote workFlexible hours
Publicis Groupe Holdings B.V
Irving, TX1 day ago - ...Why Join Fast growing and changing environment AI-native engineering model Infrastructure-level challenges High autonomy Senior, high-density team If you value judgment, system integrity, and meaningful technical impact — we should talk....SeniorLocal areaRemote work
Wazo International
United States2 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Pyspark developer. Be the first to apply!
