Senior PySpark Engineer - AWS/EMR
Saviance
Job Title: Senior PySpark Engineer - AWS/EMR Location: Remote (EST Time Zone Preferred) Duration: 6 Months Contract About BigRio:
BigRio is a remote-based, technology consulting firm with headquarters in Boston, MA. We deliver software solutions ranging from custom development and software implementation to data analytics and machine learning/AI integrations. As a one-stop shop, we attract clients from a variety of industries due to our proven ability to deliver cutting-edge, cost-effective software solutions. Job Overview:
We are seeking a Senior PySpark Engineer with strong hands-on experience in building distributed data pipelines using Apache Spark on AWS EMR . The ideal candidate is proficient in Python , has worked with Databricks , and has a solid understanding of GxP-compliant environments. This is a coding-heavy role - not DevOps or AWS administration - where you'll contribute directly to the architecture and development of robust data solutions in a highly regulated, cloud-native environment. Key Responsibilities:
BigRio is a remote-based, technology consulting firm with headquarters in Boston, MA. We deliver software solutions ranging from custom development and software implementation to data analytics and machine learning/AI integrations. As a one-stop shop, we attract clients from a variety of industries due to our proven ability to deliver cutting-edge, cost-effective software solutions. Job Overview:
We are seeking a Senior PySpark Engineer with strong hands-on experience in building distributed data pipelines using Apache Spark on AWS EMR . The ideal candidate is proficient in Python , has worked with Databricks , and has a solid understanding of GxP-compliant environments. This is a coding-heavy role - not DevOps or AWS administration - where you'll contribute directly to the architecture and development of robust data solutions in a highly regulated, cloud-native environment. Key Responsibilities:
- Design, develop, and maintain distributed ETL data pipelines using PySpark on AWS EMR
- Work within a GxP-compliant environment, ensuring data integrity and regulatory alignment
- Write clean, scalable, and efficient PySpark code for large-scale data processing
- Utilize AWS cloud services for pipeline orchestration, compute, and storage
- Collaborate closely with cross-functional teams to deliver end-to-end data solutions
- Participate in code reviews, testing, and deployment of pipeline components
- Ensure performance optimization, fault tolerance, and scalability of data workflows
- 8-10 years of experience in software or data engineering with a focus on distributed systems
- Deep hands-on experience with Apache Spark , PySpark , and AWS (especially EMR)
- Experience building pipelines using Databricks is a strong plus
- Strong programming skills in Python
- Solid understanding of cloud-native architectures
- Familiarity with GxP compliance and working in regulated data environments
- Proven ability to independently design and develop data pipelines (not a DevOps/AWS admin role)
- Experience with distributed computing and high-volume ETL pipelines
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Senior PySpark Engineer - AWS/EMR in Boston, MA vacancy
$140k - $210.9k
...focusing on enhancing the payments landscape nationally. The position requires expertise in AWS environments, strong communication, and a background in infrastructure or software engineering. Successful candidates will be responsible for producing CI/CD automation and...Amazon Web ServiceSenior- ...leading technology firm is seeking an experienced Sr. Manager, Engineering to lead their engineering team. This role focuses on developing... ...extensive experience in technical leadership, including expertise in AWS and modern programming languages like JavaScript and Node.js....Amazon Web ServiceSeniorLocal area
- ...Senior Software Engineer Opportunity We are looking for a Senior Software Engineer who thrives in the challenge of pushing high-volume consumer... ...current infrastructure uses the latest technologies: Linux, AWS, Cassandra, MySQL, AMQP, Redis, Ruby on Rails and Go. We use...Amazon Web ServiceSeniorFlexible hours
Roberts Recruiting
Boston, MA25 days ago $110.88k - $177.41k
Philips North America seeks a Cloud Operations Specialist in Cambridge, MA to manage and optimize AWS environments, ensuring compliance and operational excellence. The role requires 5+ years of AWS experience, with knowledge of cloud networking, Windows Server, and automation...Amazon Web ServiceSenior$140k - $160k
...Senior Cybersecurity Engineer St. Louis, MO; Boston, MA; New York, NY The Senior Cybersecurity Engineer is responsible for protecting Focus'... ...Must have experience securing cloud environments such as AWS and Azure Experience with API Gateways and other common...Amazon Web ServiceSeniorRemote work3 days per weekFocus Financial Partners Inc.
Boston, MA17 hours ago$286.2k - $326.7k
A leading financial services company is looking for a Senior Distinguished Data Engineer to drive technological transformation in a remote-eligible position... ...experience, with deep knowledge in data architecture and AWS applications. Responsibilities include promoting modern...Amazon Web ServiceSeniorRemote job- ...Senior IT Operations Engineer CloudZero is hiring a Senior IT Operations Engineer who treats IT as a product instead of a help desk. You will work... ...2+ years of operational time inside GCP, Snowflake, and/or AWS. • Strong API instincts. You have stitched SaaS tools...Amazon Web ServiceSeniorWork at office
CloudZero
Boston, MA14 days ago $146k - $184k
...Senior Threat Detection and Response Engineer Boston, MA April 15, 2026 Job Description Who we are At CarGurus (NASDAQ: CARG), our mission is... ...teams to design controls for a cloud first infrastructure (AWS, Kubernetes, etc) What you'll bring ~5+...Amazon Web ServiceSeniorFlexible hoursVenturefizz Product Management Community
Boston, MA17 hours ago- SecureBio, LLC is looking for a Senior Cloud Infrastructure Engineer to join our Detection team in Cambridge, MA, focusing on building and maintaining... ...monitoring systems. This full-time in-person role requires deep AWS expertise and a strong security mindset amidst ambitious...Amazon Web ServiceSeniorFull time
$163k - $246.5k
...has the right tools to get their job done. We fall under Semgrep Engineering and value automating processes, being transparent, and... ...infrastructure. We expect experience designing, deploying and maintaining AWS (or GCP) infrastructure that handles real‑world loads. You...Amazon Web ServiceSeniorCurrently hiringLocal areaRemote workWeekend work- REsurety in Boston is seeking a Senior Cloud Operations Engineer to scale and maintain its cloud-native infrastructure. The role involves implementing and automating cloud services, focusing primarily on AWS. The ideal candidate will drive Infrastructure as Code (IaC) adoption...Amazon Web ServiceSeniorWork at office3 days per week
$102.4k - $153.2k
Pegasystems, Inc. is seeking a Senior Cloud Operations Engineer to enhance the reliability and performance of its cloud infrastructure. This position requires expertise in AWS, cloud operations, Linux systems, and strong troubleshooting skills. You will work collaboratively...Amazon Web ServiceSeniorRemote jobAfternoon shift- .... They are looking to expand their team by bringing on a Senior Application Support Engineer . Salary/Hourly Rate: $120k - $145k Annually Position Overview... ...knowledge. Experience with SQL, scripting, BI tools, or AWS. Workday Studio or Workday certifications. Financial...Amazon Web ServiceSeniorHourly pay
- ...Page Object Model and TestNG test framework Partner with other engineering disciplines to develop automated test methodologies to reduce... ...such as Mezmo, Postman, and Metabase ~ Experience using AWS services including S3, Lambda, RDS, Amplify ~ Experience with...Amazon Web ServiceSeniorImmediate start
Verve
Cambridge, MA4 days ago $122.4k - $139.5k
CHS Inc. Engineer, IT Quality Assurance Senior Location: Inver Grove Heights, MN Job Description The Engineer, IT Quality Assurance Senior will... ...testing;(e) working with data lake environments using AWS;(f) using AWS datalake tools; (g) conducting API testing...Amazon Web ServiceSeniorRemote workCHS Inc
Boston, MA5 days ago$100k - $125k
...Senior Cybersecurity Engineer Join Aprio's Information Technology team and you will help clients maximize their opportunities. Aprio is a progressive... ...Experience with at least one major cloud platform (Azure, AWS, GCP) in a security-engineering capacity. ~ Ability to...Amazon Web ServiceSeniorPermanent employmentFull timeRemote workFlexible hoursAprio
Boston, MA2 days ago$125k - $205k
.... Learn more at later.com [ ABOUT THIS POSITION: As a Senior Security Engineer at Later, you will play a critical role in strengthening and... ...environments * Familiarity with cloud security tooling (AWS Security Hub, Azure Security Center, or GCP Security Command...Amazon Web ServiceSeniorPermanent employmentLocal areaRemote workLater
Boston, MA1 day ago$130.8k - $209.4k
...enterprise systems. We are seeking experienced engineers who embody the Moderna Mindsets and want... ...and efficiency. Act as a senior escalation point and technical mentor for... ...premises and cloud environments (VMware, AWS, Azure). Proficient with Microsoft and...Amazon Web ServiceSeniorPermanent employmentWork at officeRemote workWork from homeModerna
Cambridge, MA2 days ago- ...MGB Digital is Hiring! Senior IAM Engineer Identity Governance and Administration Full Time Comprehensive benefits Hybrid Working... ...applications, data and infrastructure for Cloud (Office 365, AWS, Azure, GCP, Salesforce, Workday) and Enterprise solutions...Amazon Web ServiceSeniorFull timeWork at officeLocal areaRemote workFlexible hours
Mass General Brigham (Enterprise Services)
Somerville, MA4 days ago $314.8k - $359.3k
Senior Distinguished Engineer, AI Compute (Remote Eligible) At Capital One, we are creating responsible and reliable AI systems, changing banking for... ..., or high‑throughput inference Hands‑on experience with AWS‑specific compute primitives (EKS, EC2 UltraClusters, Graviton...Amazon Web ServiceSeniorRemote jobFull timePart timeLocal area- ...Senior Sales Engineer - AI Founded in 2012, H2O.ai is on a mission to democratize AI. As the world's leading agentic AI company, H2O.ai converges... ...Dell Technologies, Deloitte, Ernst & Young (EY), Snowflake, AWS, Google Cloud Platform (GCP), VAST Data and MinIO. H2O.ai's...Amazon Web ServiceSeniorRemote workWorldwideFlexible hours
- ...world to solve problems that matter. Autodesk is seeking a Senior ML Engineer, ML Systems and Infrastructure to design and scale the... ...compute pipelines Experience with cloud platforms such as AWS, Azure, or GCP Familiarity with containers, CI/CD, observability...Amazon Web ServiceSeniorTemporary workFor contractorsRemote work
Autodesk
Boston, MA4 days ago $150k - $215k
...understanding of their bodies and daily lives. WHOOP is hiring a Senior Software Engineer to join the Business Systems team. In this role, you will... .... ~ Experience with cloud-based infrastructure (e.g., AWS, GCP, or Azure) and distributed systems. ~ Proven ability...Amazon Web ServiceSeniorFull timeWork at officeRelocationWHOOP
Boston, MA1 day ago- ...possible. About the Role We're looking for top-tier Sales Engineers who thrive on winning Fortune 500 logos. You're a driven, high-energy... ...redundancy ~ Familiarity with any cloud environment (GCP, AWS, Azure) ~ Excellent written, verbal communication, and...Amazon Web ServiceSeniorFull timeLocal areaFlexible hours
- ...Cambridge, MA — Kendall Square HQ (In-Office) The Role As a Senior Site Reliability Engineer at Blitzy's Kendall Square headquarters, you will be a... ...Strong proficiency with at least one major cloud platform (AWS preferred); experience designing and operating distributed...Amazon Web ServiceSeniorWork at office
$160k - $195k
...federal, state and local agencies fuels the RapidSOS HARMONY AI engine that delivers this intelligence to those who need it most. Learn... ...expertise in Python Real cloud infrastructure experience with AWS: networking, managed databases, cost implications of traffic routing...Amazon Web ServiceSeniorLocal areaFlexible hours$140k - $210.9k
...Candidates may come from infrastructure/DevOps backgrounds or software engineering backgrounds (e.g., Java, Python, Go) with strong interest in... ...collaboration skills. Extensive knowledge and understanding of AWS environments & services such as EC2, EBS, EKS, RDS, Aurora, S3,...Amazon Web ServiceSenior- Founding Senior Sales Engineer - Cloud Security We are a well-funded, early-stage cybersecurity company building the next-generation Cloud Security... ...preventive, intent-driven security policies directly within AWS, Azure, Google Cloud, and OCI — turning "secure by design"...Amazon Web ServiceSeniorRemote workFlexible hours
$99k - $163.4k
...PROJEKT RED and help shape the future of QA Engineering across our projects and Shared... ...Services initiatives. We're looking for a Senior QA Engineer to help build and scale technical... ...and cloud technologies (e.g., Docker, AWS, GCP). Experience with programming and...Amazon Web ServiceSeniorCasual workWork at officeHome officeFlexible hoursCD Projekt RED
Boston, MA4 days ago$137.7k - $152k
Position Overview This Senior Cloud Operations Engineer role is central to scaling and maintaining REsurety's cloud-native infrastructure and continuous... ...cloud services, primarily leveraging expertise in AWS. The successful candidate will drive the adoption of Infrastructure...Amazon Web ServiceSeniorWork at officeRemote work3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior PySpark Engineer - AWS/EMR. Be the first to apply!
Related searches
- senior cost analyst Boston, MA
- senior development engineer Boston, MA
- senior program specialist Boston, MA
- senior manager quality engineering Boston, MA
- senior software test automation engineer Boston, MA
- senior design technologist Boston, MA
- senior director corporate development Boston, MA
- senior design verification engineer Boston, MA
- senior director quality Boston, MA
- senior director of development Boston, MA