Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Big Data Engineer - Spark/Scala & Data Pipelines

$140k - $220k

I did my part and supported the Regular Toilet

I did my part and supported the Regular Toilet is seeking a Senior Software Engineer in Waltham, Massachusetts. The role involves building and optimizing big data pipelines, designing data architectures, and collaborating with data scientists to enhance our technographic data services. The ideal candidate will have 8+ years of experience in software engineering and strong expertise in big data frameworks such as Hadoop and Spark. The competitive salary ranges from $140,000 to $220,000 USD, accompanied by a comprehensive benefits package. #J-18808-Ljbffr

Vacancy posted 10 hours ago
Similar jobs that could be interesting for youBased on the Senior Big Data Engineer - Spark/Scala & Data Pipelines in Waltham, MA vacancy
  •  ...partnered to hire multiple data engineers (mid and senior) to join a small team...  ...and solving complex big data problems....  ...maintain, and optimize ETL pipelines. Work across data...  ...and feeds). Work with Spark or DASK for large-...  ...with Spark or DASK. Scala programming experience... 
    Pipeline
    Senior
    Big data
    Remote work

    Talener

    Boston, MA
    4 days ago
  •  ...partnered them to hire multiple data engineers (Mid and Senior level) to join a small...  ...ETL and solving complex big data problems. Job Title...  ..., and optimizing ETL pipelines Expertise with various database...  ...experience with Spark or DASK Scala programming experience Experience... 
    Pipeline
    Senior
    Big data
    Immediate start
    Remote work

    Talener

    Boston, MA
    9 hours ago
  • $117.6k - $161.7k

    Senior Data Engineer Become a part of our caring community. The Senior Data...  ...and maintain scalable data pipelines and workflows using Azure Databricks...  ..., implement, and support Big Data tools and frameworks...  ...Databricks, Python, Apache Spark, Git, Azure Services (Synapse... 
    Pipeline
    Senior
    Big data
    Remote job
    Temporary work
    Work from home

    Humana

    Boston, MA
    2 days ago
  •  ...Role: Senior Data Engineer Location: Brighton, MA 02135 - 4 days...  ...You'll build scalable data pipelines to power insurance analytics...  ...design of enterprise-wide big data solution. # Experience...  ...a big data solution using Spark, Scala, AWS Glue, Lambda is a must... 
    Pipeline
    Senior
    Big data
    Full time

    Lorven Technologies

    Boston, MA
    3 days ago
  •  ...Senior Big Data Engineer We are launching exciting products such as our new Wireless...  ...the data ingestion pipeline from our Connected Products....  ...Have strong expertise Apache Spark (batch and Spark streaming)...  ...scripting languages such as Python, Scala, Java and R Ability do... 
    Pipeline
    Senior
    Big data

    Roberts Recruiting

    Framingham, MA
    3 days ago
  • $106.9k - $176.5k

     ...world. Technology – Data and Decision Science – Data Engineering – Senior We are seeking a highly...  ...Lead end-to-end data pipeline development, including...  ...and experience with Spark for big data processing. ~ Proven...  ...such as Python, Scala, or SQL. Experience... 
    Pipeline
    Senior
    Big data
    Summer holiday
    Flexible hours

    EY

    Boston, MA
    2 days ago
  •  ..., you'll be part of a big group of makers, breakers...  ...needs. We are seeking Senior Data Engineers who are passionate...  ...Build and optimize data pipelines for efficient data...  ...development including Python, Scala, or Java 2+ years of...  ..., Hive, EMR, Kafka, Spark, Gurobi, or MySQL) 2+... 
    Pipeline
    Senior
    Big data
    Full time
    Part time
    Internship
    Local area

    Capital One Financial

    Cambridge, MA
    4 days ago
  • $135k

     ...bring together the rigor of data‑driven analysis with the...  ...Role: We are seeking a Senior Data Engineer with deep expertise in...  ...AI while building the pipelines, platforms, and apps that...  ...Airflow) and familiarity with Big Data tools such as Spark or Scala. Hands‑on experience... 
    Pipeline
    Senior
    Big data
    Permanent employment
    H1b
    Local area
    Worldwide
    Home office

    Lek

    Boston, MA
    11 hours ago
  • $150k - $170k

     ...Senior Data Engineer At Magnite, we cultivate an environment of continuous growth and collaboration...  ...are seeking someone with proficiency in Scala and Spark to build and optimize large-scale batch and streaming data pipelines. The Core Data Engineering team sits within... 
    Pipeline
    Senior
    Hourly pay
    Work experience placement
    Summer work
    Seasonal work
    Local area
    Shift work

    Magnite

    Boston, MA
    3 days ago
  •  ...Job Title: Senior AWS Data Engineer with 5yrs of Banking Domain Experience...  ...- Builds and maintains data pipelines to support data and analytics...  ...in specific solutions (e.g., Scala, java, micro strategy) or functional domains such as big data, ingestion, or modelling... 
    Pipeline
    Senior
    Big data

    Navtech

    Boston, MA
    2 days ago
  •  ...Senior Data Engineer (Remote) - 6 Month Contract+ Basic Qualifications...  ...analytics Experience with AWS big data services (Kinesis,...  ...languages and syntax (Python, SQL, Apache Spark, etc.) Experience with Container based orchestration of big data pipelines... 
    Pipeline
    Senior
    Big data
    Contract work
    Remote work

    Ecom Industries

    Boston, MA
    18 days ago
  • $105k - $158k

     ...Senior Java Data Engineer The Enterprise Data Frameworks team is seeking a Senior...  ...systems using Java, Apache Spark, and Kafka. This role is...  ...Spark based processing pipelines and Kafka driven data ingestion...  ...languages such as Scala or Python in a data context... 
    Pipeline
    Senior
    Work at office
    Local area
    Remote work
    Monday to Friday
    Flexible hours

    Citizens Financial Group, Inc.

    Boston, MA
    1 day ago
  • $195.3k - $199.2k

    Consulting Senior Data Engineer - Periscope Job ID: 108653 Atlanta...  ...and maintain scalable data pipelines and systems using Databricks...  ...with a strong background in big data technologies ~ Proficiency...  ...in Databricks on Azure, Spark, Python, and Spark SQL ~ Extensive... 
    Pipeline
    Senior
    Big data
    Hourly pay
    Apprenticeship
    Work at office
    Easy work

    McKinsey & Company

    Boston, MA
    3 days ago
  • $166k - $220k

     ...that turns thousands of data streams into a realtime,...  ...optimizing data models and pipelines. Your primary objective...  ...tooling, advocating for engineering best practices,...  ...Qualifications: Experience with big data processing frameworks (e.g., Apache Spark, Flink) and advanced... 
    Pipeline
    Senior
    Big data
    Full time
    Work experience placement
    Immediate start

    Anduril Industries

    Boston, MA
    5 days ago
  •  ...Bitsight is seeking an experienced Big Data Engineer to join their team in Boston. In this role, you will contribute to the development and scaling of their data pipelines, ensuring reliable and actionable cybersecurity ratings for clients. The ideal candidate possesses... 
    Pipeline
    Senior
    Big data
    Flexible hours

    BitSight

    Boston, MA
    11 hours ago
  •  ...Overview: The data engineering group, led by Ravi, is focused on building data integrations and data pipelines as part of the broader software engineering...  ...needs to onboard two new senior data engineers to meet...  ...Proficiency in Python, PySpark, and big data development. #... 
    Pipeline
    Senior
    Big data
    Local area

    My3Tech Inc

    Waltham, MA
    2 days ago
  • A leading AI and Big Data company is seeking a Senior Data Engineer in Boston. You will design, build, and maintain scalable data pipelines for analytics using Google BigQuery and Cloud Composer. The ideal candidate has over 10 years of experience in data architecture... 
    Pipeline
    Senior
    Big data

    Quantiphi, Inc.

    Boston, MA
    9 hours ago
  •  ...seeking an experienced AWS Data Engineer to design, build, and maintain scalable data pipelines and architectures on...  ...enterprise-wide big data solutions. Strong...  ...Redshift. Proficiency in Scala and Python for application...  ...technologies such as Hadoop and Spark. Familiarity with shell... 
    Pipeline
    Big data

    Compunnel

    Boston, MA
    2 days ago
  •  ...Senior Data Engineer, CASM Platform As a Senior Data Engineer, CASM Platform, you will: Data...  ...data APIs for seamless access to data pipelines, enabling real-time insights for...  ...hands-on experience with Databricks and big data frameworks. Expertise in integrating... 
    Pipeline
    Senior
    Big data

    Cedent Life Talent

    Boston, MA
    a month ago
  •  ...Senior Software Engineer - AI & Data Engineering Location: Boston, MA (Onsite every Thursday) About...  ...for similarity search and retrieval pipelines. Meet sprint "Definition of Done...  .... Familiarity with Unix/Linux, Big Data, SQL, NoSQL, and AI pipelines.... 
    Pipeline
    Senior
    Big data

    Saviance

    Boston, MA
    1 day ago
  •  ...Description Aquinas Consulting is currently looking for a HYBRID Senior Data Engineer for our high growth technology partner as they continue...  ...comfortability and experience building and optimizing ‘big data’ data pipelines, architectures and data sets. If you are interested... 
    Pipeline
    Senior
    Big data
    Work experience placement
    Local area

    Aquinas Consulting

    Boston, MA
    25 days ago
  • $130k - $155k

     ...chains, cyber insurance, and data analysis.We invented the cyber...  ...looking for an experienced Big Data Engineer to join our engineering team....  ...internet traffic.Bitsight’s data pipeline is the core of our Security...  ...with Hadoop, Spark ecosystemsExperience with Data... 
    Pipeline
    Senior
    Big data
    Full time
    Flexible hours

    BitSight

    Boston, MA
    1 day ago
  • $197.3k - $225.1k

     ...Lead Data Engineer - Data Transformation (Modeling and Architecture...  ..., you'll be part of a big group of makers,...  ...high-performance data pipelines and complex transformations that utilize SQL, Spark, and Python to process...  ...including Python, SQL, Scala, or Java ~4+ years of... 
    Pipeline
    Big data
    Full time
    Part time
    Internship
    H1b
    Local area

    Capital One

    Cambridge, MA
    11 days ago
  • $125.5k - $230.2k

     ...world. Technology – Data and Decision Science – Data Engineering – Manager We are looking...  ...Drive end‑to‑end data pipeline development, including data...  ...and experience with Spark for big data processing. Strong...  ...such as Python, Scala, or SQL. Excellent problem... 
    Pipeline
    Big data
    Summer holiday
    Flexible hours

    Ernst & Young Oman

    Boston, MA
    1 day ago
  • Lead Data Engineer - Data Transformation (Modeling and Architecture...  ..., you'll be part of a big group of makers,...  ...high-performance data pipelines and complex transformations that utilize SQL, Spark, and Python to process...  ...including Python, SQL, Scala, or Java 4+ years of experience... 
    Pipeline
    Big data
    Internship
    H1b
    Local area

    Capital One

    Cambridge, MA
    3 days ago
  • $99k - $232k

     ...Specialty/Competency: Data, Analytics & AI...  ...in data and analytics engineering focus on leveraging advanced...  ...implementing data pipelines, data integration,...  ...as Python, Java, or Scala - Familiarity with big data technologies like Hadoop, Spark, or Kafka is a plus... 
    Pipeline
    Big data
    Full time
    H1b

    PwC

    Boston, MA
    7 days ago
  • $175.5k - $180k

    Tech & AI Senior Data Engineer I - QuantumBlack, AI by McKinsey Job ID: 1092...  ...development of robust data pipelines, manage secure and governed...  ...work in polyglot environments (Scala, Java) when required by...  ...workflows using modern frameworks (Spark, LangChain, Databricks, Dask... 
    Pipeline
    Senior
    Apprenticeship
    Work at office
    Local area
    Easy work

    McKinsey & Company

    Boston, MA
    2 days ago
  • $79.2k - $178.1k

     ...Oracle's Forward Deployed Engineer (FDE) team is hiring a Senior Software Development Engineer - AI Data Platform to help...  ...science experience. Spark, PySpark, Delta Lake,...  ...Knowledge of RAG pipelines and vector DBs (e.g.,...  ...Cloud Infrastructure Big Data Service (BDS) and... 
    Pipeline
    Senior
    Big data
    Temporary work
    Flexible hours

    Oracle

    Boston, MA
    2 days ago
  • $99k - $164.8k

     ...are seeking a highly skilled Senior Data Engineer to guide the design,...  ...the delivery of scalable data pipelines, ingestion frameworks, and transformation...  ...using Snowflake, Python, Spark, Informatica (PowerCenter/...  ...: Snowpark (Python/Java/Scala) Snowflake Warehouses,... 
    Pipeline
    Senior
    Casual work
    Work at office
    Local area
    Remote work

    Kemper

    Boston, MA
    4 days ago
  • $156.28k - $223.25k

    We are looking for a Data/Backend Engineer to join our team. We are at the forefront...  ...batch and real-time data pipelines with data processing...  ...GCP, AWS or Azure You know Scala language well, and are interested...  ...Dataflow, Crunch, Scalding, Storm, Spark, Flink etc You have hands-on... 
    Pipeline
    Senior
    Flexible hours

    Spotify

    Boston, MA
    4 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Big Data Engineer - Spark/Scala & Data Pipelines. Be the first to apply!