Only W2: Sr Data Engineer - Scala, Python, Databricks & AWS | Boston, MA (Hybrid)

Tror AI for everyone

Role: Sr Data Engineer Scala, Python, Databricks & AWS
Location: Boston, MA (Hybrid)
Experience: 12+ Years

Job Summary

We are looking for an experienced Data Engineer with strong hands-on skills in Scala, Python, Databricks, and AWS to join our financial services client, State Street.

The ideal candidate will have experience building and maintaining data pipelines, processing large datasets, and developing scalable data engineering solutions using cloud technologies. The candidate should be comfortable working with financial data and collaborating with technical and business teams.

Key Responsibilities

Design, develop, and maintain data pipelines using Scala and Python.
Build and optimize data processing workflows using Databricks and Apache Spark.
Develop data engineering solutions on AWS cloud services.
Process, transform, and integrate large volumes of structured and unstructured data.
Write efficient, reusable, and high-quality code.
Troubleshoot data pipeline issues and improve performance and reliability.
Work with databases, data lakes, and other data storage systems.
Collaborate with developers, architects, and business teams to deliver data solutions.
Follow data quality, security, and coding standards.

Required Skills

Strong hands-on experience with Scala and Python.
Experience with Databricks and Apache Spark.
Experience building and supporting data pipelines.
Hands-on experience with AWS cloud services.
Strong understanding of data processing, transformation, and ETL/ELT concepts.
Experience working with large datasets and distributed data processing.
Strong problem-solving and debugging skills.

Preferred Qualifications

Experience in banking, financial services, or capital markets.
Experience working with cloud-based data platforms and data lakes.
Knowledge of SQL and relational databases.
Experience with data quality, performance tuning, and production support.

Mandatory Requirements

Must be willing to work onsite in Boston, MA, 3 days per week.
Must be willing to relocate to Boston if currently based elsewhere.
Must be available for W2 employment only.

Note: Candidates must be comfortable with the hybrid work arrangement and relocation requirement before proceeding with the interview process.

Apply

Vacancy posted 1 day ago

Similar jobs that could be interesting for youBased on the Only W2: Sr Data Engineer - Scala, Python, Databricks & AWS | Boston, MA (Hybrid) in Boston, MA vacancy

Senior Investment Data Engineer, Boston, MA, Hybrid, 2 days in, 150k to 190
Senior Investment Data Engineer, Boston, MA, Hybrid, 2 days in, 150k to 190kCompensation Commensurate with experience... ...performance computer technologies on AWS.• Build robust and efficient... ...Hands on development experience with Python (Pandas, NumPy) for modeling/analytical...
Amazon Web Service
Senior
Permanent employment
Work experience placement
Casual work
Work at office
BlueSkyClarity
Boston, MA
1 day ago
Senior Data Engineer, Boston, MA. Hybrid, Financial Services, 130-170k base
Senior Data Engineer, Boston, MA. Hybrid, Financial Services, 130-170k base, bonusOur client is seeking a Senior Data Engineer to join... ...platform centered around technologies such as AWS, Snowflake, DBT, Snaplogic, Python and Java.This is a hybrid work environment opportunity...
Amazon Web Service
Senior
Work at office
Local area
Remote work
Monday to Friday
BlueSkyClarity
Boston, MA
1 day ago
Senior Analytics Engineer - dbt/SQL/Python - Boston, Ma
$60 - $75 per hour
Boston, MAHybridContract$60/hr - $75/hr Job Description... ...a Senior Analytics Engineer to help drive the next generation of data, analytics, and AI... ...Advanced SQL and Python development skills... ...Iceberg, Trino, AWS, or similar cloud... ...benefits package Hybrid work environment Opportunity...
Amazon Web Service
Senior
Full time
Temporary work
Flexible hours
Motion Recruitment
Boston, MA
4 days ago
Lead Quant Developer, Investment Analytics and Data, Boston, MA. Hybrid, 2
...Developer, Investment Analytics and Data, Boston, MA. Hybrid, 2 days in, 150k to 190k... ...to data pipelines.• Engineer solutions that are well-tested... ...on development experience in Python (Pandas, SKLearn, PyTorch, CVXOpt... ...access and architecture; AWS or other cloud...
Amazon Web Service
Permanent employment
Casual work
Work at office
BlueSkyClarity
Boston, MA
1 day ago
Applied AI Health Data System Engineer-Senior Manager
$124k - $280k
..., our people in data and analytics engineering focus on leveraging... ...engineering, Python-based development... ...Data Services), AWS (SageMaker,... ...including Snowflake or Databricks Experience... ...CA-Sacramento; MA-Boston; MO-St. Louis; UT... ...New Orleans; US-Hybrid; OK-Oklahoma City...
Databricks
Amazon Web Service
Senior
Full time
H1b
PwC
Boston, MA
4 days ago
Data Engineer 4 (Python/AWS)
$179.4k - $225.1k
Data Engineer 4 (Python/AWS) Do you love building and pioneering in the technology... ...warehousing platforms including Databricks and Snowflake Share your... ...language (Python, Java, or Scala) At least 2 years of... ...regularly worked. Cambridge, MA: $197,300 - $225,100 for...
Databricks
Amazon Web Service
Full time
Part time
Internship
H1b
Local area
Capital One
Cambridge, MA
4 days ago
Senior Network Architect - Boston, MA - RJ
$65 - $75 per hour
...Senior Network Architect Location: Boston, MA Duration: 12 Months Pay Rate:... ...network infrastructure, including hybrid connectivity to AWS. Responsibilities: Design hub-... ...: ~10+ years of network engineering experience. ~4+ years in an Architect...
Amazon Web Service
Senior
Compu-Vision Consulting Inc.
Boston, MA
5 days ago
Senior Python Developer
$75 - $80 per hour
...1-14Location: Boston, MO; Des Moines... ...Python Developer - FP... ...Iowa or Boston, MA officesPOSITION... ...A team and IT data team to design... ...bringing deep engineering expertise while... ...Jupyter, VS Code, Databricks).Collaborate with... ...integration in hybrid cloud ecosystems (AWS / Snowflake).Hands...
Databricks
Amazon Web Service
Senior
Hourly pay
Work at office
SRI Tech
Boston, MA
1 day ago
Senior Data Engineer (Boston, MA)
...As a Senior Data Engineer, CASM Platform, you will: ~Data Integration... ...large-scale ETL/ELT pipelines on Databricks to efficiently process and... ...cybersecurity data. Utilize Python, PySpark, and Databricks to automate... ...on Databricks, utilizing AWS services such as S3, ELB, and...
Databricks
Amazon Web Service
Senior
Contract work
CEDENT
Boston, MA
more than 2 months ago
Senior Data Engineer I - QuantumBlack, AI by McKinsey
...United States) | Boston (United States)... ...of scalable data architectures for... ...feature engineering workstreams, ensuring... ...proficiency in Python and SQL and the... ...environments (Scala, Java) when required... ..., LangChain, Databricks, Dask, Airflow,... ...providers (AWS, Azure, GCP)Exceptional...
Databricks
Amazon Web Service
Senior
Apprenticeship
Work at office
Local area
Easy work
McKinsey & Company
Boston, MA
4 days ago
Sr. Databricks Data Engineer, Onsite, AVP
$90k - $157.5k
...we are looking forWe are looking for a Sr. Databricks Data Engineer with hands-on development experience... ...infrastructure using Databricks SQL & Scala/PySpark.Optimize and tune Databricks job... ...cloud-based development using Azure/AWS.Additional requirementsCommunicate effectively...
Databricks
Amazon Web Service
Senior
Full time
Temporary work
Work at office
Flexible hours
State Street Bank
Quincy, MA
2 days ago
Senior Data Engineer
$90k - $180k
...About the RoleSenior Data... ...for a Senior Data Engineer. As a member of the... ...programming skills in Python and experience with... ...platforms, especially AWS (S3, Lambda, Batch... ...architectures (Snowflake, DataBricks, Fabric).Strong... ....SummaryLocation: Boston, MA, United StatesType...
Databricks
Amazon Web Service
Senior
Full time
Remote work
Flexible hours
1 day per week
Wellington Management
Boston, MA
1 day ago
Senior Data Engineer, Vice President
$110k - $207.5k
...for a Senior hands-on Data Engineer for Cloud Data Lake design... ...in PL/SQL, Java/J2EE, Python, Scala, PERL/scripting .•... ...platforms, preferably using Databricks.• Experience in... ...of Cloud Security in AWS/Azure, specifically IAM... ...liability.SummaryLocation: Boston, MassachusettsType:...
Databricks
Amazon Web Service
Senior
Full time
Temporary work
Flexible hours
State Street Bank
Boston, MA
3 days ago
Sr Data Engineer
...-09-03Location: Boston, MAEmployment Type... ...Title: Sr Data EngineerLocation: Boston, MA (3-4 days a week... ...onsite)Skill Set: AWS (Full services),... ...for a Senior Data Engineer with added emphasis... ...Engineer to work in hybrid mode, 3-4 days... ....Proficiency in Python programming for...
Amazon Web Service
Senior
Work at office
3 days per week
SRI Tech
Boston, MA
1 day ago
GenAI Python Systems Engineer -Senior Manager
$124k - $280k
..., our people in data and analytics engineering focus on leveraging... ...[e.g., AWS Certified Solutions... ...Core, Snowflake Databricks Data Engineer Associate... ...- Proficient in Python and structured/... ...CA-Sacramento; MA-Boston; MO-St. Louis;... ...New Orleans; US-Hybrid; NY-New York; OK...
Databricks
Amazon Web Service
Senior
Full time
H1b
PwC
Boston, MA
12 hours ago
Data Engineer - East Region
...custom software, data, AI, and cloud... ...& Engineering team sees data... ...Web Services (AWS), Microsoft Azure... ...Platform (GCP), Databricks, and Snowflake... ...such as SQL, Python, Java and or Scala.* Experience with... ...do, most days. Hybrid/In office: We... ...salary ranges:  Boston, New York: $10...
Databricks
Amazon Web Service
Temporary work
Work at office
Local area
Slalom
Boston, MA
2 days ago
Senior Principal Engineer. Healthcare, Boston, MA. Hybrid, 150 - 190k
Senior Principal Engineer. Healthcare, Boston, MA. Hybrid, 150 - 190kCompensation Commensurate with experience, bonus, benefits, EOE, diverse highly educated culture. Candidates must be a U.S. citizen or national, refugee, asylum, or lawful permanent residents. Principals...
Senior
Permanent employment
BlueSkyClarity
Boston, MA
1 day ago
Mid to Senior Network Engineer, Boston, MA, Hybrid, 110k to 170k base
Mid to Senior Network Engineer, Boston, MA, Hybrid, 110k to 170k baseCompensation Commensurate with experience, bonus, benefits, EOE, diverse highly... ...during nights and weekends.· Automation skills (Ansible, Python, Cisco APIs, VMware APIs, etc.)· Network monitoring tools...
Senior
Permanent employment
Worldwide
Night shift
Weekend work
BlueSkyClarity
Boston, MA
1 day ago
Sr. Manager, Data Platform Engineering
$171.2k - $228.2k
...here. We’re embracing a hybrid work model that enables... ...-quarter Enterprise Data Platform program to move... ...Manager, Data Platform Engineering to lead the team that builds... ...in production (Databricks or comparable), including... ...Workflows/Jobs, Delta/DLT.AWS data stacks (S3,...
Databricks
Amazon Web Service
Senior
Work at office
SimpliSafe
Boston, MA
12 hours ago
Principal Solutions Support Engineer -- CRD, Boston, MA, Hybrid, 125-165k
Principal Solutions Support Engineer -- CRD, Boston, MA, Hybrid, 125k to 165k base, bonusThe Principal Solutions Engineer will provide front line support for trading technologies and actively contribute to a variety of areas, including support and configuration of order...
Local area
BlueSkyClarity
Boston, MA
4 hours ago
Lead Productivity Engineer AWS/Python/Kotlin - Boston
$180k - $234k
Boston, MAHybridFull Time$180k - $234k Job Description A high-growth B2B SaaS company is seeking a Lead Productivity Engineer to lead and develop a team focused on developer productivity, software... ...organization.Location: Boston, MA (Hybrid) Required Skills & Experience 10+...
Amazon Web Service
Full time
Motion Recruitment
Boston, MA
2 days ago
REQ: Data and Ontology Engineer in Boston, MA (Onsite)
...One of our clients is looking for Data and Ontology Engineer in Boston, MA (Onsite) Title: Data and Ontology... ...Duration: 8+ Months C2C or W2 Only Client is building... ..., SPARQL 1.1 and SHACL. ~ Solid Python (rdflib, pySHACL or similar), git...
Aita Consulting Services, Inc
Boston, MA
1 day ago
DevSecOps Engineer - Python/Jenkins/Terraform - Boston, Ma
$80 - $110 per hour
Boston, MAHybridContract$80/hr - $110/hr Job Description An established... ...a Senior Platform & Security Engineer to join its Platform... ...independent engineer with deep AWS and Infrastructure as Code expertise... ...container technologies Strong Python and Bash scripting skills Experience...
Amazon Web Service
Hourly pay
Full time
Contract work
Temporary work
Immediate start
Flexible hours
Motion Recruitment
Boston, MA
2 days ago
Senior Data Engineer - Life Sciences.AI
$176k - $179.5k
...(United States) | Boston (United States) |... ...a senior software engineer, building AI that... ...and manage scalable data pipelines and secure... ...Proficiency in Python for production-grade... ...cloud platforms (AWS, Azure, GCP) A strong... ...data platforms (Databricks, Databricks Asset...
Databricks
Amazon Web Service
Senior
Apprenticeship
Easy work
Shift work
McKinsey & Company
Boston, MA
4 days ago
Sr. Analytics Engineer
...The Analytics Engineering Team at ABCorp partners... ...to build the data foundations that drive... ...role will serve as a hybrid Data Analyst and... ...our team based in Boston, MA. How You’ll... ...BigQuery, Redshift, or Databricks, and familiarity... ...knowledge of Python or R for data analysis...
Databricks
Senior
Worldwide
ABCorp NA Inc.
West Roxbury, MA
18 days ago
Senior Scientific Data Engineer
$140k - $200k
...is the Scientific Data and AI Company building... ...includes NVIDIA, Databricks, Thermo Fisher... ...senior, hands-on engineer. In this role, you... ...data applications in Python and TypeScript.... ...on-premises, and hybrid networks, and troubleshoot... ...engineering on AWS, including core...
Databricks
Amazon Web Service
Senior
Full time
Immediate start
Flexible hours
TetraScience
Boston, MA
4 days ago
Computer Vision AI Engineer, Boston, MA. Hybrid, 140 - 190k base, bonus, eq
Computer Vision AI Engineer, Boston, MA. Hybrid, 140 - 190k base, bonus, equityCompensation Commensurate... ...defect detection, quality assurance, data-driven process modeling, and machine automation... ...-world applications.• Proficient in Python and/or C++’s Computer Vision software...
Permanent employment
Work experience placement
BlueSkyClarity
Boston, MA
1 day ago
Data Engineer Sr. Consultant
$127k - $150k
Position Summary Healthcare Data Engineer Sr. Consultant Deloitte Consulting's technology professionals help clients identify... ...to deliver cloud-based data products using Azure Databricks, PySpark, Python, AWS services, Teradata Vantage, Informatica, Airflow, GitHub...
Databricks
Amazon Web Service
Senior
Local area
Visa sponsorship
Deloitte
Boston, MA
2 days ago
Databricks Engineer
...Job Description: Databricks Engineer Location: Boston, MA 02109 (Hybrid) Experience: 9+ years... ...Databricks, Azure, Python, PySpark, Scala, SQL, Hadoop, and Data Warehousing. Job... ...warehouse solutions using Azure/AWS. Implement data ingestion...
Databricks
Amazon Web Service
Spruce Infotech
Boston, MA
1 day ago
Senior Software Engineer
...Description: Hybrid At least 2... ...in office in Boston, MA Our client... ...Software Engineer to join the team... ...and reliable data platforms. You... ...facilitate w2 and corp-to-... ...platforms on AWS using REST APIs... ...across Java, Python, Spark,... ...PySpark with Databricks, Azure and/or...
Databricks
Amazon Web Service
Senior
Hourly pay
Full time
Work at office
Local area
2 days per week
Eliassen Group
Boston, MA
2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Only W2: Sr Data Engineer - Scala, Python, Databricks & AWS | Boston, MA (Hybrid). Be the first to apply!