Data Engineer

CTI Staffing Inc

Senior Data Engineer

CTI Staffing is partnering with a leading financial services organization to find a Senior Data Engineer for their data aggregation team based in Durham, NC. This team builds external-facing data solutions that bring together retail, clearing, and custody data to power financial goal planning, investment advice, and projection tools used by partner organizations. It's high-visibility work where data reliability, security, and partner integration quality all matter.

What You'll Do:

Design and build ETL pipelines in Scala/Spark to consolidate and move data across systems
Develop and maintain Java clients consuming REST and SOAP APIs for external partner integration
Schedule, monitor, and debug ETL Spark batch jobs running on AWS EMR
Manage data flow across AWS services including S3, Lambda, SNS, IAM, and KMS
Write to and maintain NoSQL datastores (Cassandra or Yugabyte)
Support Snowflake-based data warehousing workflows
Work with large dataset storage formats such as Parquet and HDF5
Schedule and monitor production jobs using Control-M
Collaborate across teams on data architecture decisions and code reviews

Requirements:

What You Bring:

Must-Have: Bachelor's degree in Computer Science, Information Systems, or related field
8+ years of data engineering experience (10+ preferred), with proven Spark Services development for data movement
Hands-on Scala development for Spark-based ETL pipelines (not Python-based)
Java experience consuming REST and SOAP APIs in data pipeline contexts
Production experience with AWS EMR running Spark batch jobs
Working knowledge of AWS S3, Lambda, IAM, KMS, and SNS
Experience with Cassandra or Yugabyte (or comparable NoSQL datastore)
Experience with Snowflake or a comparable cloud data warehouse
Experience with large dataset storage formats (Parquet, HDF5, or similar)
Nice-to-Have: Python scripting experience
Background in financial services or other regulated data environments
Experience with enterprise job scheduling tools (Control-M or similar)
Experience building external-facing/partner-facing data integrations

Technical Environment: Scala, Java, Apache Spark, AWS (EMR, S3, IAM, KMS, Lambda, SNS, RDS), Cassandra/Yugabyte, Snowflake, Control-M, Parquet, HDF5

What Success Looks Like:

Independently owns Spark batch job development and troubleshooting within the first 90 days

Integrates external API consumption cleanly into existing pipelines

Demonstrates fluency across the AWS data stack without ongoing supervision

Apply

Vacancy posted 1 day ago

Similar jobs that could be interesting for youBased on the Data Engineer in Durham, NC vacancy

Data Engineer
...Role:- Data Engineer Location:- Durham, NC Primary Skills Informatica,Python,SQL The Expertise and Skills You Bring ~ Bachelor's Degree or equivalent in a technology related field (e.g. Computer Science, Engineering, etc.) required ~10+ years...
Suggested
Work experience placement
InterSources
Durham, NC
4 hours ago
Data Engineer
...integration of hardware, software, and real-time multi-parametric data, we have quietly built the world’s most advanced sensing system... ...environment and who has the desire to grow with us! The Data Engineer sits within the Data & Analytics organization and supports the development...
Suggested
Work at office
Remote work
Sennos
Durham, NC
4 days ago
Data Engineer
Data Engineer Hybrid Mode(5 Days in Month) Westlake,TX/Durham,NC/Boston,MA Job Description • Database development • Working knowledge on AWS • Oracle, Snowflake, Python, CICD, Jenkins • 8 years’ experience in the space
Suggested
Software Technology Inc
Durham, NC
1 day ago
Data Engineer
$65 per hour
...Data Engineer Rate:$65.00 Location: Durham, NC client:Fidelity Investments - Raleigh Durham The client, Fidelity, is initiating a migration project to enhance and update their current reporting infrastructure, aiming to move away from the existing ecosystem of Oracle...
Suggested
Argyle Infotech
Durham, NC
2 days ago
Data Engineer
...Data Engineer Position Type: Contract (09-15-2025 - 09-15-2026) Location: Durham, NC Remote Work: Partial Primary Skills: Informatica, Python, SQL The Expertise and Skills You Bring: ~ Bachelor's Degree or equivalent in a technology related field (e...
Suggested
Contract work
Work experience placement
Remote work
Georgia IT Inc
Durham, NC
4 days ago
Senior Data Engineer
...Subject Line for Opening #1: Urgent Requirement: Senior Data Engineer (Hybrid - Onsite Alternating Weeks) Job Title: Senior Data Engineer Interview Mode: Video Role Overview: As a Senior Data Engineer, you will work with a highly effective...
Worldwide
Anveta
Durham, NC
3 days ago
Senior Data Engineer
$89.6k - $123.2k
...Job Description We have an exciting opportunity fora Senior Data Engineer atUL Standards & Engagement . This is a hybrid opportunity based inourRaleigh-Durham, NCor Evanston, ILoffice. The Senior Data Engineer will support a diverse portfolio of standards...
Work experience placement
Worldwide
Flexible hours
ULSE
Durham, NC
4 days ago
Sr. Data Engineer
...Sr Data Engineer Locations: Westlake, TX OR Durham, NC (must be local) Hybrid - 50% onsite Duration: 12 months As a Senior Data Engineer you will work with highly effective squad, developing quality and scalable data solutions. You value how we work, are collaborative...
Local area
Experis
Durham, NC
5 hours ago
Senior Data Engineer
...Labcorp is seeking a Senior Data Engineer to join our team in Durham, NC. Job Responsibilities: Design and implement end-to-end data engineering solutions by leveraging the full suite of Databricks, Fabric tools, including data ingestion, transformation, and modeling...
Temporary work
Casual work
Internship
Flexible hours
LabCorp
Durham, NC
4 hours ago
Senior Data Engineer
...Data Engineer - AWS, Python, SQL Location: Hybrid Model (5 days in month), Durham NC, Westlake TX, Boston MA, New Jersey NJ Duration: Long term The Expertise and Skills You Bring: ~ Has Bachelor’s or Primary’s Degree in a technology related field (e.g. Engineering...
Samprasoft
Durham, NC
2 days ago
Senior Data Engineer
...Job:NC FAST Senior Data Engineer (743008) Location : Research Triangle Park, Durham NC 27709 Client : State of NC Q1.Please list all Professional Certifications and the year they were received. The certifications will be validated. Q2.Please provide...
Contract work
My3Tech Inc
Durham, NC
4 days ago
Data Engineer
$111k - $209k
Job Summary We are seeking an experienced Data Engineer with a strong focus on Microsoft Fabric to design, implement, and maintain enterprise data solutions. The ideal candidate will have a minimum of 2 years hands‑on experience implementing Microsoft Fabric, including...
Temporary work
Work experience placement
Local area
Remote work
Relocation
Flexible hours
K&L Gates
Durham, NC
3 days ago
Data Engineer
About the Role We are seeking a Data Engineer to join our growing data team to help design, build, and extend our data platform. This will be a transformative modernization of its enterprise systems, including the implementation of Oracle ERP, HCM, and Utility Billing platforms...
PITech Solutions
Durham, NC
2 days ago
Data Engineer ETL
We are seeking a highly motivated Data Engineer (ETL) to design, develop, and maintain scalable data engineering solutions supporting enterprise data aggregation and integration initiatives. This role focuses on building high-performance ETL pipelines, developing Apache...
Compunnel, Inc.
Durham, NC
4 days ago
Data Engineering Intern
$25 per hour
...Overview The Digital Centre of Excellence team is seeking a Data Engineering Intern to support the Data Engineering team in managing an enterprise data warehouse for analytics and business intelligence reporting. The candidate should have a working knowledge of SQL-based...
Hourly pay
Internship
Cypress Creek Renewables
Durham, NC
4 days ago
Data Scientist/Engineer - Junior (Remote)
$95k - $154k
...for. Currently, we are looking for entry-level software programmers, Java full stack developers, Python/Java developers, data analysts/data engineers/data scientists, and machine learning engineers for full-time positions with clients. We focus on Java/full stack/...
Full time
H1b
Remote work
SynergisticIT
Durham, NC
4 days ago
Senior Data Engineer
## Senior Data EngineerApplylocations: 100 New Millennium Way, Bldg 2, Durham NCtime type: Full timeposted on: Posted Todaytime left... ...and Experience**:Bachelor’s degree in Computer Science, Engineering, Information Technology, Information Systems, or a closely related...
Soteria Reinsurance Ltd.
Durham, NC
4 days ago
Senior Data Engineer
...Senior Technical Recruiter @ Seven Step | MBA, Global Talent Acquisition. Job Summary We are seeking an experienced Senior Big Data & Cloud Engineer to design, build, and deliver advanced API and data solutions that support financial goal planning, investment insights, and...
Contract work
Fortune
Durham, NC
2 days ago
Senior Data Engineer
Join to apply for the Data Engineer role at BuildOps At BuildOps, we’re transforming the commercial contracting industry with our all-in-one software platform. From service management to project coordination, our mission is to bring modern, data-driven tools to an essential...
Full time
Work at office
Work from home
Flexible hours
BuildOps
Durham, NC
2 days ago
Senior Data Engineer - Snowflake, ETL & PL/SQL (Hybrid)
A technology consulting firm is seeking a Senior Data Engineer to build scalable data solutions in a hybrid setup. Key responsibilities include designing robust ETL workflows primarily using Informatica, optimizing Oracle PL/SQL code, and contributing to data warehousing...
Eliassen Group
Durham, NC
1 day ago
Senior Data Engineer
We are seeking a Senior Data Engineer to design, develop, and maintain scalable data solutions that support critical business and analytics functions. This role will focus on data engineering, database development, data modeling, and the delivery of high-quality data platforms...
Compunnel, Inc.
Durham, NC
1 day ago
Data Analytics Engineer
...Skanska is searching for a dynamic Data Analytics Engineer. This is a great opportunity to start a career with a company that builds things that matter and values its team. We are proud to share our culture of diversity and inclusion. Our work makes a clear contribution...
Local area
Skanska
Durham, NC
3 days ago
Principal Data Engineer
...Principal Data Engineer at Fidelity Investmentsin Durham, NC to prvde database engineering supp to agile dvlpmnt team using SQL, PL/SQL, Java, Python & NodeJS. Req. Bachelor’s degree and 5 yrs. exp. or Master’s and 3 yrs. exp. For full job details and to apply, search...
Fidelity Investments
Durham, NC
1 day ago
AI Data Engineer
...AI Data Engineer Data Analytics Practice | Office of Information Technology The Office of Information Technology is looking for an AI Data Engineer to join our Data Analytics Practice and help shape the future of Duke's enterprise data platform. In this role, you'll build...
Work at office
Duke Clinical Research Institute
Durham, NC
4 days ago
Principal Data Engineer
...and SCRUM. Works with analysts to create profiles and rules for data quality using Informatica Data Quality IDQ tools and Address... ...concepts. Confers with systems analysts and other software engineers/developers to design systems and to obtain information on project...
Fidelity Investments
Durham, NC
1 day ago
Data Engineer - Python, SQL, AWS
We are seeking an experienced Data Engineer with a strong background in Python, SQL, and AWS to join our team. This role involves designing and developing scalable data pipelines, performing data analysis and modeling, and contributing to the creation of an enterprise-wide...
Compunnel, Inc.
Durham, NC
2 days ago
Hybrid Data Engineer Intern - SQL, Python, Analytics
Cypress Creek Renewables is seeking a Data Engineering Intern for its Digital Centre of Excellence in Durham, NC. The role involves supporting the Data Engineering team in managing an enterprise data warehouse for analytics and business intelligence reporting. Candidates...
Internship
3 days per week
Cypress Creek Renewables
Durham, NC
4 days ago
Senior Data Engineer: Databricks, Spark & Real-Time Analytics
Labcorp is seeking a Senior Data Engineer to join our team in Durham, NC. This role involves designing and implementing data engineering solutions, maintaining data pipelines, and collaborating with various stakeholders to fulfill business requirements. Applicants should...
Labcorp
Durham, NC
5 days ago
Senior Data Engineer: Build Scalable Data Platforms & Analytics
Compunnel, Inc. is looking for a Senior Data Engineer to design and maintain scalable data solutions that support critical business operations. Ideal candidates will have over 7 years of experience in data engineering, with strong expertise in Oracle PL/SQL and ETL tools...
Compunnel
Durham, NC
1 day ago
Senior Data Cloud Engineer
...Senior Data Cloud Engineer California, US residents click here. The job details are as follows: We are the first publicly-traded biotech or pharmaceutical company to take the form of a public benefit corporation. Our public benefit purpose is to provide a brighter...
Work at office
3 days per week
IVIVA Medical
Durham, NC
1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Engineer. Be the first to apply!