StreamSets Developer

Centstone

StreamSets Developer

Location: Remote

Job Type: Long Term Contract

Position Overview

We are looking for an experienced StreamSets Developer to design, develop, implement, and support enterprise-scale data integration and data ingestion pipelines. The ideal candidate will have strong hands-on experience with StreamSets Data Collector, ETL/ELT, real-time data integration, APIs, databases, cloud platforms, and data engineering technologies .

This is a Remote opportunity.

Key Responsibilities

Design, develop, configure, and maintain data ingestion pipelines using StreamSets .
Build scalable ETL/ELT pipelines for batch and real-time data integration.
Develop and maintain StreamSets Data Collector (SDC) pipelines and data flows.
Integrate data from multiple sources including databases, APIs, files, cloud platforms, and enterprise applications.
Configure StreamSets origins, processors, destinations, and pipeline parameters.
Develop data transformation, cleansing, enrichment, validation, and routing logic.
Monitor pipeline performance and troubleshoot data processing and integration issues.
Implement error handling, data quality checks, logging, and recovery mechanisms.
Work with structured and semi-structured data including JSON, XML, CSV, Avro, and Parquet .
Integrate StreamSets with relational and NoSQL databases.
Develop integrations with cloud-based data platforms and data warehouses.
Optimize pipelines for performance, scalability, reliability, and throughput.

Required Skills

Strong hands-on experience with StreamSets Data Collector (SDC) .
Experience designing and developing StreamSets pipelines.
Strong ETL/ELT and data integration experience.
Strong SQL skills.
Experience with relational databases such as Oracle, SQL Server, PostgreSQL, or MySQL .
Experience working with APIs and web services.
Strong understanding of REST APIs.
Experience with JSON, XML, CSV, Avro, and Parquet.

Preferred Skills

Experience with StreamSets Transformer and StreamSets Control Hub.
Experience with cloud platforms such as AWS, Azure, or GCP .
Experience with cloud data platforms such as Snowflake, Databricks, or BigQuery .
Experience with Kafka and event-driven data integration.
Experience with Hadoop/HDFS or other distributed data platforms.
Experience with Python or Java.
Experience with CI/CD tools such as Jenkins, GitHub Actions, GitLab, or Azure DevOps.
Experience with Docker/Kubernetes is a plus.
Experience working with data warehouses and data lakes.
Knowledge of data governance, metadata management, and data quality.

Qualifications

Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field preferred.
5+ years of experience in data engineering, ETL, data integration, or related technologies.
Strong StreamSets development experience is required.
Excellent analytical, troubleshooting, communication, and problem-solving skills.

Apply

Vacancy posted 2 days ago

Similar jobs that could be interesting for youBased on the StreamSets Developer in Saint Louis, MO vacancy

Mid-level Software Engineer
...from the assigned Government Lead. When I read the below it sounds like me: Domain knowledge and hands-on experience in developing and implementing software programs. Proven ability writing test scripts, test driven development, in an agile software development...
Suggested
Full time
Dls Engineering
Saint Louis, MO
1 day ago
Mid-Level Software Engineer
$87.1k - $157.45k
...Full Stack Software Engineer to join the Chinook Program supporting an Intelligence Community customer. In this role, you’ll design, develop, and deliver modern software solutions that enable critical national security missions while working alongside some of the industry...
Suggested
Contract work
Local area
Immediate start
Leidos
Venice, IL
4 days ago
Mid Software Engineer
...processing workflows designed to improve analyst efficiency and operational decision-making. Candidates will work within Agile teams developing modern enterprise applications leveraging microservices, cloud technologies, geospatial platforms, and advanced data processing...
Suggested
Trevity
Saint Louis, MO
5 days ago
ITSM Platform Engineer II
...accordance with ITSM best practices.Support configuration across incident, request, change, problem, knowledge, and asset processes.Develop and maintain integrations between Halo ITSM, Jira, and other enterprise systems using APIs, webhooks, and middleware.Troubleshoot...
Suggested
Stifel Financial
Saint Louis, MO
4 days ago
Platform Engineer
$55 - $65 per hour
DescriptionKforce has a client that is seeking a Platform Engineer in Saint Louis, MO.Key Responsibilities:Reliability Architecture & Systems Design:* Improve the reliability, availability, performance, scalability, and operability of enterprise applications, platforms,...
Suggested
KForce
Saint Louis, MO
1 day ago
Back End Software Engineer (Top Secret Cleared)
$140k - $200k
...Position Overview: We are seeking a talented Back End Software Engineer to design, develop, and maintain scalable, secure, and high-performance server-side applications. The ideal candidate will have strong proficiency in Python and experience working with C# or...
Full time
Latitude
Saint Louis, MO
1 day ago
UI Developer
...Position- UI Developer Duration-Contract Location- St.Louis, MO JD Design and develop applications. Digital : Angular 2, Angular 13 8+ Years experience Develop Angular applications using Angular 15, knowledge of unit testing...
Contract work
Immediate start
Syntricate Technologies
Saint Louis, MO
1 day ago
SQL Engineer
...and advanced SQL engineering Challenging Work: Tackle complex data problems, not routine queries Key Responsibilities Develop advanced, high-performance SQL queries across large, complex datasets (multi-table joins, window functions, aggregations)...
Leidos
Saint Louis, MO
2 days ago
Full Stack Software Engineer
...opening, and we encourage interested candidates to apply for future consideration. As a Full Stack Software Engineer, you will... Develop, deploy, and maintain cloud-based services using AWS Lambda, EC2, and other core AWS services. Write and maintain code in C#,...
Full time
Immediate start
Rgi
Saint Louis, MO
1 day ago
Mid-Level SQL Engineer
$87.1k - $157.45k
...dashboards, ensure data accuracy, and deliver reliable datasets that stakeholders depend on every day. You'll work closely with dashboard developers and application teams to provide clean, consistent, and easy-to-consume data for mission users. Our primary development team...
Local area
Immediate start
Leidos
Saint Louis, MO
4 days ago
Oracle PL/SQL Developer
Oracle PL/SQL Developer Location: ST. Louis, MO Duration: 6+ Months 7-12 Years of experience using Unix Shell Scripting 10-15 Years of experience using Oracle PL/SQL Should be working from St. Louis for this position. No Travel.
My3Tech Inc
Saint Louis, MO
14 hours ago
Oracle EBS Developer
...Oracle Ebs Developer We have a full time opening in our Oracle tech team for an Oracle EBS Developer. The Software Engineer is responsible for developing prototypes and performing application coding and programming. This position interprets end user business requirements...
Full time
The Timberline Group Company
Saint Louis, MO
1 day ago
SQL Developer
Dev: Other Strong data science, advanced analytical and programming skills with 5 plus years of experience who can perform the below functions on a day-to-day basis: Create data science projects and data modeling using R, Python, and SQL Unit, integration, ...
Software Technology Inc
Saint Louis, MO
5 days ago
Salesforce Software Developer
...applications as requiredExpected to be aware of technology and industry trends and be willing to quickly learn new technologies in order to develop innovative solutions in response to client specific business needsParticipate in definition of end user requirements of new and/or...
Work at office
Remote work
NTT DATA
Saint Louis, MO
4 days ago
Senior Software Engineer, C++
...test existing software implementations Support Technical Account Managers and Operations Mentor other Market Data Engineer developers Work with other development groups at Exegy on strategic initiatives Identify ways to automate testing, packaging, and deployment...
Full time
Exegy
Saint Louis, MO
1 day ago
Principal Software Engineer
...understanding of the full lifecycle of software development Possesses principal knowledge and principal hands-on experience in developing, implementing and leading software applications and teams. Clear communication skills are required such that highly technical...
Full time
Dls Engineering
Saint Louis, MO
1 day ago
Lead Platform Engineer
Platform Engineering Role Clayco is a full-service, turnkey real estate development, master planning, architecture, engineering, and construction firm that safely delivers clients across North America the highest quality solutions on time, on budget, and above and beyond...
For contractors
Flexible hours
CRG
Saint Louis, MO
5 days ago
Technical Solutions Engineer
Please note that this position is based on our campus in Madison, WI, and requires relocation to the area. We recruit nationally and provide financial relocation assistance. Responsibilities As a Technical Solutions Engineer at Epic, you’ll work on software that impacts...
Relocation
Visa sponsorship
Relocation package
Epic
Saint Louis, MO
1 day ago
Lead Infrastructure Engineer
...support and delivery of internal and external software solutionsLead efforts and drive strategic conversationsAssist with managing and developing solutions that are in the best interest of the WIM LOBRecommend actions that meet Enterprise deliverables while balancing...
Full time
Work experience placement
Second job
Wells Fargo
Saint Louis, MO
2 days ago
Oracle Fusion ERP Developer
...We are seeking an experienced Oracle Fusion ERP Developer with strong expertise in Oracle Fusion Cloud Financials, ERP integrations, and Oracle Integration Cloud (OIC). The ideal candidate will design, develop, support, and enhance Oracle Fusion ERP solutions, with a focus...
Full time
PB consulting
Saint Louis, MO
13 days ago
Mobile React Native Developer
...IS Mobile Developer As a developer within the Mobile team, you'll help lead our efforts to establish our mobile development capabilities. Our ability to deliver mobile solutions to our clients, will lead to greater productivity and increased engagement with our technology...
Work experience placement
The Timberline Group Company
Saint Louis, MO
5 days ago
Oracle Xstore Developer
...Oracle Xstore Developer Location : St. Louis, MO - Onsite Duration : 12+ month Contract Interview : Virtual round Background : Candidates with experience in Oracle Retail, MICROS Xstore, retail POS, store systems, payment integrations, or retail...
Contract work
Akaasa Technologies
Saint Louis, MO
2 days ago
Senior UI Engineer
...a vital contributor to our user interface team, you will leverage your expertise in Angular, TypeScript, and JavaScript to design, develop, and optimize web applications that are highly performant, scalable, and visually engaging. This is a hybrid role, requiring both in...
Work at office
Immediate start
Remote work
3B Staffing LLC
Saint Louis, MO
5 days ago
Platform Engineer
...AWS infrastructure that underpins the IIA Data Lake, agent runtime environments, CI/CD pipelines, and graph database systems, and develops the utilitarian application code, automation, and internal tooling for those systems. This role ensures production environments are...
Contract work
Work at office
Remote work
3 days per week
eTeam
Saint Louis, MO
5 days ago
Platform Infrastructure Engineer
IT Platform Infrastructure Engineer Razor is seeking an IT Platform Infrastructure Engineer to support software, platform, security, and system integration efforts for new system requirements. In this role, you will be responsible for supporting the rollout of new software...
Remote work
Razor Talent
Saint Louis, MO
4 days ago
Software Web Developer
...government and its partners. \n What we are expecting from you (i.e. the qualifications you must have): ~ Research, design, and develop computer and network software or specialized utility programs. ~ Analyze user needs and develop software solutions, applying...
Full time
Local area
Immediate start
Hexagon Us Federal
Saint Louis, MO
1 day ago
cloud security engineer
Looking for an Azure Cloud Cybersecurity Engineer to work with one of its key government clients. The Cloud Security Engineer is responsible for implementing technology initiatives to secure our key government client's cloud environment. The selected candidate...
Work at office
3B Staffing LLC
Saint Louis, MO
5 days ago
Senior Platform Engineer
$98.5k - $206.8k
...Design, implement, and maintain CI/CD pipelines supporting automated build, test, and deployment across multiple development teams. Develop and manage infrastructure-as-code using tools such as Terraform and Ansible. Implement platform monitoring, logging, and...
Contract work
Work experience placement
Flexible hours
CACI International
Saint Louis, MO
5 days ago
BackEnd Software Engineer (Experienced or Senior)
$126.65k - $171.35k
...Software Engineers.This role focuses on building prototypes and new capabilities for web applications and services. You will design APIs, develop data-processing and analytics pipelines, optimize SQL queries, and help establish production-ready infrastructure. As a backend...
Permanent employment
Full time
Work experience placement
Currently hiring
Relocation
Visa sponsorship
Work visa
Relocation package
Flexible hours
Shift work
Boeing
Saint Louis, MO
2 days ago
Senior SRE - Platform Engineering
...0 countries and one rooted in a culture of growth, opportunity, diversity and innovation, LSEG is a place where everyone can grow, develop and fulfil your potential with meaningful careers. ROLE SUMMARY: This is an exciting opportunity to join a high impact engineering...
Worldwide
LSEG (London Stock Exchange Group)
Saint Louis, MO
5 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to StreamSets Developer. Be the first to apply!