Lead Data Engineer (Real Time Streaming)
Software Technology Inc
Lead Data/Software Engineer (Real Time Streaming)
In this position the candidate will have an opportunity to drive technical standards, platform design, and technical ownership related to a modernization and build out of a foundational data platform effort. The candidate will have ownership and accountability of design decisions and direction as well as platform strategy driving high quality, scalable, and resilient data capabilities focused on seamless and configurable data exchange and real-time integrations. Initial work will be dedicated to platform design/architecture, capability discovery, and execution planning. In the second phase they will be accountable to provide direction and drive team leads solving complex business/data problems using industry best practices based on the agreed upon platform design. Candidate must be a quick learner and have excellent communication skills. A passion for growing and defining a true engineering culture while mentoring and guiding engineers with varying experience is a must.
Skills Requirements
- 7+ years of experience with at least 3 years of experience working as a lead with expertise in building and shipping production ready software in a scaled distributed environment.
- 7+ years of programming skills with Java or Python and related frameworks like Spring Boot, Flask, Hibernate, Rest Assured, etc.
- 3+ years of experience with a variety of modern open-source technologies (Kafka, AVRO, Prometheus, ELK, Kubernetes).
- 3+ years of experience of modern database technologies with experience in both RDBMS and NoSQL Implementations.
- 1-2 years’ experience building and integrating real-time data solutions such as Kafka.
- Expertise implementing containerized and scalable software based on microservices
- Knowledge of a variety of modern programming languages (Python, Java, JavaScript, Node)
- Expertise with container platforms and deployments
- Expertise defining and utilizing data integration solutions
- Expertise in incremental Agile delivery practices
- Knowledge of Continuous Integration and Deployment Strategies
- Expertise with RESTful Web Services
- Expertise with Github and Git version control
- Excellence in technical communication with peers and non-technical colleagues.
- Expertise in container virtualization utilizing Docker and CICD using Jenkins, Gitlab or CircleCI
- Expertise with a variety of security mechanisms and certifications such as SAML, Oauth, SSO, HITRUST, FedRAMP, etc.)
- Ability to lead and develop people
- A passion for modern engineering and culture
Bonus Skills
- Experience with AI/ML capabilities
- Experience with big data platforms
- Experience with cloud data platforms (e.g. Snowflake)
- Experience with GraphQL
- Expertise with AI/ML
- Health Care experience
- ...Department/Team: Engineering Clearance Requirement: Not Required... ...Employment Type: Full-time, Salaried Role Summary... ...are seeking a Senior Data Engineer to design and build high-performance real-time data platforms... .... This role focuses on streaming data pipelines, distributed...SuggestedFull timeRemote work
- ...Kraken is looking for a leader for its Data Platform team to develop real-time streaming infrastructure crucial for decision-making in digital asset trading. The role demands expertise in data engineering, AI automation, and managing engineering teams in a high-volume...Suggested
$104k - $130k
...Description What we’re looking for: As a member of the Data Platform Engineering team, the Real-Time Data Engineer II will work collaboratively to... ...sources, including change data capture systems, data streaming and event sourcing in production. You have hands-...SuggestedHourly payFull timeImmediate start- ...Senior Software Engineer – Real-Time Data Developer One of the core objectives of the group is the development of data systems for data streaming and marketing activations. The optimal candidate will have a minimum of 7 years of hands-on development experience with...SuggestedContract workWork experience placementLive in
- ...headquartered in Alpharetta, GA, is a leading IT services provider specializing in Java, .NET, Big Data, Cloud Computing (AWS, GCP,... ...technology innovation! Real-Time Analytics Engineer (Flink, Kafka) Location:... ...Design Kafka-based event streaming systems to handle high-...SuggestedFull time
- ...A leading tech company is seeking a Senior Sales Engineer to drive the technical sales process and articulate the value... ...solutions using advanced streaming data technologies, and provide technical... ...to make a significant impact in real-time data processing technology. #J-...Remote work
- ...looking for motivated Software Engineers to join our dynamic... ...and contribute to cutting-edge data-intensive solutions. At Ververica... ..., data engineering and stream processing problems Work both... ...innovative team at the forefront of real-time data processing technology....Worldwide
$150.4k - $194k
...Our talented Data & AI team is made up of globally recognized... ...join us As a Lead Solution Architect within... ..., self-service analytics, real time intelligence and AI engineering. Using the power... ...unstructured data analysis, streaming data, IoT, AI, GenAI and related...Work at officeLocal areaRemote workFlexible hours$160k - $185k
...Data Engineering Manager / Snowflake / Real-time Lake Forest, Illinois Open to Remote Direct Hire $160k - $185k This top eCommerce player... ...experience Hands-on experience with Kafka or real-time streaming architecture Strong Python and SQL abilities...Full timeWork at officeImmediate startRemote workWork from home- A leading tech company is seeking a Senior Sales Engineer to drive the technical sales process and articulate the value... ...with Apache Flink and streaming data technologies. You will engage with... ...dynamic environment focused on real-time data processing technology. #J-...
- ...A leading technology company is seeking a Senior Sales Engineer to drive the technical sales process and articulate the business... ...role requires expertise in streaming data technologies like Apache Flink... ...team at the forefront of real-time data processing technology. J-...
- 1Password is seeking a Senior Data Platform Engineer to help build a next-generation data platform. In this role, you will design, implement, and maintain a streaming-first data system, ensuring data availability for analytics and business use. The ideal candidate will...Remote work
$175k - $225k
A dynamic fintech company is seeking a Data Engineer to join their Data & Intelligence team.... ...this role, you will build next-generation real-time data systems that support pricing... ...are required, along with experience in streaming data systems like Kafka and Flink. This...Remote work- ...A leading blockchain analytics firm in the United States is seeking a skilled software engineer to develop cutting-edge ingestion systems for the... ...movement analysis, and integrate data from various Solana... ...multiple teams to enhance real-time data analytics. #J-18808-Ljbffr...
- ...A leading financial technology firm is seeking a Data Engineer to support real-time data and reporting platforms. The role requires significant experience with financial trading data, proficiency in Java and Python with Groovy scripting for customization, and a problem...
- Valid8 Financial, Inc. is looking for a Senior Data Engineer to support real-time intelligence initiatives for a Fortune 100 client. In this role, you will build high-quality data products using Denodo and other AI tools to create trusted data assets. Responsibilities...
- ...A leading healthcare technology firm is seeking a Staff Data Engineer to enhance its Real-Time Care Intelligence solutions. The ideal candidate has over 8 years of software development experience, specializes in ETL solutions, and is proficient with AWS technologies like...Remote work
- Nerdleveltech is seeking an L4 Machine Learning Engineer to join our Trust Intelligence Platform... ...operate ML infrastructure that enables real-time intelligence in customer interactions. Responsibilities include architecting data pipelines, building ML workflows, and ensuring...Remote work
- ...Senior/Lead Azure Streaming Data Engineer Ideal candidate is a senior local resource. Must be based in Minneapolis, MN. US Citizen or US green... ...Azure Streaming Data Engineer will design and build the real-time data ingestion and processing pipelines that power Client...For contractorsLocal areaImmediate start
- ...A global cybersecurity leader is seeking a Lead Data Engineer to steer their data engineering efforts. This position involves designing robust data pipelines, guiding junior engineers, and setting the vision for data architecture. The ideal candidate should have over...
$160k - $240k
...Senior Software Engineer - Real-time Data Location New York Business Area Engineering and CTO Ref # 10051647 Description & Requirements Bloomberg's Real-time Data group is responsible for distributing low-latency, high-volume data (financial, news,...Temporary workFor contractorsWork experience placement- ...Software Engineer - Real Time Aviation Data We are seeking a full-time Software Engineer - Real Time Aviation Data at Garmin's location in Chanhassen... ...process May perform as a technical leader or Lead Software Engineer for derivative software project Collaborates...Full time
- ...ECS) Group and more specifically, the Real-time Control and Data Acquisition (RCDA) team. The RCDA Team... ...data in real-time. Job Duties: Engineer I and II: Assists with implementing transmission... ...to participate and be the technical lead in performing engineering analysis....Full timeWork experience placementRemote work
- ...A financial technology company in the United States is seeking a Senior Data Engineer to build and maintain a reliable market data platform. The role involves developing historical and real-time data pipelines, mentoring junior staff, and ensuring data accuracy and performance...
- ...A leading communications technology company seeks a Machine Learning Engineer to design and operate cloud-native data infrastructure. This hands-on role involves building scalable data pipelines... ...and integrating various event streams. Candidates should have a B.S. in Computer...Remote work
- ...Senior Front-End Engineer We are seeking a Senior Front-End Engineer... ...will build sophisticated, real-time interfaces that power live... ...state orchestration, real-time data synchronization, and high-performance... ...: Earn an excellent, market-leading compensation in USD, that...Remote work
$93.2k - $164.45k
...artificial intelligence, and real-time command-and-control capabilities... ...a scalable cloud-based data platform that enables rapid ingestion... ...seeking an experienced Data Engineer to drive the orchestration of... ...will integrate with streaming ingestion pipelines and data...Full timeTemporary workWork experience placementWork at officeRemote workFlexible hours$77.6k - $176k
...Job Number: R0238411 AWS Streaming Data Engineer The Opportunity : As an AWS Streaming Data... ...role, you will utilize experience with real-time data ingestion and processing systems... ...enhancements. Grow your skills at the leading edge of innovation. Work with us as we...Full timeContract workPart timeWork at officeLocal areaRemote work- ...Overview: Streaming Data Engineer (Kafka & Spark) Location: Alpharetta, GA (willing to travel... ...client locations) Employment Type: Full-Time (W2) Role Overview We are... ...skilled Streaming Data Engineer to build real-time data pipelines using Kafka and Spark...Full time
- ...Sr. Data Engineer FULL TIME REMOTE | Lockheed Martin Sr. Data Engineer FULL TIME REMOTE Rotary... ...technologies, artificial intelligence, and real-time command-and-control capabilities... .... These databases will integrate with streaming ingestion pipelines and data lake...Full timeRemote work
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Data Engineer (Real Time Streaming). Be the first to apply!
- clinical data United States
- master data coordinator United States
- clinical data coordinator remote United States
- data intern United States
- data journalist United States
- data cabling installation United States
- data collection researcher United States
- data technician United States
- data mining United States
- minimum data set coordinator United States


