Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Lead Data Engineer (Real Time Streaming)

Software Technology Inc

Lead Data/Software Engineer (Real Time Streaming)

In this position the candidate will have an opportunity to drive technical standards, platform design, and technical ownership related to a modernization and build out of a foundational data platform effort. The candidate will have ownership and accountability of design decisions and direction as well as platform strategy driving high quality, scalable, and resilient data capabilities focused on seamless and configurable data exchange and real-time integrations. Initial work will be dedicated to platform design/architecture, capability discovery, and execution planning. In the second phase they will be accountable to provide direction and drive team leads solving complex business/data problems using industry best practices based on the agreed upon platform design. Candidate must be a quick learner and have excellent communication skills. A passion for growing and defining a true engineering culture while mentoring and guiding engineers with varying experience is a must.

Skills Requirements
  • 7+ years of experience with at least 3 years of experience working as a lead with expertise in building and shipping production ready software in a scaled distributed environment.
  • 7+ years of programming skills with Java or Python and related frameworks like Spring Boot, Flask, Hibernate, Rest Assured, etc.
  • 3+ years of experience with a variety of modern open-source technologies (Kafka, AVRO, Prometheus, ELK, Kubernetes).
  • 3+ years of experience of modern database technologies with experience in both RDBMS and NoSQL Implementations.
  • 1-2 years’ experience building and integrating real-time data solutions such as Kafka.
  • Expertise implementing containerized and scalable software based on microservices
  • Knowledge of a variety of modern programming languages (Python, Java, JavaScript, Node)
  • Expertise with container platforms and deployments
  • Expertise defining and utilizing data integration solutions
  • Expertise in incremental Agile delivery practices
  • Knowledge of Continuous Integration and Deployment Strategies
  • Expertise with RESTful Web Services
  • Expertise with Github and Git version control
  • Excellence in technical communication with peers and non-technical colleagues.
  • Expertise in container virtualization utilizing Docker and CICD using Jenkins, Gitlab or CircleCI
  • Expertise with a variety of security mechanisms and certifications such as SAML, Oauth, SSO, HITRUST, FedRAMP, etc.)
  • Ability to lead and develop people
  • A passion for modern engineering and culture
Bonus Skills
  • Experience with AI/ML capabilities
  • Experience with big data platforms
  • Experience with cloud data platforms (e.g. Snowflake)
  • Experience with GraphQL
  • Expertise with AI/ML
  • Health Care experience
Vacancy posted 3 hours ago
Similar jobs that could be interesting for youBased on the Lead Data Engineer (Real Time Streaming) in United States vacancy
  •  ...Department/Team: Engineering Clearance Requirement: Not Required...  ...Employment Type: Full-time, Salaried Role Summary...  ...are seeking a Senior Data Engineer to design and build high-performance real-time data platforms...  .... This role focuses on streaming data pipelines, distributed... 
    Suggested
    Full time
    Remote work

    Privateer LTD

    Kihei, HI
    3 days ago
  •  ...Kraken is looking for a leader for its Data Platform team to develop real-time streaming infrastructure crucial for decision-making in digital asset trading. The role demands expertise in data engineering, AI automation, and managing engineering teams in a high-volume... 
    Suggested

    Kraken

    New York, NY
    1 day ago
  • $104k - $130k

     ...Description What we’re looking for: As a member of the Data Platform Engineering team, the Real-Time Data Engineer II will work collaboratively to...  ...sources, including change data capture systems, data streaming and event sourcing in production. You have hands-... 
    Suggested
    Hourly pay
    Full time
    Immediate start

    AppFolio

    Richardson, TX
    6 hours ago
  •  ...Senior Software Engineer – Real-Time Data Developer One of the core objectives of the group is the development of data systems for data streaming and marketing activations. The optimal candidate will have a minimum of 7 years of hands-on development experience with... 
    Suggested
    Contract work
    Work experience placement
    Live in

    Software Technology Inc

    Washington DC
    22 hours ago
  •  ...headquartered in Alpharetta, GA, is a leading IT services provider specializing in Java, .NET, Big Data, Cloud Computing (AWS, GCP,...  ...technology innovation! Real-Time Analytics Engineer (Flink, Kafka) Location:...  ...Design Kafka-based event streaming systems to handle high-... 
    Suggested
    Full time

    R2 Technologies

    Alpharetta, GA
    2 days ago
  •  ...A leading tech company is seeking a Senior Sales Engineer to drive the technical sales process and articulate the value...  ...solutions using advanced streaming data technologies, and provide technical...  ...to make a significant impact in real-time data processing technology. #J-... 
    Remote work

    Ververica GmbH

    New York, NY
    3 days ago
  •  ...looking for motivated Software Engineers to join our dynamic...  ...and contribute to cutting-edge data-intensive solutions. At Ververica...  ..., data engineering and stream processing problems Work both...  ...innovative team at the forefront of real-time data processing technology.... 
    Worldwide

    Ververica | Original creators of Apache Flink®

    Beaver, OH
    3 days ago
  • $150.4k - $194k

     ...Our talented Data & AI team is made up of globally recognized...  ...join us As a Lead Solution Architect within...  ..., self-service analytics, real time intelligence and AI engineering. Using the power...  ...unstructured data analysis, streaming data, IoT, AI, GenAI and related... 
    Work at office
    Local area
    Remote work
    Flexible hours

    Avanade

    Chicago, IL
    4 days ago
  • $160k - $185k

     ...Data Engineering Manager / Snowflake / Real-time Lake Forest, Illinois Open to Remote Direct Hire $160k - $185k This top eCommerce player...  ...experience Hands-on experience with Kafka or real-time streaming architecture Strong Python and SQL abilities... 
    Full time
    Work at office
    Immediate start
    Remote work
    Work from home

    Motion Recruitment

    Lake Forest, IL
    22 hours ago
  • A leading tech company is seeking a Senior Sales Engineer to drive the technical sales process and articulate the value...  ...with Apache Flink and streaming data technologies. You will engage with...  ...dynamic environment focused on real-time data processing technology. #J-... 

    Ververica | Original creators of Apache Flink

    San Francisco, CA
    2 days ago
  •  ...A leading technology company is seeking a Senior Sales Engineer to drive the technical sales process and articulate the business...  ...role requires expertise in streaming data technologies like Apache Flink...  ...team at the forefront of real-time data processing technology. J-... 

    Ververica | Original creators of Apache Flink®

    New York, NY
    18 hours ago
  • 1Password is seeking a Senior Data Platform Engineer to help build a next-generation data platform. In this role, you will design, implement, and maintain a streaming-first data system, ensuring data availability for analytics and business use. The ideal candidate will... 
    Remote work

    1Password

    New York, NY
    4 days ago
  • $175k - $225k

    A dynamic fintech company is seeking a Data Engineer to join their Data & Intelligence team....  ...this role, you will build next-generation real-time data systems that support pricing...  ...are required, along with experience in streaming data systems like Kafka and Flink. This... 
    Remote work

    Trumid

    New York, NY
    3 days ago
  •  ...A leading blockchain analytics firm in the United States is seeking a skilled software engineer to develop cutting-edge ingestion systems for the...  ...movement analysis, and integrate data from various Solana...  ...multiple teams to enhance real-time data analytics. #J-18808-Ljbffr... 

    Framework Ventures

    New York, NY
    1 day ago
  •  ...A leading financial technology firm is seeking a Data Engineer to support real-time data and reporting platforms. The role requires significant experience with financial trading data, proficiency in Java and Python with Groovy scripting for customization, and a problem... 

    Memx Inc

    New York, NY
    1 day ago
  • Valid8 Financial, Inc. is looking for a Senior Data Engineer to support real-time intelligence initiatives for a Fortune 100 client. In this role, you will build high-quality data products using Denodo and other AI tools to create trusted data assets. Responsibilities... 

    VALID8 Financial

    New York, NY
    3 days ago
  •  ...A leading healthcare technology firm is seeking a Staff Data Engineer to enhance its Real-Time Care Intelligence solutions. The ideal candidate has over 8 years of software development experience, specializes in ETL solutions, and is proficient with AWS technologies like... 
    Remote work

    Bamboo Health Inc.

    New York, NY
    1 day ago
  • Nerdleveltech is seeking an L4 Machine Learning Engineer to join our Trust Intelligence Platform...  ...operate ML infrastructure that enables real-time intelligence in customer interactions. Responsibilities include architecting data pipelines, building ML workflows, and ensuring... 
    Remote work

    Nerdleveltech

    San Francisco, CA
    3 days ago
  •  ...Senior/Lead Azure Streaming Data Engineer Ideal candidate is a senior local resource. Must be based in Minneapolis, MN. US Citizen or US green...  ...Azure Streaming Data Engineer will design and build the real-time data ingestion and processing pipelines that power Client... 
    For contractors
    Local area
    Immediate start

    Kapital Data Corp

    Minneapolis, MN
    22 hours ago
  •  ...A global cybersecurity leader is seeking a Lead Data Engineer to steer their data engineering efforts. This position involves designing robust data pipelines, guiding junior engineers, and setting the vision for data architecture. The ideal candidate should have over... 

    OPSWAT

    New York, NY
    1 day ago
  • $160k - $240k

     ...Senior Software Engineer - Real-time Data Location New York Business Area Engineering and CTO Ref # 10051647 Description & Requirements Bloomberg's Real-time Data group is responsible for distributing low-latency, high-volume data (financial, news,... 
    Temporary work
    For contractors
    Work experience placement

    Bloomberg

    New York, NY
    5 days ago
  •  ...Software Engineer - Real Time Aviation Data We are seeking a full-time Software Engineer - Real Time Aviation Data at Garmin's location in Chanhassen...  ...process May perform as a technical leader or Lead Software Engineer for derivative software project Collaborates... 
    Full time

    Garmin

    Chanhassen, MN
    22 hours ago
  •  ...ECS) Group and more specifically, the Real-time Control and Data Acquisition (RCDA) team. The RCDA Team...  ...data in real-time. Job Duties: Engineer I and II: Assists with implementing transmission...  ...to participate and be the technical lead in performing engineering analysis.... 
    Full time
    Work experience placement
    Remote work

    Georgia System Operations Corporation

    Tucker, GA
    a month ago
  •  ...A financial technology company in the United States is seeking a Senior Data Engineer to build and maintain a reliable market data platform. The role involves developing historical and real-time data pipelines, mentoring junior staff, and ensuring data accuracy and performance... 

    Ethena Labs

    New York, NY
    1 day ago
  •  ...A leading communications technology company seeks a Machine Learning Engineer to design and operate cloud-native data infrastructure. This hands-on role involves building scalable data pipelines...  ...and integrating various event streams. Candidates should have a B.S. in Computer... 
    Remote work

    Twilio

    New York, NY
    1 day ago
  •  ...Senior Front-End Engineer We are seeking a Senior Front-End Engineer...  ...will build sophisticated, real-time interfaces that power live...  ...state orchestration, real-time data synchronization, and high-performance...  ...: Earn an excellent, market-leading compensation in USD, that... 
    Remote work

    TrueLogic Company

    United States
    2 hours ago
  • $93.2k - $164.45k

     ...artificial intelligence, and real-time command-and-control capabilities...  ...a scalable cloud-based data platform that enables rapid ingestion...  ...seeking an experienced Data Engineer to drive the orchestration of...  ...will integrate with streaming ingestion pipelines and data... 
    Full time
    Temporary work
    Work experience placement
    Work at office
    Remote work
    Flexible hours

    Lockheed Martin Corporation

    United States
    2 hours ago
  • $77.6k - $176k

     ...Job Number: R0238411 AWS Streaming Data Engineer The Opportunity : As an AWS Streaming Data...  ...role, you will utilize experience with real-time data ingestion and processing systems...  ...enhancements. Grow your skills at the leading edge of innovation. Work with us as we... 
    Full time
    Contract work
    Part time
    Work at office
    Local area
    Remote work

    Booz Allen Hamilton

    McLean, VA
    2 days ago
  •  ...Overview: Streaming Data Engineer (Kafka & Spark) Location: Alpharetta, GA (willing to travel...  ...client locations) Employment Type: Full-Time (W2) Role Overview We are...  ...skilled Streaming Data Engineer to build real-time data pipelines using Kafka and Spark... 
    Full time

    R2 Technologies

    Alpharetta, GA
    3 days ago
  •  ...Sr. Data Engineer FULL TIME REMOTE | Lockheed Martin Sr. Data Engineer FULL TIME REMOTE Rotary...  ...technologies, artificial intelligence, and real-time command-and-control capabilities...  .... These databases will integrate with streaming ingestion pipelines and data lake... 
    Full time
    Remote work

    Lockheed Martin Corporation

    United States
    22 hours ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Lead Data Engineer (Real Time Streaming). Be the first to apply!