Lead Streaming Data Engineer
Full-time
Siri Info Solutions Inc
Job Title : Lead Streaming Data Engineer
Location : Tampa, FL, On-site
Experience : 10+ Years
Domain : Banking (Mandatory)
Key Responsibilities
Mandatory
Build scalable and fault-tolerant streaming applications using Apache Spark Structured Streaming , AWS Flink , and Apache Kafka .
Role Summary
We are seeking an experienced Lead Streaming Data Engineer to design, develop, and lead the implementation of large-scale real-time data processing platforms. The ideal candidate should possess strong expertise in Apache Spark, AWS Flink, and Kafka Streaming , along with proficiency in Python or Java . The candidate will be responsible for technical leadership, architecture decisions, mentoring team members, and ensuring successful delivery of streaming data solutions.
Key Responsibilities
- Lead the architecture, design, and implementation of real-time data processing pipelines.
- Build scalable and fault-tolerant streaming applications using Apache Spark Structured Streaming , AWS Flink , and Apache Kafka .
- Define technical standards, best practices, and coding guidelines for the team.
- Collaborate with business stakeholders, architects, product owners, and engineering teams.
- Optimize streaming applications for performance, reliability, scalability, and cost efficiency.
- Drive solution design reviews, code reviews, and production readiness assessments.
- Mentor and guide development teams across onshore and offshore locations.
- Troubleshoot complex production issues and provide technical leadership during critical incidents.
- Ensure adherence to security, governance, and compliance requirements
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Lead Streaming Data Engineer in Tampa, FL vacancy
- Wipro is seeking a Data Engineer specialized in PySpark to join our data engineering team in Irving, TX. You will design and implement robust... ...years of experience, excellent communication, and hands-on experience with PySpark, streaming platforms, and #J-18808-Ljbffr WiproSuggested
- ...Lead Data EngineerThe Lead Data Engineer will be responsible for designing, developing, and maintaining the company's data architecture. They will lead a team of data engineers and work closely with data scientists, analysts, and other stakeholders to ensure that data...Suggested
ClearanceJobs
Tampa, FL14 hours ago - ...Lead Data EngineerLocation: Remote (EST)Contract: 6+ months ongoing (possible contract to hire/must be eligible for conversion)Summary: As a Lead Data Engineer, you will play a critical role in designing, developing, and maintaining our data infrastructure. You will be...SuggestedOngoing contractContract workRemote work
RIT Solutions
Tampa, FL1 day ago $113.84k - $170.76k
...move beyond just writing code and start leading the technical vision? We are searching for... ...seasoned Java expert with a passion for data and a talent for leadership, this is... ...technical field (Computer Science, Electrical Engineering etc..). • Master’s degree in a technical...SuggestedFull time- ...skills and talents will be valued and celebrated. Together we will create a brighter future and make a meaningful difference.As a Lead Data Engineer at JPMorganChase within the Commercial & Investment Bank, you are an integral part of an agile team that works to enhance,...Suggested
$116.2k - $229.1k
...Join Deloitte’s AI & Engineering practice and help organizations... ...technology platforms, modernize data environments, and unlock value... ...scalability. • Team and Technology Lead: Evaluate, pilot, and... ...Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache...Local areaVisa sponsorship$77.5k - $176k
Data Engineer, SeniorThe Opportunity: Ever-expanding technology like IoT, machine learning, and... ...build advanced technology solutions and lead data engineering activities on some of... ...AlteryxExperience working on real-time data and streaming applications Experience with data...Full timeContract workPart timeWork at officeLocal areaRemote work- JPMorgan Chase & Co. is seeking a Lead Data Engineer in Tampa, Florida. This role involves designing and maintaining scalable data pipelines for document processing, leveraging AWS cloud services, Java, Groovy, and Python. A strong focus is on building robust OCR integration...
- ...Data Engineer (PySpark)Choosing Capgemini means choosing a company where you will be empowered... ...possible. Join us and help the world's leading organizations unlock the value of... ...StrongproficiencyinSpark Core Spark SQL Spark Streaming and SparkGraphXbeneficialExpertlevel...Full timeLocal area
Capgemini
Tampa, FL14 hours ago - ...Exception Handling, JDBC, Multithreading, Streams, Lambda Expressions, Functional... ..., Neo4j).3+ years of experience leading/owning software development projects... ...Seeking a Core Java and Apache Spark Engineer with expertise in big data processing, particularly within the...
Rose International
Tampa, FL2 days ago - ...Data Engineer With DatabricksWe are seeking a talented Data Engineer with hands-on experience in Databricks to join our dynamic data team... ...platform using Apache Spark.Build and optimize batch and streaming data pipelines to process large volumes of structured and unstructured...Local areaWorldwide
Avance Consulting
Tampa, FL1 day ago - ...Graham Technologies is seeking a highly skilled Data Engineer to design, develop, and maintain enterprise data engineering solutions that... ...structured and unstructured data. Develop batch and streaming data pipelines utilizing technologies such as Apache Kafka, Apache...Flexible hours
Graham Tech
Tampa, FL4 days ago $118.9k - $162.3k
...moves missions and the government forward! We are looking for a Data Engineer with strong hands‑on experience designing, developing, and... ...generative AI production systems Background in distributed systems, streaming platforms, or data mesh architectures Clearance An active TS/...Work at officeLocal areaAccenture-Federal-Services-2
Tampa, FL1 day ago- ...services and tools, including GCP databases (PostgreSQL, MongoDB), Data Flow, and related services.GKE + Google Data flowPostgreSQL... ...Google Cloud Data Flow or Apache Beam for data processing and streaming.Database Security: Familiarity with database security best practices...
Syntricate Technologies
Tampa, FL2 days ago $107.9k - $195.05k
...capabilities. We're assembling a team of top-tier data professionals who are driven by... ...is seeking highly qualified Senior Data Engineers to support a multidisciplinary team... ...workflows supporting batch, near-real-time, and streaming data processing requirements. Develop...Contract workFor contractorsLeidos
Tampa, FL1 day ago- ...Data EngineerThis position is Hybrid in Tampa, FL.We are seeking a Data Engineer with strong Databricks expertise to modernize and scale... ...and complex query designKafka streaming applications and connector... ...supply chain partners. Backed by leading investors TA Associates and...Temporary workCasual workLocal area
Fintech Brand
Tampa, FL3 days ago $118.9k - $162.3k
...Data EngineerAt Accenture Federal Services, nothing matters more than helping the US federal... ...forward!We are looking for a Data Engineer with strong hands-on experience designing... ...systemsBackground in distributed systems, streaming platforms, or data mesh architecturesClearanceAn...Live inWork at officeLocal areaAccenture Federal Services
Tampa, FL14 hours ago- ...cleareance* Responsibilities:Provide data science (DS) and operations... .... Identify and develop data stream interfaces for authoritative... ...can execute tasks. Develop and lead small teams in the development... ...research, data science, math, engineering, science, or computer science....Work at office
- Data Engineer / Databricks Location: Tampa, FL Role: Data Engineer with Databricks Databricks / Data Engineering... ...Scalable data pipeline architecture Batch data processing Streaming data processing Structured and unstructured data...
Sysmind LLC
Tampa, FL1 day ago - ...We are seeking a Data Engineer with strong Databricks expertise to modernize and scale our Business Intelligence (BI) capabilities. This... ...Advanced SQL optimization and complex query design Kafka streaming applications and connector development Databricks workflow...Work at officeLocal areaTampa, FL19 days ago
- ...Join us and help the world’s leading organizations unlock the value... ...of HDFS architecture data storage and fault tolerance mechanisms... ...Core Spark SQL Spark Streaming and SparkGraphXbeneficialExpertlevel... ...from strategy and design to engineering, all fueled by its market leading...Full timeLocal area
$60k - $135k
Job Description Role: Data Engineer - PySpark Location: Irving, TX (3 Days onsite/week) Key Responsibilities Strong programming skills in... ...be familiar with data warehouse concepts. Experience with streaming data platforms. Excellent analytical and problem-solving skills...Minimum wageLocal area3 days per week$100k - $115k
...we co-create custom software, data, and cloud products with... ...change. Our Data Architecture & Engineering team sees data as the foundation... ...processing engines, event streaming platforms, and more Working... ...technology consulting company that leads with outcomes to bring more...Temporary workLocal area- NSI requires a Data Engineer to support CENTCOM Headquarters Logistics Operating Environment 3.0. You will design and implement high-throughput... ...systems into a centralized data lake using Kafka for streaming and NiFi/Airflow for ETL. Emphasis on data governance, encryption...
- AgileEngine is seeking a Senior Data Engineer to architect, build, and scale a modern data platform. You will design ETL/ELT pipelines,... ...work with Airflow, Prefect, or Dagster, integrate REST APIs and streaming data, ensure data quality and observability, and collaborate...Remote job
- Description: NSI requires a Data Engineer to support CENTCOM Headquarters Logistics Operating Environment 3.0. Upon award of contract the... .... The architecture will leverage Apache Kafka for real-time streaming data and ETL frameworks such as Apache NiFi or Apache Airflow...Contract workTemporary workFlexible hours
- ...Group (MUFG), one of the world’s leading financial groups. Across the... ...motivated Sr. Database Engineer as part of the Security Engineering... ...role that drives security data engineering standards and implementation... ...AWS S3, etc.Familiarity with streaming platforms like Cribl, Kafka,...Full timeWork at officeLocal areaRemote work1 day per week
$118.9k - $162.3k
...moves missions and the government forward! We are looking for a Data Engineer with strong hands‑on experience designing, developing, and... ...AI production systems Background in distributed systems, streaming platforms, or data mesh architectures Clearance An active TS...Live inWork at officeLocal area$100k - $115k
...we co-create custom software, data, AI, and cloud products with... ...intelligence into products, engineering systems that support learning... ...enterprise data warehouses. Streaming data platformsfor real-time ingestion... ...consulting company that leads with outcomes to bring more...Temporary workWork at officeFlexible hours- ...Strong hands-on experience in Python for data engineering and application development. Extensive experience with AWS cloud services, including... .... Hands-on experience with Apache Flink for real-time stream processing and event-driven data pipelines. Experience designing...
Purple Drive
Tampa, FLa month ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Streaming Data Engineer. Be the first to apply!
