Lead Streaming Data Engineer
Full-time
Siri Info Solutions Inc
Job Title : Lead Streaming Data Engineer
Location : Tampa, FL, On-site
Experience : 10+ Years
Domain : Banking (Mandatory)
Key Responsibilities
Mandatory
Build scalable and fault-tolerant streaming applications using Apache Spark Structured Streaming , AWS Flink , and Apache Kafka .
Role Summary
We are seeking an experienced Lead Streaming Data Engineer to design, develop, and lead the implementation of large-scale real-time data processing platforms. The ideal candidate should possess strong expertise in Apache Spark, AWS Flink, and Kafka Streaming , along with proficiency in Python or Java . The candidate will be responsible for technical leadership, architecture decisions, mentoring team members, and ensuring successful delivery of streaming data solutions.
Key Responsibilities
- Lead the architecture, design, and implementation of real-time data processing pipelines.
- Build scalable and fault-tolerant streaming applications using Apache Spark Structured Streaming , AWS Flink , and Apache Kafka .
- Define technical standards, best practices, and coding guidelines for the team.
- Collaborate with business stakeholders, architects, product owners, and engineering teams.
- Optimize streaming applications for performance, reliability, scalability, and cost efficiency.
- Drive solution design reviews, code reviews, and production readiness assessments.
- Mentor and guide development teams across onshore and offshore locations.
- Troubleshoot complex production issues and provide technical leadership during critical incidents.
- Ensure adherence to security, governance, and compliance requirements
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Lead Streaming Data Engineer in Tampa, FL vacancy
- Wipro is seeking a Data Engineer specialized in PySpark to join our data engineering team in Irving, TX. You will design and implement robust... ...years of experience, excellent communication, and hands-on experience with PySpark, streaming platforms, and #J-18808-Ljbffr WiproSuggested
- ...Lead Data EngineerThe Lead Data Engineer will be responsible for designing, developing, and maintaining the company's data architecture. They will lead a team of data engineers and work closely with data scientists, analysts, and other stakeholders to ensure that data...Suggested
ClearanceJobs
Tampa, FL3 days ago - ...Lead Data EngineerLocation: Remote (EST)Contract: 6+ months ongoing (possible contract to hire/must be eligible for conversion)Summary: As a Lead Data Engineer, you will play a critical role in designing, developing, and maintaining our data infrastructure. You will be...SuggestedOngoing contractContract workRemote work
RIT Solutions
Tampa, FL4 days ago - ...Lead Data Engineer Snowflake shop ETL processes Data migration modern data engineering practices, etc. Opentable formats like datalake and iceberg. Exposed to databricks pipeline Data mesh exposure. Must see the data frameworks they have worked with in the resume....Suggested
RIT Solutions
Tampa, FL4 days ago $113.84k - $170.76k
...move beyond just writing code and start leading the technical vision? We are searching for... ...seasoned Java expert with a passion for data and a talent for leadership, this is... ...technical field (Computer Science, Electrical Engineering etc..). • Master’s degree in a technical...SuggestedFull time- ...skills and talents will be valued and celebrated. Together we will create a brighter future and make a meaningful difference.As a Lead Data Engineer at JPMorganChase within the Commercial & Investment Bank, you are an integral part of an agile team that works to enhance,...
$116.2k - $229.1k
...Join Deloitte’s AI & Engineering practice and help organizations... ...technology platforms, modernize data environments, and unlock value... ...scalability. • Team and Technology Lead: Evaluate, pilot, and... ...Tables, Autoloader, Structured Streaming, Databricks Workflows, Apache...Local areaVisa sponsorship$77.5k - $176k
Data Engineer, SeniorThe Opportunity: Ever-expanding technology like IoT, machine learning, and... ...build advanced technology solutions and lead data engineering activities on some of... ...AlteryxExperience working on real-time data and streaming applications Experience with data...Full timeContract workPart timeWork at officeLocal areaRemote work- ...leveraging common standards in architecture, data and security. Altamira believes that our... ...is seeking a highly skilled Data Engineer with hands-on experience in building and... ...or deep learning frameworks.• Exposure to streaming media systems or real‑time video processing...Worldwide
- JPMorgan Chase & Co. is seeking a Lead Data Engineer in Tampa, Florida. This role involves designing and maintaining scalable data pipelines for document processing, leveraging AWS cloud services, Java, Groovy, and Python. A strong focus is on building robust OCR integration...
- ...services and tools, including GCP databases (PostgreSQL, MongoDB), Data Flow, and related services.GKE + Google Data flowPostgreSQL... ...Google Cloud Data Flow or Apache Beam for data processing and streaming.Database Security: Familiarity with database security best practices...
Syntricate Technologies
Tampa, FL23 hours ago - ...Exception Handling, JDBC, Multithreading, Streams, Lambda Expressions, Functional... ..., Neo4j).3+ years of experience leading/owning software development projects... ...Seeking a Core Java and Apache Spark Engineer with expertise in big data processing, particularly within the...
Rose International
Tampa, FL1 day ago - ...Data Engineer (PySpark)Choosing Capgemini means choosing a company where you will be empowered... ...possible. Join us and help the world's leading organizations unlock the value of... ...StrongproficiencyinSpark Core Spark SQL Spark Streaming and SparkGraphXbeneficialExpertlevel...Full timeLocal area
Capgemini
Tampa, FL3 days ago $118.9k - $162.3k
...Data EngineerAt Accenture Federal Services, nothing matters more than helping the US federal... ...forward!We are looking for a Data Engineer with strong hands-on experience designing... ...systemsBackground in distributed systems, streaming platforms, or data mesh architecturesClearanceAn...Live inWork at officeLocal areaAccenture Federal Services
Tampa, FL3 days ago$107.9k - $195.05k
...capabilities. We're assembling a team of top-tier data professionals who are driven by... ...is seeking highly qualified Senior Data Engineers to support a multidisciplinary team... ...workflows supporting batch, near-real-time, and streaming data processing requirements. Develop...Contract workFor contractorsLeidos
Tampa, FL4 days ago- ...Data EngineerThis position is Hybrid in Tampa, FL.We are seeking a Data Engineer with strong Databricks expertise to modernize and scale... ...and complex query designKafka streaming applications and connector... ...supply chain partners. Backed by leading investors TA Associates and...Temporary workCasual workLocal area
Fintech Brand
Tampa, FL1 day ago - ...Data Engineer (PySpark) Choosing Capgemini means choosing a company where you will be empowered... ...possible. Join us and help the world's leading organizations?unlock the value of... ...StrongproficiencyinSpark Core Spark SQL Spark Streaming and SparkGraphXbeneficialExpertlevel...Permanent employmentFull timeContract workLocal area
Capgemini
Tampa, FL2 days ago - ...Position Overview: We are seeking a skilled and motivated Data Warehouse and Reporting Engineer to join our team. The ideal candidate has extensive... ...compliance best practices. Familiarity with data streaming technologies (e.g., Kafka, Spark Streaming). Certification...
Exaways Corporation
Tampa, FL4 days ago $118.9k - $162.3k
...Data Engineer At Accenture Federal Services, nothing matters more than helping the US federal government make the nation stronger and... ...AI production systems Background in distributed systems, streaming platforms, or data mesh architectures Clearance ~ An...Live inWork at officeLocal areaAccenture Federal Services
Tampa, FL3 days ago- ...cleareance* Responsibilities:Provide data science (DS) and operations... .... Identify and develop data stream interfaces for authoritative... ...can execute tasks. Develop and lead small teams in the development... ...research, data science, math, engineering, science, or computer science....Work at office
- ...Group (MUFG), one of the world’s leading financial groups. Across the... ...motivated Sr. Database Engineer as part of the Security Engineering... ...role that drives security data engineering standards and implementation... ...AWS S3, etc.Familiarity with streaming platforms like Cribl, Kafka,...Full timeWork at officeLocal areaRemote work1 day per week
$60k - $135k
Job Description Role: Data Engineer - PySpark Location: Irving, TX (3 Days onsite/week) Key Responsibilities Strong programming skills in... ...be familiar with data warehouse concepts. Experience with streaming data platforms. Excellent analytical and problem-solving skills...Minimum wageLocal area3 days per week- ...Join us and help the world’s leading organizations unlock the value... ...of HDFS architecture data storage and fault tolerance mechanisms... ...Core Spark SQL Spark Streaming and SparkGraphXbeneficialExpertlevel... ...from strategy and design to engineering, all fueled by its market leading...Full timeLocal area
- AgileEngine is seeking a Senior Data Engineer to architect, build, and scale a modern data platform. You will design ETL/ELT pipelines,... ...work with Airflow, Prefect, or Dagster, integrate REST APIs and streaming data, ensure data quality and observability, and collaborate...Remote job
- Graham Technologies is seeking a highly skilled Data Engineer to design, develop, and maintain enterprise data engineering solutions that... ...structured and unstructured data. Develop batch and streaming data pipelines utilizing technologies such as Apache Kafka, Apache...Flexible hours
$100k - $115k
...we co-create custom software, data, and cloud products with... ...change. Our Data Architecture & Engineering team sees data as the foundation... ...processing engines, event streaming platforms, and more Working... ...technology consulting company that leads with outcomes to bring more...Temporary workLocal area$100k - $115k
...we co-create custom software, data, AI, and cloud products with... ...intelligence into products, engineering systems that support learning... ...enterprise data warehouses. Streaming data platformsfor real-time ingestion... ...consulting company that leads with outcomes to bring more...Temporary workWork at officeFlexible hours- ...willing to be onsite at MacDill AFB. Description NSI requires a Data Engineer to support CENTCOM Headquarters Logistics Operating... ...lake. The architecture will leverage Apache Kafka for real-time streaming data and ETL frameworks such as Apache NiFi or Apache Airflow...Contract workTemporary workFlexible hours
$118.9k - $162.3k
...moves missions and the government forward! We are looking for a Data Engineer with strong hands‑on experience designing, developing, and... ...AI production systems Background in distributed systems, streaming platforms, or data mesh architectures Clearance An active TS...Live inWork at officeLocal area- NSI requires a Data Engineer to support CENTCOM Headquarters Logistics Operating Environment 3.0. You will design and implement high-throughput... ...systems into a centralized data lake using Kafka for streaming and NiFi/Airflow for ETL. Emphasis on data governance, encryption...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Lead Streaming Data Engineer. Be the first to apply!
