Big Data Engineer
Purple Drive
Overview: Job Title: Big Data Engineer Location: Atlanta, GA / Tampa, FL/ Dallas, TX Job Summary We are seeking an experienced Big Data Engineer to design, build, and optimize large-scale data pipelines and distributed systems across cloud and on-prem platforms. The ideal candidate will have strong expertise in Spark, Hadoop ecosystems, cloud data services, ETL/ELT design, streaming platforms , and best practices for scalable data processing. Responsibilities
- Design, develop, and maintain big data pipelines using Spark (PySpark/Scala), Hadoop, Kafka, and distributed computing frameworks.
- Build and optimize ETL/ELT pipelines for structured and unstructured data across cloud and on-prem data platforms.
- Work with cloud technologies (AWS, Azure, or GCP) including Data Lake, Databricks, EMR, Glue, Dataflow, Synapse, or Snowflake.
- Develop Delta Lake / Lakehouse architecture for high-performance ingestion and processing.
- Build real-time streaming solutions using Kafka, Spark Streaming, Kinesis, or Event Hub.
- Collaborate with data architects, analysts, and application teams to gather data requirements and deliver scalable solutions.
- Implement and maintain CI/CD pipelines , automated jobs, and orchestration using Airflow/Azure Data Factory/Glue Workflows.
- Optimize data pipelines for performance, cost efficiency, and reliability.
- Ensure data quality, validation, governance, and lineage best practices across the ecosystem.
- Troubleshoot and resolve production issues in a high-availability environment.
- 5-8+ years of experience as a Big Data Engineer or Data Engineer.
- Strong hands-on skills with Spark (PySpark or Scala), Hadoop, Hive, HDFS, MapReduce .
- Experience working with Databricks, EMR, Glue, Synapse, DataProc , or equivalent big-data compute engines.
- Proficiency in Python or Scala for data engineering.
- Experience with Kafka or other event-streaming technologies.
- Strong understanding of cloud data architectures (AWS S3/Glue/EMR | Azure ADLS/ADF/Databricks | GCP BigQuery/DataProc).
- Solid SQL skills and experience with relational + NoSQL databases.
- Experience with version control (Git) and CI/CD tools (Jenkins, Azure DevOps, GitHub Actions).
- Hands-on experience with Airflow , ADF, or other orchestration and scheduling tools.
- Familiarity with data modeling, data governance, and best practices for data quality.
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Tampa, FL vacancy
- ...Big Data Engineer City :Tampa State :FL Job Description : TOP REQUIREMENTS: Big Data (Spark, Scala, Hive, Hadoop Ecosystem) Data Streaming (Kafka) Responsibilities Building and supporting a cloud based analytical platform...Big data
Ruri Software Technologies LLC
Tampa, FL8 hours ago - ...Responsibilities Data Architecture: Design and implement scalable, robust, and efficient data architectures, including data lakes,... ...functional teams, including data scientists, analysts, software engineers, and business stakeholders, to understand data requirements and...Big data
Doran Jones Inc
Tampa, FL3 days ago - Job Title: Sr. DATA EngineerWork Location : Tampa FLJob Description:Seeking a Senior professional... ...SQL to design and optimize scalable big data processing solutions within the... ...and data pipelines Collaborate with data engineers’ data scientists and stakeholders to translate...Big data
- Job Title: DATA Engineer Work LocationTampa FLJob Description:Mandatory Karat Interview Role Overview We are seeking a highly skilled and motivated... ...ecosystem The ideal candidate will have strong expertise in big data processing using PySpark and a deep understanding of data...Big data
- ...5Post ID: 123357Location: Tampa, Florida, USPosted: 2026-02-14Unlock your potential as a Data Engineer in a fully remote position, where you'll play a crucial role in advancing Big Data and Analytics initiatives.We are seeking a talented individual who is passionate about...Big dataRemote work
- ...Tampa, FloridaDesign develop and maintain data pipelines using PySpark for largescale... ...root cause analysisWork closely with data engineers analysts QA and DevOps teams in Agile delivery... ...management 712 years of experience in Big Data Data Engineering rolesStrong handson...Big data
- Job Title: Data Engineer – MEM SQL Location: New Jersey / Irving, TX / Tampa, FL Job Description: We are looking for an experienced Data Engineer... ...with cloud platforms (AWS / Azure / GCP) Knowledge of Big Data technologies (Spark, Kafka, etc.) Telecom domain...Big data
Qode
Tampa, FL5 days ago - ...Job Title: Sr Data Engineer Work Location: Tampa, FL Duration: 8+ Months Job Description: • Data Management -BigQuery big data hive GCP components • In this role, you will be part of Trane Technologies' Data Engineering team, providing solutions and data...Big data
Ruri Software Technologies LLC
Tampa, FL10 hours ago - ...maintain BI solutions leveraging Microsoft’s data stack Apply industry best practices for... ...delivering enterprise-level BI or data engineering solutions Degree in Computer Science, Engineering... ..., Snowflake, or Azure Databricks for big data analytics Proficient in T-SQL and...Big dataFull time
The Phoenix Group
Tampa, FL5 days ago - ...Data Engineer (Python + React, Healthcare Domain)We are seeking a Data Engineer with strong experience in Python and React to build and maintain... ...(HIPAA, security-sensitive systems)Experience with big data technologies and distributed processing systemsExperience...Big data
Inizio Partners
Tampa, FL4 days ago - ...Silverthorne Advisory Group is seeking a skilled and highly motivated Data Engineer to join an exciting and growing opportunity within the Defense... ...the accuracy and integrity of large datasets. Leverage big data technologies to efficiently process and analyze large datasets...Big dataWork from homeFlexible hours
Silverthorne Advisory Group LLC
Tampa, FL4 days ago - ...government services provider in Tampa is seeking a passionate Data Engineer to support data analytics initiatives. The ideal candidate will... ...data pipeline development, and proficiency in Python, SQL, and big data tools. This role involves working within Agile teams to drive...Big data
- Wipro is seeking a Data Engineer specialized in PySpark to join our data engineering team in Irving, TX. You will design and implement robust data pipelines in a Big Data environment, leveraging Hadoop ecosystem tools, Hive, HDFS, Spark, and Scala. The role emphasizes...Big data
$77k - $180k
...Department of Defense (DoD) to transform data into actionable intelligence, ensuring mission... .... Our mission-first software and data engineering platform modernizes data operations,... ...optimizing the performance of NoSQL and or big data infrastructure. Create and maintain...Big dataWork experience placementSocket
Tampa, FL3 days ago- ...Data Engineer Employment Type: Full-Time, Mid-level CGS is seeking a passionate and driven Data Engineer to support a rapidly growing... ...manipulate data (Python, R, SQL, SAS). ~ Strong knowledge of big data analysis and storage tools and technologies. ~ Strong understanding...Big dataFull timeFlexible hours
Contact Government Services LLC
Tampa, FL2 days ago - ...government services provider in Tampa, FL, seeks a passionate Data Engineer to enhance its Data Analytics and Business Intelligence platform... ...R, SQL, and SAS, as well as experience with ETL processes and big data analysis tools. Opportunities for professional growth and...Big data
$150k - $200k
Dark Wolf Solutions in Tampa, FL is seeking a Data Engineer to build and maintain data infrastructure powering AI/ML models on-site at MacDill... ...of data engineering, cloud experience, SQL, ETL tools, and big data tech. Bachelor’s degree required; TS clearance preferred....Big data- ...Title: Data Engineer Company: Peoples Gas System State and City: Florida - Tampa Shift: 8 Hr. X 5 Days WHO WE ARE? Peoples Gas System is the... ...functions. Demonstrated competence with cloud storage, cloud tools and Big Data. WHO WILL BE A PART OF YOUR TEAM? Staff augmentation,...Big dataFor contractorsWork experience placementShift work
New Mexico Gas Co - Peoples Gas - Tampa Electric
Tampa, FL2 days ago - ...with free counseling, legal, and financial services. NowHiring:Data Engineer We’relookingfora Data Engineer to lead the design, development,... ...lakes, and data warehouses in Azure. Use Azure Databricks for big data transformations & analytics. Optimize SQL queries, stored...Big dataFull timeTemporary workPart timeRemote work
GrabJobs
Tampa, FL3 days ago $142.4k - $180k
Title:Big Data Systems EngineerBelong, Connect, Grow, with KBR!KBR’s National Security Solutions (NSS) team provides high-end engineering and advanced technology solutions to our customers in the intelligence and national security communities. In this position, your work...Big dataFull timeContract workTemporary workLocal areaRemote workWork from homeRelocation package$60k - $135k
Job Description Role: Data Engineer - PySpark Location: Irving, TX (3 Days onsite/week) Key Responsibilities Strong programming skills in PySpark... ...with exceptional hands-on capabilities Familiarity with big data processing tools and techniques. Experience with the Hadoop...Big dataMinimum wageLocal area3 days per week- ...Strong hands-on experience in Python for data engineering and application development. Extensive experience with AWS cloud services, including... ...platformsStrong understanding of distributed computing and big data technologies. Experience with Docker, Kubernetes, and CI/...Big data
Purple Drive
Tampa, FLa month ago - SpatialGIS is seeking a motivated Data Engineer to join our technical team. Core Responsibilities Design, build, and evolve scalable data... ...clearance (or higher) Experience with BI tools, cloud platforms, and big data technologies; proficiency in SQL, Python, and/or Scala...Big dataFull timeInterim role
$150k - $200k
Data Engineer job at Dark Wolf Solutions . Tampa, FL. Dark Wolf Solutions is seeking a driven and innovative Data Engineer to join our team... ...languages such as R, Python, or Javascript 1+ years experience using Big Data technologies and tools (e.g. Spark, Hadoop, Hive,...Big data$75k - $85k
...Spark, Scala,SQL ,Hive, Impala, Hadoop, Splunk, Autosys . 3. Data Analysis and Data Wrangling skills when dealing with Huge Volume.... ...analysis, troubleshooting and resolution including Cloudera Big Data eco system. 5. Experience with Linux-based infrastructures...Big dataFlexible hoursTata Consultancy Services
Tampa, FL3 days ago- ...approach for managing an organization.Job DescriptionJob title: Cloud Engineer Location: Tampa, FL | Remotely for (Chicago, NYC, CT, Dallas or... ...a fast paced high performance team toprovide support for Cloud Data Services. The candidate will have the traditional skillset of a...Big dataFull timeRemote workFlexible hours
$100k - $115k
At Slalom, we co-create custom software, data, and cloud products with clients who are... ...drive true change. Our Data Architecture & Engineering team sees data as the foundation for... ...class solutions that inspire people to dream big and move faster. What You’ll Do As a...Big dataTemporary workLocal area$100k - $115k
At Slalom we co-create custom software, data, AI, and cloud products with clients who are... ...on injecting intelligence into products, engineering systems that support learning and insight... ..., secure, cloud-native platforms. Big Data Platforms (Dataproc, Apache Spark) GoogleBigQuery...Big dataTemporary workWork at officeFlexible hours$113.84k - $170.76k
...scalable, fault-tolerant batch and real-time data processing pipelines.Develop robust data... ...environment.ETL/ELT Transformation: Re-engineer existing stored procedures and complex legacy... ...between legacy outputs and new big data results.Schema Evolution: Map and transform...Big dataFull timeFlexible hours- ...Big Data DeveloperExecutes highly complex functional work tracks for the team. Drives the execution of operational/technical objectives for business solutions using Java and Hadoop skills. Partners closely with peers in the department to ensure holistic Big Data solutions...Big data
ClifyX
Tampa, FL4 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- aws data engineer Tampa, FL
- data science developer Tampa, FL
- sr information security engineer Tampa, FL
- senior data engineer Tampa, FL
- data engineer machine learning Tampa, FL
- junior data engineer remote Tampa, FL
- data center engineer Tampa, FL
- data developer Tampa, FL
- senior data center engineer Tampa, FL
- big data developer Tampa, FL