Big Data Engineer
Purple Drive
Overview: Job Title: Big Data Engineer Location: Atlanta, GA / Tampa, FL/ Dallas, TX Job Summary We are seeking an experienced Big Data Engineer to design, build, and optimize large-scale data pipelines and distributed systems across cloud and on-prem platforms. The ideal candidate will have strong expertise in Spark, Hadoop ecosystems, cloud data services, ETL/ELT design, streaming platforms , and best practices for scalable data processing. Responsibilities
- Design, develop, and maintain big data pipelines using Spark (PySpark/Scala), Hadoop, Kafka, and distributed computing frameworks.
- Build and optimize ETL/ELT pipelines for structured and unstructured data across cloud and on-prem data platforms.
- Work with cloud technologies (AWS, Azure, or GCP) including Data Lake, Databricks, EMR, Glue, Dataflow, Synapse, or Snowflake.
- Develop Delta Lake / Lakehouse architecture for high-performance ingestion and processing.
- Build real-time streaming solutions using Kafka, Spark Streaming, Kinesis, or Event Hub.
- Collaborate with data architects, analysts, and application teams to gather data requirements and deliver scalable solutions.
- Implement and maintain CI/CD pipelines , automated jobs, and orchestration using Airflow/Azure Data Factory/Glue Workflows.
- Optimize data pipelines for performance, cost efficiency, and reliability.
- Ensure data quality, validation, governance, and lineage best practices across the ecosystem.
- Troubleshoot and resolve production issues in a high-availability environment.
- 5-8+ years of experience as a Big Data Engineer or Data Engineer.
- Strong hands-on skills with Spark (PySpark or Scala), Hadoop, Hive, HDFS, MapReduce .
- Experience working with Databricks, EMR, Glue, Synapse, DataProc , or equivalent big-data compute engines.
- Proficiency in Python or Scala for data engineering.
- Experience with Kafka or other event-streaming technologies.
- Strong understanding of cloud data architectures (AWS S3/Glue/EMR | Azure ADLS/ADF/Databricks | GCP BigQuery/DataProc).
- Solid SQL skills and experience with relational + NoSQL databases.
- Experience with version control (Git) and CI/CD tools (Jenkins, Azure DevOps, GitHub Actions).
- Hands-on experience with Airflow , ADF, or other orchestration and scheduling tools.
- Familiarity with data modeling, data governance, and best practices for data quality.
Vacancy posted 1 day ago
Similar jobs that could be interesting for youBased on the Big Data Engineer in Tampa, FL vacancy
- Unlock your potential as a Data Engineer in a fully remote position, where you'll play a crucial role in advancing Big Data and Analytics initiatives.We are seeking a talented individual who is passionate about leveraging data to drive insights and innovation. In this role...Big dataRemote work
$50 - $60 per hour
...Title: Senior Big Data Engineer Location: Mississauga, ON Employment Type: Contract Compensation: Pay Range:$50.00-$60.00 Per HR Description Join our dynamic team as a Senior Big Data Engineer in a hybrid role based in Canada. This contract...Big dataContract workWork experience placementMitchell Martin
Tampa, FL3 days ago- Job Title: Data Engineer – MEM SQL Location: New Jersey / Irving, TX / Tampa, FL Job Description: We are looking for an experienced Data Engineer... ...with cloud platforms (AWS / Azure / GCP) Knowledge of Big Data technologies (Spark, Kafka, etc.) Telecom domain...Big data
Qode
Tampa, FL1 day ago - ...Job Title: Sr Data Engineer Work Location: Tampa, FL Duration: 8+ Months Job Description: • Data Management -BigQuery big data hive GCP components • In this role, you will be part of Trane Technologies' Data Engineering team, providing solutions and data...Big data
Ruri Software Technologies LLC
Tampa, FL9 hours ago - ...Strong hands-on experience in Python for data engineering and application development. Extensive experience with AWS cloud services, including... ...platformsStrong understanding of distributed computing and big data technologies. Experience with Docker, Kubernetes, and CI/...Big data
Purple Drive
Tampa, FL16 days ago - ...government services provider in Tampa is seeking a passionate Data Engineer to support data analytics initiatives. The ideal candidate will... ...data pipeline development, and proficiency in Python, SQL, and big data tools. This role involves working within Agile teams to drive...Big data
- Wipro is seeking a Data Engineer specialized in PySpark to join our data engineering team in Irving, TX. You will design and implement robust data pipelines in a Big Data environment, leveraging Hadoop ecosystem tools, Hive, HDFS, Spark, and Scala. The role emphasizes...Big data
- ...government services provider in Tampa, FL, seeks a passionate Data Engineer to enhance its Data Analytics and Business Intelligence platform... ...R, SQL, and SAS, as well as experience with ETL processes and big data analysis tools. Opportunities for professional growth and...Big data
- ...global technology consulting company is seeking a highly skilled Data Engineer in Tampa, Florida. The role involves designing, building, and... ...infrastructure and pipelines using Apache Spark, Java, and other big data technologies. Ideal candidates should possess at least a...Big data
$150k - $200k
Dark Wolf Solutions in Tampa, FL is seeking a Data Engineer to build and maintain data infrastructure powering AI/ML models on-site at MacDill... ...of data engineering, cloud experience, SQL, ETL tools, and big data tech. Bachelor’s degree required; TS clearance preferred....Big data$142.4k - $180k
Title:Big Data Systems EngineerBelong, Connect, Grow, with KBR!KBR’s National Security Solutions (NSS) team provides high-end engineering and advanced technology solutions to our customers in the intelligence and national security communities. In this position, your work...Big dataFull timeContract workTemporary workLocal areaRemote workWork from homeRelocation package$99k - $232k
...LevelManagerJob Description & SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques... ...languages such as Python, Java, or Scala- Familiarity with big data technologies like Hadoop, Spark, or Kafka is a plus-...Big dataFull timeH1b$60k - $135k
Job Description Role: Data Engineer - PySpark Location: Irving, TX (3 Days onsite/week) Key Responsibilities Strong programming skills in PySpark... ...with exceptional hands-on capabilities Familiarity with big data processing tools and techniques. Experience with the Hadoop...Big dataMinimum wageLocal area3 days per week- ...maintain BI solutions leveraging Microsoft’s data stack Apply industry best practices for... ...delivering enterprise-level BI or data engineering solutions Degree in Computer Science,... ...Fabric, Snowflake, or Azure Databricks for big data analytics Proficient in T-SQL and capable...Big dataFull time
- ...approach for managing an organization.Job DescriptionJob title: Cloud Engineer Location: Tampa, FL | Remotely for (Chicago, NYC, CT, Dallas or... ...a fast paced high performance team toprovide support for Cloud Data Services. The candidate will have the traditional skillset of a...Big dataFull timeRemote workFlexible hours
- ...Silverthorne Advisory Group is seeking a skilled and highly motivated Data Engineer to join an exciting and growing opportunity within the Defense... ...the accuracy and integrity of large datasets. Leverage big data technologies to efficiently process and analyze large datasets...Big dataWork from homeFlexible hours
$113.84k - $170.76k
...scalable, fault-tolerant batch and real-time data processing pipelines.Develop robust data... ...environment.ETL/ELT Transformation: Re-engineer existing stored procedures and complex legacy... ...between legacy outputs and new big data results.Schema Evolution: Map and transform...Big dataFull timeFlexible hours$112.6k - $152.81k
...: Business Intelligence CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence... ...to manipulate data (Python, R, SQL, SAS) Strong knowledge of big data analysis and storage tools and technologies Strong...Big dataFull timeFlexible hours$150k - $200k
Data Engineer job at Dark Wolf Solutions . Tampa, FL. Dark Wolf Solutions is seeking a driven and innovative Data Engineer to join our team... ...languages such as R, Python, or Javascript 1+ years experience using Big Data technologies and tools (e.g. Spark, Hadoop, Hive,...Big data- ...Technical Skills 2 Technology|Agentic AI|Agent Engineering Technical Skills 3 Domain|Telecom|Network Inventory... ...Technical Skills 4 Technology|Analytics - Packages|Python - Big Data Overview The Infosys Engineering unit is dedicated...Big dataFull timeTemporary workRelocation
Infosys
Tampa, FL4 days ago $100k - $115k
At Slalom, we co-create custom software, data, and cloud products with clients who are... ...drive true change. Our Data Architecture & Engineering team sees data as the foundation for... ...class solutions that inspire people to dream big and move faster. What You’ll Do As a...Big dataTemporary workLocal area- ...at scale. For more information, please visit Job Title: Sr. DATA Engineer Work Location Job Description Mandatory Karat Interview Role... ...AWS ecosystem The ideal candidate will have strong expertise in big data processing using PySpark and a deep understanding of data...Big dataTemporary workWork at officeLocal area
- ...Responsibilities Design, develop and maintain data pipelines using PySpark for large‑scale... ...‑cause analysis Work closely with data engineers, analysts, QA and DevOps teams in Agile... ...Self‑directed learning of new big‑data technologies and cloud data platforms...Big dataTemporary workLocal area
$141.44k - $212.16k
...are on a mission to harness the power of data to drive innovation, create exceptional customer... ...? We are looking for a Senior Data Engineering Lead to be a player-coach for our... ...Extensive hands-on experience with modern big data technologies and Data streaming (like...Big dataFull timeCitigroup Inc
Tampa, FL9 hours ago$113.84k - $170.76k
...Development, ProfessionalCompany: CitiCiti is looking for a Senior Big Data Developer to design, build, and scale high-performance data... ...-level role, you will lead the development of complex data engineering solutions, working closely with cross-functional technology teams...Big dataFull time- ...Doran Jones is looking for a Senior Software Engineer to leverage their engineering experience... ...best practices in software development, data engineering, and cloud computing. Support... ...technologies and industry trends in big data and cloud computing to drive innovation...Big dataFull timeWork at office2 days per week3 days per week
Doran Jones Inc.
Tampa, FL1 day ago $60 - $65 per hour
Rose International in Tampa, FL seeks a Python AI and ML Engineer for a hybrid contract role. Three days onsite and two remote, six months, USD 60-65/hour. You will lead design and implementation of Python-based frameworks, build AI agents and autonomous workflows, and...Big dataContract workRemote work$99k - $225k
Data Engineer, SeniorThe Opportunity: Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there’s more structured and unstructured data available today than ever before. As a data engineer, you know that organizing data can yield...Full timeContract workPart timeWork at officeLocal areaRemote work$116.2k - $229.1k
Position Summary Join our AI & Engineering team in transforming technology platforms, driving innovation, and helping make a significant... ...operate integrated/verticalized sector solutions in software, data, AI, network, and hybrid cloud infrastructure. These solutions...Local areaVisa sponsorship- ...strategies and memory settings to meet SLAsSeeking an experienced Ab Initio Python Developer with strong expertise in ETL development data integration and enterprise data processing The candidate will be responsible for designing, supporting and optimizing largescale...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Big Data Engineer. Be the first to apply!
Related searches
- aws data engineer Tampa, FL
- big data devops engineer Tampa, FL
- big data developer Tampa, FL
- software data engineer Tampa, FL
- data center engineer Tampa, FL
- big data cloud engineer Tampa, FL
- director data engineering Tampa, FL
- hadoop big data developer Tampa, FL
- big data engineer Tampa, FL
- senior data integration developer Tampa, FL