Tech Lead - Data Engineering - Tampa
$52k - $182kPhoton
Job Description
Key Responsibilities:
- Optimize and tune Spark applications for better performance on large-scale data sets.
- Work with the Cloudera Hadoop ecosystem (e.g., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions.
- Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions.
- Design and implement high-performance data processing and analytics solutions.
- Ensure data integrity, accuracy, and security across all processing tasks.
- Troubleshoot and resolve performance issues in Spark, Cloudera, and related technologies.
- Implement version control and CI/CD pipelines for Spark applications.
Required Skills & Experience:
- Minimum 10+ years of experience in application development.
- Strong hands on experience in Apache Spark, Scala, and Spark SQL for distributed data processing.
- Hands-on experience with Cloudera Hadoop (CDH) components such as HDFS, Hive, Impala, HBase, Kafka, and Sqoop.
- Familiarity with other Big Data technologies, including Apache Kafka, Flume, Oozie, and Nifi.
- Experience building and optimizing ETL pipelines using Spark and working with structured and unstructured data.
- Experience with SQL and NoSQL databases such as HBase, Hive, and PostgreSQL.
- Knowledge of data warehousing concepts, dimensional modeling, and data lakes.
- Ability to troubleshoot and optimize Spark and Cloudera platform performance.
- Familiarity with version control tools like Git and CI/CD tools (e.g., Jenkins, GitLab).
Compensation, Benefits and Duration
Minimum Compensation: USD 52,000Maximum Compensation: USD 182,000Compensation is based on actual experience and qualifications of the candidate. The above is a reasonable and a good faith estimate for the role.Medical, vision, and dental benefits, 401k retirement plan, variable pay/incentives, paid time off, and paid holidays are available for full time employees.This position is not available for independent contractorsNo applications will be considered if received more than 120 days after the date of this post
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Tech Lead - Data Engineering - Tampa in Washington DC vacancy
$143k - $215k
Freddie Mac is seeking a Tech Lead Data Engineer to build data platforms and enhance business processes through cloud technology. This role focuses on architectural support in data science and involves working with large-scale data integration, ensuring effective data pipeline...Suggested$58 per hour
...Position: Lead Data Engineer Location: Bellevue, WA Duration: 6 Months Work Type: Hybrid Payrate:$ 58.00 - 58.00/hr. Overview: TekWissen is a global workforce management provider headquartered in Ann Arbor, Michigan that offers strategic talent solutions...SuggestedTekWissen ®
Washington DC7 hours ago- 6AM City, LLC is seeking a skilled Data Engineer to design and develop scalable data pipelines in Washington, D.C. You will collaborate with teams to ensure data quality and reliability, utilizing skills in Azure Synapse, PySpark, and SQL. This role offers the chance to...Suggested
- ...Technical Lead At LMI, we're reimagining the path from insight to outcome at The New... ...for guiding a team that delivers modern data pipelines and advanced analytics in support... ...oversee a multidisciplinary team of data engineers and data scientists. Collaborate with...Suggested
LMI
Washington DC3 days ago - ...About Infinitive Infinitive is a data and AI consultancy that enables its clients to modernize and operationalize their data... ...Work. Position Overview Infinitive is seeking a Senior / Lead Data Engineer to join our team. In this role, you will act as a critical bridge...Suggested
Infinitive
Washington DC2 days ago - ...Overview BigBear.ai is seeking a Lead Data Engineer to support one of our customer. This position will be based out of Washington, D.C. and will offer remote flexibility. You will be joining our amazing BigBear.ai team to provide development for legacy...Temporary workRemote work
BigBear Inc
Washington DC3 days ago - ...Lead Data & AI Security Engineer Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments...Full timePart timeWorldwideFlexible hours
Dynamic Yield
Arlington, VA3 days ago - ...Job Description Job Description Overview BigBear.ai is seeking a Lead Data Engineer to support one of our customer. This position will be based out of Washington, D.C. and will offer remote flexibility. You will be joining our amazing BigBear.ai team to...Temporary workRemote work
Bigbear.ai
Washington DC14 days ago - ...HeadSpace membership, as well as access to TalkSpace and mental health coverage through our medical plans. Overview Lead Data Engineers at Excella drive the architecture, development, and optimization of data solutions, ensuring they align with business goals...Work from homeHome officeFlexible hours
Excella Consulting
Arlington, VA7 hours ago - A leading technology firm is seeking a Project Manager to lead complex data linkage initiatives in healthcare for Federal projects. You will manage data security, optimize algorithms, and ensure compliance with Federal standards. Ideal candidates possess over 5 years of...Remote job
- Humana Inc in Washington is seeking a Lead Data Engineer for the Risk Adjustment and Stars Analytics team. This role entails designing and optimizing data pipelines, ensuring effective collaboration across teams to deliver data solutions that meet business needs. The ideal...Remote job
$99k - $225k
Phase2 Technology in Washington, D.C. is seeking a Project Manager with expertise in healthcare data linkage. The role involves overseeing complex datasets, ensuring compliance with Federal standards, and developing algorithms to optimize linkage accuracy. Candidates should...Remote job- Bigbear.ai is seeking a Lead Data Engineer to support one of our customers in Washington, D.C., with some remote flexibility. You will manage complex assignments, contribute to performance metrics, and function as a technical expert across multiple projects. Candidates...Remote job
- Ex Parte provides our customers with the data and insight to make smart and informed decisions... ...for talented, enthusiastic senior data engineers who share our passion for big data, AI,... ...League Baseball. Job Description You’ll lead a team that owns the AI self-service...
- HiLabs is looking for highly motivated and technically strong Lead Data Engineers with deep expertise in Big Data platforms and a passion for... ...institutes including Harvard, Yale, Carnegie Mellon, Duke, Georgia Tech, Indian Institute of Management, and Indian Institute of...RelocationRelocation package
$151.5k - $252.5k
Relha LLC in Arlington, Virginia, is seeking a Lead Data Engineer II to manage transformative data initiatives using the Databricks platform. You will lead teams, build client relationships, and design solutions that drive business value. The ideal candidate has 7+ years...- Accenture-Federal-Services-2 is looking for a Data Engineering Lead in Arlington, Virginia. This role involves leading a team of data engineers and driving the technical strategy for a robust data pipeline ecosystem. The ideal candidate will have over 10 years of experience...
$67k - $136.8k
...around this simple story. The opportunity As an FSO DevOps Engineer Senior Analyst, you’ll be based in our Service Delivery Center,... ..., while building trust in capital markets. Enabled by data, AI and advanced technology, EY teams help clients shape the future...Summer holidayFlexible hoursEY
Washington DC4 days ago$110k - $160k
...highly skilled Database and Dashboard Developer with strong expertise in extract cloud asset data, RDBMS (ex: Postgres, Redshift), Python and AWS to support enterprise data engineering, analytics, and reporting initiatives. This role combines responsibilities across...Full timePart timeSunTrust Investment Services, Inc.
Washington DC3 days ago$142.3k - $195.7k
...Become a part of our caring community The Lead Data Engineer oversees data processing architectures and solutions ensuring the efficient conversion of structured and unstructured data to insights at enterprise scale. You will work on problems of diverse scope and complexity...Full timeTemporary workApprenticeshipRemote workCenterWell
Washington DC3 days ago$131.3k - $237.35k
...Leidos! We are currently seeking a Technical Lead to join the Compartmented Enterprise... ...is 100% on-site. Primary Responsibilities Engineering Experience in working on teams utilizing... ...development and integration of secure APIs, data pipelines (structured/unstructured)...Temporary workWork at office$138k - $170k
BDO USA is seeking a Lead Data Engineer in Washington, D.C., to drive technical designs for data solutions that enhance operational efficiencies. The ideal candidate should have extensive experience in data engineering, particularly with tools like PowerBI and Tableau....Remote job- Silverthorne Advisory Group is looking for a Talent Acquisition Specialist to oversee recruitment processes in Virginia. This position involves managing full-cycle recruitment across various roles, collaborating closely with hiring managers, and building candidate pipelines...Remote job
$100k - $160k
...JOB TITLE: Senior Data Engineer (Secret Clearance Required) LOCATION: DC Metro Area, Fayetteville NC, Tampa FL DURATION: Permanent SALARY RANGE: $100K - $160K POSITION SUMMARY: Ever-expanding technology like IoT, machine learning, and artificial...Hourly payPermanent employmentFull timeUrsus Inc
Washington DC1 day ago- A cutting-edge healthcare data platform company is seeking a Lead Data Engineer with expertise in Big Data technologies. This role involves leading the end-to-end design of data platforms, and building scalable systems using Spark and PySpark. Candidates should have 6 to...
$110.4k - $190.9k
The Federal Reserve System is seeking a Data Engineer to focus on modernizing technical infrastructure and leveraging nontraditional data. This role will be pivotal in supporting critical statistical releases and improving data management systems. Ideal candidates will...Work at office- Leidos LLC is seeking a Cyber Security Engineer—Technical Lead in Bethesda, Maryland. This role involves protecting information systems from cyber threats by leading technical engineering work. The successful candidate will manage security controls, conduct assessments,...Flexible hours
- A government-focused tech firm in Virginia seeks a Tech Lead / Full-Stack Engineer to modernize a Python/React application for a high-visibility Department of War program. The role requires active DoD Secret clearance and strong experience in Python backend and React frontend...Remote jobFlexible hours
- ...Job Description Job Description We’re seeking an AI/ML Engineer & Data Scientist to build ML solutions, develop scalable data pipelines, and improve information discovery and decision‐making. You’ll work with structured and unstructured data, support digitization...Contract workLocal area
Azulo LLC
Washington DC10 days ago - Capital One is looking for a Senior Lead Data Engineer in McLean, VA to spearhead data projects using Python, AWS, and Snowflake. You will collaborate with Agile teams to create innovative solutions that address real business challenges and enhance customer experiences...
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Tech Lead - Data Engineering - Tampa. Be the first to apply!
Related searches