Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Senior Data Engineer

LTM

Role description

Job Title: DATA Engineer


Work Location

Tampa FL

Job Description:

Mandatory Karat Interview


Role Overview

  • We are seeking a highly skilled and motivated AWS Certified Engineer to design build and optimize scalable data solutions within the Amazon Web Services AWS ecosystem
  • The ideal candidate will have strong expertise in big data processing using PySpark and a deep understanding of data warehousing concepts including Hive and modern table formats like Iceberg
  • This role involves developing deploying and managing robust efficient and secure data pipelines and analytics solutions on AWS leveraging core networking and compute services
Core Responsibilities
  • AWS Solution Design Implementation Design develop and deploy scalable and costeffective data solutions on AWS leveraging services such as S3 for data lakes EC2 EMR Glue Athena Lambda Redshift and Kinesis
  • Data Pipeline Development Build and maintain robust ETLELT data pipelines using PySpark for data ingestion transformation and loading into various data stores including those utilizing open table formats like Iceberg
  • Big Data Processing Develop and optimize big data processing jobs using PySpark on AWS EMR or AWS Glue handling large datasets efficiently and integrating with Iceberg table formats
  • Data Warehousing Design implement and manage data warehousing solutions including schema design data modeling and query optimization with a focus on Hive and modern data lake table formats like Iceberg for historical data and analytical queries
  • Cloud Infrastructure Networking Implement secure and robust cloud infrastructure components including VPCs subnets routing and security groups to ensure proper connectivity and isolation for data solutions
  • Containerized Workloads Design deploy and manage containerized data processing applications on Amazon Elastic Kubernetes Service EKSPerformance Tuning Optimization Optimize AWS resources and big data applications Spark Hive Iceberg for performance cost and efficiency
  • Data Governance Security Implement best practices for data security access control and compliance within AWS including IAM policies S3 bucket policies and encryption
  • Monitoring Troubleshooting Set up monitoring ing and logging for data pipelines and AWS infrastructure troubleshoot and resolve issues promptly
  • Automation Develop and maintain automation scripts using Python and shell scripting for infrastructure provisioning deployment and operational tasks
  • Collaboration Work closely with data scientists analysts and other engineering teams to understand data requirements and deliver reliable data solutions
Required Skills Qualifications
  • AWS Certification Hold at least one AWS certification eg AWS Certified Solutions Architect Associate AWS Certified Data Analytics Specialty AWS Certified Developer Associate
  • AWS Services Expertise Handson experience with key AWS services for data processing and storage including
  • Storage S3 for data lakes EC2
  • Data Processing EMR Glue Athena Lambda
  • Networking VPC Subnets Routing Security Groups
  • Containerization EKS
  • Big Data Processing Strong proficiency in PySpark for developing complex data transformations and analytics
  • Data Lake Table Formats Practical experience with Apache Iceberg for managing and querying data lakes
  • Data Warehousing Indepth knowledge and practical experience with Apache Hive for data storage querying and schema management
  • Programming Languages
  • Python Expert level proficiency in Python for scripting data manipulation and AWS automation Boto3
  • Shell Scripting Proficient in shell scripting for automation and operational tasks
  • Database SQL Strong SQL skills for data querying and manipulation
  • Data Concepts Solid understanding of ETLELT processes data modeling distributed computing and data governance
Good to Have Skills
  • Containerization Orchestration Experience with Kubernetes for deploying and managing containerized applications
  • CICD Experience with CICD tools and practices eg AWS CodePipeline GitHub Actions GitLab CI for automating deployment of data solutions
  • Orchestration Experience with workflow orchestration tools like Apache Airflow
  • Version Control Proficient in using Git for source code management
  • Other Big Data Technologies Exposure to other big data technologies like Apache Kafka Flink or Presto
Certifications
  • AWS Certified Solutions Architect Associate Professional
  • AWS Certified Data Analytics Specialty
  • AWS Certified Developer Associate
Vacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Tampa, FL vacancy
  •  ...DeveloperWork Location : Tampa, FloridaJob SummarySeeking an experienced Ab Initio Python Developer with strong expertise in ETL development data integration and enterprise data processing The candidate will be responsible for designing developing supporting and optimizing... 
    Senior

    LTM

    Tampa, FL
    6 hours ago
  •  ...award of contract**SOS International LLC (SOSi) is seeking a Data Engineer (C4ISR Architecture) to support our customer in McDill AFB, Florida...  ...Department of Education and an additional 5 years of related senior experience, for a total of 17 years, as a substitute to the... 
    Senior
    Contract work
    Work at office
    Worldwide

    SOSi

    Tampa, FL
    3 days ago
  • Req ID:371514NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want...  ...-thinking organization, apply now.We are currently seeking a Senior Data Engineer to join our team in Tampa, Florida (US-FL), United States (US... 
    Senior
    Work at office
    Remote work
    Flexible hours

    NTT DATA

    Tampa, FL
    6 hours ago
  • $128k - $252.5k

     ...programs that transform our clients' businesses. We are hiring a Senior Data Scientist to collaborate directly with clients to design and...  ....Working with a team of interdisciplinary data scientists, engineers, architects, and consultants, our work includes novel areas such... 
    Senior
    Local area

    Deloitte

    Tampa, FL
    2 days ago
  • $99k - $225k

    Data Engineer, SeniorThe Opportunity: Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there’s...  ...fraud detection to cancer research to national intelligence. As a senior engineer, you know that machine learning is critical to... 
    Senior
    Full time
    Contract work
    Part time
    Work at office
    Local area
    Remote work

    Booz Allen Hamilton

    Tampa, FL
    3 days ago
  • $77k - $202k

     ...LevelSenior AssociateJob Description & SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques...  ...and implement thorough data architecture strategies. As a Senior Associate you analyze complex problems, mentor others, and... 
    Senior
    Full time
    H1b

    PwC

    Tampa, FL
    3 days ago
  •  ...established and growing capabilities across Intelligence, Analytics, Engineering, Mission Support, and Communications disciplines. Founded in...  ...challenges. Join our team.Barbaricum is currently seeking a Senior Data Security Engineer (Data Rights Management) to serve as a... 
    Senior
    For contractors
    Work at office

    Barbaricum

    Tampa, FL
    3 days ago
  •  ...Senior Data Engineer Location: Bethesda 5x Onsite Duration: 6-month CTH Partner with Data Services product owners, data engineers, data scientists, and BI developers to deliver data modeling, data quality, and overall data warehousing requirements in support... 
    Senior

    RIT Solutions

    Tampa, FL
    2 days ago
  •  ...Position: Senior Data Engineer Location: 217 Broadway, 8th Floor, New York, NY 10007, US Work Auth: Not open to sponsorship Pay rate: $65-75 w2 max | max: $70/hr on c2c Duration: 6 months + Visa-USC/GC Hybrid or Remote?: Remote... 
    Senior
    For contractors
    Remote work

    RIT Solutions, Inc.

    Tampa, FL
    1 day ago
  •  ...to grow, make an impact, and work with people who care, we'd love to meet you! ABOUT THE ROLE We are looking for a Senior Data Engineer to design and build scalable data lakes, warehouses, and lakehouse architectures supporting a thematic research platform that... 
    Senior
    Work at office
    Remote work
    Visa sponsorship
    Work visa
    Flexible hours

    AgileEngine

    Tampa, FL
    5 days ago
  •  ...infrastructure capabilities to meet client needs and implementing data standards and governance.Pay and Benefits:Competitive...  ...team or employee).The Impact You Will Have in This RoleAs a Senior Software Engineer within Enterprise Cloud Services, you will design, build, and... 
    Senior
    Remote work
    Flexible hours

    DTCC- The Depository Trust & Clearing Corporation

    Tampa, FL
    3 days ago
  • $124k - $280k

     ...LevelSenior ManagerJob Description & SummaryAt PwC, our people in data and analytics engineering focus on leveraging advanced technologies and techniques...  ...that meet current and future business needs. As a Senior Manager you lead large projects, innovate processes, and maintain... 
    Senior
    Full time
    H1b

    PwC

    Tampa, FL
    3 days ago
  • $137.53k - $166.65k

     ...Senior Data Engineer Working with Us Challenging. Meaningful. Life-changing. Those aren't words that are usually associated with a job. But working at Bristol Myers Squibb is anything but usual. Here, uniquely interesting work happens every day, in every department... 
    Senior
    Hourly pay
    Full time
    Temporary work
    Part time
    For contractors
    Summer work
    Work at office
    Remote work
    Flexible hours
    Shift work

    Bristol-Myers Squibb

    Tampa, FL
    4 days ago
  • $127.2k - $228.96k

     ...Senior Data Engineer Hybrid 1: This role requires associates to be in-office 1 - 2 days per week, fostering collaboration and connectivity, while providing flexibility to support productivity and work-life balance. This approach combines structured office engagement with... 
    Senior
    Temporary work
    Work experience placement
    Work at office
    Local area
    2 days per week
    1 day per week

    Elevance Health

    Tampa, FL
    4 days ago
  • A government services company is seeking an experienced CommVault Systems Engineer in Tampa, Florida. This role involves designing, implementing, and supporting backup and recovery solutions for a federal environment. Ideal candidates should have a strong background in... 
    Senior

    CGS Federal (Contact Government Services)

    Tampa, FL
    1 day ago
  • A technology services company is seeking a Senior Data Engineer to create scalable ETL pipelines and work with vast datasets. The role requires strong Python and SQL skills, along with experience in tools like PySpark and AWS. This full-time position is remote, offering... 
    Senior
    Remote job
    Full time

    Lumenalta

    Tampa, FL
    3 days ago
  • $77k - $202k

     ...LevelSenior AssociateJob Description & SummaryAt PwC, our people in data and analytics focus on leveraging data to drive insights and...  ...solutions to build and manage the advanced Data ecosystem. As a Senior Associate you are responsible for analyzing complex problems, mentoring... 
    Senior
    Full time
    H1b

    PwC

    Tampa, FL
    2 days ago
  • $130k - $150k

    Senior Data Engineer 100% Remote Senior Data Solutions Engineer / Lead Data Engineer Needed for Industry-Leader! This Jobot Job is hosted by: Reed Kellick Are you a fit? Easy Apply now by clicking the "Apply Now" button and sending us your resume. Salary: $130,000 -... 
    Senior
    Local area
    Remote work
    Work from home

    Jobs via Dice

    Tampa, FL
    3 days ago
  •  ...maintain BI solutions leveraging Microsoft’s data stack Apply industry best practices for...  ...delivering enterprise-level BI or data engineering solutions Degree in Computer Science,...  ...with colleagues across departments and seniority levels Able to operate independently... 
    Senior
    Full time

    The Phoenix Group

    Tampa, FL
    3 days ago
  • Senior Data Engineer at Moffitt Cancer Center in Tampa, FL (onsite) will design, deploy, and maintain data ingestion, transformation, and maintenance pipelines to support enterprise data needs across cloud and on-prem environments, with a focus on automation and self-service... 
    Senior

    Moffitt Cancer Center

    Tampa, FL
    5 days ago
  •  ...A leading technology company is seeking an experienced Data Engineer to join its team. This role focuses on designing and optimizing scalable data pipelines, primarily using MEM SQL (SingleStore). The ideal candidate will possess strong SQL skills, experience with ETL... 
    Senior

    QODE

    Tampa, FL
    2 days ago
  •  ...established and growing capabilities across Intelligence, Analytics, Engineering, Mission Support, and Communications disciplines. Founded in...  ...rewarding challenges. Join our team.Barbaricum is seeking a Senior Data Security Engineer (DRM Specialist) to support a Zero Trust... 
    Senior
    For contractors

    Barbaricum

    Tampa, FL
    2 days ago
  • Seeking an experienced Ab Initio Python Developer with strong expertise in ETL development data integration and enterprise data processing The candidate will be responsible for designing developing supporting and optimizing largescale data integration solutions Design... 
    Senior
    Temporary work
    Local area

    LTM

    Tampa, FL
    2 days ago
  • $124k - $280k

    Industry/SectorNot ApplicableSpecialismManaged ServicesManagement LevelSenior ManagerJob Description & SummaryThe OpportunityAs a Senior Data Engineer - Senior Manager, you will leverage data and analytics to provide strategic insights and drive informed decision-making for... 
    Senior
    Full time
    H1b

    PwC

    Tampa, FL
    3 days ago
  • $145.64k - $155.64k

     ...generate operational alerts, and enable self-service analysis; define data requirements, optimize analytical workflows, and translate...  ..., accurate, and reliable enterprise reporting. Data Pipeline Engineering & Data Integration (30%): Design, build, and maintain scalable... 
    Senior
    Remote work
    Worldwide

    Fanatics Commerce

    Tampa, FL
    2 days ago
  •  ...Service Delivery Center, AI & Data, Machine Learning Engineer (MLE) - Senior Location: Manayunk Other locations: Anywhere in Region Salary: Competitive At EY, we're all in to shape your future with confidence. We'll help you succeed in a globally connected powerhouse... 
    Senior

    EY

    Tampa, FL
    4 days ago
  •  ...Baker Tilly US is seeking a Senior Consultant – Associate Data Engineer in Tampa, Florida. This role involves designing and optimizing data solutions primarily using the Microsoft stack including Azure and Synapse. You'll collaborate with architects and stakeholders to... 
    Senior

    Baker Tilly US

    Tampa, FL
    5 days ago
  •  ...experienced Epic Analytics and Reporting Engineer you will have the ability to share new ideas...  ..., Caboodle and either in EPIC Clinical Data Model or Revenue Data Model modules with...  ...development From entry-level employees to senior leaders, we believe there’s always room... 
    Senior
    Work experience placement

    Deloitte

    Tampa, FL
    2 days ago
  • $99k - $232k

     ...ApplicableSpecialismManaged ServicesManagement LevelManagerJob Description & SummaryThe OpportunityAs a Managed Services - Senior Data Engineer - Manager, you will leverage data and analytics to provide strategic insights and drive informed decision-making for clients... 
    Senior
    Full time
    H1b

    PwC

    Tampa, FL
    4 days ago
  • $155.6k - $306.8k

    Position Summary At Deloitte, Forward Deployed Engineers (FDE) don’t just build AI solutions, they help clients turn...  ...Recruiting for this role ends on 10/30/2026.Work you’ll doAs a Senior Microsoft AI&Data FDE, you will work side by side with senior functional and... 
    Senior
    Local area

    Deloitte

    Tampa, FL
    2 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!