Senior Data Engineer
LTM
Role description Job Title: DATA Engineer
Work Location Tampa FL Job Description: Mandatory Karat Interview
Role Overview
Work Location Tampa FL Job Description: Mandatory Karat Interview
Role Overview
- We are seeking a highly skilled and motivated AWS Certified Engineer to design build and optimize scalable data solutions within the Amazon Web Services AWS ecosystem
- The ideal candidate will have strong expertise in big data processing using PySpark and a deep understanding of data warehousing concepts including Hive and modern table formats like Iceberg
- This role involves developing deploying and managing robust efficient and secure data pipelines and analytics solutions on AWS leveraging core networking and compute services
- AWS Solution Design Implementation Design develop and deploy scalable and costeffective data solutions on AWS leveraging services such as S3 for data lakes EC2 EMR Glue Athena Lambda Redshift and Kinesis
- Data Pipeline Development Build and maintain robust ETLELT data pipelines using PySpark for data ingestion transformation and loading into various data stores including those utilizing open table formats like Iceberg
- Big Data Processing Develop and optimize big data processing jobs using PySpark on AWS EMR or AWS Glue handling large datasets efficiently and integrating with Iceberg table formats
- Data Warehousing Design implement and manage data warehousing solutions including schema design data modeling and query optimization with a focus on Hive and modern data lake table formats like Iceberg for historical data and analytical queries
- Cloud Infrastructure Networking Implement secure and robust cloud infrastructure components including VPCs subnets routing and security groups to ensure proper connectivity and isolation for data solutions
- Containerized Workloads Design deploy and manage containerized data processing applications on Amazon Elastic Kubernetes Service EKSPerformance Tuning Optimization Optimize AWS resources and big data applications Spark Hive Iceberg for performance cost and efficiency
- Data Governance Security Implement best practices for data security access control and compliance within AWS including IAM policies S3 bucket policies and encryption
- Monitoring Troubleshooting Set up monitoring ing and logging for data pipelines and AWS infrastructure troubleshoot and resolve issues promptly
- Automation Develop and maintain automation scripts using Python and shell scripting for infrastructure provisioning deployment and operational tasks
- Collaboration Work closely with data scientists analysts and other engineering teams to understand data requirements and deliver reliable data solutions
- AWS Certification Hold at least one AWS certification eg AWS Certified Solutions Architect Associate AWS Certified Data Analytics Specialty AWS Certified Developer Associate
- AWS Services Expertise Handson experience with key AWS services for data processing and storage including
- Storage S3 for data lakes EC2
- Data Processing EMR Glue Athena Lambda
- Networking VPC Subnets Routing Security Groups
- Containerization EKS
- Big Data Processing Strong proficiency in PySpark for developing complex data transformations and analytics
- Data Lake Table Formats Practical experience with Apache Iceberg for managing and querying data lakes
- Data Warehousing Indepth knowledge and practical experience with Apache Hive for data storage querying and schema management
- Programming Languages
- Python Expert level proficiency in Python for scripting data manipulation and AWS automation Boto3
- Shell Scripting Proficient in shell scripting for automation and operational tasks
- Database SQL Strong SQL skills for data querying and manipulation
- Data Concepts Solid understanding of ETLELT processes data modeling distributed computing and data governance
- Containerization Orchestration Experience with Kubernetes for deploying and managing containerized applications
- CICD Experience with CICD tools and practices eg AWS CodePipeline GitHub Actions GitLab CI for automating deployment of data solutions
- Orchestration Experience with workflow orchestration tools like Apache Airflow
- Version Control Proficient in using Git for source code management
- Other Big Data Technologies Exposure to other big data technologies like Apache Kafka Flink or Presto
- AWS Certified Solutions Architect Associate Professional
- AWS Certified Data Analytics Specialty
- AWS Certified Developer Associate
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Tampa, FL vacancy
- ...Are you an experienced Senior Data Engineer with a desire to excel? If so, then Talent Software Services may have the job for you! Our client is seeking an experienced Senior Data Engineer to work at their company. Need only US Citizens Description: This...Senior
Talent Software Services
Tampa, FL1 day ago - ...Position: Senior Data Engineer Location: 217 Broadway, 8th Floor, New York, NY 10007, US Work Auth: Not open to sponsorship Pay rate: $65-75 w2 max | max: $70/hr on c2c Duration: 6 months + Visa-USC/GC Hybrid or Remote?: Remote...SeniorFor contractorsRemote work
RIT Solutions, Inc.
Tampa, FL4 days ago - ...Responsibilities: Build and operate production-grade batch and streaming data pipelines across SQL Server, cloud applications, device/event... ...on-call activities. Work closely with Product, Application Engineering, Quality Assurance, DevOps/Site Reliability Engineering,...Senior
Highbrow
Tampa, FL3 days ago - ...Quantiphi is an award-winning, AI-First digital engineering and consulting company focused on... ...industry expertise, disciplined cloud and data engineering practices, and cutting-edge applied... ...Role: We are seeking an experienced Senior Data Engineer with deep expertise in...SeniorFull timeRemote work
Quantiphi
Tampa, FL3 days ago - ...solutions that enable seamless communication and collaboration across the supply chain. DESCRIPTION: Transflo is seeking a Senior Data Engineer to architect and own our enterprise data platform — from raw ingestion through curated, analytics-ready data products. You...SeniorRemote work
Transflo
Tampa, FL4 days ago $77.5k - $176k
...Data Engineer, SeniorThe Opportunity:Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there's more structured and unstructured data available today than ever before. As a data engineer, you know that organizing data can yield...SeniorFull timeContract workPart timeWork at officeLocal areaRemote workBooz Allen Hamilton
Tampa, FL1 hour ago- ...established and growing capabilities across Intelligence, Analytics, Engineering, Mission Support, and Communications disciplines. Founded in... ...challenges. Join our team. Barbaricum is seeking a Senior Data Security Engineer (DRM Specialist) to support a Zero Trust cybersecurity...SeniorFor contractors
Barbaricum
Tampa, FLa month ago - ...Job Description Job Description Description: Athenix Special Missions is seeking a Data Security Engineer (DRM Specialist) – Senior, Zero Trust Program (USSOCOM) in MacDill Air Force Base (Tampa), Florida! ASM Quality Policy: To meet or exceed our customers...Senior
Athenix Solutions Group
Tampa, FLa month ago - ...Senior Database DeveloperWe are seeking a hands-on Senior Database Developer to design, develop, and optimize data solutions across Microsoft SQL Server and the Databricks Lakehouse Platform... ...standards and patterns for other engineering teams to follow....Senior
Rooms To Go
Seffner, FL1 day ago - ...Position Summary: This role is designed for a Senior Data Engineer responsible for architecting, developing, and optimizing end-to-end data solutions that support enterprise-scale AI, machine learning, and business intelligence initiatives. With deep expertise in Databricks...Senior
Talentify.io
Seffner, FL4 days ago $114.08k
...active-duty military spouses consistent with applicable policy and business needs. The Opportunity As a dedicated Senior Infrastructure Engineer ~ Data Protection, you will be responsible for designing, implementing, maintaining, and troubleshooting our data backup,...SeniorH1bWork at officeRemote workRelocation packageFlexible hoursUsaa
Tampa, FL1 day ago- ...portfolio of AI/high-performance computing (HPC) data center facilities to support Bitcoin mining,... ...next-generation digital infrastructure. As a senior member of the Site Development Team , the Senior Mechanical Engineer serves as the technical authority for...SeniorFor contractors
MARA
Tampa, FL2 days ago - ...Principal Data EngineerRemote MUST BE IN EST TIME ZONESDuration: 6 months to start, with potential for extension.Required Skills:Extensive experience in the Python ecosystem (minimum 8 years), with deep expertise in data wrangling, JSON parsing, and connecting to APIs...
RIT Solutions
Tampa, FL2 days ago $110k - $145k
...Job Description Summary The Senior Data Engineer designs and builds the AWS-native data foundation behind our enterprise AI applications - knowledge graphs, semantic layers, retrieval corpora, and the pipelines that keep them trustworthy. This role leads both the design...SeniorPermanent employmentContract workRemote workVisa sponsorshipWork visaRelocation packageGE Aerospace
Tampa, FL4 days ago- Job Title: Sr. DATA EngineerWork Location : Tampa FLJob Description:Seeking a Senior professional with 3 to 5 years of experience in Python Scala and Spark SQL to design... ...jobs and data pipelines Collaborate with data engineers’ data scientists and stakeholders to translate...Senior
LTM
Tampa, FL1 day ago $113.84k - $170.76k
...The Vice President, Data Analytics Developer is a senior individual contributor role within Equities & Prime Services Technology, focused on designing... ...and pipelines. This position requires deep hands-on engineering expertise, strong financial data domain knowledge, and...SeniorPermanent employmentFull timeDay shift- ...award of contract**SOS International LLC (SOSi) is seeking a Data Engineer (C4ISR Architecture) to support our customer in McDill AFB, Florida... ...Department of Education and an additional 5 years of related senior experience, for a total of 17 years, as a substitute to the...SeniorContract workWork at officeWorldwide
SOSi
Tampa, FL1 day ago - ...Overview: Job Title: Big Data Engineer Location: Atlanta, GA / Tampa, FL/ Dallas, TX Job Summary We are seeking an experienced Big Data Engineer to design, build, and optimize large-scale data pipelines and distributed systems across cloud and on-prem...
Purple Drive
Tampa, FL19 hours ago - ...insurance industry with best-in-class, proprietary, AI-driven data analytics. We've spent years building our own proprietary AI... ...We are a team of 10 and growing quickly. As our second Data Engineer, you will own the data layer that turns customer policy, claims,...
Soteris
Tampa, FL3 days ago - ...AWS Data EngineerLocation: Tampa, FL/Boston, MA/Dallas, TX (Remote until COVID)Duration: 6 Months PlusJob Description: Further requirements... ...Specialty• 5+ years' experience in database administration and engineering• 2+ years' experience on AWS Platform around automated...Remote work
ClifyX
Tampa, FL1 hour ago - ...Snowflake Data Platform Operations EngineerAs a Snowflake Data Platform Operations Engineer, you will play a critical role in maintaining the reliability and resilience of DTCC's cloud-based data infrastructure. Your contributions will directly support the flawless clearing...Remote work
Mindlance
Tampa, FL2 days ago - ...NICE TO HAVES (OR WHAT GETS THE WIN): Talend Big data and loading data into Hadoop (Hive, Spark, etc.) Python AWS... ...Team Size & Structure: Over 20 on team (+ offshore resources) Level (junior/mid/senior –years of experience): Mid/Sr. Level resource...
Software Technology Inc
Tampa, FL5 days ago - ...Data Engineer Employment Type: Full-Time, Mid-level CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence platform focused on providing solutions that empower our federal customers with the tools...Full timeFlexible hours
Contact Government Services LLC
Tampa, FL5 days ago - ...JOB Title:Data Engineer Location:Tampa ,FL Our team's line of questioning would be testing candidate's ability to deploy using automation, operate, incident handle, tune for performance, cloud data migration in one or many data stores they have experience...
Ruri Software Technologies LLC
Tampa, FL4 days ago $100k - $120k
...Data Engineering - DevOps Fractal Analytics is a strategic AI partner to Fortune 500 companies with a vision to power every human decision in the enterprise. Fractal is building a world where individual choices, freedom, and diversity are the greatest assets. An ecosystem...Hourly payFull timeLocal areaRemote workFractal, Inc.
Tampa, FL3 days ago- ...About the job Data Engineer - Healthcare Position - Data Engineer (Python + React, Healthcare Domain) Location - Tampa/Remote Number of positions - 2 Overview We are seeking a Data Engineer with strong experience in Python and React to build and maintain...Remote work
Inizio Partners
Tampa, FL5 days ago - ...Position Overview: We are seeking a skilled and motivated Data Warehouse and Reporting Engineer to join our team. The ideal candidate has extensive experience working with databases such as PostgreSQL and MySQL, proficient in Python scripting, possesses expertise in ETL...
Exaways Corporation
Tampa, FL5 days ago $100k
...Cloud World/Oracle Java one (Las Vegas) -2023/2022 and at Gartner Data Analytics Summit (Florida)-2023.All positions are open for all... ..., data analysts/data scientists, and machine learning engineers for full-time positions with clients. Who should apply? Recent...Full timeH1bSynergisticIT
Tampa, FL2 days ago- ...Data Engineer (PySpark) Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like... ...independence of judgement and autonomy Acts as SME to senior stakeholders and or other team members Qualifications 58...Permanent employmentFull timeContract workLocal area
Capgemini
Tampa, FL3 days ago - ...Data Engineer This position is Hybrid in Tampa, FL. We are seeking a Data Engineer with strong Databricks expertise to modernize and scale our Business Intelligence (BI) capabilities. This role will design and build data pipelines, deploy machine learning solutions...Temporary workCasual workLocal area
Fintech Brand
Tampa, FL5 days ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- big data cloud engineer Tampa, FL
- entry level big data engineer Tampa, FL
- senior data quality engineer Tampa, FL
- senior cloud data engineer Tampa, FL
- software data engineer Tampa, FL
- data infrastructure engineer Tampa, FL
- senior data center engineer Tampa, FL
- data center engineer Tampa, FL
- senior data engineer Tampa, FL
- finance data engineer Tampa, FL