Senior Data Engineer
LTM
Role description Job Title: DATA Engineer
Work Location Tampa FL Job Description: Mandatory Karat Interview
Role Overview
Work Location Tampa FL Job Description: Mandatory Karat Interview
Role Overview
- We are seeking a highly skilled and motivated AWS Certified Engineer to design build and optimize scalable data solutions within the Amazon Web Services AWS ecosystem
- The ideal candidate will have strong expertise in big data processing using PySpark and a deep understanding of data warehousing concepts including Hive and modern table formats like Iceberg
- This role involves developing deploying and managing robust efficient and secure data pipelines and analytics solutions on AWS leveraging core networking and compute services
- AWS Solution Design Implementation Design develop and deploy scalable and costeffective data solutions on AWS leveraging services such as S3 for data lakes EC2 EMR Glue Athena Lambda Redshift and Kinesis
- Data Pipeline Development Build and maintain robust ETLELT data pipelines using PySpark for data ingestion transformation and loading into various data stores including those utilizing open table formats like Iceberg
- Big Data Processing Develop and optimize big data processing jobs using PySpark on AWS EMR or AWS Glue handling large datasets efficiently and integrating with Iceberg table formats
- Data Warehousing Design implement and manage data warehousing solutions including schema design data modeling and query optimization with a focus on Hive and modern data lake table formats like Iceberg for historical data and analytical queries
- Cloud Infrastructure Networking Implement secure and robust cloud infrastructure components including VPCs subnets routing and security groups to ensure proper connectivity and isolation for data solutions
- Containerized Workloads Design deploy and manage containerized data processing applications on Amazon Elastic Kubernetes Service EKSPerformance Tuning Optimization Optimize AWS resources and big data applications Spark Hive Iceberg for performance cost and efficiency
- Data Governance Security Implement best practices for data security access control and compliance within AWS including IAM policies S3 bucket policies and encryption
- Monitoring Troubleshooting Set up monitoring ing and logging for data pipelines and AWS infrastructure troubleshoot and resolve issues promptly
- Automation Develop and maintain automation scripts using Python and shell scripting for infrastructure provisioning deployment and operational tasks
- Collaboration Work closely with data scientists analysts and other engineering teams to understand data requirements and deliver reliable data solutions
- AWS Certification Hold at least one AWS certification eg AWS Certified Solutions Architect Associate AWS Certified Data Analytics Specialty AWS Certified Developer Associate
- AWS Services Expertise Handson experience with key AWS services for data processing and storage including
- Storage S3 for data lakes EC2
- Data Processing EMR Glue Athena Lambda
- Networking VPC Subnets Routing Security Groups
- Containerization EKS
- Big Data Processing Strong proficiency in PySpark for developing complex data transformations and analytics
- Data Lake Table Formats Practical experience with Apache Iceberg for managing and querying data lakes
- Data Warehousing Indepth knowledge and practical experience with Apache Hive for data storage querying and schema management
- Programming Languages
- Python Expert level proficiency in Python for scripting data manipulation and AWS automation Boto3
- Shell Scripting Proficient in shell scripting for automation and operational tasks
- Database SQL Strong SQL skills for data querying and manipulation
- Data Concepts Solid understanding of ETLELT processes data modeling distributed computing and data governance
- Containerization Orchestration Experience with Kubernetes for deploying and managing containerized applications
- CICD Experience with CICD tools and practices eg AWS CodePipeline GitHub Actions GitLab CI for automating deployment of data solutions
- Orchestration Experience with workflow orchestration tools like Apache Airflow
- Version Control Proficient in using Git for source code management
- Other Big Data Technologies Exposure to other big data technologies like Apache Kafka Flink or Presto
- AWS Certified Solutions Architect Associate Professional
- AWS Certified Data Analytics Specialty
- AWS Certified Developer Associate
Vacancy posted 5 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in Tampa, FL vacancy
- ...Position: Senior Data Engineer Location: 217 Broadway, 8th Floor, New York, NY 10007, US Work Auth: Not open to sponsorship Pay rate: $65-75 w2 max | max: $70/hr on c2c Duration: 6 months + Visa-USC/GC Hybrid or Remote?: Remote...SeniorFor contractorsRemote work
RIT Solutions, Inc.
Tampa, FL4 days ago - ...Job Description Job Description Description: Athenix Special Missions is seeking a Data Security Engineer (DRM Specialist) – Senior, Zero Trust Program (USSOCOM) in MacDill Air Force Base (Tampa), Florida! ASM Quality Policy: To meet or exceed our customers...Senior
Athenix Solutions Group
Tampa, FLa month ago - ...established and growing capabilities across Intelligence, Analytics, Engineering, Mission Support, and Communications disciplines. Founded in... ...challenges. Join our team. Barbaricum is seeking a Senior Data Security Engineer (DRM Specialist) to support a Zero Trust cybersecurity...SeniorFor contractors
Barbaricum
Tampa, FLa month ago $114.08k
...active-duty military spouses consistent with applicable policy and business needs. The Opportunity As a dedicated Senior Infrastructure Engineer ~ Data Protection, you will be responsible for designing, implementing, maintaining, and troubleshooting our data backup,...SeniorH1bWork at officeRemote workRelocation packageFlexible hoursUsaa
Tampa, FL1 day ago- ...portfolio of AI/high-performance computing (HPC) data center facilities to support Bitcoin mining,... ...next-generation digital infrastructure. As a senior member of the Site Development Team , the Senior Mechanical Engineer serves as the technical authority for...SeniorFor contractors
MARA
Tampa, FL2 days ago $110k - $145k
...Job Description Summary The Senior Data Engineer designs and builds the AWS-native data foundation behind our enterprise AI applications - knowledge graphs, semantic layers, retrieval corpora, and the pipelines that keep them trustworthy. This role leads both the design...SeniorPermanent employmentContract workRemote workVisa sponsorshipWork visaRelocation packageGE Aerospace
Tampa, FL4 days ago$113.84k - $170.76k
...The Vice President, Data Analytics Developer is a senior individual contributor role within Equities & Prime Services Technology, focused on designing... ...and pipelines. This position requires deep hands-on engineering expertise, strong financial data domain knowledge, and...SeniorPermanent employmentFull timeDay shift- ...Overview: Job Title: Big Data Engineer Location: Atlanta, GA / Tampa, FL/ Dallas, TX Job Summary We are seeking an experienced Big Data Engineer to design, build, and optimize large-scale data pipelines and distributed systems across cloud and on-prem...
Purple Drive
Tampa, FL18 hours ago - ...NICE TO HAVES (OR WHAT GETS THE WIN): Talend Big data and loading data into Hadoop (Hive, Spark, etc.) Python AWS... ...Team Size & Structure: Over 20 on team (+ offshore resources) Level (junior/mid/senior –years of experience): Mid/Sr. Level resource...
Software Technology Inc
Tampa, FL5 days ago - ...Data Engineer Employment Type: Full-Time, Mid-level CGS is seeking a passionate and driven Data Engineer to support a rapidly growing Data Analytics and Business Intelligence platform focused on providing solutions that empower our federal customers with the tools...Full timeFlexible hours
Contact Government Services LLC
Tampa, FL5 days ago - ...JOB Title:Data Engineer Location:Tampa ,FL Our team's line of questioning would be testing candidate's ability to deploy using automation, operate, incident handle, tune for performance, cloud data migration in one or many data stores they have experience...
Ruri Software Technologies LLC
Tampa, FL4 days ago $100k - $120k
...Data Engineering - DevOps Fractal Analytics is a strategic AI partner to Fortune 500 companies with a vision to power every human decision in the enterprise. Fractal is building a world where individual choices, freedom, and diversity are the greatest assets. An ecosystem...Hourly payFull timeLocal areaRemote workFractal, Inc.
Tampa, FL3 days ago- ...About the job Data Engineer - Healthcare Position - Data Engineer (Python + React, Healthcare Domain) Location - Tampa/Remote Number of positions - 2 Overview We are seeking a Data Engineer with strong experience in Python and React to build and maintain...Remote work
Inizio Partners
Tampa, FL5 days ago - ...Position Overview: We are seeking a skilled and motivated Data Warehouse and Reporting Engineer to join our team. The ideal candidate has extensive experience working with databases such as PostgreSQL and MySQL, proficient in Python scripting, possesses expertise in ETL...
Exaways Corporation
Tampa, FL5 days ago $118.9k - $162.3k
...Data Engineer At Accenture Federal Services, nothing matters more than helping the US federal government make the nation stronger and safer and life better for people. Our 13,000+ people are united in a shared purpose to pursue the limitless potential of technology...Live inWork at officeLocal areaAccenture Federal Services
Tampa, FL4 days ago- ...Job Description – Job Title: Data Architect / Data Engineer / Data Lead Location : Irving, TX OR Tampa, FL (Day 1 onsite) Roles and Responsibilities: Engage with business, product, operations, fraud, risk, compliance, and technology stakeholders to gather,...
Talentify.io
Tampa, FL1 day ago - ...Data Engineer (PySpark) Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you’d like... ...independence of judgement and autonomy Acts as SME to senior stakeholders and or other team members Qualifications 58...Permanent employmentFull timeContract workLocal area
Capgemini
Tampa, FL3 days ago - ...Data Engineer This position is Hybrid in Tampa, FL. We are seeking a Data Engineer with strong Databricks expertise to modernize and scale our Business Intelligence (BI) capabilities. This role will design and build data pipelines, deploy machine learning solutions...Temporary workCasual workLocal area
Fintech Brand
Tampa, FL5 days ago $88k - $110k
...MDM Data Engineer- Tampa, Florida Be a part of a revolutionary change! At Philip Morris International (PMI), we've chosen to do something incredible. We're totally transforming our business and building our future on one clear purpose - to deliver a smoke-free future...Philip Morris International U.S.
Tampa, FL3 days ago- ...Big Data Engineer City :Tampa State :FL Job Description : TOP REQUIREMENTS: Big Data (Spark, Scala, Hive, Hadoop... ...and reports to all levels of the organization, including senior leadership. What skills/attributes are a must have? ~5+...
Ruri Software Technologies LLC
Tampa, FL4 days ago $88k - $110k
...Data Engineer Be a part of a revolutionary change! At Philip Morris International (PMI), we are transforming our business to deliver a smoke-free future. Join us to create better solutions and contribute to meaningful progress. Our scale offers. Your 'day to day'...Philip Morris International
Tampa, FL2 days ago- Job Title: Sr. DATA EngineerWork Location : Tampa FLJob Description:Seeking a Senior professional with 3 to 5 years of experience in Python Scala and Spark SQL to design... ...jobs and data pipelines Collaborate with data engineers’ data scientists and stakeholders to translate...Senior
LTM
Tampa, FL1 day ago - ...Who Should Apply? Recent graduates in Computer Science, Engineering, Mathematics, Statistics, or related STEM fields Professionals... ...& Cloud Engineers Python/Java Software Programmers Data Analysts, Data Scientists Data Engineers & AI/Machine Learning...Full time
SynergisticIT
Tampa, FL5 days ago - ...award of contract**SOS International LLC (SOSi) is seeking a Data Engineer (C4ISR Architecture) to support our customer in McDill AFB, Florida... ...Department of Education and an additional 5 years of related senior experience, for a total of 17 years, as a substitute to the...SeniorContract workWork at officeWorldwide
SOSi
Tampa, FL1 day ago - ...infrastructure capabilities to meet client needs and implementing data standards and governance. Pay and Benefits: Competitive... ...a member of IT FinSight Delivery team, the data integration engineer role specializes in planning, detailing technical requirements,...Remote workFlexible hours
The Depository Trust & Clearing Corporation (DTCC)
Tampa, FL3 days ago $77.5k - $176k
Data Engineer, SeniorThe Opportunity: Ever-expanding technology like IoT, machine learning, and artificial intelligence means that there’s more structured and unstructured data available today than ever before. As a data engineer, you know that organizing data can yield...SeniorFull timeContract workPart timeWork at officeLocal areaRemote workBooz Allen Hamilton
Tampa, FL3 days ago- ...Lead Data Engineer Location- Remote (EST) Contract: 6+ months Ongoing (possible contract to hire/must be eligible for conversion) Summary: s a Lead Data Engineer, you will play a critical role in designing, developing, and maintaining our data infrastructure...Ongoing contractContract workRemote work
RIT Solutions, Inc.
Tampa, FL2 days ago - ...Overview: Strong hands-on experience in Python for data engineering and application development. Extensive experience with AWS cloud services, including S3, EMR, Glue, Lambda, IAM, EC2, ECS/EKS, CloudWatch, and Redshift. Strong expertise in Apache Spark for large...
Purple Drive
Tampa, FL3 days ago - ...Lead Data Engineer Snowflake shop ETL processes Data migration modern data engineering practices, etc. opentable formats like datalake and iceberg Exposed to databricks pipeline Data mesh exposure Must see the Data frameworks they have worked with in the resume Exposure...
RIT Solutions
Tampa, FL5 days ago - ...Role: Senior Data Scientist Duration: 12 months Location: Phoenix Arizona will get first preference, Remote is ok Time... ...Requirements: ~8+ years of experience in data science , data engineering , with a proven track record of delivering impactful...SeniorRemote work
RIT Solutions, Inc.
Tampa, FL1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- big data cloud engineer Tampa, FL
- entry level big data engineer Tampa, FL
- senior data quality engineer Tampa, FL
- senior cloud data engineer Tampa, FL
- software data engineer Tampa, FL
- data infrastructure engineer Tampa, FL
- senior data center engineer Tampa, FL
- data center engineer Tampa, FL
- senior data engineer Tampa, FL
- finance data engineer Tampa, FL