Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Hadoop Data engineer

eTeam Inc.

Job Description

Job Description

Job Title: Hadoop Data engineer
Work Location: Maryland Heights MO 63043 (hybrid )
Contract duration: 12
F2F interview - Yes

Job Details:
Must Have skills:
AWS, Hadoop

Key Responsibilities

Design, build, and optimize scalable batch and real-time data pipelines using Apache Spark (Scala/Python), Core Java, and Apache Kafka to process high-volume data.
Manage and maintain enterprise data Lakehouse architectures spanning AWS and Cloudera environments, leveraging S3, Apache Iceberg, and Hive for scalable storage and querying.
Implement Change Data Capture (CDC) and write complex SQL to integrate data from relational databases (Oracle, SQL Server) into dimensional data warehouses.
Automate and orchestrate pipeline workflows using Unix shell scripting and Python.
Lead and support migration of legacy Hadoop workloads to AWS cloud-native architectures.
Monitor, troubleshoot, and tune JVM and Spark job performance to ensure reliability and efficiency at scale.
Ensure all data pipelines and storage practices adhere to regulatory compliance and data governance standards.
Collaborate with cross-functional teams (data architects, analysts, platform engineers) to translate business requirements into robust data solutions.

Required Skills & Technology:
Strong programming experience in Scala/Python (Spark) and Core Java
Hands-on experience with Apache Kafka for streaming data pipelines
Working knowledge of AWS services (S3) and Cloudera platform tools (Hive, Iceberg)
Strong SQL skills, including CDC concepts, across Oracle and SQL Server
Experience with dimensional data warehouse modeling
Proficiency in Unix shell scripting and Python for automation
Experience migrating on-prem Hadoop workloads to cloud platforms
Understanding of JVM internals and Spark performance tuning techniques

Preferred Qualifications:
Prior experience in the Communications/Telecom domain (CDRs, network telemetry data)
Familiarity with data governance and regulatory compliance frameworks
Bachelor s degree in computer science, Engineering, or a related field, or equivalent practical experience

Top 3 responsibilities
Manage and maintain enterprise data lakehouse architectures spanning AWS and Cloudera environments, leveraging S3, Apache Iceberg, and Hive for scalable storage and querying. Implement Change Data Capture CDC and write complex SQL to integrate data from relational databases Oracle, SQL Server into dimensional data warehouses.
Automate and orchestrate pipeline workflows using Unix shell scripting and Python. Lead and support migration of legacy Hadoop workloads to AWS cloudnative architectures.
M

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Hadoop Data engineer in Maryland Heights, MO vacancy
  •  ...Network/Data EngineerWork Location - 12976 HOLLENBERG DR Bridgeton MO 63044, Irving TX 75039 or Middletown NJ 07748Positions Requested - 1Hours per Day - 8Hours per Week - 40Total Hours – 3 year contractProject Name: Network Cloud BuildTOP 5 SKILLS NEEDED:Executing network... 
    Suggested
    Night shift

    TriOptus LLC

    Bridgeton, MO
    4 days ago
  • $142.8k - $193.2k

     ...Senior Data Engineer Company: The Boeing Company Boeing Defense, Space & Security (BDS) is hiring a Senior Data Engineer for a Proprietary Program in Saint Louis, MO . We seek passionate, curious, and talented data scientists who want their job to have real-world... 
    Suggested
    Permanent employment
    Immediate start
    Relocation
    Visa sponsorship
    Work visa
    Flexible hours
    Shift work

    Boeing Company

    Hazelwood, MO
    1 hour ago
  • $53.9 - $77 per hour

    Location:Chesterfield, MissouriType:ContractJob#46865Technology Partners is currently seeking a talented Data Engineer. Do you have 4-6 years of experience assembling complex data sets and building high-performing big data platforms? Let us help you make your next big career... 
    Suggested
    Flexible hours
    3 days per week

    Technology Partners

    Chesterfield, MO
    2 days ago
  • $94.35k - $127.65k

     ...great opportunity for professional growth. Find your future with us. The Boeing Company is currently seeking a Data Fusion Systems Software Engineer/Analyst (Associate, Experienced or Senior) to support our Software Development team within the Phantom Works Network... 
    Suggested
    Permanent employment
    Full time
    Contract work
    Work experience placement
    Interim role
    Currently hiring
    Relocation
    Visa sponsorship
    Work visa
    Relocation package
    Flexible hours
    Shift work
    Day shift

    Boeing Careers

    Berkeley, MO
    2 days ago
  • $111.6k - $167.4k

     ...Qualifications:   Experience with HCM/HR data Bachelor’s degree – Computer Science or a minimum of 5 years’ progressive experience...  ...join our team.   What will you be doing?  As a Senior Data Engineer, you will collaborate with a multi-disciplinary team of solution... 
    Suggested
    Full time
    Remote work
    Flexible hours
    Shift work

    World Wide Technology Holding

    Maryland Heights, MO
    4 hours ago
  • $103.7k - $140.3k

    Experienced Configuration & Data Management EngineerCompany:The Boeing CompanyThe Experienced Configuration & Data Management Engineer will lead configuration and data management activities and enable technical integration across engineering toolchains for Phantom Works... 
    Permanent employment
    Full time
    Work experience placement
    Immediate start
    Relocation
    Visa sponsorship
    Work visa
    Relocation package
    Flexible hours
    Shift work

    Boeing

    Saint Charles, MO
    3 days ago
  • $140.25k - $165k

     ...Job Title Senior Manager, Data Engineering Job Title: Data Engineering Senior Manager Position: Data Engineering Senior Manager Department: TDS Technology and Data Solutions Reports To: Global Head of Data Architecture & Engineering Location... 
    Minimum wage
    Local area
    Remote work
    Flexible hours

    Cushman & Wakefield

    Creve Coeur, MO
    4 days ago
  •  ...generation ~ LLM APIs - OpenAI Chat Completions, Responses API, streaming, tool calling ~ Async Python - asyncio, FastAPI ~ Prompt engineering - system prompts, few-shot, structured JSON output ~ Circuit breaker patterns, retry logic, resilient service design ~... 
    Contract work

    2T Consulting

    Maryland Heights, MO
    a month ago
  •  ...Job Description Job Description Senior Data Engineer We are seeking a hands-on Senior Data Engineer to build a greenfield, AI-ready enterprise data platform on Azure. Working alongside Data Architects, you will spend 90%+ of your time developing scalable pipelines... 
    Contract work
    Remote work
    Flexible hours
    3 days per week

    duvari group

    Maryland Heights, MO
    3 days ago
  •  ...filings (ie. Call Report, FR Y-9C, FR Y-2900, FR Y-8, etc).  Read and interpret regulatory guidance and instructions, sourcing vital data, and preparing reports schedules with detailed supporting work papers. Collaborate with teams to develop working relationships to... 
    Full time
    Local area

    Enterprise Bank and Trust

    Bridgeton, MO
    a month ago
  •  ...in Maryland Heights, MO that is seeking a Senior Java Software Engineer to join a highly collaborative engineering team responsible for...  ...management, scheduling, and reporting functions * Publish and consume data across event-driven architectures and messaging platforms *... 
    Hourly pay
    Contract work

    Kforce Technology Staffing

    Maryland Heights, MO
    1 hour ago
  •  ...developer with 3-4 years of experience who is eager to continue building technical expertise and growing within a collaborative engineering environment. We are looking for professionals who are motivated, adaptable, and capable of taking ownership of their work while contributing... 
    Temporary work

    TalentsBridge

    Maryland Heights, MO
    2 days ago
  •  ...deployment across environments. Security Implementation: Implement data security measures to protect sensitive information....  ...~ Education: Bachelor's degree in Computer Science, Software Engineering, or a related field. ~ Experience: At least 5-7 years of professional... 
    Relocation

    United IT

    Bridgeton, MO
    1 day ago
  •  ...provide telephonic and email support for Handicare, Span, and Savaria products across North America. The role partners with Quality, Engineering, and Service teams to troubleshoot issues and process RMAs. The ideal candidate will handle multiple work orders, read technical... 

    Savaria

    Maryland Heights, MO
    5 days ago
  •  ...Job Description Job Description Position: Data Integrations Engineer (onsite with some hybrid flexibility, Florissant, MO) Schedule: Full Time FLSA: Exempt (not eligible for overtime) Reporting to: Senior Manager of Enterprise Technology Position Summary... 
    Full time
    Work at office

    Augustine Institute Inc

    Florissant, MO
    28 days ago
  • $100.2k - $167k

     ...than a diversified global financial markets infrastructure and data business. We are dedicated, open-access partners with a dedication...  ...profile: We are seeking a highly motivated Senior Database Engineer to join our DataScope Database Administration team. The team... 
    Part time
    Internship
    Worldwide

    LSEG (London Stock Exchange Group)

    Creve Coeur, MO
    1 day ago
  • $112.2k - $151.8k

     ...Security (BDS) is hiring an Experienced or Senior Aerodynamics Engineer to perform propulsion system qualification support and analysis...  ...(including Manufacturing Technology), Computer Science, Data Science, Mathematics, Physics, Chemistry or non-US equivalent qualifications... 
    Permanent employment
    Full time
    Interim role
    Immediate start
    Relocation
    Visa sponsorship
    Work visa
    Flexible hours
    Shift work
    Day shift

    Boeing Careers

    Berkeley, MO
    2 days ago
  •  ...university: Computer Science, Computer Information Systems, Business Technology Management, Engineering Technology Management, Electrical and Computer Engineering, Data Science, Information Technology, Information Science, Management Science and Engineering, Marketing... 
    Full time
    Summer work
    Internship
    Summer internship
    Local area
    Visa sponsorship

    Spectrum

    Maryland Heights, MO
    2 days ago
  • $115k - $160k

     ...Data Scientist bioMerieux's Data Science group is looking for an experienced Data Scientist to help develop solutions for the next...  ...collaboration and interaction with other scientists and engineers while prototyping, integrating and testing the technology for the... 
    Temporary work
    Work experience placement

    BioFire Diagnostics

    Hazelwood, MO
    4 days ago
  • $135k - $150k

     ...Fabric medallion architecture (Bronze → Silver → Gold), ensuring data flows optimally from raw ingestion through conformed, analytics...  ...— balancing speed, reliability, and cost. Establish the engineering practices that keep the platform healthy as it scales: version... 
    Full time
    Contract work

    AON

    Chesterfield, MO
    6 days ago
  • $89.31k - $134.87k

     ...motivated, and collaborative people, and help us make financial protection accessible to all. A Brief Overview Maintain and enhance data integrity by supporting existing validations and adding additional data validations around key data points like security master,... 
    Work experience placement
    Immediate start
    Remote work

    Reinsurance Group of America

    Chesterfield, MO
    2 days ago
  • $149.6k - $202.4k

     ...Company is currently seeking a highly motivated, Senior Systems Engineering Analyst  to join the F-15 team located in Berkeley, MO ....  ...and expertise to research, analyze and compile complex technical data. Developing system architectures, functional requirements, etc... 
    Permanent employment
    Full time
    Immediate start
    Relocation
    Visa sponsorship
    Work visa
    Relocation package
    Flexible hours
    Shift work
    Day shift

    Boeing Careers

    Berkeley, MO
    2 days ago
  •  ...Develops and maintains auditing procedures and rating documentation for all assigned accounts. Analyzes audit and rating performance data and recommends process improvements that will improve customer outcomes, audit quality, and operational efficiency. Collaborates... 
    Contract work
    Work at office

    Cass Information Systems

    Bridgeton, MO
    1 day ago
  •  ...information technical partners can understand. Qualifications Associate or Bachelor's degree preferred in Business, Finance, IT, Data Analytics, or related field. Experience in business analysis, technical analysis, systems, ERP, or a related role. Strong... 
    Full time

    Security Equipment Supply Inc

    Earth City, MO
    8 days ago
  • $750 per week

     ...accepting applicants for Focus Group studies. Earn up to $750 per week part-time working from home. Must register to see if you qualify. No Data Entry experience needed. Data Entry Clerk Work From Home - Part Time Remote Focus Group Panelists Our company is seeking... 
    Extra income
    Full time
    Temporary work
    Part time
    Local area
    Remote work
    Work from home
    Flexible hours

    Apex Focus Group

    Florissant, MO
    1 day ago
  •  ...- (BA to document the requirements, experience with Telemetry data, IOT data collection, AWS Cloud etc will be value add) Responsibilities...  ...with cross-functional teams including product managers, data engineers, cloud architects, and stakeholders. Key Responsibilities:... 

    United IT

    Bridgeton, MO
    5 days ago
  • $105k - $128.14k

     ...Solutions, a part of Boeing Global Services BGS, is seeking a Software Engineer in Maryland Heights, MO to support future franchise programs....  ...engineering technology), chemistry, physics, mathematics, data science, or computer science and 5+ years of related work experience... 
    Permanent employment
    Full time
    Work experience placement
    Interim role
    Worldwide
    Relocation
    Visa sponsorship
    Work visa
    Relocation package
    Flexible hours
    Shift work
    Day shift

    Boeing Careers

    Maryland Heights, MO
    2 days ago
  •  ...This role serves as a vital bridge between business users and engineering teams to ensure optimal systems performance.Key ResponsibilitiesReviews...  ...partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or... 

    Apex Systems

    Maryland Heights, MO
    2 days ago
  •  ...control, and technology refresh processes. Understanding of cybersecurity best practices, endpoint security, phishing awareness, and data protection principles. Requisite Experience* Associate degree in Computer Science, Information Technology, or a related... 
    Work experience placement
    Remote work
    Monday to Friday
    Flexible hours
    Afternoon shift

    Webster University

    Webster Groves, MO
    4 days ago
  •  ...important role in maintaining reliable building access, supporting our customers and installation partners, and collaborating with Engineering, Product, and Operations teams to resolve technical challenges. We are seeking a technically curious, resourceful, and... 
    Temporary work
    Work at office
    Immediate start
    Remote work
    Flexible hours
    Night shift
    3 days per week

    Door Systems Inc

    Olivette, MO
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Hadoop Data engineer. Be the first to apply!