Hadoop Data engineer
eTeam Inc.
Job Description
Job Description
Job Title: Hadoop Data engineer
Work Location: Maryland Heights MO 63043 (hybrid )
Contract duration: 12
F2F interview - Yes
Must Have skills:
AWS, Hadoop Key Responsibilities Design, build, and optimize scalable batch and real-time data pipelines using Apache Spark (Scala/Python), Core Java, and Apache Kafka to process high-volume data.
Manage and maintain enterprise data Lakehouse architectures spanning AWS and Cloudera environments, leveraging S3, Apache Iceberg, and Hive for scalable storage and querying.
Implement Change Data Capture (CDC) and write complex SQL to integrate data from relational databases (Oracle, SQL Server) into dimensional data warehouses.
Automate and orchestrate pipeline workflows using Unix shell scripting and Python.
Lead and support migration of legacy Hadoop workloads to AWS cloud-native architectures.
Monitor, troubleshoot, and tune JVM and Spark job performance to ensure reliability and efficiency at scale.
Ensure all data pipelines and storage practices adhere to regulatory compliance and data governance standards.
Collaborate with cross-functional teams (data architects, analysts, platform engineers) to translate business requirements into robust data solutions. Required Skills & Technology:
Strong programming experience in Scala/Python (Spark) and Core Java
Hands-on experience with Apache Kafka for streaming data pipelines
Working knowledge of AWS services (S3) and Cloudera platform tools (Hive, Iceberg)
Strong SQL skills, including CDC concepts, across Oracle and SQL Server
Experience with dimensional data warehouse modeling
Proficiency in Unix shell scripting and Python for automation
Experience migrating on-prem Hadoop workloads to cloud platforms
Understanding of JVM internals and Spark performance tuning techniques Preferred Qualifications:
Prior experience in the Communications/Telecom domain (CDRs, network telemetry data)
Familiarity with data governance and regulatory compliance frameworks
Bachelor s degree in computer science, Engineering, or a related field, or equivalent practical experience Top 3 responsibilities
Manage and maintain enterprise data lakehouse architectures spanning AWS and Cloudera environments, leveraging S3, Apache Iceberg, and Hive for scalable storage and querying. Implement Change Data Capture CDC and write complex SQL to integrate data from relational databases Oracle, SQL Server into dimensional data warehouses.
Automate and orchestrate pipeline workflows using Unix shell scripting and Python. Lead and support migration of legacy Hadoop workloads to AWS cloudnative architectures.
M
Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Hadoop Data engineer in Maryland Heights, MO vacancy
- ...Network/Data EngineerWork Location - 12976 HOLLENBERG DR Bridgeton MO 63044, Irving TX 75039 or Middletown NJ 07748Positions Requested - 1Hours per Day - 8Hours per Week - 40Total Hours – 3 year contractProject Name: Network Cloud BuildTOP 5 SKILLS NEEDED:Executing network...SuggestedNight shift
$142.8k - $193.2k
...Senior Data Engineer Company: The Boeing Company Boeing Defense, Space & Security (BDS) is hiring a Senior Data Engineer for a Proprietary Program in Saint Louis, MO . We seek passionate, curious, and talented data scientists who want their job to have real-world...SuggestedPermanent employmentImmediate startRelocationVisa sponsorshipWork visaFlexible hoursShift work$53.9 - $77 per hour
Location:Chesterfield, MissouriType:ContractJob#46865Technology Partners is currently seeking a talented Data Engineer. Do you have 4-6 years of experience assembling complex data sets and building high-performing big data platforms? Let us help you make your next big career...SuggestedFlexible hours3 days per week$94.35k - $127.65k
...great opportunity for professional growth. Find your future with us. The Boeing Company is currently seeking a Data Fusion Systems Software Engineer/Analyst (Associate, Experienced or Senior) to support our Software Development team within the Phantom Works Network...SuggestedPermanent employmentFull timeContract workWork experience placementInterim roleCurrently hiringRelocationVisa sponsorshipWork visaRelocation packageFlexible hoursShift workDay shift$111.6k - $167.4k
...Qualifications: Experience with HCM/HR data Bachelor’s degree – Computer Science or a minimum of 5 years’ progressive experience... ...join our team. What will you be doing? As a Senior Data Engineer, you will collaborate with a multi-disciplinary team of solution...SuggestedFull timeRemote workFlexible hoursShift work$103.7k - $140.3k
Experienced Configuration & Data Management EngineerCompany:The Boeing CompanyThe Experienced Configuration & Data Management Engineer will lead configuration and data management activities and enable technical integration across engineering toolchains for Phantom Works...Permanent employmentFull timeWork experience placementImmediate startRelocationVisa sponsorshipWork visaRelocation packageFlexible hoursShift work$140.25k - $165k
...Job Title Senior Manager, Data Engineering Job Title: Data Engineering Senior Manager Position: Data Engineering Senior Manager Department: TDS Technology and Data Solutions Reports To: Global Head of Data Architecture & Engineering Location...Minimum wageLocal areaRemote workFlexible hours- ...generation ~ LLM APIs - OpenAI Chat Completions, Responses API, streaming, tool calling ~ Async Python - asyncio, FastAPI ~ Prompt engineering - system prompts, few-shot, structured JSON output ~ Circuit breaker patterns, retry logic, resilient service design ~...Contract work
- ...Job Description Job Description Senior Data Engineer We are seeking a hands-on Senior Data Engineer to build a greenfield, AI-ready enterprise data platform on Azure. Working alongside Data Architects, you will spend 90%+ of your time developing scalable pipelines...Contract workRemote workFlexible hours3 days per week
- ...filings (ie. Call Report, FR Y-9C, FR Y-2900, FR Y-8, etc). Read and interpret regulatory guidance and instructions, sourcing vital data, and preparing reports schedules with detailed supporting work papers. Collaborate with teams to develop working relationships to...Full timeLocal area
- ...in Maryland Heights, MO that is seeking a Senior Java Software Engineer to join a highly collaborative engineering team responsible for... ...management, scheduling, and reporting functions * Publish and consume data across event-driven architectures and messaging platforms *...Hourly payContract work
- ...developer with 3-4 years of experience who is eager to continue building technical expertise and growing within a collaborative engineering environment. We are looking for professionals who are motivated, adaptable, and capable of taking ownership of their work while contributing...Temporary work
- ...deployment across environments. Security Implementation: Implement data security measures to protect sensitive information.... ...~ Education: Bachelor's degree in Computer Science, Software Engineering, or a related field. ~ Experience: At least 5-7 years of professional...Relocation
- ...provide telephonic and email support for Handicare, Span, and Savaria products across North America. The role partners with Quality, Engineering, and Service teams to troubleshoot issues and process RMAs. The ideal candidate will handle multiple work orders, read technical...
- ...Job Description Job Description Position: Data Integrations Engineer (onsite with some hybrid flexibility, Florissant, MO) Schedule: Full Time FLSA: Exempt (not eligible for overtime) Reporting to: Senior Manager of Enterprise Technology Position Summary...Full timeWork at office
$100.2k - $167k
...than a diversified global financial markets infrastructure and data business. We are dedicated, open-access partners with a dedication... ...profile: We are seeking a highly motivated Senior Database Engineer to join our DataScope Database Administration team. The team...Part timeInternshipWorldwide$112.2k - $151.8k
...Security (BDS) is hiring an Experienced or Senior Aerodynamics Engineer to perform propulsion system qualification support and analysis... ...(including Manufacturing Technology), Computer Science, Data Science, Mathematics, Physics, Chemistry or non-US equivalent qualifications...Permanent employmentFull timeInterim roleImmediate startRelocationVisa sponsorshipWork visaFlexible hoursShift workDay shift- ...university: Computer Science, Computer Information Systems, Business Technology Management, Engineering Technology Management, Electrical and Computer Engineering, Data Science, Information Technology, Information Science, Management Science and Engineering, Marketing...Full timeSummer workInternshipSummer internshipLocal areaVisa sponsorship
$115k - $160k
...Data Scientist bioMerieux's Data Science group is looking for an experienced Data Scientist to help develop solutions for the next... ...collaboration and interaction with other scientists and engineers while prototyping, integrating and testing the technology for the...Temporary workWork experience placement$135k - $150k
...Fabric medallion architecture (Bronze → Silver → Gold), ensuring data flows optimally from raw ingestion through conformed, analytics... ...— balancing speed, reliability, and cost. Establish the engineering practices that keep the platform healthy as it scales: version...Full timeContract work$89.31k - $134.87k
...motivated, and collaborative people, and help us make financial protection accessible to all. A Brief Overview Maintain and enhance data integrity by supporting existing validations and adding additional data validations around key data points like security master,...Work experience placementImmediate startRemote work$149.6k - $202.4k
...Company is currently seeking a highly motivated, Senior Systems Engineering Analyst to join the F-15 team located in Berkeley, MO .... ...and expertise to research, analyze and compile complex technical data. Developing system architectures, functional requirements, etc...Permanent employmentFull timeImmediate startRelocationVisa sponsorshipWork visaRelocation packageFlexible hoursShift workDay shift- ...Develops and maintains auditing procedures and rating documentation for all assigned accounts. Analyzes audit and rating performance data and recommends process improvements that will improve customer outcomes, audit quality, and operational efficiency. Collaborates...Contract workWork at office
- ...information technical partners can understand. Qualifications Associate or Bachelor's degree preferred in Business, Finance, IT, Data Analytics, or related field. Experience in business analysis, technical analysis, systems, ERP, or a related role. Strong...Full time
$750 per week
...accepting applicants for Focus Group studies. Earn up to $750 per week part-time working from home. Must register to see if you qualify. No Data Entry experience needed. Data Entry Clerk Work From Home - Part Time Remote Focus Group Panelists Our company is seeking...Extra incomeFull timeTemporary workPart timeLocal areaRemote workWork from homeFlexible hours- ...- (BA to document the requirements, experience with Telemetry data, IOT data collection, AWS Cloud etc will be value add) Responsibilities... ...with cross-functional teams including product managers, data engineers, cloud architects, and stakeholders. Key Responsibilities:...
$105k - $128.14k
...Solutions, a part of Boeing Global Services BGS, is seeking a Software Engineer in Maryland Heights, MO to support future franchise programs.... ...engineering technology), chemistry, physics, mathematics, data science, or computer science and 5+ years of related work experience...Permanent employmentFull timeWork experience placementInterim roleWorldwideRelocationVisa sponsorshipWork visaRelocation packageFlexible hoursShift workDay shift- ...This role serves as a vital bridge between business users and engineering teams to ensure optimal systems performance.Key ResponsibilitiesReviews... ...partners. Frequency varies for text messages. Message and data rates may apply. Carriers are not liable for delayed or...
- ...control, and technology refresh processes. Understanding of cybersecurity best practices, endpoint security, phishing awareness, and data protection principles. Requisite Experience* Associate degree in Computer Science, Information Technology, or a related...Work experience placementRemote workMonday to FridayFlexible hoursAfternoon shift
- ...important role in maintaining reliable building access, supporting our customers and installation partners, and collaborating with Engineering, Product, and Operations teams to resolve technical challenges. We are seeking a technically curious, resourceful, and...Temporary workWork at officeImmediate startRemote workFlexible hoursNight shift3 days per week
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Hadoop Data engineer. Be the first to apply!
Related searches
- data collection researcher Maryland Heights, MO
- data analysis part time Maryland Heights, MO
- data collection Maryland Heights, MO
- data modeling Maryland Heights, MO
- data Maryland Heights, MO
- data labeling Maryland Heights, MO
- data cabling installation Maryland Heights, MO
- test data management Maryland Heights, MO
- provider data management Maryland Heights, MO
- data tech Maryland Heights, MO









