Senior Data Engineer
IdelSoft
Senior Data Engineer
We are looking for a skilled Data Engineer to own and scale our data processing pipelines and search infrastructure. This role is ideal for someone with strong AWS and Elasticsearch expertise, a passion for clean data, and the ability to think deeply about data architecture, scalability, and distributed systems — not just implement pipelines, but design robust foundations for growth and search performance in real-world applications.
Responsibilities
- Own and maintain our data pipelines using AWS Glue (PySpark) and S3
- Process and manage large-scale datasets stored in Elasticsearch and MongoDB
- Build and optimize workflows for data transformation, cleaning, and normalization
- Improve the performance and relevance of our search system through algorithmic tuning and semantic enhancements (e.g. LLMs, DeepL, embeddings)
- Monitor data quality, handle schema evolution, and ensure operational stability
- Collaborate with backend and product teams to ensure fast, reliable, and accurate data-driven features
- Contribute to data architecture and system design decisions, with a focus on scalability, maintainability, and distributed processing
Must-Have Skills
- Solid experience with AWS data engineering tools (Glue, S3, Lambda)
- Strong knowledge of Elasticsearch (query design, aggregations, performance tuning)
- Proficiency in Python, especially with PySpark and Pandas
- Experience with data quality, schema evolution, and pipeline monitoring
- Experience with Kafka or other streaming systems
- Strong understanding of data architecture, data modeling, and scalable system design
- Ability to reason about distributed data systems and build solutions that scale reliably
Nice-to-Have
- Experience with CDC pipelines (Debezium or similar)
- Experience designing distributed data platforms
- Familiarity with LLMs, embeddings, or search ranking improvements
- Previous experience with B2B datasets, contact enrichment, or lead intelligence
Why Join
- Shape the tech direction and build from the ground up
- Collaborate closely with the founder on product execution
- Work with real user feedback and fast iteration cycles
Interview Process
- HR Interview
- Cultural Fit Interview
- Technical Interview
Benefits
- 100% remote
- Competitive salary in USD
- PTO (vacation, sick leave, holidays)
- International experience
- Udemy trainings covered
- $200 for home-office equipment
Vacancy posted 4 days ago
Similar jobs that could be interesting for youBased on the Senior Data Engineer in United States vacancy
- ...MANTECH seeks a motivated, career and customer-oriented Senior Data Engineer to join our team in Chantilly, VA. In this role, you will leverage your software development expertise to support the design, ingestion, cleansing, transformation, loading, and visualization...SeniorWork at office
MANTECH
Chantilly, Loudoun County, VA10 hours ago - Job ID: 21061868Reference Number: 24-00028Title: Senior Data EngineerLocation: Iselin, NJ, 08830Posted Date: 2024-01-05Company: HAN StaffingDESenior
- Job ID: 21057342Reference Number: 24-00019Title: Senior Data EngineerLocation: Iselin, NJ, 08830Posted Date: 2024-01-04Company: HAN StaffingData EngineerSenior
- ...\ Duration: 6 months \ \ Work Authorization: \\ GC, USC, All valid EADs except H1B, OPT, CPT \ Must Have: \ \ ~4–6+ years of data science or machine learning experience \ ~ NLP classification for customer messages or call transcripts \ ~ Intent, topic, sentiment...SeniorFull timeH1bRemote work
Akube
United States10 hours ago - ...hybridExperience with UC delta share and UC cataloguesImplemented ALMLOpsJob DutiesWrite and manage notebooks in DatabricksImplementing new data analytics requirement using ADLS Gen2 Pyspark Python Scala and SQLJob monitoring problem solving of iris service now ticketsCode...Senior
- THE GLOBAL LEADER IN DATA & ANALYTICS RECRUITMENTHarnham Search and Selection Company Number: 05723485Harnham Search and Selection is a registered company in England and Wales. Reg no. 05723485Harnham Europe Limited Company Number: 09956940Harnham GmbH HRB: 196954Harnham...SeniorWork at office
- Job ID: 21295731Reference Number: 24-00153Title: Senior Healthcare Data EngineerLocation: Iselin, NJ, 08830Posted Date: 2024-02-07Company:... ...Healthcare DomainMinimum of 10+ years of experience in Data Engineering.Required technical skills: Python, PySpark, SQL,...SeniorContract workRemote work
- ...DeveloperWork Location : Tampa, FloridaJob SummarySeeking an experienced Ab Initio Python Developer with strong expertise in ETL development data integration and enterprise data processing The candidate will be responsible for designing developing supporting and optimizing...Senior
- ...Computer SoftwareClient: WiproContact: Meghana GorusuCompany: SRI Tech SolutionsJob Title: Senior Data EngineerLocation - Mount Laurel, NJ (Day 1 Onsite)Job Description:Senior Data Engineer with 10 + years of experienceWorked on ETL, Azure, Databricks, Informatica, Oracle...SeniorWork at office
- ...PCCI) Dallas, TX | Hybrid Are you passionate about using data and technology to improve health outcomes for underserved... ...community outcomes. Position Summary PCCI is seeking a Senior Data Engineer for a contract-to-hire opportunity . This hands-on technical...SeniorLong term contractContract work
Parkland Health and Hospital System
Dallas, TX9 hours ago - TBDGen is proud to be an equal-opportunity employer, committed to diversity and inclusivity. We base employment decisions on merit, experience, and business needs, without considering race, color, national origin, age, religion, sex, pregnancy, genetic information, disability...SeniorFull time
- Senior to Principal Data Engineer (SQLserver, Financial Services), Boston, MA. Hybrid, min 3 days week in office, 135k to 175k base on experienceCompensation Commensurate with experience, EOE, diverse highly educated culture Candidates must be a U.S. citizen or national...SeniorPermanent employmentContract workWork at officeLocal area3 days per week
- ...CClient: TechMContact: Bhargav Chukka, Gulam Mohammed , Jhansi Bugatha, Vamsi SattaruCompany: SRI Tech SolutionsJob Summary (Senior ML Data Engineer) - Lead the design and maintenance of scalable data pipelines using Databricks, Spark, and Airflow. - Develop and manage...SeniorHourly pay
$116.1k - $170.28k
...About the Role: We are seeking a highly skilled and experienced Senior Big Data Engineer to join our dynamic team. The ideal candidate will have a strong background in developing batch processing systems, with extensive experience in the Apache Hadoop ecosystem (Map...SeniorRemote jobFull timeRackspace
Remote10 hours ago- ...Bellevue, WAEmployment Type: C2CIndustry: Computer SoftwareClient: WiproContact: Meghana GorusuCompany: SRI Tech SolutionsRole: Senior Data Engineer Location: Bellevue, WA Job Description: We are seeking a skilled and motivated Senior Data Engineer/Data Engineer to join...Senior
- ...uurHBOStafRotterdamEen baan boordevolInnovatie: Jij bouwt en optimaliseert data-backendoplossingen die onze organisatie intelligenter en efficië... ...te ontwikkelen en te implementeren.Jij gaat het makenAls Data Engineer bij Croonwolter&dros ben jij verantwoordelijk voor het ontwerpen...SeniorFull timeWork at office
$45 - $55 per hour
DescriptionKforce has a client in Minneapolis, MN that is seeking a hybrid Senior Data Engineer to join their team.Summary:The client is looking for a Senior Data Engineer that can hit the ground running with a growing team. This team is focused on a large aspect of the...SeniorFlexible hours- ...Metro Area, Texas, United StatesPosted: 2025-11-11Company: Addison GroupTitle: Senior Data EngineerLocation: Coppell, TXSalary Range: $120K-$140KWe are looking to bring on a Senior Data Engineer to our team due to growth. What we need is someone who comes 8+ years of...Senior
- ...candidate is a problem-solver who enjoys working on complex data systems and is passionate about data quality. You thrive in collaborative... ...and confidently.About the RoleWe're seeking a talented Senior Data Engineer to join our Enterprise Architecture team in a cross-cutting...Senior
- ...services. We are in search of a highly motivated candidate to join our talented Team.Job Title: Senior Data EngineerLocation: McLean, VA (Remote)Summary: Our Data Engineering team is dedicated to integrating our client data and applications with client infrastructure....SeniorRemote work
- ...award of contract**SOS International LLC (SOSi) is seeking a Data Engineer (C4ISR Architecture) to support our customer in McDill AFB, Florida... ...Department of Education and an additional 5 years of related senior experience, for a total of 17 years, as a substitute to the...SeniorContract workWork at officeWorldwide
- Position SummaryOdyssey has an exciting opportunity for a Senior Weapon Data Link Engineer supporting the Air Force Life Cycle Management Center Armament Directorate. This role provides systems engineering and acquisition support to advance Air Force weapons programs....SeniorFull timeContract workLive out
- Job Title: Sr. DATA Engineer Work LocationTampa FLJob Description:Mandatory Karat InterviewRole Overview We are seeking a highly skilled and motivated AWS Certified Engineer to design build and optimize scalable data solutions within the Amazon Web Services AWS ecosystem...Senior
- ...and Business consulting services. We are in search of a highly motivated candidate to join our talented Team. Job Title: Senior Data Engineer Location(s): White Plains, NYWe are seeking a Senior Data Engineer to join our Data Services team. The ideal candidate will...Senior
$180k - $220k
Senior Data Engineer - Market and Credit Risk PlatformsLocation: New York City or Remote (US-based)Salary: $180,000 - $220,000 base (commensurate with experience)About the RoleWe are looking for an accomplished Senior Data Engineer to join a dynamic team focused on designing...SeniorWork at officeRemote workFlexible hoursShift work2 days per week1 day per week$150k - $190k
...capabilities are our top-tier program and project management, data analytics, and audit services, the backbone of which is... ...and trusted results. We are looking for a dynamic Senior Data Scientist/ML Engineer with an active TS/SCI CI Poly or higher to join our team...SeniorFull timeTemporary workWork experience placementCathexis
Remote10 hours ago$120k - $170k
OverviewSteampunk wants you to join our awesome team as a Senior Data Visualization Engineer. In this role you'll be working with a large team of Steampunk and clients to identify data sources, tools, and mission challenges that can all be brought together to create decision...Senior$60 - $66 per hour
DescriptionKforce has a client that is seeking a Senior Data Engineer in Charlotte, NC.Requirements* Minimum 8 years of hands-on data engineering experience in development using Python and Pyspark* Experience in AWS cloud services like Glue, Lambda, MSK (Kafka), S3, Step...Senior- About the RoleJoin the Supply Chain AI Hub as a Senior Data Engineer helping turn AI ambition into reliable data foundations and delivery-ready assets. This role helps engage business, engineering and ICT stakeholders around practical data needs and constraints, scale...Senior
$121k - $151k
Las Vegas, Nevada • Job Type: Direct Hire • Posted: 1 month agoSenior Data Engineer -Will RELOOur client is investing heavily in modernizing its data platform and is looking for Senior Data Engineers who want to build impactful, scalable solutions from the ground up. This...SeniorLocal areaVisa sponsorship
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Senior Data Engineer. Be the first to apply!
Related searches
- junior data engineer remote United States
- data pipeline engineer United States
- director data engineering United States
- hadoop big data developer United States
- data engineer intern United States
- senior data quality engineer United States
- senior cloud data engineer United States
- data engineer contract United States
- data infrastructure engineer United States
- junior data developer United States