Research Crawling Engineer
$160k - $250kTrue Talent Solutions Partners
About the Role
Join a data infrastructure team building large-scale web crawling systems and datasets for AI research and model development. This role focuses on reliable data acquisition across diverse, changing web environments.
What You'll Do
Build and maintain web crawlers across social, travel, and multilingual websites.
Design high-throughput, fault-tolerant systems that collect millions to billions of URLs per day.
Adapt crawling approaches to anti-bot systems, rate limits, and dynamic or JavaScript-heavy sites.
Develop pipelines to clean, deduplicate, filter, and normalize web data at TB-to-PB scale.
Build and maintain datasets for research and model training in collaboration with research teams.
Monitor crawl performance, coverage, and data quality, and adjust systems as websites change.
Optimize crawling infrastructure for cost, latency, and reliability across cloud or bare-metal environments.
What We're Looking For
At least 2 years of experience building web crawlers or large-scale data pipelines; typically 4 or more years, or 2 or more years with a PhD.
Hands-on experience building and operating web crawlers at scale, including data pipelines handling TB-scale workloads.
Strong proficiency in Go, Rust, Python, Java, or C++, with experience in distributed systems or parallel processing.
Deep knowledge of networking, and browser behavior, including experience working with anti-bot systems, rate limits, and JavaScript-heavy sites.
Experience with headless browsers, proxy systems, IP rotation, and request orchestration is valuable.
Familiarity with data quality evaluation, large-scale data processing, and cloud or bare-metal infrastructure.
Experience with NLP pipelines, machine learning dataset curation, or AI research data is a plus.
A degree in computer science, engineering, or a related technical field is helpful; a PhD is a plus.
Compensation & Benefits
Salary range: $160,000 to $250,000 annually. Visa sponsorship is not available.
Location
Remote.
- ...the development of next-generation open models, the full-time Research Engineer will find and evaluate training data, build scalable data... ...end and collaborating with researchers Relevant experience in web crawling, document extraction, or large-scale corpus curation...SuggestedFull timeRemote work
Virtual Vocations Inc
United States5 days ago - ...About ElevenLabs ElevenLabs is an AI research and product company transforming how we interact... ...of their lives. We are researchers, engineers, and operators. IOI medalists and ex-... ...ElevenLabs, focused on large-scale web crawling for our frontier AI models. The quality...SuggestedFull timeImmediate startRemote work
Elevenlabs
Remote7 days ago $150k - $350k
...models trained end to end for long-horizon tasks like autonomous research, and the full-stack platform our own research team uses to... ...improve the system. Relevant experience may include: Web crawling, document extraction, code-data collection, or large-scale corpus...SuggestedFull timeRemote workVisa sponsorshipRelocation packageFlexible hours- ...the industry. \n \n Job Summary \n The Senior Innovation Engineer is a key member of the Front-End Innovation and Product... ...This role combines disruptive innovation, advanced engineering research, and product development activities to drive product differentiation...SuggestedWork from homeOverseas
Midea America
Louisville, KY6 days ago - ...tracking tools). Develop reproducible pipelines that enable researchers to compare model performance across versions and datasets .... ...Develop lightweight internal tools and dashboards that allow engineers and researchers to: Inspect model outputs Compare...SuggestedFull timeRemote work
Green Key Resources
United States2 days ago - ...students to review reinforcement learning tasks and environments used to test whether frontier AI models can carry out real research and engineering work. Other contributors design the tasks. Your job is to make sure each one is correct, fair, and actually measures what...Contract workPart timeRemote workFlexible hours
Cobalt
United States1 day ago $90k - $120k
...Research Engineer Photonic Integrated Circuit Development Job Location: Golden (Hybrid Remote) Job Type: Full Time Salary: $80,000-$120,000 based upon education, work experience, and skill Please send your resume with a cover letter to ****@*****.***...Full timeWork experience placementRemote workFlexible hoursVescent
Golden, CO4 days ago- ...Research Engineer, Biological Safety and Orthopedic Devices Location: Remote, US-based Preferred location: Denver, CO, with onsite work possible for local candidates We are looking for a Research Engineer to support investigation, research, and remediation...Local areaRemote work
Mantu
Denver, CO2 days ago - Research & Engineering ManagerJob DescriptionJoin the team behind iconic brands like Huggies, Kleenex, Cottonelle, Scott, Kotex, Poise, Depend, and Kimberly-Clark Professional. At Kimberly-Clark, it’s all here for you—innovation, growth, and the chance to make a real impact...Full timeLocal areaRemote workRelocation packageFlexible hours
Kimberly-Clark
Roswell, GA1 day ago $104k
...organization spread across the U.S. and Canada. Sony AI is Sony's new research organization pursuing the mission to use AI to unleash human... ...Summary We are seeking a motivated and passionate Research Engineer Intern to join our interdisciplinary team working at the...Hourly payInternshipLocal areaRemote workWorldwide$150k - $350k
...models trained end to end for long-horizon tasks like autonomous research, and the full-stack platform our own research team uses to... ...optimizing GPU inference systems, with an understanding of inference-engine internals. Strong Python skills and experience with PyTorch...Full timeRemote workVisa sponsorshipRelocation packageFlexible hours- ...About ElevenLabs ElevenLabs is an AI research and product company transforming how we interact with technology. We launched in January... ...doing the best work of their lives. We are researchers, engineers, and operators. IOI medalists and ex-founders. If you want to...Full timeImmediate startRemote work
$150k - $250k
...traditional 9-to-5. The Opportunity We're building the engine that solves customer challenges at scale. When customers hit a... ...steerable and cloned voices, and using their feedback to guide the research methodology Releasing new benchmarks for Voice AI use-cases...Full time$150k - $350k
...models trained end to end for long-horizon tasks like autonomous research, and the full-stack platform our own research team uses to... ...jobs and improve end-to-end throughput, working with systems engineers on hardware-aware execution. Make long runs resilient to failures...Full timeRemote workVisa sponsorshipRelocation packageFlexible hours- ...how we build, and it is how we hire. Job Summary Lead applied research in one or more Orbis AI focus areas — agentic AI, knowledge... ...evaluation, and honest error analysis — with methodology another engineer can reproduce. Build and maintain the datasets and evaluation harnesses...Full timeWork at officeRemote work
$127k - $235k
...solutions for customers? Then come and apply your skills and passion for technology at Thomson Reuters Labs.We are seeking a Senior Research Engineer who will bring expertise in AI and ML and is interested in building data-driven capabilities that transform the way legal,...Full timeWork at officeLocal areaRemote workFlexible hoursThomson Reuters
Saint Paul, MN2 days ago$84.58k - $130k
Research --> Basic Science/TechnicalNew York • ID: 1160040_RR00118667 • Full-Time/RegularNYU Grossman School of Medicine is one... ...We have an exciting opportunity to join our team as a Research Engineer. This position offers an exceptional opportunity to contribute...Full timeNYU Langone Medical Center
New York, NY1 day ago$86.08k - $129.12k
...capability required for job execution. Embrace a diverse and inclusive cultureMinimum Qualifications:Bachelor’s degree in Electrical Engineering/ Mechatronics/ Mechanical Engineering (with minor in Electronics or Electrical Engineering) with 5+ years of experience or Master...Full timeSummer workWork at officeLocal areaFlexible hoursZebra Technologies Corporation
Morris Plains, NJ5 days ago- ...The Cloud Technology Advancement Department of the Applied Research Laboratory (ARL) at Penn State University is seeking graduate... ...integrate supporting AI/ML models, agentic workflows, and agentic engineering services Develop HPC / cloud security principals, protocols...Part timeFor contractorsInterim roleRemote work
The Pennsylvania State University
University Park, PA4 days ago $192k - $304.75k
We are now looking for a Senior Research Engineer passionate about Generative AI inference. Are you excited to change the way people infuse AI into products and services? NVIDIA is at the forefront of generative AI models, from language to images. NVIDIA provides building...Full timeRemote workNvidia
Santa Clara, CA4 days ago$81.2k - $121.8k
...automotive and intelligent mobility. This is not an IC chip design engineer role. This role combines semiconductor expertise with field... ...flag weak signals and propose initiatives. Conduct approved research through visits, interviews, conferences, demonstrations, and...Full timeTemporary workWork experience placementRemote workRelocation packageShift workHonda Dev. and Mfg. of Am.,LLC
Raymond, OHa month ago$99.6k - $192.9k
In this position...This is an opportunity to work in a research environment defining the next generation of emissions and aftertreatment... ...'s degree in Mechanical / Chemical / Automotive / Controls Engineering or a related field3+ years of experience in engine, emissions,...Immediate startFord
Dearborn, MI5 days ago- ...development, optimization, and validation.Document results, maintain accurate records, and provide technical insights to engineering and research teams.Operate general machine shop and material-fabrication tools in accordance with safe operating procedures.Required QualificationsBachelor...Full timeLocal areaWork from home
General Motors
Center Line, MI4 days ago $100.32k - $144.21k
Valencia, CA (Hybrid) Senior Engineer, Research Advanced Bionics is seeking a Senior Engineer, Research to support the design and development of in-situ neural measurement and brain health monitoring capabilities within cochlear implant systems. This onsite role applies...Temporary workWork experience placementRemote workFlexible hoursSonova
Valencia, CA2 days ago$86.8k - $165.2k
...leading businesses, world-class operations and investments in research and development, we offer capabilities and opportunity no one else... ...and propulsion technology to serve as a Senior Research Engineer. The successful candidate will join an inter-disciplinary research...Temporary workWork experience placementWork at officeRemote workFlexible hoursRaytheon
East Hartford, CT4 days ago$115k - $265k
Research Engineer Opportunities - IDA Center for Computing SciencesThe Institute for Defense Analyses Center for Computing Sciences (IDA/CCS) is looking for outstanding researchers to address difficult computing problems vital to the nation's security. IDA/CCS is an independent...For contractorsFlexible hoursInstitute for Defense Analyses
Bowie, MD1 day ago$90.58k - $134.74k
OverviewFrom our Ann Arbor, MI office, we have an opening for a Research Engineer with RF hardware experience. You will participate in multi-disciplinary, collaborative teams and contribute to the development of state-of-the-art remote sensing and surveillance processing...Work at officeRemote workSRI International
Ann Arbor, MI1 day ago$161.8k - $242.6k
Company:Qualcomm Technologies, Inc.Job Area:Engineering Group, Engineering Group > GPU ASICS EngineeringGeneral Summary:Qualcomm’s GPU Research Team is seeking innovative GPU architects to advance state-of-the-art capabilities in Artificial Intelligence (AI), Machine Learning...Work experience placementWork from homeQualcomm
San Diego, CA1 day ago$150k - $200k
Santa Clara, CASoftware Engineering - Controls /Full-time /HybridPlusAI is a Physical AI company pioneering AI-based virtual driver software... ...for talented individuals to join its fast-growing teams.As a Research Engineer, you will deliver mission-critical improvements and...Full timePlus.ai
Santa Clara, CA1 day ago$62k - $141k
PNT Research EngineerThe Opportunity:Are you passionate about developing Positioning, Navigation, and Timing (PNT) solutions? Do you enjoy working where science, engineering, and mission-driven innovation meet? If you are excited about supporting cutting-edge science and...Full timeContract workPart timeWork at officeLocal areaRemote workBooz Allen Hamilton
Washington DC1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Research Crawling Engineer. Be the first to apply!
- research engineer Remote
- engineering change analyst Remote
- engineering business analyst Remote
- junior machine learning research engineer Remote
- research programmer Remote
- senior research engineer Remote
- engineering analyst Remote
- deep learning research engineer Remote
- lab research Remote
- cosmetic research Remote