Data Acquisition Engineer: Scale Web Crawling & Pipelines

Vagaro Inc

Vagaro in Pleasanton, CA is seeking a Data Acquisition Engineer to design and build scalable systems for collecting and processing high-quality external data. Candidates should have 3+ years of experience in web crawling and scraping, along with strong programming skills in Python or JavaScript. The role requires a hands-on approach to manage data flows and ensure compliance with data collection practices. Comprehensive benefits and a collaborative work culture make this a compelling opportunity for growth. #J-18808-Ljbffr

Apply

Vacancy posted 7 hours ago

Similar jobs that could be interesting for youBased on the Data Acquisition Engineer: Scale Web Crawling & Pipelines in Pleasanton, CA vacancy

Data Engineer, Data Acquisition (Web Crawling & Pipelines)
$120k - $135k
...the Role We are seeking a Data Acquisition Engineer to design, build, and scale systems that collect,... ...external data from the web and third-party sources.... ...role combines hands‑on web crawling, scraping, and data... ...business goals Optimize pipelines for performance, scalability...
Pipeline
Web
Monday to Friday
Vagaro Inc
Pleasanton, CA
7 hours ago
Software Engineer, Data Infrastructure & Acquisition - Fremont, CA, USA
$140k - $200k
...Chrome Extension, and Web App. Google recently named... ...frontend and backend engineers, AI research scientists... ...looking to hire for our Data side of our AI team at... ...quality datasets at petabyte-scale and low cost through a... ...it into our ingestion pipeline Operate and extend the...
Pipeline
Web
Full time
Work at office
Shift work
Speechify
Fremont, CA
2 days ago
Agentic Analytics Engineer
$80 per hour
...Job Title: Agentic Analytics Engineer (contract) PR: $80/hr Contract... ...scientific and business data from multiple sources to generate... ...an AI can follow. RAG Pipeline Maintenance: Build and optimize... ...Nice to Haves: Experience in web application development...
Pipeline
Web
Contract work
Work experience placement
Immediate start
Medasource
Hayward, CA
4 days ago
Data Engineer
...are looking for a highly skilled Senior Azure Databricks (ADB) Developer to join our Data Engineering team. This role involves developing large-scale batch and streaming data pipelines on Azure Cloud. The ideal candidate will have strong expertise in Python, Databricks...
Pipeline
InterSources
Pleasanton, CA
3 days ago
DATA ENGINEER
...Overview: Job Summary: The Senior Data Engineer will be responsible for designing, building, and maintaining robust data pipelines and architectures on AWS to support... ...~ Proficiency in PySpark for large-scale data transformation and processing. ~...
Pipeline
Purple Drive
Pleasanton, CA
1 day ago
Senior Data Engineer
...Senior Data Engineer Location: Pleasanton, California (hybrid work) Role Overview As... ...ownership of core data infrastructure—from pipelines to storage to data products. You'll be a... ...optimization, stored procedures, large-scale workloads). Advanced knowledge of...
Pipeline
SnapCode Inc
Pleasanton, CA
3 days ago
Sr. Data Engineer
$93k - $124k
...Job Description Summary As the Sr. Data Engineer, you will play a critical role in building... ...logging, and alerting, optimizing data pipelines for scalability, and ensuring compliance... ...this job. Desired Characteristics: Web application stacks (Node.js, Vue, React)...
Pipeline
Web
Permanent employment
Contract work
Remote work
Visa sponsorship
Work visa
Relocation package
GE Aerospace
San Ramon, CA
2 days ago
Account Executive
$100k - $150k
...Account Executive (SAE) to join our Acquisition Sales organization. This role... ..., and closing. Master pipeline management: maintain disciplined... ...Salesforce. Leverage data-driven insights: use metrics,... ...visitors, while a full range of web presence offerings has established...
Pipeline
Web
Base plus commission
Remote work
Martindale-Avvo
Pleasanton, CA
2 days ago
Senior Data Engineer — Lakehouse & Real-Time Pipelines
...organization in life sciences is seeking a Senior Data Engineer to lead the design and implementation of a... ...will build real-time and batch data ingestion pipelines and develop complex ETL workflows to optimize large-scale data processing. The ideal candidate has over 5...
Pipeline
Veeva Systems
Pleasanton, CA
4 days ago
Data Analytics Engineer
...Data Analytics Engineer VentureSoft Global, Inc. is a technology services company specializing in... ...Engineer, you will build and maintain data pipelines, tools, and visualizations to enable... ...existing tools, and evangelize for scaled approaches to expand data access and insights...
Pipeline
Remote work
Flexible hours
Venturesoft
Pleasanton, CA
4 days ago
Archer Data Scientist
...the Fortune 500. Learn more at Data Scientist - LLM & Data Pipeline Engineering (LegalTech / RegTech AI)... ...AWS & Deployment * Deploy and scale AI pipelines using AWS services such... ...decisions. Layoffs, reorganizations, acquisitions, and mergers. Yet, throughout these...
Pipeline
Local area
Archer Technologies
Livermore, CA
3 days ago
Senior Data Engineer
$115k - $175k
..., employees, and communities. The Role A Senior Data Engineer who can lead the design and implementation of our... ...Build and manage real-time and batch data ingestion pipelines using Kafka and Spark. Deploy, manage, and scale data workloads (such as Spark executors) using...
Pipeline
Work at office
Local area
Work from home
Veeva Systems
Pleasanton, CA
5 days ago
.NET Full Stack Developer
...APIs and microservices using ASP.NET Core Web API Implement secure authentication... ..., ConfigMaps, and Secrets Implement scaling, rolling updates, and health monitoring... ...Qualifications Experience with CI/CD pipelines Knowledge of Infrastructure as Code...
Pipeline
Web
Permanent employment
Contract work
Local area
Remote work
Tekfortune Inc
Pleasanton, CA
2 days ago
Backend Developer
...services using Spring Boot, Quarkus, and modern web technologies, following 12-factor app... ..., CI/CD automation, and deployment pipelines. Build and deploy containerized applications... ...or OCI) for application deployment, scaling, and operational readiness. If required...
Pipeline
Web
Ampcus
Pleasanton, CA
5 days ago
Principal Integrations Developer, Workday HCM
...seamless, secure, and scalable data flow across our global... ...Core Connectors, and Workday Web Services (SOAP/REST) Partner... ...to enable scalable people data pipelines, reporting, and advanced analytics... ...Snowflake is growing fast, and we're scaling our team to help enable and...
Pipeline
Web
Work at office
3 days per week
Snowflake Computing
Dublin, CA
2 days ago
Full Stack Engineer
...Provide software application engineering and maintenance for all phases... ...search application including crawling, indexing, query tuning,... .... Create and update CI/CD pipelines to build and test new features... ...trends and best practices in web architecture and design in one...
Pipeline
Web
Vets Hired
Livermore, CA
4 days ago
IT Consultant IV, Solutions - Data Engineer
$129.2k - $167.2k
...technical initiatives-solving problems at scale, driving improvements in performance... ...follow. You will partner closely with Data Engineering, Platform Engineering, Data Science, Architecture... ...Develop & Maintain Scalable Data Pipelines: Architect, build, and optimize ETL/...
Pipeline
Full time
Temporary work
Work experience placement
Work from home
Flexible hours
Shift work
Kaiser Permanente
Pleasanton, CA
1 day ago
AI Data Infrastructure Engineer
$100k - $150k
...to grow, we're looking for a skilled AI Data Infrastructure Engineer to join our dynamic team and contribute to... ...Engineer to build and operate the large-scale data systems that power modern AI training and evaluation pipelines. The role combines deep data engineering...
Pipeline
Full time
H1b
Local area
Immediate start
Remote work
Visa sponsorship
Work visa
Bright Vision Technologies
Dublin, CA
3 days ago
Java Full Stack Architect - Pleasanton, CA (Onsite Role)
...Designing and building and maintaining large web systems at scale • 5+ years of experience in... ...with knowledge and experience with CICD pipeline, Containerization, APIs and Infrastructure... ...with relational, NoSQL databases and data warehouse concepts. • Strong knowledge...
Pipeline
Web
Futran Tech Solutions Pvt. Ltd.
Pleasanton, CA
4 days ago
Software Engineer (XO) - Platform Consumption Console
$148k - $222k
...central nervous system for usage data across the enterprise. By engineering seamless data ingestion pipelines, pinpoint-accurate billing... ...years to come. Massive Technical Scale: This is not a maintenance... ...years of experience with UML, Web application development or SaaS...
Pipeline
Web
Work experience placement
Work at office
Immediate start
Remote work
Home office
Flexible hours
HR Tech Job
Pleasanton, CA
6 hours ago
Senior Azure Data Platform Engineer - Scale & Automate
...design and support enterprise-grade Azure data platforms. The ideal candidate will have... ...10 years in IT infrastructure and cloud engineering, with a focus on building Azure data... ...Responsibilities include creating CI/CD pipelines and optimizing performance and cost for...
Pipeline
SIMARN Solutions
Fremont, CA
4 days ago
Full Stack Engineering Intern
$30 - $35 per hour
...Full Stack Engineering Intern Pleasanton, California,... ...and connects operational data across siloed systems,... ...decision-making at industrial scale. Cutting-Edge AI... ...experience with modern web technologies and cloud... ...tools and deployment pipelines Familiarity with AWS...
Pipeline
Web
Full time
Internship
Local area
Avathon
Pleasanton, CA
4 days ago
Principal Product Manager, Developer Platform Experience
$196k - $294k
...developer content pipeline end-to-end, working across product, engineering, and developer relations... ...success building, scaling, and driving... ...analytical capability with data systems,... ...familiarity with APIs, web services,... ...through launch, user acquisition, and continuous data...
Pipeline
Web
Work at office
Remote work
Home office
Flexible hours
Workday
Pleasanton, CA
3 days ago
Data Engineer: Real-Time Pipelines & ML in Production
$88.1k - $141k
...Cornerstone Research in Dublin, CA is seeking a Data Engineer to design and maintain data pipelines in a hybrid work environment. Candidates should have strong SQL skills and experience with cloud-based data solutions. The role involves working with data ingestion tools...
Pipeline
Cornerstone Research
Dublin, CA
4 days ago
Research Engineer
...Research Engineer, Foundation Models About the Opportunity... ...generation of large-scale AI systems. This role... ..., and deployment pipelines for large-scale AI models... ...manage large-scale data processing, collection... ...ETL, Data Processing, Web Crawling, Data Collection, Feature...
Pipeline
Web
Visa sponsorship
Relocation package
Flexible hours
Acceler8 Talent
Fremont, CA
4 days ago
.NET Full Stack Developer
$100k - $150k
...maintain enterprise-grade web applications and... ...This role spans the full engineering lifecycle - requirements... ...Contribute to CI/CD pipeline integration, automated... ...runbooks so that the team can scale and onboard new... ...programming principles, data structures, design patterns...
Pipeline
Web
Full time
H1b
Local area
Immediate start
Remote work
Visa sponsorship
Work visa
Bright Vision Technologies
Dublin, CA
3 days ago
Data Engineer
...computer science, applied math, physics, engineering, statistics, economics or related field.... ...3+ years of industry experience in Data Engineering 3+ years of work experience... ...experience on building modern data pipelines - Ingestion, Profiling, Integration, Summarization...
Pipeline
Work experience placement
Apex Informatics
Pleasanton, CA
2 days ago
Data Engineer (Hybrid) - Dublin, CA /Houston, TX
...Data Engineer (Hybrid) Dublin, CA / Houston, TX (onsite 1-2 days a week) Duration: 6 month CTH Top skill sets: Snowflake Must... ...develop Experienced with designing and implementing data pipelines that move data from various sources (such as database) into Snowflake...
Pipeline
2 days per week
1 day per week
Staffing the Universe
Dublin, CA
2 days ago
Senior Data Engineer
...Data Architect / Senior Data Engineer Accomplished Data Architect / Senior Data Engineer with 12+ years of... ...domains. Architected scalable ETL/ELT pipelines using Python, PySpark, Databricks,... ...data processing. Led enterprise-scale Data Architecture initiatives,...
Pipeline
Cynet Systems
Fremont, CA
3 days ago
Java Full Stack Developer
$100k - $150k
...maintain enterprise-grade web applications and... ...operate at significant scale and across multiple business... ...for the end-to-end engineering lifecycle, from translating... ..., ensuring predictable data flow, easier debugging,... ...meaningfully to CI/CD pipeline design and deployment automation...
Pipeline
Web
Full time
Contract work
H1b
Local area
Immediate start
Remote work
Visa sponsorship
Work visa
Bright Vision Technologies
Dublin, CA
3 days ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Data Acquisition Engineer: Scale Web Crawling & Pipelines. Be the first to apply!