Python Web Scraping Engineer — Crawler Architect
Invisible Technologies
Invisible Technologies in San Francisco is looking for a skilled Python Developer to create and maintain web scrapers for various platforms. The ideal candidate will have extensive experience developing Python scripts with a focus on overcoming technical challenges in web scraping.
The position requires a solid background in API development, SQL databases, and familiarity with various web development frameworks. Strong interpersonal skills and the ability to work with diverse teams are essential for this position.
#J-18808-LjbffrVacancy posted 2 days ago
Similar jobs that could be interesting for youBased on the Python Web Scraping Engineer — Crawler Architect in San Francisco, CA vacancy
- ...Software solutions is looking for a Gen AI Architect Details: GenAI Architect (... ...architect. ~ Must have : Core Python - Iterators, Generators , OOP concepts,... ...ChromaDB ~ Deep expertise in Prompt Engineering using DsPy tools etc. ~ Knowledge of...Python
Nava Software Solutions
San Francisco, CA4 days ago - ...A pioneering research lab is seeking a Senior Software Engineer focused on building next-generation conversational AI interfaces. The ideal candidate will have deep expertise in Python and experience with modern LLM frameworks. This position involves ownership of end-to...Python
Jack & Jill
San Francisco, CA1 day ago - ...refining and mastering their craft. As an Architect for the Snowflake CoE you will be... ...best practices in architecture, core data engineering, and scalable analytics* Be a mentor and... ...Object-Oriented Programming skills (Java, Python)* Experience with NoSQL Databases (DynamoDB...PythonTemporary workLocal area
$206.4k - $379.1k
...personalization.We're looking for a Principal Architect to build and implement the AI framework... ....This role blends applied research and engineering leadership — ideal for someone who can... ...application engineeringProficiency in Python, Java, C++, or Go, with an emphasis on distributed...PythonFull timeTemporary workLocal areaWorldwideFlexible hours- Heartflow is seeking a Staff Application Database Architect to be the backend database expert powering our clinical and operational platform... ...on role focuses on OLTP schemas, high-performance queries, and Python/Django services, shaping data access across our AWS-based...Python
$154.38k - $193.13k
Job DescriptionAI Architect, AI & AutomationAbout the Role The applicant should have deep,... ...pipelines.Strong hands-on proficiency in Python and ML/AI frameworks such as TensorFlow,... ...AI.Experience in data architecture and engineering to support AI initiatives, including data...PythonFull timeTemporary workWork experience placement- ...than 500,000 patients worldwide. The Test Architect is a senior individual contributor and technical leader on the Test Engineering team. This role sets the technical direction... ...mainstream language used for automation (e.g., Python, TypeScript/JavaScript, Java, or C#); able...PythonContract workFor contractorsLocal areaWorldwideRelocation
- ...Manager for defining and managing cloud resources programmatically Scripting and Automation: Proficiency in scripting languages (Python, Bash, PowerShell) to automate cloud operations and deployments. Technical skills: Expertise in Big Query, Dataflow, Pub/...Python
Omni Inclusive
San Francisco, CA2 days ago - ...AWS Architect We are directly work with Infosys. Established in 1981, Infosys is a... ...script in administrative type language Ruby, Python, PowerShell, Bash Experience with... ...Certifications (Required): Bachelor of Engineering Responsibilities 1. Cloud Design and...Python
TestingXperts
San Francisco, CA5 days ago $172.5k - $260.1k
...is seeking a Staff Business Intelligence Architect (GTM) to join the Data & Insights team.... ...closely with leaders across Go-to-Market, Engineering, Finance, and Data to solve complex... ...programming language for analytics, such as Python or R. Strong experience building...PythonFull time$164.7k - $266k
....What you'll doWe are seeking a Lead AI Architect to turn enterprise data, metadata, relationships... ..., AI CoE, Data, Product, and Engineering teams to shape long-term enterprise AI architecture... ...with programming skills in Python and SQLExperience with modern cloud data...PythonContract workWork at officeLocal areaRemote work2 days per week- ...Palo Alto Networks, Inc. is seeking a Senior Principal Backend Engineer in the Cortex group to lead the development and scaling of the... ...and tackle complex distributed systems challenges, with a focus on Python, Go, and Java, cloud-native #J-18808-Ljbffr Jobleads-USPython
- ...candidate will not only manage SEO but also build systems to generate and distribute content. Expertise in Next.js, TypeScript, and Python is essential for success in this role. You'll work on measurable growth experiments and run our developer community through various...Python
- Bot Auto in San Francisco is looking for a Senior Software Engineer to architect and build the platforms that run their autonomous trucking operations... ...experience in software engineering, with strong skills in Python, Go, or Java. Your role will involve collaborating with...Python
- ...building a super client-heavy, data-intensive web app aimed at a huge and profound goal:... .... You will write tons of it. Engineer wicked smart solutions. Our users are highly... ...here to do. Our alpha product uses Python+Django, Javascript+jQuery, and whatever else you...PythonFull timeFlexible hours
Elationemr
San Francisco, CA1 day ago $205.9k - $407.5k
...looking to bring on a Senior Principal ML GPU Architect to lead the ML GPU optimization team in... ...will partner with the Director of ML Engineering who is responsible for our platform... ...Ansible, Docker, Kubernetes (7+yrs) Expert in Python and C++ Expert in CUDA/CuTe, NCCL,...Python- ...replica environments (high-fidelity clones of websites and web applications) used to train computer-use models. This is a... ...projects. Required Technical Skills (Must‑Have) Full‑stack engineering: React + Python web backend (FastAPI preferred) Data layer: SQL databases,...PythonFor contractorsWork at officeRemote work
$180k - $240k
...the Role We are seeking a Senior AI Agent Architect to design and deploy autonomous, multi-... ...5+ years of experience in AI, software engineering, or distributed systems Proven track record... ..., and context-window optimization Python LangGraph CrewAI Pinecone OpenAI API...PythonFull time- Astro Mechanica in San Francisco is seeking a PLM Engineer to own the digital backbone for design, manufacturing, and delivery. You will... ...5+ years in PLM, experience with Siemens tools, and skills in Python or APIs to automate workflows. This in-office role offers a collaborative...PythonWork at office
$115k - $184k
...for a Professional Services Architect, Accounting & Reporting—a senior... ...cross‑functionally with Engineering, Product, and Customer Success... ...CRM systems. Exposure to SQL/Python for financial data analysis or... ...CaptivateIQ participates in E‑Verify, web‑based system that allows...PythonFlexible hours$200k - $400k
A leading technology firm in San Francisco seeks a Software Engineer to design and build AI agents that enhance customer interactions.... ...candidates should have 5+ years of experience, proficiency in Python and Typescript, and a knack for solving complex system issues....Python$140k - $220k
...research at MIT and Caltech for over 10 years. And our Head of Engineering was one of the earliest engineers at Figma. Full Stack... ...Tech Stack Languages & Frameworks: TypeScript, Nestjs, Python, Django Client Application Technologies: Nextjs, React,...PythonFull timeMaxai
San Francisco, CA1 day ago- ...and pesticides). With an easy-to-use web platform, growers get a real-time management... ...exceptionally motivated, self-starting engineer with strong experience developing rich... ...related technical field ~ Experience with Python and Django (preferred) Additional...PythonFull timeRemote work
Mavrx
San Francisco, CA1 day ago - Senior AI Architect - Multi-Agent Systems & Platform Infrastructure Senior AI Architect -... ...of AI Systems & Orchestration / Head of Engineering Seniority: Senior-Level (Hands-On Architect... ...matter • Hands-on coding ability (Python preferred), not just oversight • Strong...PythonFull timeWork at officeRemote work
$140k - $180k
...Loft Orbital is looking for a Senior Full‑Stack Engineer to join our Oort team. Oort is our central web platform—a unified environment that consolidates all... ...Must Haves: Demonstrated proficiency in Python for backend engineering. Practical experience...PythonFull timeLoft Orbital Solutions
San Francisco, CA1 day ago- ...Join SignalFire’s Talent Network for Founding Back-end Software Engineer Roles at VC-Backed Startups This is not an application for a... ...Kubernetes) ~ Proficiency in backend programming languages such as Python, Go, Java, Node.js, or Ruby ~ Familiarity with CI/CD...PythonFull time
Signal Fire Inc
San Francisco, CA1 day ago - ...This role As a backend software engineer working on our radiology platform, you'll... ...the standard services needed by a modern web application. What you'll do Take... ...efficient features and improvements, often using Python and Django. Collaborate with...PythonFull time
New Lantern
San Francisco, CA1 day ago $170k - $200k
...one dream About this role We are looking for a full stack engineer for our Enterprise Scale team. Our team is responsible for the... ...required, but we build and move fast!) Our tech stack Backend Python + Django PostgreSQL Redis Celery + AmazonMQ...PythonFull timeScribe
San Francisco, CA1 day ago$140k - $190k
...siteLoft Orbital is looking for a Backend Engineer to join our Mission Operations Services (... ....Write production backend code in Python, owning services end‑to‑end from design and... ...development.Hands‑on experience with backend web development frameworks (e.g., Django, Flask...PythonFull timeLocal area$210k - $350k
...voice superintelligence. To achieve this, we need more great engineers. The work affects millions of people every day and our engineers... ...Infrastructure: AWS, Modal, Kubernetes, Postgres Backend: Python (Django/FastAPI), TypeScript (Node.js) You Might Be a Fit...PythonFull timeWork at officeGiga
San Francisco, CA1 day ago
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Python Web Scraping Engineer — Crawler Architect. Be the first to apply!
Related searches
- python developer data analytics San Francisco, CA
- python developer remote San Francisco, CA
- python developer San Francisco, CA
- full stack / python developer (remote) San Francisco, CA
- senior python developer San Francisco, CA
- python programmer San Francisco, CA
- python engineer San Francisco, CA
- website content developer San Francisco, CA
- remote junior web developer San Francisco, CA
- lead web developer San Francisco, CA