Data Engineer - Web Scraping
Temporary
Cxg
We are growing! We are currently looking to hire a Data Engineer - Web Scraping to work with us remotely on a 5 months contract .
What you will be doing:
- Maintain and manage website scraping configurations using Python .
- Monitor scraping configurations for errors and potential crashes.
- Oversee retrieved data to detect potential issues and blockages.
- Coordinate with stakeholders to understand scraping task requirements and report issues.
- Prepare and share periodic reports on scraping activities with stakeholders.
- Develop necessary pipelines to ingest data into the Datalake and perform required transformations.
Requirements
What you will bring along:
- Proven experience in data engineering with expertise in designing and implementing scalable data architectures.
- Strong experience with ETL processes, data modeling, and data warehousing ( Airflow & DBT preferred).
- Expertise in database technologies, both relational ( SQL ) and NoSQL.
- Knowledge of cloud platforms, particularly Azure .
- Solid understanding of data security measures and compliance standards.
- Excellent Python experience for data engineering and automation.
- Strong collaboration skills to work closely with data scientists and analysts.
- Ability to optimize data pipelines for performance and efficiency.
- Ability to build, test, and maintain tasks and projects.
- Experience with version control systems, such as Git .
- Hands-on experience with Airflow and/or DBT .
- Experience with Terraform for infrastructure management.
- Minimum 2 years of experience in a similar role.
- Strong academic background in a relevant field.
- Fluent in English (French is a plus).
Vacancy posted 13 days ago
Similar jobs that could be interesting for youBased on the Data Engineer - Web Scraping in Remote vacancy
- ...Mindrift is seeking a highly skilled Senior Python Data Scraping Engineer for the Tendem project to drive specialized data scraping workflows.... ...part-time remote opportunity requires hands-on experience in web scraping and data extraction. You will be responsible for end...WebPart timeRemote work
Mind Rift
New York, NY3 days ago - ...A leading tech firm is seeking a Python Data Scraping Engineer for a part-time freelance role on the Tendem project. You will automate data extraction... ...role requires at least 3 years of relevant experience in web scraping and strong Python skills. Applicants with a degree...WebPart timeFreelanceRemote work
Mind Rift
Wausau, WI1 day ago $37 per hour
...Mindrift is seeking skilled Python data scraping engineers for the Tendem project. This freelance, part-time remote role focuses on web extraction, processing, and delivering high-quality datasets using tools like Apify and OpenRouter. Candidates should have 3+ years...WebHourly payPart timeFreelanceRemote workMind Rift
Brockport, NY4 days ago- Mindrift is seeking a highly skilled Python Data Scraping Engineer to join the Tendem project and drive specialized data scraping workflows. This... ...is perfect for technical professionals with extensive web scraping experience. Key responsibilities include handling end...WebRemote jobPart time
$37 per hour
...Mindrift is looking for highly skilled Web Scraping specialists to join the Tendem project ( and drive specialized data scraping workflows for real-world use cases.... ...looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive...WebHourly payPart timeFreelanceRemote work10 hours per weekMind Rift
United States3 days ago$32 per hour
...A data engineering company is seeking a Python Data Scraping Engineer to drive specialized workflows within a hybrid AI + human system. This part-time remote role requires at least 3 years of experience in web scraping and data engineering, with a strong focus on Python...WebHourly payPart timeRemote workMind Rift
Lansing, MI1 day ago$32 per hour
...Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows... ...ideal for technical professionals with hands‑on experience in web scraping, data extraction and processing. What We Do The Mindrift...WebHourly payPart timeFreelanceRemote workMind Rift
Wausau, WI5 days ago$37 per hour
Mindrift is looking for a skilled Python Data Scraping Engineer to join the Tendem project and drive data scraping workflows. This part-time remote role requires hands-on experience in web scraping and a technical background. The ideal candidate will leverage tools like...WebRemote jobHourly payPart time- Mindrift is seeking a skilled Python Data Scraping Engineer to join the Tendem project to drive specialized data scraping workflows. This part-... ...ideal candidate should have at least 3 years of experience in web scraping and data processing. Key benefits include working...WebRemote jobPart time
$32 per hour
A data solutions company seeks a skilled Python Data Scraping Engineer to remotely manage data extraction workflows for the Tendem project. The ideal candidate has at least 3 years of experience in web scraping, automation, and a strong proficiency in Python. The role offers...WebRemote jobHourly payPart timeFlexible hours$45 per hour
Mindrift is seeking a Senior Python Data Scraping Engineer for the Tendem project. This part-time remote role involves collaborating with Tendem... .... The ideal candidate has 5+ years of experience in web scraping, a strong technical background, excellent attention...WebRemote jobHourly payPart time10 hours per week$32 per hour
Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within... ...for technical professionals with hands‑on experience in web scraping, data extraction and processing. What We Do The...WebHourly payPart timeFreelanceRemote work- ...listed on behalf of a partner company, who manages all applications and next steps. Our partner is looking for a Senior Data Engineer - Web Scraping based in United States. This is a fully remote opportunity for a data engineering professional specializing in web scraping...WebRemote jobFull time
$150k - $250k
...driven communication. If you're ready to own data strategy at a high-growth AI company,... ...of everything we build. As Senior Data Engineer , you won’t just clean datasets and... ...accuracy. Be a data hunter – Whether it’s web scraping, third-party integrations, or unconventional...WebFull timeRemote workFlexible hoursGloo
San Francisco, CA4 days ago- ...learn more about our company and culture: About the Senior Data Engineer Role WIN is looking to add Senior Data Engineer to our growing... ...through hands on analyses and automated tools including web scraping, ETL pipelines and SQL queries. Conduct in‑depth research and...WebRemote work
WIN Home Inspection
Delhi, OH5 days ago $160k
...next generation of predictive sports analytics data products. We believe that oddsmaking is a challenge rooted in engineering, mathematics, and sports betting expertise;... ...infrastructures (AWS) Experience with web scraping and cleaning unstructured data Knowledge of...WebRemote work$32 per hour
...is seeking Vibecode specialists to join the Tendem project. This part-time, fully remote role requires strong skills in data analysis, web scraping, and Python programming. Responsibilities include conducting advanced research, extracting data from complex sites, and maintaining...WebRemote jobPart timeFlexible hours$155k - $165k
...on the platform. The Role Are you a data engineer who thrives on building robust pipelines... ...Design, optimize and own data pipelines that scrape, process and ingest transaction and... ...Nice-to-haves: Experience with web scraping technologies (Selenium, Puppeteer...WebWork at officeImmediate startWork from homeFlexible hours$100 - $120 per hour
...issue organizing, and civic engagement. Data plays a central role in how we make... ...We are seeking an Intermediate Data Engineer Contractor to design, build, and maintain... ...Experience with social media APIs and web scraping methodologies. Familiarity with data...WebHourly payContract workFor contractors$145k - $160k
Role Description We are seeking a Senior Data Integrations Engineer - AI with expertise in Enterprise System Integrations, Business Process Automation... ...in building AI solutions using RAG, LangGraph, Web scraping, or any other AI technology. ~Proficient in JavaScript...WebFull timeFlexible hoursCeligo
Remote8 days ago$160k - $200k
...foster a dynamic culture rooted in strong engineering, a sense of ownership, and transparency,... ...About the role Building AI-Powered Web Data Acquisition as a Staff Data Engineer and... ...this crucial position. To solve complex scraping problems and set the highest operational...WebRemote workHome office$75k - $100k
...00K We are hiring on behalf of our client who is seeking a Web Scraping Specialist to join a specialized technical team focused on building the infrastructure that delivers massive amounts of web data for the training of advanced AI models. This organization operates...WebFull timeRemote workMLabs
United States3 days ago- ...flights. None of that happens without great data, and we couldn’t do it without our amazing people.As a Senior Analytics Engineer, you’ll work as part of a multi‑disciplinary,... ...TeamData Engineering & Analytics TeamIT Systems & Web Development Location: Leeds City Centre Job...WebRemote work
- Computer Technologies Consultants (CTC) is seeking a Web Scraping Engineer to support the United States Department of State in Arlington, VA.... ...CTC is a leading technology company providing lifecycle IT, data analytics, cloud managed hosting services, agile software development...WebContract workFor contractorsLocal areaRemote work
$32 per hour
A digital consultancy is seeking a Vibecode specialist to manage data extraction and analysis for AI projects. The role involves advanced web scraping, technical problem-solving, and writing Python scripts for data processing. Ideal candidates will possess at least one...WebRemote jobHourly payFlexible hours- ...Florida Business Journal. Job Summary The Data & AI Engineer designs, builds, and operates the data... ...AWS Fargate / ECS (scheduled ingest or scrape, enrich, deliver) with CloudWatch alarms... ...on AWS end to end, including internal web apps and demos. Build internal...WebFull timeLocal areaRemote workWork from homeHome officeMonday to Friday
$86.8k - $165.2k
...than 100 years of experience and renowned engineering expertise to meet the needs of today’s... ...defense.What You Will Do:Create and maintain data visualization and statistical analysis... ...Perl, C, C++, C#, Java etc).Experience with web application development.The ability to...WebTemporary workWork experience placementInterim roleWork at officeRemote workFlexible hours- ...the development and maintenance of the agency’s web scraping infrastructure. Responsible for extracting data from various websites and APIs, ensuring data quality... ...of scraped data. Collaborate with data engineering and data science teams to integrate scraped data...WebFull timeFor subcontractorRemote work
- ...that allows shippers to connect disparate sources of data into the first fully transparent situational analysis engine designed for the logistics industry. Data that is... ...like Spark and comfortable working with web-scale datasets.You are passionate about the end-to...WebLocal areaRemote work
- ...rapidly, and we are currently seeking a full-time, office-based Data Engineer to join our AI team. This position will work on a team to... ...of more unconventional data such as unstructured content from web-based sites and varying content (documents, images etc) into different...WebFull timeContract workWork at officeWork from home
Do you want to receive more vacancies?
Subscribe and receive similar vacancies to Data Engineer - Web Scraping. Be the first to apply!
