Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Freelance Data Scraping Engineer (Python)

$32 per hour

Mind Rift

Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an AI Pilot - that's how we refer to this role at Mindrift - you'll collaborate with Tendem Agents that handle repetitive tasks, while you provide critical thinking, domain expertise, and quality control to deliver accurate and actionable results. This part-time remote opportunity is ideal for technical professionals with hands‑on experience in web scraping, data extraction and processing. What We Do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real‑world expertise from across the globe. About The Role This is a freelance role for a Tendem project. As a Python Data Scraping Engineer, you'll handle data scraping tasks requiring technical precision for web extraction and processing, utilizing various tools such as our provided Apify and OpenRouter alongside your own resourceful approaches. Key Responsibilities Own end-to-end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets. Leverage internal tools (Apify, OpenRouter) alongside custom workflows to accelerate data collection, validation, and task execution while meeting defined requirements. Ensure reliable extraction from dynamic and interactive web sources, adapting approaches as needed to handle JavaScript‑rendered content and changing site behavior. Enforce data quality standards through validation checks, cross‑source consistency controls, adherence to formatting specifications, and systematic verification prior to delivery. Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against minor site structure changes. Compensation On this project, contributors can earn up to $32 per hour equivalent , depending on their level and pace of contribution. Compensation varies across projects depending on scope, complexity, and required expertise. Please note that other projects on the platform may offer different earning levels based on their requirements. How To Get Started Simply apply to this post, qualify, and get the chance to contribute to projects that match your technical skills, on your own schedule. From coding and automation to fine‑tuning AI outputs, you'll play a key role in advancing AI capabilities and real‑world applications. Requirements At least 3 years of relevant experience in data engineering, web scraping, automation, or software development (required). Bachelor's or Master's Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields is a plus. Strong experience in Python web scraping (BeautifulSoup, Selenium or similar), including dynamic content (JS, AJAX, infinite scroll) and APIs via proxies. Proven ability to extract data from complex structures (hierarchies, archived pages, inconsistent HTML). Solid background in data cleaning, normalization, and validation, delivering structured datasets (CSV, JSON, Google Sheets). Hands‑on experience with LLMs and AI frameworks to enhance automation and problem‑solving. Strong attention to detail and commitment to data accuracy. Self‑directed work ethic with ability to troubleshoot independently. A link to GitHub is a plus. English proficiency: Upper‑intermediate (B2) or above (required). Benefits Why this freelance opportunity might be a great fit for you? Work fully remote on your own schedule with just a laptop and stable internet connection. Gain hands‑on experience in a unique hybrid environment where human expertise and AI agents collaborate seamlessly — a distinctive skill set in a rapidly growing field. Participate in performance‑based bonus programs that reward high‑quality work and consistent delivery. #J-18808-Ljbffr

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Freelance Data Scraping Engineer (Python) in New York, NY vacancy
  • $45 per hour

     ...Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows...  ...real‑world expertise from across the globe. This is a freelance role for a Tendem project. As a Senior Python Data... 
    Freelance
    Hourly pay
    Part time
    Remote work
    10 hours per week

    Mind Rift

    New York, NY
    3 days ago
  • $45 per hour

    Mindrift is seeking a Senior Python Data Scraping Engineer to drive specialized data scraping workflows within the Tendem project. This part-time...  ...expertise in web scraping and data extraction. In this freelance position, you’ll manage end-to-end workflows, ensuring data... 
    Freelance
    Remote job
    Hourly pay
    Part time

    Mindrift

    New York, NY
    5 days ago
  • $37 per hour

    Mindrift is seeking a highly skilled Senior Python Data Scraping Engineer for the Tendem project. This part-time remote role involves collaborating with AI agents to handle data scraping tasks, ensuring accuracy and quality control in web extraction and processing. Candidates... 
    Freelance
    Remote job
    Hourly pay
    Part time

    Mindrift

    New York, NY
    2 days ago
  •  ...Mindrift is seeking a highly skilled Python Data Scraping Engineer to join the Tendem project and drive specialized data scraping workflows. This part-time remote opportunity is perfect for technical professionals with extensive web scraping experience. Key responsibilities... 
    Suggested
    Part time
    Remote work

    Mind Rift

    New York, NY
    3 days ago
  •  ...Mindrift is seeking a highly skilled Senior Python Data Scraping Engineer for the Tendem project to drive specialized data scraping workflows. This part-time remote opportunity requires hands-on experience in web scraping and data extraction. You will be responsible for... 
    Suggested
    Part time
    Remote work

    Mind Rift

    New York, NY
    3 days ago
  • $37 per hour

    Mindrift is looking for a highly skilled Python Data Scraping Engineer to contribute to the Tendem project. This part-time remote opportunity involves driving specialized data scraping workflows, collaborating with AI agents, and ensuring high-quality results. As a Python... 
    Remote job
    Hourly pay
    Part time
    Flexible hours

    Mindrift

    New York, NY
    5 days ago
  • $125k - $200k

     ...Trading, and Global Quantitative Trading. Data Engineer Role We are seeking a Data Engineer with experience utilizing Web Scraping technologies, frameworks and libraries in addition...  ...tools like Cron, Glue, Eventbridge, Python based ETL, AWS Redshift Normalizing/standardizing... 

    Verition Fund Management LLC

    New York, NY
    4 days ago
  •  ...Now Hiring: Python Data Engineer Location: Houston, TX (in office 5 days/week) A leading global commodities and energy trading firm is looking...  .... Computer Science, MIS, or a related degree. Experience scraping websites with Requests, Beautiful Soup, Selenium, etc. Oracle... 
    Long term contract
    Permanent employment
    Full time
    Work at office
    Immediate start

    The Talance Group

    New York, NY
    4 days ago
  • $55 per hour

    A leading AI consultancy is seeking experienced Civil Engineers with Python skills to freelance as AI Trainers. This remote role involves designing and evaluating AI solutions geared towards real-world engineering problems. Candidates should possess strong analytical ability... 
    Freelance
    Remote job

    Mindrift

    New York, NY
    4 days ago
  • An innovative firm is seeking a skilled Data Engineering Trainer to deliver engaging training sessions for aspiring data engineers. This role involves designing comprehensive courses that cover vital topics such as data pipeline development, ETL processes, and big data... 
    Freelance

    Technology Pvt. Ltd.

    New York, NY
    4 days ago
  •  ...technology-first global investment firm in New York is seeking a Data Engineer to support their investment platform. In this key role, you’ll...  .... Ideal candidates should have a strong background in SQL and Python, along with experience in building robust data pipelines. This... 

    Mondrian Alpha

    New York, NY
    5 days ago
  • Exadel, Inc is seeking a Middle Data Engineer in Georgia. The role involves solving analytical challenges and building impactful solutions with a collaborative team. Applicants should have 3+ years of experience in software development, especially with PySpark and SQL.... 
    Remote job
    Work at office

    Exadel, Inc

    New York, NY
    5 days ago
  •  ...Goods receipt and Putaway, Picking and Shipping, Internal Warehouse movements, Transportation Management. Good understanding of Master data such as Material Master, Business Partners, Carrier etc. The role will participate and lead testing, training, and implementation at... 
    Worldwide

    TechDigital Group

    New York, NY
    1 day ago
  • Join Exadel as a Middle Data Engineer with ADB and Python. Solve analytical challenges and build solutions that matter—with a sharp, collaborative team. About the Client Our client is one of the Big Four accounting firms and the world’s largest professional services network... 
    Contract work
    Work at office
    Local area
    Remote work

    Exadel, Inc

    New York, NY
    5 days ago
  • Vanguard Hr Associates is seeking a candidate proficient in Python and SQL with experience in AWS services like S3 and Redshift. Applicants should have strong analytical and communication skills, a knack for troubleshooting, and the ability to apply SOPs accurately. The... 

    Vanguard Hr Associates

    New York, NY
    4 days ago
  • $150k - $180k

    Quberesearchandtechnologies is looking for a Data Support Engineer in New York, NY. This role supports researchers and traders in navigating comprehensive datasets and contributes to data documentation and quality assurance. The ideal candidate holds a Bachelor’s degree... 

    Quberesearchandtechnologies

    New York, NY
    2 days ago
  •  ...technology analytics firm based in New York is seeking an experienced data engineer to enhance data solutions. The ideal candidate will have at...  ...have experience in object-oriented programming languages like Python or Java. Candidates with machine learning exposure and... 

    Cloud Analytics Technologies, LLC

    New York, NY
    2 days ago
  • Lead Data Engineer with SQL, Python and Capital banking job at Cortex consultants LLC. New York, NY. Our challenge Lead the development and optimization of batch and real-time data pipelines, ensuring scalability, reliability, and performance. Architect, design, and deploy... 

    Carlsbad Tech

    New York, NY
    4 days ago
  • $55 per hour

    Freelance AI Trainer - Civil Engineering & Python 1 day ago - Be among the first 25 applicants Get AI‑powered advice on this job and more exclusive features. This opportunity is only for candidates currently residing in the specified country. Your location may affect... 
    Freelance
    Part time
    Remote work
    Flexible hours

    Mindrift

    New York, NY
    4 days ago
  • Job Description: We are seeking a skilled Data Engineering Trainer to deliver high-quality training sessions for individuals and groups....  ...data engineering concepts, tools, and best practices. As a freelance Data Engineering Trainer, you will design, develop, and conduct... 
    Freelance
    Internship

    Technology Pvt. Ltd.

    New York, NY
    4 days ago
  •  ...to relocation. Position Overview We are seeking a well-rounded Data Engineer to design, build, and support scalable data pipelines,...  ...across the organization. The ideal candidate is hands‑on with Python, SQL, and ETL development , while also being comfortable building... 
    Work at office
    Local area
    Remote work
    Relocation

    TSG Risk Management

    New York, NY
    1 day ago
  • $115k - $130k

    CenterLight Health System is seeking a Data Engineer III to design and maintain the organization's data architecture. This role primarily involves T-SQL development, ETL processes, and Python scripting. Candidates should have a minimum of 5 years of experience and the... 

    CenterLight Health System

    New York, NY
    4 days ago
  • Role - GCP Data Engineer with Python Location: NY (Onsite) Contract Need GCP Data Engineer , GCP Certified Skills Required Python GCP Bigtable scalable cloud solutions crossfunctional collaboration security best practices documentation. Responsibilities Architect... 
    Contract work

    US staffing Inc

    New York, NY
    7 days ago
  • A healthcare solutions provider is seeking a Data Engineer III to design and maintain data architecture. Key responsibilities include T-SQL development, ETL processes, and Python scripting for data automation. The role requires a Bachelor's degree in a relevant field and... 

    C2Q Health Solutions

    New York, NY
    3 days ago
  • A technology firm in New York is seeking an experienced GCP Data Engineer to design, develop, and optimize cloud solutions using Python and GCP Bigtable. Candidates should have 5 to 7 years of experience and be skilled in scalable cloud architecture, automation, and cross... 

    LTM

    New York, NY
    3 days ago
  •  ...Description We are seeking a skilled and motivated Python, ETL, and PL/SQL Developer to join our Data and Analytics team. Candidate should have 5-6 years...  ...leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI... 
    Full time
    Local area

    Capgemini

    New York, NY
    3 days ago
  • Full-Stack Software Engineer (Python & React) This is a full-stack role with python/Django backend and React frontend. For Node.js full stack...  ...for the opportunity to build something new and cool. Bonus: Freelance experience: delivered projects, managed budget/estimate,... 
    Freelance
    Contract work
    Remote work
    Flexible hours
    Afternoon shift

    Uplift Media Group

    New York, NY
    4 days ago
  •  ...of AI-native platform where data is the product. The system processes...  ...Partner with product and engineering leadership to ensure data...  ...external data sources, APIs, or scraping systems at scale Comfort...  ...Strong engineering fundamentals (Python or similar; experience with distributed... 

    Greylock Partners

    New York, NY
    5 days ago
  •  ...represented in AI. About the Role As a Senior Data Acquisition Engineer , you will own and evolve the systems...  ...design and maintain production-grade scraping and ingestion infrastructure that...  .... Experience with typescript or python Operated systems in environments with... 
    Work at office

    Rachel Paul Recruiting

    New York, NY
    5 days ago
  • Wynd Labs is seeking a Web Scraping Specialist in the United States to join a motivated team. This role involves data extraction from complex websites, optimizing scraping processes, and ensuring data quality. The ideal candidate will have a strong background in asynchronous... 

    Wynd Labs

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Freelance Data Scraping Engineer (Python). Be the first to apply!