Sign up to access all features of our service.
  • Job search
  • Favorites
  • Create a CV
    New
  • Salaries
  • Subscriptions

Freelance Data Scraping Engineer (Python)

$32 per hour

Mind Rift

Mindrift is looking for highly skilled Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows within our hybrid AI + human system. In this role, as an AI Pilot - that's how we refer to this role at Mindrift - you'll collaborate with Tendem Agents that handle repetitive tasks, while you provide critical thinking, domain expertise, and quality control to deliver accurate and actionable results. This part-time remote opportunity is ideal for technical professionals with hands‑on experience in web scraping, data extraction and processing. What We Do The Mindrift platform connects specialists with AI projects from major tech innovators. Our mission is to unlock the potential of Generative AI by tapping into real‑world expertise from across the globe. About The Role This is a freelance role for a Tendem project. As a Python Data Scraping Engineer, you'll handle data scraping tasks requiring technical precision for web extraction and processing, utilizing various tools such as our provided Apify and OpenRouter alongside your own resourceful approaches. Key Responsibilities Own end-to-end data extraction workflows across complex websites, ensuring complete coverage, accuracy, and reliable delivery of structured datasets. Leverage internal tools (Apify, OpenRouter) alongside custom workflows to accelerate data collection, validation, and task execution while meeting defined requirements. Ensure reliable extraction from dynamic and interactive web sources, adapting approaches as needed to handle JavaScript‑rendered content and changing site behavior. Enforce data quality standards through validation checks, cross‑source consistency controls, adherence to formatting specifications, and systematic verification prior to delivery. Scale scraping operations for large datasets using efficient batching or parallelization, monitor failures, and maintain stability against minor site structure changes. Compensation On this project, contributors can earn up to $32 per hour equivalent , depending on their level and pace of contribution. Compensation varies across projects depending on scope, complexity, and required expertise. Please note that other projects on the platform may offer different earning levels based on their requirements. How To Get Started Simply apply to this post, qualify, and get the chance to contribute to projects that match your technical skills, on your own schedule. From coding and automation to fine‑tuning AI outputs, you'll play a key role in advancing AI capabilities and real‑world applications. Requirements At least 3 years of relevant experience in data engineering, web scraping, automation, or software development (required). Bachelor's or Master's Degree in Engineering, Applied Mathematics, Computer Science, or related technical fields is a plus. Strong experience in Python web scraping (BeautifulSoup, Selenium or similar), including dynamic content (JS, AJAX, infinite scroll) and APIs via proxies. Proven ability to extract data from complex structures (hierarchies, archived pages, inconsistent HTML). Solid background in data cleaning, normalization, and validation, delivering structured datasets (CSV, JSON, Google Sheets). Hands‑on experience with LLMs and AI frameworks to enhance automation and problem‑solving. Strong attention to detail and commitment to data accuracy. Self‑directed work ethic with ability to troubleshoot independently. A link to GitHub is a plus. English proficiency: Upper‑intermediate (B2) or above (required). Benefits Why this freelance opportunity might be a great fit for you? Work fully remote on your own schedule with just a laptop and stable internet connection. Gain hands‑on experience in a unique hybrid environment where human expertise and AI agents collaborate seamlessly — a distinctive skill set in a rapidly growing field. Participate in performance‑based bonus programs that reward high‑quality work and consistent delivery. #J-18808-Ljbffr

Vacancy posted 3 days ago
Similar jobs that could be interesting for youBased on the Freelance Data Scraping Engineer (Python) in New York, NY vacancy
  • $45 per hour

     ...Mindrift is looking for highly skilled Senior Python Data Scraping Engineers to join the Tendem project and drive specialized data scraping workflows...  ...real‑world expertise from across the globe. This is a freelance role for a Tendem project. As a Senior Python Data... 
    Freelance
    Hourly pay
    Part time
    Remote work
    10 hours per week

    Mind Rift

    New York, NY
    3 days ago
  •  ...Mindrift is seeking a highly skilled Senior Python Data Scraping Engineer for the Tendem project to drive specialized data scraping workflows. This part-time remote opportunity requires hands-on experience in web scraping and data extraction. You will be responsible for... 
    Suggested
    Part time
    Remote work

    Mind Rift

    New York, NY
    3 days ago
  •  ...Mindrift is seeking a highly skilled Python Data Scraping Engineer to join the Tendem project and drive specialized data scraping workflows. This part-time remote opportunity is perfect for technical professionals with extensive web scraping experience. Key responsibilities... 
    Suggested
    Part time
    Remote work

    Mind Rift

    New York, NY
    3 days ago
  • $125k - $200k

     ...Trading, and Global Quantitative Trading. Data Engineer Role We are seeking a Data Engineer with experience utilizing Web Scraping technologies, frameworks and libraries in addition...  ...tools like Cron, Glue, Eventbridge, Python based ETL, AWS Redshift Normalizing/standardizing... 
    Suggested

    Verition Fund Management LLC

    New York, NY
    4 days ago
  •  ...Now Hiring: Python Data Engineer Location: Houston, TX (in office 5 days/week) A leading global commodities and energy trading firm is looking...  .... Computer Science, MIS, or a related degree. Experience scraping websites with Requests, Beautiful Soup, Selenium, etc. Oracle... 
    Suggested
    Long term contract
    Permanent employment
    Full time
    Work at office
    Immediate start

    The Talance Group

    New York, NY
    4 days ago
  •  ...to relocation. Position Overview We are seeking a well-rounded Data Engineer to design, build, and support scalable data pipelines,...  ...across the organization. The ideal candidate is hands‑on with Python, SQL, and ETL development , while also being comfortable building... 
    Work at office
    Local area
    Remote work
    Relocation

    TSG Risk Management

    New York, NY
    1 day ago
  •  ...Description We are seeking a skilled and motivated Python, ETL, and PL/SQL Developer to join our Data and Analytics team. Candidate should have 5-6 years...  ...leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI... 
    Full time
    Local area

    Capgemini

    New York, NY
    3 days ago
  •  ...of AI-native platform where data is the product. The system processes...  ...Partner with product and engineering leadership to ensure data...  ...external data sources, APIs, or scraping systems at scale Comfort...  ...Strong engineering fundamentals (Python or similar; experience with distributed... 

    Greylock Partners

    New York, NY
    5 days ago
  •  ...represented in AI. About the Role As a Senior Data Acquisition Engineer , you will own and evolve the systems...  ...design and maintain production-grade scraping and ingestion infrastructure that...  .... Experience with typescript or python Operated systems in environments with... 
    Work at office

    Rachel Paul Recruiting

    New York, NY
    5 days ago
  •  ...Job Title: Python Data Engineer Work Location: New YorkNY10004 Contract duration: 12 Target Start Date: 04 May 2026 Does this position require Visa independent candidates only? Yes Job Details: Must Have Skills Developing Python based frameworks.... 
    Contract work

    Diverse Lynx

    New York, NY
    5 days ago
  • $72.39k - $109.49k

     ...Exchange. Overview The Sr. Analyst, Data Analytics & Intelligence, is responsible...  ...team. This role involves working with Engineering and BI Product Development to build...  ...roles may be eligible to participate in our freelancer/temporary employee medical plan through... 
    Freelance
    Temporary work
    Work at office
    Local area
    Worldwide
    Flexible hours

    Publicis Groupe Holdings B.V

    New York, NY
    12 hours ago
  • $73.15k - $112.55k

     ...us to lead the way in connecting media, data, technology, and teams by what matters most...  ...using languages and tools such as Python Develop, build, test, debug, monitor, and...  ...roles may be eligible to participate in our freelancer/temporary employee medical plan through a... 
    Freelance
    Temporary work
    Flexible hours

    Unavailable

    New York, NY
    5 days ago
  • $88.54k - $127.16k

     ...Job Title Data Manager of Data Engineering Job Description The Data Manager of Data Engineering...  ...engineering and automation) Proficiency in Python and SQL for data processing and...  ...be eligible to participate in our freelancer/temporary employee medical plan... 
    Freelance
    Temporary work
    Flexible hours

    Starcom Mediavest Group Germany Gmbh

    New York, NY
    4 days ago
  • $135.38k - $216.68k

     ...This role will be a leadership role and overseeing our data engineering practice reporting to the VP of Data Engineering. This position...  ...time. Temporary roles may be eligible to participate in our freelancer/temporary employee medical plan through a third-party benefits... 
    Freelance
    Temporary work
    Work at office
    Local area
    Flexible hours

    Starcom Mediavest Group Germany Gmbh

    New York, NY
    4 days ago
  • $135.38k - $216.68k

     ...Leadership Role in Data Engineering At Razorfish, we're leaders in what's next. Since the dawn of the internet, we've helped brands move...  ...time. Temporary roles may be eligible to participate in our freelancer/temporary employee medical plan through a third-party... 
    Freelance
    Temporary work
    Work at office
    Local area
    Flexible hours

    MSLGROUP

    New York, NY
    5 days ago
  •  ...Senior C# Full-Stack Engineer - AI Data & Infrastructure About the Role What if your C# expertise could directly shape the infrastructure...  ...and flexible - structure your week around your best work Freelance autonomy with the substance of high-impact engineering work... 
    Freelance
    Hourly pay
    Ongoing contract
    Contract work
    Remote work
    Flexible hours

    Alignerr

    New York, NY
    4 days ago
  • $60 - $85 per hour

     ...A fast-growing AI company''s Finance organization is looking for a Data Engineer to develop and maintain the data infrastructure that supports its CFO team. This role offers the opportunity to join a small, dynamic team with a wide-ranging mandate: build data pipelines... 
    Hourly pay
    Full time
    Contract work

    SaidGig

    New York, NY
    4 days ago
  •  ...leading tech firm is seeking an AI Pilot to work on specialized data scraping tasks for the Tendem project. This part-time, fully remote position is ideal for skilled professionals with experience in Python web scraping and data processing. Responsibilities include... 
    Part time
    Remote work

    Mind Rift

    New York, NY
    1 day ago
  •  ...We are looking for an experienced Senior Data Center Engineer who can help our team keep Jane Street’s data safe and accessible around the clock...  ...in a Linux environment (Scripting skills in Bash or Python are a plus) Experience with a variety of server and network... 
    Full time
    Work at office
    Remote work
    Flexible hours
    Day shift
    Afternoon shift

    Jane Street

    New York, NY
    5 days ago
  •  ...General Catalyst, and In-Q-Tel. Role Summary You will own the data infrastructure that powers Twenty’s cyber operations...  ...scale datasets usable and economical. You’ll partner closely with engineers and intelligence analysts to turn messy, high-volume operational... 
    Full time
    Work at office
    Flexible hours

    Twenty

    New York, NY
    13 days ago
  • $21 - $31 per hour

     ...growing quickly and looking for talented individuals to join us. Are you a hands-on and technology-driven engineer? Do you have extensive knowledge of the hosting and data center landscape? Are you energetic and able to get things done? Then you should apply with us!... 
    Hourly pay
    Price work
    Temporary work
    Work at office
    Relocation
    Monday to Friday
    Flexible hours

    6AM City

    New York, NY
    3 days ago
  • $85k - $110k

     ...global capital markets community by providing exceptional market data services and customized managed infrastructure solutions. As...  ...our environment. Working closely with our Network and Systems engineering teams and our Project Management and client Service Delivery functions... 
    Work at office
    Work from home
    Flexible hours
    Night shift

    Pico

    New York, NY
    5 days ago
  •  ...Job Title : Data Center Project Manager Location: Somerset, NJ (Hybrid - minimum 4 days per week at various sites in the NY/NJ area...  ...Enterprise Data Centers Reporting Manager: Vice President, EDC Engineering & Operations Position Summary The Data Center Project Manager (... 
    Contract work

    Openkyber

    New York, NY
    4 days ago
  •  ...exceptional professionals for this role. We’re seeking a future team member for the role of Senior Specialist, AI / Machine Learning Engineer to join our AI Hub team. This role is located in New York, NY. This role is located in our AI Hub and is focused on building AI... 
    Work experience placement
    Worldwide

    BNY

    New York, NY
    14 days ago
  •  ...Internship • New York/Remote • Engineering Data Engineering Intern Help our team build reliable ETL pipelines and improve data quality for...  ...the team Requirements Basic SQL and one scripting language (Python preferred) Understanding of tables, joins and incremental loads... 
    Internship
    Remote work

    Pipevia

    New York, NY
    1 day ago
  •  ...Big Data Engineer Location: Remote/USA Duration: 6-12+ Months Job Description: ~ BS degree in computer science, computer engineering...  ...enterprise software solutions ~ Proficient in Spark, Scala, Python, AWS Cloud technologies ~3+ years of experience across... 
    Remote work

    Zortech Solutions

    New York, NY
    4 days ago
  •  ...Vertex Elite is currently seeking a qualified AWS Data Engineer . Work Authorization: USC or Any valid USA work authorization. Job Type:...  ...Step Functions, CloudWatch Advanced SQL and Query Optimization Python for Data Engineering and Automation Data Warehouse Modeling :... 

    Vertex Elite LLC

    New York, NY
    3 days ago
  •  ...Graph Data Engineer Local only. Must be able to work 4 days on site. NYC, NY. Long Term Consulting Assignment. Position Overview:...  ...knowing when to apply them Proficiency in Java SpringBoot. Python and Scala is a plus Experience building APIs and microservices... 
    Local area

    Anveta

    New York, NY
    5 days ago
  •  ...team member for the role of Vice President, AI / Machine Learning Engineer to join our AI Hub team. This role is located in New York, NY....  ...seeking the following: ~ Bachelor's degree in Computer Science, Data Engineering, or a related field or the equivalent combination of... 
    Worldwide

    BNY

    New York, NY
    14 days ago
  •  ...what we do. We bring trading capabilities, data, and analytics together for the first...  ...enthusiastic summer interns to join our data engineering team. The internship provides hands‑on...  ...Your responsibilities include developing Python‑based data workflows, supporting cloud‑based... 
    Internship
    Summer internship
    Work at office
    Monday to Friday

    Motive Partners

    New York, NY
    1 day ago

Do you want to receive more vacancies?

Subscribe and receive similar vacancies to Freelance Data Scraping Engineer (Python). Be the first to apply!