DEV-STAX
  • 💴DEV-STAX
    • Activity Feeds & Chat Messaging
    • App Hosting
    • App Testing
    • Application Performance Monitoring
    • Code Collaboration Tools
    • Code Review & Coverage
    • Content Delivery Networks
    • Content as a Service
    • Continuous integration/delivery
    • DNS Hosting
    • Data Mining
    • Database Management
    • Dependency Management
    • Emailing
    • Error Reporting
    • File Transformation
    • Logging
    • Messaging Queue Services
    • Misc
    • Mobile Analytics
    • Monitoring
    • Push Notifications
    • Scheduling & Booking
    • Searching
    • Security
    • Serverless App Hosting
    • Static App Hosting
    • User Authentication
    • Web Scraping
    • Website Audit
Powered by GitBook
On this page
  • Apify
  • ProxyCrawl
  • Scraper API
  • PhantomJsCloud

Was this helpful?

Edit on GitHub
  1. DEV-STAX

Web Scraping

  • Apify

  • ProxyCrawl

  • Scraper API

  • PhantomJsCloud

Apify

Apify Home Page

  • Free tier: 5,000 Free Page Crawls Per Month

  • Pros: Handles proxies, provides simple interface and url classification to make scraping easier

  • Limitations: Rate limited to 1 crawler at a time, data retention of 7 days.

ProxyCrawl

ProxyCrawl Home Page

  • Free tier: 1,000 Free API Calls

  • Pros: Bypass blocks, captchas and allows to scrape javascript pages with a simple API without managing proxies. Supports all websites.

  • Limitations: Rate limited to 20 requests per second, may be increased upon request.

Scraper API

Scraper API Home Page

  • Free tier: 1,000 Free API Calls Per Month

  • Pros: Handles proxies, browsers, and CAPTCHAs for you, so you can scrape any web page with a simple API call.

  • Limitations: Rate limited to 5 requests per second, may be increased upon request.

PhantomJsCloud

PhantomJsCloud Home Page

  • Free tier: About 500 pages/day ($0.05/day in credit)

  • Pros: Browser Automation, PDF Generation, Screenshots, Full request/response details in JSON. Scales to hundreds of parallel requests.

  • Limitations: Free tier blocked from using the Builtin Anonymous Proxy system.

PreviousUser AuthenticationNextWebsite Audit

Last updated 2 years ago

Was this helpful?

💴