SERP Scraper API offers three main integration methods: Push-Pull, Realtime, and Proxy Endpoint.

  • Push-Pull. One of the simplest and the most reliable methods. In this scenario, you send us a query, and we return your job id. When the job is done, you can use this id to get the data from /results endpoint. You can either check the job status manually or set up a listener that will notify you with a callback message once the content is ready to be retrieved. This method can be easily scaled up.

  • Realtime. This integration method requires the user to keep the connection open throughout the whole process, including sending us a query, fetching the content, and bringing it back, all on the same connection.

  • Proxy Endpoint. This integration method is similar to Realtime, but you should use HTML Scraper API as a proxy. You have to set up a proxy endpoint and send a GET request to the desired URL to fetch the results. After this, your data will return to you via the open connection.

Did this answer your question?