SERP Scraper API offers three main integration methods: Push-Pull, Realtime, and Proxy Endpoint.
Push-Pull. One of the most reliable methods. In this scenario, you send us a query, and we return your job id. When the job is done, you can use this id to get the data from /results endpoint. You can either check the job status manually or set up a listener that will notify you with a callback message once the content is ready to be retrieved. This method can be easily scaled up.
Realtime. This integration method requires the user to keep the connection open throughout the whole process, including sending us a query, fetching the content, and bringing it back, all on the same connection.
Proxy Endpoint. This integration method is similar to Realtime, but you should use HTML Scraper API as a proxy. You have to set up a proxy endpoint and send a GET request to the desired URL to fetch the results. After this, your data will return to you via the open connection.