Browser Engine Scrape

As the name suggests, Browser Scrape Engine is used to scrape data from websites that are dynamic. This engine is particularly well-suited for websites that are built with frameworks like React, Vue, and Angular.

The Browser Scrape Model

The Browser Scrape Model contains all the information about your Browser Scrape request and response.

POST/v1/scrape/browser

Perform a Browser scrape

This endpoint allows perform a HTML scrape on target URL using a browser and return the HTML response.

Required attributes

Name
url
Type
string
Description
The URL to scrape.

Optional attributes

Name
premium_proxy
Type
boolean
Description
Use a premium proxy to scrape the URL at additional cost but with higher success rate and bypass anti-scraping measures.
Name
country_code
Type
string
Description
The country code accept an ISO 3166-1 alpha-2 code used for geolocation of the proxy.

Request

POST

/v1/scrape/browser

curl https://scrapinglabs.com/api/v1/scrape/browser \
  -H "Authorization: Bearer {token}" \
  -d url="https://www.example.com" \
  -d premium_proxy="true" \
  -d country_code="GE"

Response

<html>
<head>
<title>Example Domain</title>

<meta charset="utf-8" />
<meta http-equiv="Content-type" content="text/html; charset=utf-8" />
<meta name="viewport" content="width=device-width, initial-scale=1" />
<style type="text/css">
body {
    background-color: #f0f0f2;
    margin: 0;
    padding: 0;
    font-family: -apple-system, system-ui, BlinkMacSystemFont, "Segoe UI", "Open Sans", "Helvetica Neue", Helvetica, Arial, sans-serif;
    
}
div {
    width: 600px;
    margin: 5em auto;
    padding: 2em;
    background-color: #fdfdff;
    border-radius: 0.5em;
    box-shadow: 2px 3px 7px 2px rgba(0,0,0,0.02);
}
a:link, a:visited {
    color: #38488f;
    text-decoration: none;
}
@media (max-width: 700px) {
    div {
        margin: 0 auto;
        width: auto;
    }
}
</style>    
</head>

<body>
<div>
<h1>Example Domain</h1>
<p>This domain is for use in illustrative examples in documents. You may use this
domain in literature without prior coordination or asking for permission.</p>
<p><a href="https://www.iana.org/domains/example">More information...</a></p>
</div>
</body>
</html>