Our Ai Smart Scraper and Universal Search APIs are used to pull price fields off of ecommerce sites. You can grab many price field variations (cost, MSRP, price, etc) with a single text prompt.
Works for any ecommerce site with no site specific setup required.
url = '<https://app.pumice.ai/scraper/smart-scrape>'
headers = {
'x-api-key': api_key,
'Content-Type': 'application/json'
}
data = {
"prompt": prompt,
"source_url": product_url
}
Provide the URL of the product page you want to scrape, provide a text prompt of the data you want to scrape, and run it! It uses Ai to review the page and figure out what data is relevant to the query.
You can ask for fields “give me the title” or HTML tags “give me the <h1> tag”
If the scraper cannot find the data on the site, it will return N/A for that key.
url = '<https://app.pumice.ai/scraper/universal>'
headers = {
'x-api-key': api_key,
'Content-Type': 'application/json'
}
data = {
'query': query
}
Smart scraper is used to pull data off of the web page.
Universal search allows you to search all pages on the website based on keywords.