Skip to content

Parameter "pages" sometimes is not honored #7

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wang27jing opened this issue Mar 27, 2025 · 0 comments
Open

Parameter "pages" sometimes is not honored #7

wang27jing opened this issue Mar 27, 2025 · 0 comments

Comments

@wang27jing
Copy link

wang27jing commented Mar 27, 2025

Using the playground to test use. I have the following request. It is clear that this ASIN has a lot of reviews (actually ~190 reviews as I tested). I have received 8 reviews/page * 10 pages = ~80 reviews. Any reason the scraping stopped early at page 10 when "pages" is explicitly set to 20?
Result is attached: data.json

payload = {
'source': 'amazon_reviews',
'query': 'B0BPN4NL4R',
'parse': True,
'domain': 'com',
'pages': '20',
'start_page': '1'
}

response = requests.request(
'POST',
'https://realtime.oxylabs.io/v1/queries',
auth=('YOUR_USERNAME', 'YOUR_PASSWORD'), #Your credentials go here
json=payload,
)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant