Background:
– Shopee uses javascript to get data as json from server
– Shopee server only provides data for request with “User-agent”, “X-Requested-With”, “Referer”. Requests without these will get empty result.
Required tool:
– Using devtool to find url of json
– python to run js request.
Ref: https://stackoverflow.com/questions/59557071/how-can-i-crawl-the-product-items-from-shopee-website