Category Archives: Python

Collect shopee data automatically

Background: – Shopee uses javascript to get data as json from server – Shopee server only provides data for request with “User-agent”, “X-Requested-With”, “Referer”. Requests without these will get empty result. Required tool: – Using devtool to find url of json – python to run js request. Ref: https://stackoverflow.com/questions/59557071/how-can-i-crawl-the-product-items-from-shopee-website