amazon-scrapy

Scrapy the detail and lowest price of amazon best seller product by python spider

In developing........, welcome to join !

Some code has apply to pricejot.com. https://www.pricejot.com/

How to install

install python3.6 pip install -r requirements.txt

if you are contributer recommend to php install pipreqs run "pipreqs /path/to/project" if you add some packages in your code

Source url

• list page https://www.amazon.com/Best-Sellers/zgbs/ update every two hours.
• price detail page https://www.amazon.com/gp/offer-listing/B01FCTAEK4

TODO

1. Scrapy the reviews by asin https://www.amazon.com/Libratone-ONE-Click-Caribbean-Green/product-reviews/B00ZU33BBC
2. Scrapy the detail by asin pool(50%)

done

1. Scrapy the category of level 1 from https://www.amazon.com/Best-Sellers/zgbs/ and store in mysql
2. Scrapy the asin in the best seller asin from https://www.amazon.com/Best-Sellers/zgbs/ and store in mysql
3. Scrapy the keywords rank by asin

Reffering Documents

• python https://bop.molun.net/
• scrapy https://docs.scrapy.org/en/latest/

Contract us

Email：[email protected] Wechat:dzdzhuang

Based on Python 3.6

License

The MIT License(http://opensource.org/licenses/MIT)

Please feel free to use and contribute to the development.

Contribution

If you have any ideas or suggestions to improve Amazon-scrapy, welcome to submit an issue/pull request.

Backer

您的支持是我们坚持的最大动力。

Thanks