Amazon-Review-Scraper

KO | EN

gitlite — search

#game #python #docker #swift #golang #unity3d #javascript #kotlin #android #go #data-science #arduino

Amazon-Review-Scraper

★ 47 Open GitHub ↗

A python library to scrape data from amazon.com

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Amazon Review Scraper
This is a simple python library that scrapes reviews from amazon.com and writes it into a csv file.

## Installation
In your command prompt/terminal: ```pip install amazon-review-scraper```

## Usage
1. Instantiating the object: ```scraper = amazon_review_scraper.amazon_review_scraper(url, start_page, end_page, time)```

* ```url```: In the product's page, scroll down to the end of the reviews and click **see all reviews**. Click on that and copy the ```url```. This ```url``` is your first parameter. 
   	Example: ```https://www.amazon.com/Apple-iPhone-Factory-Unlocked-Phone/product-reviews/B00NQGP42Y/ref=cm_cr_dp_d_show_all_btm?ie=UTF8&reviewerType=all_reviews&pageNumber=1```
   	Note: In the end of the URL, **&pageNumber=1** will not be there by default. You will have to add it else the program won't work. This will be fixed in the next release.

* ```start page```: This is the second parameter. Mention the page from which you want to scrape.

* ```end page```: This is the third parameter. Mention at what page the scraper has to stop scraping.

* ```time(in seconds)```: This is the 4th argument. Amazon might block your IP if it receives too many requests every second. To prevent that, you can mention ```time``` (in seconds). The scraper will wait anywhere from ```0``` to the ```time``` before scraping every page. If you don't want to wait before scraping every page, give the value as **0**.

2. Call the ```scraper()``` method: ```scraper.scrape()```

3. Write to CSV using ```write_csv()``` method: ```scraper.write_csv(file_name)```

* ```file_name```: Enter the file name of the CSV that you want the program to generate.

## Example Code

```
from amazon_review_scraper import amazon_review_scraper

url = input("Enter URL: ")
start_page = input("Enter Start Page: ")
end_page = input("Enter End Page: ")
time_upper_limit = input("Enter upper limit of time range (Example: Entering the value 5 would mean the program will wait anywhere from 0 to 5 seconds before scraping a page. If you don't want the program to wait, enter 0): ")
file_name = "iphone6"

scraper = amazon_review_scraper.amazon_review_scraper(url, start_page, end_page, time_upper_limit)
scraper.scrape()
scraper.write_csv(file_name)
```

## Issues

In the end of the URL, **&pageNumber=1** will not be there by default. You will have to add it else the program won't work. This will be fixed in the next release.

Url when copied directly: 
>https://www.amazon.com/Apple-iPhone-Factory-Unlocked-Phone/product-reviews/B00NQGP42Y/ref=cm_cr_dp_d_show_all_btm?ie=UTF8&reviewerType=all_reviews

After adding **&pageNumber=1**:
>https://www.amazon.com/Apple-iPhone-Factory-Unlocked-Phone/product-reviews/B00NQGP42Y/ref=cm_cr_dp_d_show_all_btm?ie=UTF8&reviewerType=all_reviews&pageNumber=1

Amazon-Review-Scraper

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README