hepsiburada-review-scraper

KO | EN

gitlite — search

#hacktoberfest #android #rust #linux #docker #macos #nodejs #java #windows #cli #awesome-list #pytorch #openai #open-source

hepsiburada-review-scraper

(★ 26)

Hepsiburada review/comment and rating scraper. Turkish text dataset creator for data science and NLP projects. 📜

hepsiburada-review-scraper 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

[![Made with Python](http://ForTheBadge.com/images/badges/made-with-python.svg)](https://www.python.org/)

# Hepsiburada Review Scraper [![HB Review Scraper](https://img.shields.io/badge/version-1.0.0%20-red.svg)](https://github.com/n1rv4n4/hepsiburada-review-scraper/) [![Build Status](https://travis-ci.org/0x01h/hepsiburada-review-scraper.svg?branch=master)](https://travis-ci.org/0x01h/hepsiburada-review-scraper) [![GPLv3](https://img.shields.io/badge/License-GPLv3-blue.svg)](https://www.gnu.org/licenses/gpl-3.0.en.html)
[Hepsiburada](https://www.hepsiburada.com) review/comment and rating scraper. Turkish text dataset creator for data science and NLP projects. Nearly 30M reviews with category and product links can be crawled and used for text classification, sentiment analysis, text mining, NLP models etc. Supported by multithreading, written in Python.

## Prerequisites
`$ pip3 install -r requirements.txt`

## Installation
```
$ git clone https://github.com/0x01h/hepsiburada-review-scraper.git
$ cd hepsiburada-review-scraper
$ python3 hepsiburada.py
```

## Usage
Program provides an human-friendly interactive shell for users.

### Features
- Shutdown computer after finishing: Optional choice for deep and long scrapings.
- Threads: Try to give a proper number. (Recommended value is 64.)
- Timeout: Giving a large number could result in long waiting times, small numbers could lead connection failures. (Recommended time range is 15-30 seconds.)
- Pagination Depth: Maximum number of paginated review pages for each product.

You can track your progress via *progress bars.* `categories.txt`, `products.txt`, `hepsiburada.txt` will be saving to your current directory.

**Do not scrape aggressively! Otherwise, you will be caught by captcha challenge!**

[![Say thanks.](https://img.shields.io/badge/say-thanks-ff69b4.svg)](https://www.linkedin.com/in/orçunözdemir/)

**For educational purposes only.**

hepsiburada-review-scraper

hepsiburada-review-scraper 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

hepsiburada-review-scraper

hepsiburada-review-scraper 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README