quotesbot

KO | EN

gitlite — search

#javascript #python #hacktoberfest #go #machine-learning #rust #linux #nodejs #java #cli #vue #security #ios #openai

(★ 1,360)

This is a sample Scrapy project for educational purposes

파일 탐색기

최종 버전 다운로드 (.zip)

- - __init__.py
  - toscrape-css.py
  - toscrape-xpath.py
- __init__.py
- items.py
- pipelines.py
- settings.py
.gitignore
LICENSE
README.md
scrapy.cfg

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# QuotesBot
This is a Scrapy project to scrape quotes from famous people from http://quotes.toscrape.com ([github repo](https://github.com/scrapinghub/spidyquotes)).

This project is only meant for educational purposes.

## Extracted data

This project extracts quotes, combined with the respective author names and tags.
The extracted data looks like this sample:

{
        'author': 'Douglas Adams',
        'text': '“I may not have gone where I intended to go, but I think I ...”',
        'tags': ['life', 'navigation']
    }

## Spiders

This project contains two spiders and you can list them using the `list`
command:

$ scrapy list
    toscrape-css
    toscrape-xpath

Both spiders extract the same data from the same website, but `toscrape-css`
employs CSS selectors, while `toscrape-xpath` employs XPath expressions.

You can learn more about the spiders by going through the
[Scrapy Tutorial](http://doc.scrapy.org/en/latest/intro/tutorial.html).

## Running the spiders

You can run a spider using the `scrapy crawl` command, such as:

$ scrapy crawl toscrape-css

If you want to save the scraped data to a file, you can pass the `-o` option:
    
    $ scrapy crawl toscrape-css -o quotes.json

quotesbot

파일 탐색기

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

quotesbot

파일 탐색기

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README