KO
|
EN
gitlite — search
Search
#typescript
#ai-agents
#ai
#dsh-plugin
#deepseek-harness
#open-source
#cli
#claude-code
#codex
#developer-tools
#react
#windows
zhihu-spider
★ 720
Open GitHub ↗
A web spider for zhihu.com
Download README (.md)
Explore Similar Repositories
hstream
:
HStreamDB is an open-source, cloud-native streaming database for IoT and beyond. Modernize your data stack for real-time applications.
neonize
:
whatsapp automation library, written in python
vexcl
:
VexCL is a C++ vector expression template library for OpenCL/CUDA/OpenMP
mobile-semantic-segmentation
:
Real-Time Semantic Segmentation in Mobile device
nostrum
:
Elixir Discord Library
// repository documentation
Was this content helpful?
★ 0
(0 ratings)
Select Rating:
★
★
★
★
★
Submit Feedback
Recent Feedback
×
Download README
Do you want to download the
README.md
file for
zhihu-spider
?
Download (.md)
# zhihu-spider A web spider for zhihu.com, which is used for [ZhihuHot](http://zhihuhot.sinaapp.com/). This spider can scrape question & topic data from zhihu.com. ## Author I'm Morgan Zhang, a graduate computer science student in University of San Francisco. ### My another tool See my another command line tool `line` [here](https://github.com/MorganZhang100/line), which can tell you the amount of lines and files under current directory. ### Why I made zhihu-spider Coding for fun as well as learn Python. ### Contact Information MorganZhang100@gmail.com ## Run it ### What do you need to run it - Python 2.7.6 (Maybe it work for other versions.) - MySQL - BeautifulSoup ### How to run it 1. Download the code 1. Run init.sql to set up datebase and insert initial data. 1. Find out your cookie of zhihu.com throught browser's developer tool. 1. Modify config.ini 1. Use ```python question.py``` to scrpy questions from zhihu.com 1. Use ```python topic.py``` to scrpy topics from zhihu.com ## Warning You can change thread amount in config.ini to make this spider run faster. But your IP may be blocked from zhihu.com if you connect to zhihu.com too frequently. You'd better use proxy when you use multi thread mode. ## License The MIT license.
