SpiderConfig

(★ 8)

一个用于增量式爬虫抓取目标url、目标html源码等功能的通用配置父类。

SpiderConfig Latest Version Download

Download Latest Version (.zip)

Today's picks

public-apis ★ 461,313

A collective list of free APIs

Python
gemini-cli ★ 106,532

An open-source AI agent that brings the power of Gemini directly into your terminal.

TypeScript
awesome-claude-skills ★ 72,610

A curated list of awesome Claude Skills, resources, and tools for customizing Claude AI wo

Python
markitdown ★ 174,077

Python tool for converting files and office documents to Markdown.

Python
awesome-mcp-servers ★ 92,434

A collection of MCP servers.
agent-skills ★ 87,722

Production-grade engineering skills for AI coding agents.

JavaScript
// repository documentation