cutout

KO | EN

gitlite — search

#typescript #ai-agents #ai #dsh-plugin #deepseek-harness #open-source #cli #claude-code #codex #developer-tools #react #windows

★ 76 Open GitHub ↗

A toolbox for data grabbing and processing in python 3

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

cutout
======

A toolbox for data grabbing and processing in python 3

Introduction
------------

**cutout** is a Python toolbox for data grabbing and processing. Types::

* Grab html page to get data
* Download files from the Internet
* ProgressBar for download
* Cache use memory or file system
* Generate SQL statements
* More powerful features

This software is still under development, improvement and perfection.

Pre-requisites
--------------

* Python 3.4+ 
 * import PyMySQL

Installation
------------

You can download **cutout** by [click here](https://github.com/jojoin/cutout/archive/master.zip), and use it in your code like this::

```python
from cutout import download, cutout
from cutout.common import get_html, get_argv_dict
from cutout.util import sec2time
...
```

Documentation
-------------

[中文API手册](http://jojoin.github.io/cutout/)

To get baidu music pc software download url, like this::

>>> from cutout import cutout
    >>> para = {} #p aram
    >>> para['url'] = 'http://music.baidu.com/'
    >>> para['start'] = '<a class="downloadlink-pc"'
    >>> para['end'] = '>下载PC版</a>'
    >>> para['dealwith'] = { 'start':'href="', 'rid':'"', 'end':'"' } # get href url
    >>> cutout(**para) # do grab
    'http://qianqian.baidu.com/download/BaiduMusic-12345630.exe'

To create a cache, like this::

>>> from cutout.cache import FileCache
    >>> c = FileCache('./cache') # set cache dir './cache'
    >>> c.set("foo", "value")
    >>> c.get("foo")
    'value'
    >>> c.get("missing") is None
    True

To create a ProgressBar for download, like this:：

>>> from cutout import download
    >>> from cutout.common import ProgressBar
    >>> bar = ProgressBar(piece_total=1);
    >>> face = { 'sh_piece_division':1024, 'sh_piece_unit':'KB' }
    >>> bar.face(**face)
    >>> download('http://qianqian.baidu.com/download/BaiduMusic-12345630.exe',showBar=bar)
    '[=============================>                    ]  59.23%  14.81%/s  1280.00KB/s  5120.00KB/8644.81KB  00:00:04'

Read or run the [example.py](https://github.com/jojoin/cutout/blob/master/example.py) to get more example.

Download and use the browser to open the [document.zh.htm](https://github.com/jojoin/cutout/blob/master/document.zh.htm), A detailed understanding of all API.

```bash
$ python3 cutout/test.py
```

Author
------

**cutout** is developed and maintained by Yang Jie (yangjie@jojoin.com).
It can be found here: http://github.com/jojoin/cutout

Contact way:

* Home : http://jojoin.com
* Email: yangjie@jojoin.com
* QQ   : 446342398

cutout

Explore Similar Repositories

Was this content helpful?

Recent Feedback

Download README