cutout

KO | EN

gitlite — search

#hacktoberfest #react #ai #golang #android #linux #docker #macos #windows #kubernetes #awesome-list #mcp #openai #open-source

(★ 76)

A toolbox for data grabbing and processing in python 3

File Explorer

Download Latest Version (.zip)

- - __init__.py
  - basecache.py
  - filecache.py
  - memcache.py
  - memcachedcache.py
  - posixemulation.py
  - rediscache.py
- __init__.py
- common.py
- cutout.py
- http.py
- mysql.py
- sys.py
- util.py
.gitignore
example.py
favicon.ico
LICENSE
README.md

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

cutout
======

A toolbox for data grabbing and processing in python 3

Introduction
------------

**cutout** is a Python toolbox for data grabbing and processing. Types::

* Grab html page to get data
* Download files from the Internet
* ProgressBar for download
* Cache use memory or file system
* Generate SQL statements
* More powerful features

This software is still under development, improvement and perfection.

Pre-requisites
--------------

* Python 3.4+ 
 * import PyMySQL

Installation
------------

You can download **cutout** by [click here](https://github.com/jojoin/cutout/archive/master.zip), and use it in your code like this::

```python
from cutout import download, cutout
from cutout.common import get_html, get_argv_dict
from cutout.util import sec2time
...
```

Documentation
-------------

[中文API手册](http://jojoin.github.io/cutout/)

To get baidu music pc software download url, like this::

>>> from cutout import cutout
    >>> para = {} #p aram
    >>> para['url'] = 'http://music.baidu.com/'
    >>> para['start'] = '<a class="downloadlink-pc"'
    >>> para['end'] = '>下载PC版</a>'
    >>> para['dealwith'] = { 'start':'href="', 'rid':'"', 'end':'"' } # get href url
    >>> cutout(**para) # do grab
    'http://qianqian.baidu.com/download/BaiduMusic-12345630.exe'

To create a cache, like this::

>>> from cutout.cache import FileCache
    >>> c = FileCache('./cache') # set cache dir './cache'
    >>> c.set("foo", "value")
    >>> c.get("foo")
    'value'
    >>> c.get("missing") is None
    True

To create a ProgressBar for download, like this:：

>>> from cutout import download
    >>> from cutout.common import ProgressBar
    >>> bar = ProgressBar(piece_total=1);
    >>> face = { 'sh_piece_division':1024, 'sh_piece_unit':'KB' }
    >>> bar.face(**face)
    >>> download('http://qianqian.baidu.com/download/BaiduMusic-12345630.exe',showBar=bar)
    '[=============================>                    ]  59.23%  14.81%/s  1280.00KB/s  5120.00KB/8644.81KB  00:00:04'

Read or run the [example.py](https://github.com/jojoin/cutout/blob/master/example.py) to get more example.

Download and use the browser to open the [document.zh.htm](https://github.com/jojoin/cutout/blob/master/document.zh.htm), A detailed understanding of all API.

```bash
$ python3 cutout/test.py
```

Author
------

**cutout** is developed and maintained by Yang Jie (yangjie@jojoin.com).
It can be found here: http://github.com/jojoin/cutout

Contact way:

* Home : http://jojoin.com
* Email: yangjie@jojoin.com
* QQ   : 446342398

cutout

File Explorer

Today's picks

Was this content helpful?

Recent Feedback

cutout

File Explorer

Today's picks

Was this content helpful?

Recent Feedback

Download README