dig-dictionary-extraction

KO | EN

gitlite — search

#python #hacktoberfest #rust #deep-learning #linux #windows #awesome #kubernetes #vue #awesome-list #security #pytorch #ios #openai

dig-dictionary-extraction

(★ 9)

Implements dictionary-based entity extraction as described in the FAERIE paper http://dbgroup.cs.tsinghua.edu.cn/dd/papers/sigmod2011-faerie.pdf

dig-dictionary-extraction 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Faerie Entity Extraction

This is an implementation of [faeire entity extraction](http://dbgroup.cs.tsinghua.edu.cn/ligl/papers/sigmod2011-faerie.pdf), a dictionary-baesd entity extraction.

## Installation and dependencies

```bash
pip install faerie
```

## Usage

Run it in console

```bash
faerie sampledictionary.json sampledocuments.json sampleconfig.json
```

Or you can import and use it in your python code

```python
import faerie
faerie.run("sampledictionary.json","sampledocuments.json","sampleconfig.json")
```

### Example input and dictionary file format

```json
{
  "Country": "united states",
  "State": "georgia",
  "AdministrativeArea": "douglas county",
  "name": "Woods Valley",
  "id": "4231869"
}
```

### Example config file format

```json
{
  "dictionary": {
    "id_attribute": "id",
    "value_attribute": [
      "name"
    ]
  },
  "document": {
    "id_attribute": "id",
    "value_attribute": [
      "name"
    ]
  },
  "token_size": 2,
  "threshold": 0.8
}
```

### Arguments:

#### Required

* `documents` a json file for extracting entities

And
  * `dictionary` a json file providing entities to extract

#### Optional
  * `config`
                        a json file contains fields, tokensize and threshold

## Output
```json
{
  "entities": {
    "4231869": {
      "value": "Woods Valley",
      "candwins": [
        {
          "start": 64,
          "score": 11,
          "end": 74
        },
        {
          "start": 65,
          "score": 10,
          "end": 74
        },
        {
          "start": 196,
          "score": 10,
          "end": 206
        }
      ]
    }
  },
  "document": {
    "id": "4231868",
    "value": "The choice of San Diego golf enthusiasts and beginners alike is Woods Valley Golf Club. Stunning tree-lined fairways and beautiful rolling slopes highlight the 18-hole championship golf course at Woods Valley. Designed with an emphasis on strategy and shot-making, the course winds through the community, following the natural contours of the countryside."
  }
}
```

dig-dictionary-extraction

dig-dictionary-extraction 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

dig-dictionary-extraction

dig-dictionary-extraction 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README