parse-english

KO | EN

gitlite — search

#python #react #typescript #go #golang #deep-learning #linux #docker #java #nodejs #kubernetes #awesome-list #security #open-source

(★ 11)

parse-english is a minimum viable English parser implemented in LexYacc

parse-english Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

[![Build Status](https://secure.travis-ci.org/onlyuser/parse-english.png)](http://travis-ci.org/onlyuser/parse-english)

parse-english
===========

About
-----

parse-english is a minimum viable English parser implemented in LexYacc. It parses in parallel all possible interpretations of an English sentence accepted by a grammar and generates abstract syntax trees for successful parses. The algorithm is completely deterministic. No training data is required.

See old version here: [NatLang](https://github.com/onlyuser/NatLang)

A Motivating Example
--------------------

input:
<pre>
the quick brown fox jumps over the lazy dog.
</pre>

output:

![picture alt](https://sites.google.com/site/onlyuser/files/ast_fox2.png "ast_fox2")

Usage
-----

<pre>
cd ./demo/0_parse-english_full_nlp
./demo.sh "the quick brown fox jumps over the lazy dog"
</pre>

<table>
    <tr><th> Switch </th><th> Description </th></tr>
    <tr><td> -e SENTENCE </td><td> input sentence </td></tr>
    <tr><td> -l </td><td> Lisp mode </td></tr>
    <tr><td> -g </td><td> graph mode (slow for deep trees) </td></tr>
    <tr><td> -d </td><td> dot mode </td></tr>
    <tr><td> -x </td><td> extract ontology mode </td></tr>
    <tr><td> -q </td><td> quiet mode </td></tr>
    <tr><td> -m </td><td> memory debug </td></tr>
    <tr><td> -n </td><td> indent lisp </td></tr>
</table>

Requirements
------------

Unix tools and 3rd party components (accessible from $PATH):

gcc flex bison

Supported Features
------------------
* Parallel reentrant parsing
* Lisp / graph / dot output (multiple trees)

Supported Grammar Syntaxes
--------------------------

* Present tense
* Progressive tense
* Future tense
* Past tense
* Past perfect tense
* Passive voice
* Questions
* Conditionals
* Imperitive mood
* Comparisons

Limitations
-----------

* Hard coded grammar & vocabulary.
* A brute force algorithm tries all supported interpretations of a sentence. This is slow for long sentences.
* BNF rules are suitable for specifying constituent-based phrase structure grammars, but are a poor fit for expressing non-local dependencies.

Make Targets
------------

<table>
    <tr><th> target </th><th> action                                                </th></tr>
    <tr><td> all    </td><td> make binaries                                         </td></tr>
    <tr><td> test   </td><td> all + run tests                                       </td></tr>
    <tr><td> pure   </td><td> test + use valgrind to check for memory leaks         </td></tr>
    <tr><td> dot    </td><td> test + generate .png graph for tests                  </td></tr>
    <tr><td> lint   </td><td> use cppcheck to perform static analysis on .cpp files </td></tr>
    <tr><td> doc    </td><td> use doxygen to generate documentation                 </td></tr>
    <tr><td> xml    </td><td> test + generate .xml for tests                        </td></tr>
    <tr><td> import </td><td> test + use ticpp to serialize-to/deserialize-from xml </td></tr>
    <tr><td> clean  </td><td> remove all intermediate files                         </td></tr>
</table>

References
---------

<dl>
    <dt>"Part-of-speech tagging"</dt>
    <dd>http://en.wikipedia.org/wiki/Part-of-speech_tagging</dd>
    <dt>"Princeton WordNet"</dt>
    <dd>http://wordnet.princeton.edu/</dd>
    <dt>"Syntactic Theory: A Unified Approach"</dt>
    <dd>ISBN: 0340706104</dd>
    <dt>"Enju - A fast, accurate, and deep parser for English"</dt>
    <dd>http://www.nactem.ac.uk/enju/</dd>
</dl>

Keywords
--------

Natural Language Processing, English parser, Yacc, BNF

parse-english

parse-english Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

parse-english

parse-english Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README