Japanese-stemmer

KO | EN

gitlite — search

#python #hacktoberfest #typescript #llm #golang #rust #linux #awesome #cli #kubernetes #awesome-list #vue #pytorch #openai

Japanese-stemmer

(★ 11)

A Japanese language stemming algorithm

Japanese-stemmer 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# JapaneseStemmer
JapaneseStemmer a Japanese stemming algorithm I made for a school project, which is based on Martin Porter's Porter Stemming Algorithm.
As I couldn't find any easily-accessible stemming algorithms specifically for Japanese, I decided to make one myself.
Unlike Porter's algorithm which focuses on removing a word's ending; this stemming algorithm conjugates a word into it's [plain form](https://study.gaijinpot.com/library/introduction-to-japanese-volume-1/plain-form-verbs/). Although the code is fully functional there is still room for improvemnt, and feedback is appreciated. This is still a work in progress, and I plan to update and improve whenever I can.

# Usage
```
stemming("Token to be stemmed")
```
This function returns the conjugated word as a string.

Instead of returning the literal word stem, JapaneseStemmer conjugates the token into plain form. So, the token 食べなかった is returned as 食べる, not 食べ.

This implementation is somewhat limited however. As word forms such as [Te](http://www.punipunijapan.com/te-form-making-requests/) or [Tai](http://www.punipunijapan.com/tai-form/) cannot be accurately conjugated without the use of a dictionary or large lookup table, I decided to leave them out for simplicity's sake.

Japanese-stemmer

Japanese-stemmer 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Japanese-stemmer

Japanese-stemmer 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README