Split-and-Rephrase

KO | EN

gitlite — search

#javascript #python #hacktoberfest #typescript #llm #golang #android #nodejs #macos #java #awesome-list #pytorch #mcp #open-source

Split-and-Rephrase

(★ 14)

Break long English Sentence into simple sentences

Split-and-Rephrase 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Split-and-Rephrase

## Overview

The aim is to split a complex sentence into a meaning-preserving sequence of shorter sentences.

The input sentence with more than two clauses is strategically broken into 2 sentences, each sentence having no more than 2 clauses. They are sent to the **Hugging Face's T5** pre-trained model fine-tuned with 300K sentences from websplit v1.0 dataset, to split up into multiple sentences. Each multiple sentence is further assigned a similarity score to the input sentence based on **TF-IDF Vectorizer**. The sentences with fewer similarity scores are removed.

The link to the models and data can be found [here](https://drive.google.com/drive/folders/1RmVMuqlxBKkgmbRU5ww1E_LRibFcdtqt?usp=sharing), and link to the jars can be found [here](https://drive.google.com/drive/folders/1g8GDCR-sXCLWHon11Sa_7p3Le4lQESCT?usp=sharing).

## Example

## Future Works

[1] Preservation of keywords is an important factor. But the output from the fine-tuned Hugging Face's T5 model replaced a few words with their synonyms. This can be improved by filtering the training data from the dataset. <br>
[2] Loss of important keywords. The output sometimes ignores important dates, places, etc.

## Credits

[1] rui-yan: [split-and-rephrase](https://github.com/rui-yan/split-and-rephrase) <br>
[2] shreyaUp: [Sentence-Simplification](https://github.com/shreyaUp/Sentence-Simplification)

Split-and-Rephrase

Split-and-Rephrase 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Split-and-Rephrase

Split-and-Rephrase 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README