MathReader

KO | EN

gitlite — search

#python #hacktoberfest #react #ai #go #deep-learning #linux #macos #nodejs #windows #cli #pytorch #security #open-source

(★ 33)

Implementation of MathReader, Text-to-Speech for Mathematical Documents

MathReader 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# MathReader: Text-to-Speech for Mathematical Documents
<h3 align="center">ICASSP 2025 (Oral)</h3>
<p align="center">
  <a href="https://arxiv.org/abs/2501.07088"><img src="https://img.shields.io/badge/arXiv-2501.07088-b31b1b.svg" alt="arXiv"></a>
  <a href="https://aidaslab.github.io/MathReader/"><img src="https://img.shields.io/badge/Project-Page-blue.svg" alt="Project Page"></a>
</p>

This is the official repository for MathReader, an advanced TTS document reader for academic mathematical documents.

Demo page: [https://hyeonsieun.github.io/MathReader_demo/](https://hyeonsieun.github.io/MathReader_demo/)

### This paper was accepted for oral presentation at ICASSP 2025.

The experimental code and test dataset developed for our research can be found here.

---

## How to use MathReader

1. Install Nougat and NVIDIA NeMo and transformers library in your development environment.
   - [Nougat github](https://github.com/facebookresearch/nougat)
   - [NVIDIA NeMo](https://docs.nvidia.com/nemo-framework/user-guide/latest/nemotoolkit/tts/models.html#vits)
   - You can also set up the environment using the following code through the **mathreader_environment.yml** file

: `conda env create -f ./mathreader_environment.yml`
2. Create a folder named 'test_audio' in the same location as MathReader.py.

3. Modify line 102 in MathReader.py (Write the path of the PDF file you want to perform OCR on.).

4. Run `python MathReader.py` in the terminal.

## Citation

```bibtex
@INPROCEEDINGS{HyeonICASSP25,
    author={Hyeon, Sieun and Jung, Kyudan and Kim, Nam-Joon and Ryu, Hyun Gon and Do, Jaeyoung},
    booktitle={ICASSP 2025 - 2025 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP)}, 
    title={MathReader : Text-to-Speech for Mathematical Documents}, 
    year={2025},
    pages={1-5},
    keywords={Text recognition;Error analysis;Pipelines;Optical character recognition;Graphics processing units;Signal processing;Real-time systems;Mathematical models;Text to speech;Speech processing;OCR;T5;TTS;document reader;LaTeX},
    doi={10.1109/ICASSP49660.2025.10890531}
  }
```

MathReader

MathReader 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

MathReader

MathReader 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README