MeetingStory

KO | EN

gitlite — search

#javascript #python #hacktoberfest #ai #typescript #llm #golang #go #android #linux #macos #windows #awesome-list #pytorch

(★ 14)

A project I built while doing research for Professor Kwan-Liu Ma in the Visual & Interface Design Innovation Lab at UC Davis.

MeetingStory 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# MeetingStory (A Meeting Visualization Software)

## Overview

MeetingStory takes in audio from a meeting and visualizes the meeting in a way that can potentially help with retaining the contents of that meeting.

The architecture contains four backend components: speech recognition, speaker recognition, topic modeling, and information extraction. It utilizes voice recognition and machine learning to capture and process data. The frontend is the web-based storyline system which uses python's Django and Javascript.

The root directory looks like this:

* **meeting** - folder where meeting audio file will go
* **training** - folder where voice training audio files will go
* **project** - folder where resulting will be after program is run
* **streaming-storyline-algo** - folder where storyline timestamp generation scripts locate
* **visualization** - folder where visualization scripts locate
* **main.py** - file that contains code for speaker & speech recognition
* **transcript_generator.py** - file that generates transcript from audio
* **transcript_processor.py** - file that processes transcript
* **transcript_analyzer.py** - helper file

## Backend

#### Step 0: Setting up the recording environment

It is important to maintain consistency with the recording device throughout all audio recordings. We recommend using Audacity to record the following audio. Download it [here](https://sourceforge.net/projects/audacity/). In order for the audio be compatible with Microsoft Speaker Recognition, keep the audio settings as follows:

* **Container:** WAV
* **Encoding:** PCM
* **Rate:** 16k
* **Sample Format:** 16 bit
* **Channel:** Mono

The below images show where these settings can be found if you are recording with Audacity.

**Before the recording**, set the Project Rate on the bottom left, as well as the Channel towards the top.

![Mou icon](http://i.imgur.com/U6x71up.png)

**After the recording:**, make sure the Sample Format and the Encoding is set properly.

![Mou icon](http://i.imgur.com/w88nfub.png)

**Before exporting**, make sure the file is being exported as a WAV.

![Mou icon](http://i.imgur.com/yDubBtx.png)

#### Step 1: Preparing Training Audio for Speaker Recognition

Record a sample audio file of at least 20 seconds for each member in the meeting, in the audio environment set up in Step 0. Read the following script:

Audacity is free software, developed by a group of volunteers and distributed under the GNU General Public License (GPL). Programs like Audacity are also called open source software, because their source code is available for anyone to study or use. There are thousands of other free and open source programs, including the Firefox web browser, the LibreOffice or Apache OpenOffice office suites and entire Linux‐based operating systems such as Ubuntu

Name the audio file in the following format, in all lowercase:

[person’s name]_voice.wav

Place it in the **training** folder. This file will train the Microsoft Speaker Recognition API to recognize the individual's voice. Repeat for each member of the meeting.

#### Step 2: Preparing Meeting Audio for Speech Recognition

Record the meeting in the audio environment set up in Step 0. Name the audio file in the following format, in all lowercase:

[meeting_title].wav

Place it in the meeting folder. This file can be converted to text by the Google Speech API and analyzed alongside the training audio.

#### Step 3: Checking Results of Data Processing

Make sure you are in the root directory, and run the following command:

python main.py -m [meeting_title] -s [person 1’s name] [person 2’s name] ...

Inside [the data folder](project/data), you will see a folder with the following format:

[year][month][day][hour][min][second]

The folder name is derived from the timestamp of the meeting audio. For example, if the meeting began on June 1st, 2016 at 1:30 PM, the file would have the title “20160601133000”. Inside that folder, you will see the following files:

* **storyline.txt** - storyline of meeting
* **topic.json** - relevant topics extracted from meeting
* **transcript.txt** - transcript of meeting
* **user.json** - each user and their percentage contribution broken down by time segments
* **wordcloud.json** - words that appear on the topic bubble of the visualization
	
#### Step 4: Generating transcript timestamp for storyline

Run the following command
		
	python StreamStoryline.py -i=./your_data.tsv -a=choose_a_algorithm 
	[
	-i : input file name 
	e.g., -i=./Data/sample.tsv 
	-a : choose the greedy algorithm (comprehensive / onebyone / region / extreme) 
	e.g., a=region
	]

Take the last tsv file in [the output folder](streaming-storyline-algo/output) and rename it storyline_default.tsv, put it in [the data folder](project/data)
	
#### Step 5: Visualizating it on web browser
Copy the folder in [the data folder](project/data) you want to viusalize and put it in [the data folder](visualization/data)

Add the name of the folder in 'Select Dataset' section in index.html

Run the following command

python -m SimpleHTTPServer 8000

Go to localhost:8000 in web browser

MeetingStory

MeetingStory 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

MeetingStory

MeetingStory 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README