html2vec

KO | EN

gitlite — search

#javascript #python #react #llm #golang #go #android #macos #nodejs #java #cli #awesome-list #pytorch #mcp

(★ 11)

Vectorize HTML files and generate embeddings with structural and semantic expression (WIP)

html2vec Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# html2vec (WIP)
Vectorize HTML files and generate embeddings with structural and semantic expression

# Technologies
- Node.js
	- `HTML2EdgeList.js` - cli tool for converting the HTML file to an .edgelist representation
	- `VectorizeHTMLEmbeddings.js` - Use node2vec dimensions and various dimensions found from the edgelist conversion to generate a matrix with vectors for each node in the HTML tree.
	- `HTML2Vector.js` - cli tool that builds the entire embedding pipleine
- Python (Version 3)
	- For running `node2vec/main.py` - cli tool generating node2vec dimensions from .edgelist files
		- Using cli tool by apoorvavinod https://github.com/apoorvavinod/node2vec
	- `Brain.js` for Neural Network

# Install
Node.js setup
```
$ npm install
```

Python setup
```
$ cd node2vec
# set up virtualenv if you'd like 
$ pip install -r requirements.txt
```

# Usage

Run pipeline
```
node HTML2Vector.js -i ./html_corpus/ -o ./inputs/

/*
HTML2Vector.js
	-i = "Directory with html files" 
	-o = "Output folder where you want to store your embeddings"
*/
```

html2vec

html2vec Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

html2vec

html2vec Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README