KO
|
EN
gitlite โ search
Search
#python
#java
#python3
#arduino
#golang
#machine-learning
#rust
#html
#flask
#javascript
#seismology
#nodejs
RWKV-15Puzzle
โ 12
Open GitHub โ
No description available.
Download README (.md)
Explore Similar Repositories
TeraBox-Video-DL
:
TeraBox-Video-DL @SudoR2spr
itomori
:
Gymnasium environment for research of UAVs and risk constraints
AI-Development-With-Gemini
:
Germini AI Application
TOR-Forensics
:
An Awesome list of study material for learning TOR Forensics or Darkweb Forensics ๐ต๏ธโโ๏ธ๐ต๏ธโโ๏ธ๐ต๏ธโโ๏ธ
NES-Hub
:
Documentation of the NES Hub
// repository documentation
Was this content helpful?
โ 0
(0 ratings)
Select Rating:
โ
โ
โ
โ
โ
Submit Feedback
Recent Feedback
×
Download README
Do you want to download the
README.md
file for
RWKV-15Puzzle
?
Download (.md)
# RWKV-15PUZZLE A specialized RWKV model for solving 15-puzzle problems  ## Requirements - rwkv - tkinter ## Quick Start - Run `demo.py` or `minimum_inference.py` ## Model The current model `rwkv_15puzzle_20241214.pth` is a specialized RWKV-v6 model trained on 1m 15-puzzle samples (~2.1B tokens) specifically for solving 15-puzzle problems. Model specifications: - Parameters: ~4M - Vocabulary size: 83 - Architecture: 4 layers, 256 dimensions The model includes a simple improvement for better performance (see `model.py` line 372). Corresponding modifications were made in the inference code (`rwkv_model.py` lines 852, 893-896). ## Training The model was trained using the [RWKV-LM](https://github.com/BlinkDL/RWKV-LM) repository. Hyperparameters: - `M_BSZ`: 64 - `CTX_LEN`: 8192 - `LR`: 12e-4 to 3e-5 - `ADAM_EPS`: 1e-18 - `ADAM_BETA1`: 0.9 - `ADAM_BETA2`: 0.999 - `WEIGHT_DECAY`: 0.1 
