RWKV-PEFT
No description available.
File Explorer
Download Latest Version (.zip)- logo.jpg
- rwkv7_clampw.cpp
- rwkv7_clampw.cu
- rwkv7_state_clampw.cpp
- rwkv7_state_clampw.cu
- rwkv7_statepassing_clampw.cpp
- rwkv7_statepassing_clampw.cu
- wkv5_cuda.cu
- wkv5_op.cpp
- wkv6_cuda.cu
- wkv6_op.cpp
- wkv6infctx_cuda.cu
- wkv6infctx_op.cpp
- wkv6state_cuda.cu
- wkv6state_op.cpp
- wkv7_cuda.cu
- wkv7_op.cpp
- indexed_dataset.py
- preprocess_data.py
- rwkv_tokenizer.py
- tokenizer.py
- 20B_tokenizer.json
- README.md
- requirements.txt
- rwkv_vocab_v20230424.txt
- sample.jsonl
- merge_state.py
- __init__.py
- binidx.py
- dataset.py
- mask.py
- rwkvsftdataset.py
- SFTdataset.py
- utils.py
- __init__.py
- light_rwkv.py
- trainer.py
- rwkvop.py
- config.json
- __init__.py
- att.py
- block.py
- ffn.py
- model.py
- __init__.py
- att.py
- block.py
- ffn.py
- model.py
- __init__.py
- att.py
- block.py
- ffn.py
- model.py
- __init__.py
- lrs.py
- __init__.py
- args_type.py
- infctx_module.py
- peft_loading.py
- lora.sh
- miss.sh
- run_sft.sh
- state tuning.sh
- .gitignore
- .python-version
- LICENSE
- main.py
- pyproject.toml
- README.md
- README_zh.md
- requirements.txt
- train.py
- uv.lock
# Installation Guide
1. Get the code
git clone https://github.com/Joluck/RWKV-PEFT
Downloads the entire project code from GitHub to your computer.
cd RWKV-PEFT
Moves into the project folder you just downloaded.
2. Python
Easy RecommendedPrerequisites
pip install -r json2binidx_tool/requirements.txt
Installs the Python libraries listed in requirements.txt (or similar).
python main.py
Runs the Python script (or module).
If it runs without errors and prints output in the terminal, it worked.
// repository documentation
Was this content helpful?
(0 ratings)