bitsandbytes-prebuilt-all_arch

KO | EN

gitlite — search

#javascript #python #hacktoberfest #ai #golang #go #android #machine-learning #deep-learning #nodejs #windows #awesome #vue #mcp

bitsandbytes-prebuilt-all_arch

(★ 40)

A repository containing prebuilt versions of the bitsandbytes library for Windows

bitsandbytes-prebuilt-all_arch Latest Version Download

Download Latest Version (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# bitsandbytes-prebuilt-all_arch

## Update (4/6/23)

Apologies for the inactivity, I have been incredibly busy! I expect things to wind down by the end of the month, at which point I plan to resume updates.

## Update (2/3/23)

I have added an experimental build of 0.37.0. I didn't notice any apparent regressions in testing, but let me know if you run into any issues. :)

## About

This repository contains builds of the bitsandbytes library compiled with the "all" option for GPU architecture support. They are useful if you are running into issues running bitsandbytes on older Nvidia GPUs. In theory, support exists for Kepler, Maxwell, Pascal, Volta, and newer GPUs. This was built and tested on Pascal however, so no guarantees.

I am not sure that there is any point to the WSL .so, however learning to build it was useful. Please see the credit below with regard to the Windows build; while I toiled over this for a while, the user below provided the method and CMake scripts. Hopefully this compiled dll saves someone else many hours of fighting with dependencies and scouring the internet for information!

## Using with SD Dreambooth Extension

To use this with the SD Dreambooth Extension for Automatic's WebUI on Windows:

* Navigate to ```<sd-install>\extensions\sd_dreambooth_extension\bitsandbytes_windows```
* Place the dll file from this repository alongside the other dll file, such that ```libbitsandbytes_cudaall.dll``` is in the same folder as ```libbitsandbytes_cuda116.dll```
* Open ```main.py``` in the same folder and find line 118: ```    return "libbitsandbytes_cuda116.dll"            ```
* Replace it with: ```    return "libbitsandbytes_cudaall.dll"            ```, making sure to preserve the indentation
* Fully restart your SD and you should be in business! If in doubt about settings to not go OOM, check the screen cap below, they are printed out.

I do not plan to actively maintain this repository long-term, but for now, please raise an issue if these steps fail for you on a Pascal card under Windows and I will look into it! :)

*Note: To be clear, the purpose of this dll is to be able to use bitsandbytes under Windows running Pascal and potentially other architecture cards. Bitsandbytes is a library that enables memory-efficient optimizations such that you can train on less than cutting-edge levels of VRAM.*

## Training Dreambooth on 1080Ti under Windows!

![working-finally](https://user-images.githubusercontent.com/71165873/204723173-d16ea596-ad84-4403-a375-7dea895a31ae.png)

## About Bitsandbytes

For more information about the bitsandbytes library please visit the active project:

https://github.com/TimDettmers/bitsandbytes

## Windows Build Credit

Thank you to gracious github user [centerionware](https://github.com/centerionware) who provided CMake scripts that finally solved things on this: https://github.com/TimDettmers/bitsandbytes/issues/30#issuecomment-1330951753

bitsandbytes-prebuilt-all_arch

bitsandbytes-prebuilt-all_arch Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

bitsandbytes-prebuilt-all_arch

bitsandbytes-prebuilt-all_arch Latest Version Download

Today's picks

Was this content helpful?

Recent Feedback

Download README