aklein4 / pBit Public

Notifications You must be signed in to change notification settings
Fork 0
Star 1

Extreme quantization and sparsity of large language models by representing parameters as probaility distributions.

1 star 0 forks Branches Tags Activity

Notifications

Name		Name	Last commit message	Last commit date
Latest commit History 133 Commits
deprecated		deprecated
src		src
.gitignore		.gitignore
LICENSE		LICENSE
README.md		README.md
setup_vm.sh		setup_vm.sh

Repository files navigation

pBit

Extreme quantization and sparsity of large language models by representing parameters as probaility distributions.

See the report: https://api.wandb.ai/links/aklein4/f54zip18

TPU VM Setup Instructions

Create VM with version: tpu-ubuntu2204-base
Run command: git clone https://github.com/aklein4/pBit.git
Run command: cd ~/pBit && . setup_vm.sh <HF_TOKEN> <WANDB_TOKEN>

About

Extreme quantization and sparsity of large language models by representing parameters as probaility distributions.

Report repository

Releases

No releases published

Packages

Contributors

Languages