Testing mixed int8 quantization

Library requirements

Hardware requirements

Virtual envs

Troubleshooting

Torch does not correctly do the operations on GPU

` bitsandbytes operations are not supported under CPU!`

`To use the type as a Parameter, please correct the detach() semantics defined by torchdispatch() implementation.`

`Parameter has no attribute .CB`

`RuntimeError: CUDA error: an illegal memory access was encountered ... consider passing CUDALAUNCHBLOCKING=1`

`CUDA illegal memory error: an illegal memory access at line...`: