reshard-safetensors

github.com/NotTheStallion/reshard-safetensorsUpdated 9mo ago

This repo helps you understand how safetensors are structured to store different layers of an LLM and re-shard/re-chunk safetensors files even if they don't fit in the GPU.. ( No Autoclass )

Loading community details…

Community

Post about reshard-safetensors...Post
Loading...