reshard-safetensors

This repo helps you understand how safetensors are structured to store different layers of an LLM and re-shard/re-chunk safetensors files even if they don't fit in the GPU.. ( No Autoclass )

Loading community details…
Loading project owner…
Loading launchers…
Loading check-ins…

Community

Create post
Ask or share about reshard-safetensors…
Loading...