Announced today from the PyTorch Conference EU in Paris is word that Hugging Face has contributed their Safetensors project to the PyTorch Foundation, which is an umbrella organization under the Linux Foundation for hosting AI initiatives. Safetensors aims to help mitigate arbitrary code execution risks and more.
Safetensors is a file format for storing and loading model weights while avoiding the risk of arbitrary code execution and security shortcomings of other formats like Pickle while also offering better performance and robust compatibility.
Safetensors will now be developed under the PyTorch Foundation umbrella moving forward alongside the likes of PyTorch, Ray, vLLM, DeepSpeed, and other open-source AI projects.
More details for those interested via this morning’s Linux Foundation press release.
