Huggingface actually recently did this, but I think it's for inference on their giant models like BLOOM