The following would be great to add: - [mlc](https://llm.mlc.ai/docs/) - [FlexFlow](https://github.com/flexflow/FlexFlow) - [skypilot](https://skypilot.readthedocs.io/en/latest/) - [aphrodite](https://github.com/PygmalionAI/aphrodite-engine) - [HuggingFace TGI](https://github.com/huggingface/text-generation-inference)
The following would be great to add: