Added TensorRT-LLM support and update demo

This commit is contained in:
Hao Feng 2025-06-30 21:28:19 +08:00 committed by GitHub
parent f03da2de6b
commit d01f4ac50b
No known key found for this signature in database
GPG Key ID: B5690EEEBB952194

View File

@ -51,7 +51,7 @@ Dolphin achieves promising performance across diverse page-level and element-lev
Try our demo on [Demo-Dolphin](http://115.190.42.15:8888/dolphin/).
## 📅 Changelog
- 🔥 **2025.06.30** Added [TensorRT-LLM support](https://github.com/bytedance/Dolphin/blob/master/deployment/tensorrt_llm/ReadMe.md) for accelerated inference
- 🔥 **2025.06.30** Added [TensorRT-LLM support](https://github.com/bytedance/Dolphin/blob/master/deployment/tensorrt_llm/ReadMe.md) for accelerated inferenceDemo acceleration update!
- 🔥 **2025.06.27** Added [vLLM support](https://github.com/bytedance/Dolphin/blob/master/deployment/vllm/ReadMe.md) for accelerated inference
- 🔥 **2025.06.13** Added multi-page PDF document parsing capability.
- 🔥 **2025.05.21** Our demo is released at [link](http://115.190.42.15:8888/dolphin/). Check it out!