Large Model（大模型） #

cv 大模型 #

• facebookresearch/segment-anything
• UX-Decoder/Segment-Everything-Everywhere-All-At-Once
  • SEEM: Segment Everything Everywhere All at Once
• baaivision/Painter
  • Painter & SegGPT Series: Vision Foundation Models from BAAI

大模型推理框架 #

• ggerganov/llama.cpp
• ollama/ollama
• vllm-project/vllm
• NVIDIA/TensorRT-LLM
  • NVIDIA/FasterTransformer
    • 废弃了，改用 TensorRT-LLM
• ModelTC/lightllm
• microsoft/DeepSpeed-MII
• huggingface/text-generation-inference
  • TGI