Large Model（大模型） #

cv 大模型 #

• facebookresearch/segment-anything
• UX-Decoder/Segment-Everything-Everywhere-All-At-Once
  • SEEM: Segment Everything Everywhere All at Once
• baaivision/Painter
  • Painter & SegGPT Series: Vision Foundation Models from BAAI

大模型推理框架 #

• sgl-project/sglang
• vllm-project/vllm
• huggingface/text-generation-inference
  • TGI
• InternLM/lmdeploy
• ggerganov/llama.cpp
• ollama/ollama
• gpustack/gpustack
• NVIDIA/TensorRT-LLM
  • NVIDIA/FasterTransformer
    • 废弃了，改用 TensorRT-LLM
• deepspeedai/DeepSpeed-MII
• microsoft/onnxruntime
• ModelTC/lightllm

教程 #

• rasbt/LLMs-from-scratch

调度 #

• ray-project/ray
• kubeflow/kubeflow
• mlflow/mlflow
• sql-machine-learning/sqlflow
  • Brings SQL and AI together.

加速 Pandas #

• dask/dask
• modin-project/modin
• vaexio/vaex
• rapidsai/cudf

部署模型推理 #

• SeldonIO/seldon-core
• mlflow/mlflow
• combust/mleap
• awslabs/multi-model-server