Skip to content

Issues: InternLM/lmdeploy

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Clear current search query, filters, and sorts
224 Open 1,772 Closed
224 Open 1,772 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Issues list

[Bug] 微调后的 qwen-vl-chat的模型，使用提供的方法量化成 INT4，显存占用没有下降
#2028 opened Jul 15, 2024 by yanxinsong
2 tasks done
@lvhan028
How multimodal batch inference works?
#2027 opened Jul 15, 2024 by bonre
微调后的glm-4v-9b通过lmdeploy部署会报错
#2026 opened Jul 15, 2024 by danxuan2022
2 tasks
What is the expected chat template for phi-3-vl?
#2024 opened Jul 15, 2024 by xinke-wang
@RunningLeon
1
bump version to v0.5.1
#2022 opened Jul 15, 2024 by lvhan028 Loading…
8
[Docs] A100算力加持！书生大模型实战营第3期全面升级，趣味闯关模式等你开启
#2021 opened Jul 15, 2024 by boshallen
[Bug] lmdeploy has two questions about lora
#2020 opened Jul 14, 2024 by Volta-lemon
2 tasks done
@grimoire
1
[Benchmark] PyTorch Engine Mixtral 8x7B performance issue benchmark
#2019 opened Jul 13, 2024 by zhyncs
1
Add log info for prefix cache
#2018 opened Jul 13, 2024 by ispobock Loading…
14
使用lmdeploy部署后模型返回空
#2006 opened Jul 12, 2024 by ChingKwanCheung
@lvhan028
6
[Bug] 两张 V100 部署 InternVL2-26B，多模态对话时无应答
#2004 opened Jul 12, 2024 by zhanghx0905
2 tasks done
10
[Feature] Flash Attention 3
#2003 opened Jul 11, 2024 by zhyncs
2
[Bug] 访问一段时间后服务卡死/无响应
#2001 opened Jul 11, 2024 by hezeli123
2 tasks done
3
[Feature] 请问是否可以支持多模态模型donut的推理
#1999 opened Jul 11, 2024 by levinxo
lmdeploy serve的并发机制是怎样的
#1997 opened Jul 11, 2024 by sunzx8
@AllentDan
4
Supoort glm4 awq
#1993 opened Jul 11, 2024 by AllentDan Loading…
9
[Bug] 使用lmdeploy方法部署InternVL-Chat-V1-5-AWQ，0.4.2版本openai客户端可以正常访问，0.5.0版本会卡死，没有任何响应，新增的cogvlm2也有类似现象。
#1992 opened Jul 11, 2024 by kklots
2 tasks done
@irexyc
11
用lmdeploy部署internlm2_5-7B-chat请求返回为空
#1991 opened Jul 11, 2024 by wwwyfff
@lvhan028
6
Could not use my local internVL mini model for inference
#1990 opened Jul 10, 2024 by shiva-vardhineedi
1 of 2 tasks
@lvhan028
2
[Feature] 我们支持gptq量化模型的推理么
#1989 opened Jul 10, 2024 by eigen2017
@lzhangzz
7
Remove the triton inference server backend "turbomind_backend" WIP
#1986 opened Jul 10, 2024 by lvhan028 Loading…
6
Phi3 awq
#1984 opened Jul 10, 2024 by grimoire Loading…
1 task
[Bug] MiniCPMV的推理有问题 awaiting response
#1981 opened Jul 10, 2024 by LDLINGLINGLING
2 tasks done
@irexyc
13
[Feature] Any plan for support Minfernece?
#1980 opened Jul 10, 2024 by TianzhongSong
glm4-9b如何量化运行？
#1976 opened Jul 9, 2024 by maxin9966
@AllentDan
2
ProTip! Follow long discussions with comments:>50.