Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[错误]: MCP不识别部分 tool_call 模型 #3627

Closed
3 tasks done
yshumy opened this issue Mar 19, 2025 · 11 comments · Fixed by #3642
Closed
3 tasks done

[错误]: MCP不识别部分 tool_call 模型 #3627

yshumy opened this issue Mar 19, 2025 · 11 comments · Fixed by #3642
Labels
bug Something isn't working MCP

Comments

@yshumy
Copy link

yshumy commented Mar 19, 2025

提交前检查

  • 我理解 Issue 是用于反馈和解决问题的,而非吐槽评论区,将尽可能提供更多信息帮助问题解决。
  • 我已经查看了置顶 Issue 并搜索了现有的 开放Issue已关闭Issue,没有找到类似的问题。
  • 我填写了简短且清晰明确的标题,以便开发者在翻阅 Issue 列表时能快速确定大致问题。而不是“一个建议”、“卡住了”等。

平台

macOS

版本

v1.1.8

错误描述

MCP不识别这个 tool_call 模型。

输入栏没有出现MCP按钮。

Image

重现步骤

加载本地模型:qwen2.5-0.5b-instruct-mlx(This model has been trained for tool use)

预期行为

MCP不识别这个 tool_call 模型。输入栏没有出现MCP按钮。(This model has been trained for tool use)

相关日志输出

附加信息

No response

@yshumy yshumy added the bug Something isn't working label Mar 19, 2025
@DeJeune
Copy link
Collaborator

DeJeune commented Mar 19, 2025

自己手动给它打标签

@yshumy
Copy link
Author

yshumy commented Mar 19, 2025

自己手动给它打标签

现在是能识别了,但是不能用sqlite服务器功能。说了句开始搜索,就没有下文了,直接结束,不返回要求的内容。

@DeJeune
Copy link
Collaborator

DeJeune commented Mar 19, 2025

自己手动给它打标签

现在是能识别了,但是不能用sqlite服务器功能。说了句开始搜索,就没有下文了,直接结束,不返回要求的内容。

具体报错是什么?0.5b大概率不能干这个,起码得7b

@yshumy
Copy link
Author

yshumy commented Mar 19, 2025

自己手动给它打标签

现在是能识别了,但是不能用sqlite服务器功能。说了句开始搜索,就没有下文了,直接结束,不返回要求的内容。

具体报错是什么?0.5b大概率不能干这个,起码得7b

14b的也没成功sqlite.

@DeJeune
Copy link
Collaborator

DeJeune commented Mar 19, 2025

自己手动给它打标签

现在是能识别了,但是不能用sqlite服务器功能。说了句开始搜索,就没有下文了,直接结束,不返回要求的内容。

具体报错是什么?0.5b大概率不能干这个,起码得7b

14b的也没成功sqlite.

ctrl shift i 看下控制台和网络请求

@mzx2689
Copy link
Contributor

mzx2689 commented Mar 19, 2025

我试了一下,这个似乎是 LM Studio 的问题,没有正确处理工具调用。

截一部分 Response:

data: {"id":"chatcmpl-m18o33dw2hd4flg9jwgkr3","object":"chat.completion.chunk","created":1742406178,"model":"qwen2.5-7b-1m-mlx","system_fingerprint":"qwen2.5-7b-1m-mlx","choices":[{"index":0,"delta":{"tool_calls":[{"index":0,"type":"function","function":{"name":"","arguments":"}"}}]},"logprobs":null,"finish_reason":null}]}

data: {"id":"chatcmpl-m18o33dw2hd4flg9jwgkr3","object":"chat.completion.chunk","created":1742406178,"model":"qwen2.5-7b-1m-mlx","system_fingerprint":"qwen2.5-7b-1m-mlx","choices":[{"index":0,"delta":{},"logprobs":null,"finish_reason":"stop"}]}

data: [DONE]

给的 finish_reasonstop,就没有调用工具,直接结束了。

Image

正常应该是 tool_calls

data: {"choices":[{"delta":{"tool_calls":[{"function":{"arguments":"}"},"index":0,"id":"","type":"function"}]},"index":0}],"object":"chat.completion.chunk","usage":null,"created":1742406564,"system_fingerprint":null,"model":"qwen-max-latest","id":"chatcmpl-fdbba430-0370-9543-959d-c206bcd09e00"}

data: {"choices":[{"finish_reason":"tool_calls","delta":{},"index":0,"logprobs":null}],"object":"chat.completion.chunk","usage":null,"created":1742406564,"system_fingerprint":null,"model":"qwen-max-latest","id":"chatcmpl-fdbba430-0370-9543-959d-c206bcd09e00"}

data: [DONE]

Sorry, something went wrong.

@mzx2689
Copy link
Contributor

mzx2689 commented Mar 19, 2025

#3546

Sorry, something went wrong.

@vaayne vaayne added the MCP label Mar 20, 2025
@vaayne
Copy link
Collaborator

vaayne commented Mar 20, 2025

我感觉可以 fix 一下这个,主要还是这些模型不大规范,推荐使用 GPT/Claude/Gemini/Qwen 系列模型

@vaayne
Copy link
Collaborator

vaayne commented Mar 20, 2025

Image

@FHBOL
Copy link

FHBOL commented Mar 20, 2025

Image
好像识别不了意图

@vaayne
Copy link
Collaborator

vaayne commented Mar 20, 2025

换更好的模型 @FHBOL

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working MCP
Projects
None yet
Development

Successfully merging a pull request may close this issue.

5 participants