Initial commit: Natural Memory Agent Lab:模型服务 + TypeScript agent + 记忆能力场景评测(冲突更新、跨会话回忆、遗忘撤回、多跳、未知拒答)
This commit is contained in:
File diff suppressed because one or more lines are too long
@@ -0,0 +1,23 @@
|
||||
{
|
||||
"baseUrl": "http://127.0.0.1:8766/v1",
|
||||
"outDir": "H:\\Memory\\agent_lab\\agent\\runs\\conflict_fixed",
|
||||
"arms": [
|
||||
"on"
|
||||
],
|
||||
"scenarios": [
|
||||
{
|
||||
"id": "conflict_update",
|
||||
"description": "同一属性先给旧值再给新值;跨会话询问时必须返回新值,且旧值不得作为 active 事实被读取。",
|
||||
"arms": {
|
||||
"on": {
|
||||
"activeRecords": 1,
|
||||
"assertionsPassed": 3,
|
||||
"assertionsTotal": 3,
|
||||
"passRate": 1,
|
||||
"failures": [],
|
||||
"meanSecondsPerTurn": 8.64
|
||||
}
|
||||
}
|
||||
}
|
||||
]
|
||||
}
|
||||
Reference in New Issue
Block a user