mirror of
https://github.com/langbot-app/LangBot.git
synced 2026-06-11 00:06:04 +00:00
Compare commits
2 Commits
refactor/e
...
feat/human
| Author | SHA1 | Date | |
|---|---|---|---|
|
|
d3d366b569 | ||
|
|
db68c5d0c9 |
9
.github/ISSUE_TEMPLATE/bug-report.yml
vendored
9
.github/ISSUE_TEMPLATE/bug-report.yml
vendored
@@ -10,15 +10,6 @@ body:
|
|||||||
placeholder: 例如:v3.3.0、CentOS x64 Python 3.10.3、Docker
|
placeholder: 例如:v3.3.0、CentOS x64 Python 3.10.3、Docker
|
||||||
validations:
|
validations:
|
||||||
required: true
|
required: true
|
||||||
- type: dropdown
|
|
||||||
attributes:
|
|
||||||
label: 部署版本
|
|
||||||
description: 请选择您使用的 LangBot 部署版本。
|
|
||||||
options:
|
|
||||||
- 社区版
|
|
||||||
- 云服务
|
|
||||||
validations:
|
|
||||||
required: true
|
|
||||||
- type: textarea
|
- type: textarea
|
||||||
attributes:
|
attributes:
|
||||||
label: 异常情况
|
label: 异常情况
|
||||||
|
|||||||
9
.github/ISSUE_TEMPLATE/bug-report_en.yml
vendored
9
.github/ISSUE_TEMPLATE/bug-report_en.yml
vendored
@@ -10,15 +10,6 @@ body:
|
|||||||
placeholder: "For example: v3.3.0, CentOS x64 Python 3.10.3, Docker"
|
placeholder: "For example: v3.3.0, CentOS x64 Python 3.10.3, Docker"
|
||||||
validations:
|
validations:
|
||||||
required: true
|
required: true
|
||||||
- type: dropdown
|
|
||||||
attributes:
|
|
||||||
label: Deployment version
|
|
||||||
description: Please select the LangBot deployment version you are using.
|
|
||||||
options:
|
|
||||||
- Community Edition
|
|
||||||
- Cloud Service
|
|
||||||
validations:
|
|
||||||
required: true
|
|
||||||
- type: textarea
|
- type: textarea
|
||||||
attributes:
|
attributes:
|
||||||
label: Exception
|
label: Exception
|
||||||
|
|||||||
1
.github/pull_request_template.md
vendored
1
.github/pull_request_template.md
vendored
@@ -21,7 +21,6 @@
|
|||||||
*请在方括号间写`x`以打勾 / Please tick the box with `x`*
|
*请在方括号间写`x`以打勾 / Please tick the box with `x`*
|
||||||
|
|
||||||
- [ ] 阅读仓库[贡献指引](https://github.com/langbot-app/LangBot/blob/master/CONTRIBUTING.md)了吗? / Have you read the [contribution guide](https://github.com/langbot-app/LangBot/blob/master/CONTRIBUTING.md)?
|
- [ ] 阅读仓库[贡献指引](https://github.com/langbot-app/LangBot/blob/master/CONTRIBUTING.md)了吗? / Have you read the [contribution guide](https://github.com/langbot-app/LangBot/blob/master/CONTRIBUTING.md)?
|
||||||
- [ ] 我已签署或将在机器人提示后签署 [CLA](https://github.com/langbot-app/LangBot/blob/master/CLA.md)。 / I have signed, or will sign when prompted by the bot, the [CLA](https://github.com/langbot-app/LangBot/blob/master/CLA.md).
|
|
||||||
- [ ] 与项目所有者沟通过了吗? / Have you communicated with the project maintainer?
|
- [ ] 与项目所有者沟通过了吗? / Have you communicated with the project maintainer?
|
||||||
- [ ] 我确定已自行测试所作的更改,确保功能符合预期。 / I have tested the changes and ensured they work as expected.
|
- [ ] 我确定已自行测试所作的更改,确保功能符合预期。 / I have tested the changes and ensured they work as expected.
|
||||||
|
|
||||||
|
|||||||
25
.github/workflows/check-i18n.yml
vendored
25
.github/workflows/check-i18n.yml
vendored
@@ -1,25 +0,0 @@
|
|||||||
name: Check i18n Keys
|
|
||||||
|
|
||||||
on:
|
|
||||||
push:
|
|
||||||
branches:
|
|
||||||
- main
|
|
||||||
- master
|
|
||||||
|
|
||||||
jobs:
|
|
||||||
check-i18n:
|
|
||||||
name: Check i18n Key Consistency
|
|
||||||
runs-on: ubuntu-latest
|
|
||||||
permissions:
|
|
||||||
contents: read
|
|
||||||
steps:
|
|
||||||
- name: Checkout code
|
|
||||||
uses: actions/checkout@v4
|
|
||||||
|
|
||||||
- name: Setup Node.js
|
|
||||||
uses: actions/setup-node@v4
|
|
||||||
with:
|
|
||||||
node-version: '20'
|
|
||||||
|
|
||||||
- name: Check i18n keys against en-US reference
|
|
||||||
run: node web/scripts/check-i18n.mjs
|
|
||||||
41
.github/workflows/cla.yml
vendored
41
.github/workflows/cla.yml
vendored
@@ -1,41 +0,0 @@
|
|||||||
name: "CLA Assistant"
|
|
||||||
on:
|
|
||||||
issue_comment:
|
|
||||||
types: [created]
|
|
||||||
pull_request_target:
|
|
||||||
types: [opened, closed, synchronize, reopened]
|
|
||||||
|
|
||||||
permissions:
|
|
||||||
actions: write # re-run the failed CLA check after signing
|
|
||||||
contents: read # signatures are stored in the remote langbot-app/cla repo
|
|
||||||
pull-requests: write # post guidance comments, lock PR after merge
|
|
||||||
statuses: write # set the commit status
|
|
||||||
|
|
||||||
jobs:
|
|
||||||
CLAAssistant:
|
|
||||||
runs-on: ubuntu-latest
|
|
||||||
steps:
|
|
||||||
- name: "CLA Assistant"
|
|
||||||
if: (github.event.comment.body == 'recheck' || github.event.comment.body == 'I have read the CLA Document and I hereby sign the CLA') || github.event_name == 'pull_request_target'
|
|
||||||
# Upstream repo was archived in 2026-03; pin to the v2.6.1 commit SHA.
|
|
||||||
uses: contributor-assistant/github-action@ca4a40a7d1004f18d9960b404b97e5f30a505a08 # v2.6.1
|
|
||||||
env:
|
|
||||||
GITHUB_TOKEN: ${{ secrets.GITHUB_TOKEN }}
|
|
||||||
# repo-scope PAT with write access to langbot-app/cla
|
|
||||||
PERSONAL_ACCESS_TOKEN: ${{ secrets.CLA_PAT }}
|
|
||||||
with:
|
|
||||||
path-to-document: 'https://github.com/langbot-app/LangBot/blob/master/CLA.md'
|
|
||||||
remote-organization-name: 'langbot-app'
|
|
||||||
remote-repository-name: 'cla'
|
|
||||||
path-to-signatures: 'signatures/version1/cla.json'
|
|
||||||
branch: 'main'
|
|
||||||
allowlist: 'dependabot[bot],github-actions[bot],devin-ai-integration[bot],Copilot,renovate[bot],bot*'
|
|
||||||
custom-notsigned-prcomment: |
|
|
||||||
Thank you for your contribution! :heart: Before we can merge this pull request, we need you to sign the [LangBot Contributor License Agreement (CLA)](https://github.com/langbot-app/LangBot/blob/master/CLA.md). You keep full copyright of your code — the CLA grants us a license to use and distribute your contribution. Signing takes 10 seconds and covers all repositories in this organization, permanently.
|
|
||||||
|
|
||||||
感谢您的贡献!合并前请阅读并签署[贡献者许可协议(CLA)](https://github.com/langbot-app/LangBot/blob/master/CLA.md)。您保留代码的全部版权,签署仅需回复下方指定内容,一次签署对本组织全部仓库永久有效。
|
|
||||||
custom-allsigned-prcomment: 'All contributors have signed the CLA. :white_check_mark: 所有贡献者均已签署 CLA。'
|
|
||||||
lock-pullrequest-aftermerge: true
|
|
||||||
# SECURITY: this workflow runs on pull_request_target (it holds secrets and has
|
|
||||||
# write access to the base repository). NEVER add an actions/checkout step that
|
|
||||||
# checks out the PR's code here.
|
|
||||||
115
.github/workflows/run-tests.yml
vendored
115
.github/workflows/run-tests.yml
vendored
@@ -4,25 +4,25 @@ on:
|
|||||||
pull_request:
|
pull_request:
|
||||||
types: [opened, ready_for_review, synchronize]
|
types: [opened, ready_for_review, synchronize]
|
||||||
paths:
|
paths:
|
||||||
- 'src/langbot/**'
|
- 'pkg/**'
|
||||||
- 'tests/**'
|
- 'tests/**'
|
||||||
- '.github/workflows/run-tests.yml'
|
- '.github/workflows/run-tests.yml'
|
||||||
- 'pyproject.toml'
|
- 'pyproject.toml'
|
||||||
- 'uv.lock'
|
|
||||||
- 'run_tests.sh'
|
- 'run_tests.sh'
|
||||||
- 'scripts/test-*.sh'
|
|
||||||
push:
|
push:
|
||||||
branches:
|
branches:
|
||||||
- master
|
- master
|
||||||
- develop
|
- develop
|
||||||
- 'feat/**'
|
paths:
|
||||||
# No path filter on push: every push to the branches above runs the
|
- 'pkg/**'
|
||||||
# full unit-test suite. feat/** branches in particular must be tested
|
- 'tests/**'
|
||||||
# on every push (they accumulate large changes before a PR exists).
|
- '.github/workflows/run-tests.yml'
|
||||||
|
- 'pyproject.toml'
|
||||||
|
- 'run_tests.sh'
|
||||||
|
|
||||||
jobs:
|
jobs:
|
||||||
test:
|
test:
|
||||||
name: Unit Tests
|
name: Run Unit Tests
|
||||||
runs-on: ubuntu-latest
|
runs-on: ubuntu-latest
|
||||||
strategy:
|
strategy:
|
||||||
matrix:
|
matrix:
|
||||||
@@ -39,13 +39,28 @@ jobs:
|
|||||||
python-version: ${{ matrix.python-version }}
|
python-version: ${{ matrix.python-version }}
|
||||||
|
|
||||||
- name: Install uv
|
- name: Install uv
|
||||||
uses: astral-sh/setup-uv@v4
|
run: |
|
||||||
|
curl -LsSf https://astral.sh/uv/install.sh | sh
|
||||||
|
echo "$HOME/.cargo/bin" >> $GITHUB_PATH
|
||||||
|
|
||||||
- name: Install dependencies
|
- name: Install dependencies
|
||||||
run: uv sync --dev
|
run: |
|
||||||
|
uv sync --dev
|
||||||
|
|
||||||
- name: Run unit + smoke tests
|
- name: Run unit tests
|
||||||
run: uv run pytest tests/unit_tests/ tests/smoke/ -q --tb=short
|
run: |
|
||||||
|
bash run_tests.sh
|
||||||
|
|
||||||
|
- name: Upload coverage to Codecov
|
||||||
|
if: matrix.python-version == '3.12'
|
||||||
|
uses: codecov/codecov-action@v5
|
||||||
|
with:
|
||||||
|
files: ./coverage.xml
|
||||||
|
flags: unit-tests
|
||||||
|
name: unit-tests-coverage
|
||||||
|
fail_ci_if_error: false
|
||||||
|
env:
|
||||||
|
CODECOV_TOKEN: ${{ secrets.CODECOV_TOKEN }}
|
||||||
|
|
||||||
- name: Test Summary
|
- name: Test Summary
|
||||||
if: always()
|
if: always()
|
||||||
@@ -54,79 +69,3 @@ jobs:
|
|||||||
echo "" >> $GITHUB_STEP_SUMMARY
|
echo "" >> $GITHUB_STEP_SUMMARY
|
||||||
echo "Python Version: ${{ matrix.python-version }}" >> $GITHUB_STEP_SUMMARY
|
echo "Python Version: ${{ matrix.python-version }}" >> $GITHUB_STEP_SUMMARY
|
||||||
echo "Test Status: ${{ job.status }}" >> $GITHUB_STEP_SUMMARY
|
echo "Test Status: ${{ job.status }}" >> $GITHUB_STEP_SUMMARY
|
||||||
|
|
||||||
integration:
|
|
||||||
name: Fast Integration Tests
|
|
||||||
runs-on: ubuntu-latest
|
|
||||||
|
|
||||||
steps:
|
|
||||||
- name: Checkout code
|
|
||||||
uses: actions/checkout@v4
|
|
||||||
|
|
||||||
- name: Set up Python
|
|
||||||
uses: actions/setup-python@v5
|
|
||||||
with:
|
|
||||||
python-version: '3.12'
|
|
||||||
|
|
||||||
- name: Install uv
|
|
||||||
uses: astral-sh/setup-uv@v4
|
|
||||||
|
|
||||||
- name: Install dependencies
|
|
||||||
run: uv sync --dev
|
|
||||||
|
|
||||||
- name: Run fast integration tests
|
|
||||||
run: uv run pytest tests/integration/ -m "not slow" -q --tb=short
|
|
||||||
|
|
||||||
- name: Integration Test Summary
|
|
||||||
if: always()
|
|
||||||
run: |
|
|
||||||
echo "## Integration Tests Results" >> $GITHUB_STEP_SUMMARY
|
|
||||||
echo "" >> $GITHUB_STEP_SUMMARY
|
|
||||||
echo "Test Status: ${{ job.status }}" >> $GITHUB_STEP_SUMMARY
|
|
||||||
|
|
||||||
coverage:
|
|
||||||
name: Coverage Gate
|
|
||||||
runs-on: ubuntu-latest
|
|
||||||
needs: [test, integration]
|
|
||||||
|
|
||||||
steps:
|
|
||||||
- name: Checkout code
|
|
||||||
uses: actions/checkout@v4
|
|
||||||
|
|
||||||
- name: Set up Python
|
|
||||||
uses: actions/setup-python@v5
|
|
||||||
with:
|
|
||||||
python-version: '3.12'
|
|
||||||
|
|
||||||
- name: Install uv
|
|
||||||
uses: astral-sh/setup-uv@v4
|
|
||||||
|
|
||||||
- name: Install dependencies
|
|
||||||
run: uv sync --dev
|
|
||||||
|
|
||||||
- name: Run coverage (unit + smoke)
|
|
||||||
run: |
|
|
||||||
uv run pytest tests/unit_tests/ tests/smoke/ \
|
|
||||||
--cov=langbot \
|
|
||||||
--cov-report=xml \
|
|
||||||
--cov-report=term-missing \
|
|
||||||
--cov-fail-under=18 \
|
|
||||||
-q --tb=short
|
|
||||||
|
|
||||||
- name: Upload coverage to Codecov
|
|
||||||
uses: codecov/codecov-action@v5
|
|
||||||
with:
|
|
||||||
files: ./coverage.xml
|
|
||||||
flags: unit-tests
|
|
||||||
name: coverage-report
|
|
||||||
fail_ci_if_error: false
|
|
||||||
env:
|
|
||||||
CODECOV_TOKEN: ${{ secrets.CODECOV_TOKEN }}
|
|
||||||
|
|
||||||
- name: Coverage Summary
|
|
||||||
if: always()
|
|
||||||
run: |
|
|
||||||
echo "## Coverage Results" >> $GITHUB_STEP_SUMMARY
|
|
||||||
echo "" >> $GITHUB_STEP_SUMMARY
|
|
||||||
echo "Threshold: 18%" >> $GITHUB_STEP_SUMMARY
|
|
||||||
echo "Status: ${{ job.status }}" >> $GITHUB_STEP_SUMMARY
|
|
||||||
78
.github/workflows/test-migrations.yml
vendored
78
.github/workflows/test-migrations.yml
vendored
@@ -1,78 +0,0 @@
|
|||||||
name: Test Migrations
|
|
||||||
|
|
||||||
on:
|
|
||||||
push:
|
|
||||||
branches:
|
|
||||||
- main
|
|
||||||
- master
|
|
||||||
- dev
|
|
||||||
paths:
|
|
||||||
- 'src/langbot/pkg/persistence/**'
|
|
||||||
- 'src/langbot/pkg/entity/persistence/**'
|
|
||||||
- 'tests/integration/persistence/**'
|
|
||||||
pull_request:
|
|
||||||
types: [opened, synchronize, reopened, ready_for_review]
|
|
||||||
paths:
|
|
||||||
- 'src/langbot/pkg/persistence/**'
|
|
||||||
- 'src/langbot/pkg/entity/persistence/**'
|
|
||||||
- 'tests/integration/persistence/**'
|
|
||||||
|
|
||||||
jobs:
|
|
||||||
test-migrations-sqlite:
|
|
||||||
name: Migrations (SQLite)
|
|
||||||
runs-on: ubuntu-latest
|
|
||||||
steps:
|
|
||||||
- name: Checkout code
|
|
||||||
uses: actions/checkout@v4
|
|
||||||
|
|
||||||
- name: Set up Python
|
|
||||||
uses: actions/setup-python@v5
|
|
||||||
with:
|
|
||||||
python-version: '3.12'
|
|
||||||
|
|
||||||
- name: Install uv
|
|
||||||
uses: astral-sh/setup-uv@v4
|
|
||||||
|
|
||||||
- name: Install dependencies
|
|
||||||
run: uv sync --dev
|
|
||||||
|
|
||||||
- name: Run SQLite migration tests
|
|
||||||
run: uv run pytest tests/integration/persistence/test_migrations.py -q --tb=short
|
|
||||||
|
|
||||||
test-migrations-postgres:
|
|
||||||
name: Migrations (PostgreSQL)
|
|
||||||
runs-on: ubuntu-latest
|
|
||||||
services:
|
|
||||||
postgres:
|
|
||||||
image: postgres:16
|
|
||||||
env:
|
|
||||||
POSTGRES_USER: langbot
|
|
||||||
POSTGRES_PASSWORD: langbot
|
|
||||||
POSTGRES_DB: langbot_test
|
|
||||||
ports:
|
|
||||||
- 5432:5432
|
|
||||||
options: >-
|
|
||||||
--health-cmd="pg_isready -U langbot"
|
|
||||||
--health-interval=5s
|
|
||||||
--health-timeout=5s
|
|
||||||
--health-retries=5
|
|
||||||
|
|
||||||
steps:
|
|
||||||
- name: Checkout code
|
|
||||||
uses: actions/checkout@v4
|
|
||||||
|
|
||||||
- name: Set up Python
|
|
||||||
uses: actions/setup-python@v5
|
|
||||||
with:
|
|
||||||
python-version: '3.12'
|
|
||||||
|
|
||||||
- name: Install uv
|
|
||||||
uses: astral-sh/setup-uv@v4
|
|
||||||
|
|
||||||
- name: Install dependencies
|
|
||||||
run: uv sync --dev
|
|
||||||
|
|
||||||
- name: Run PostgreSQL migration tests
|
|
||||||
env:
|
|
||||||
TEST_POSTGRES_URL: postgresql+asyncpg://langbot:langbot@localhost:5432/langbot_test
|
|
||||||
run: uv run pytest tests/integration/persistence/test_migrations_postgres.py -q --tb=short
|
|
||||||
1
.gitignore
vendored
1
.gitignore
vendored
@@ -47,7 +47,6 @@ plugins.bak
|
|||||||
coverage.xml
|
coverage.xml
|
||||||
.coverage
|
.coverage
|
||||||
src/langbot/web/
|
src/langbot/web/
|
||||||
testsdk/
|
|
||||||
|
|
||||||
# Build artifacts
|
# Build artifacts
|
||||||
/dist
|
/dist
|
||||||
|
|||||||
143
AGENTS.md
143
AGENTS.md
@@ -1,134 +1,81 @@
|
|||||||
# AGENTS.md
|
# AGENTS.md
|
||||||
|
|
||||||
This file guides code agents (Claude Code, GitHub Copilot, OpenAI Codex, etc.) working in the LangBot project. `CLAUDE.md` is a symlink to this file.
|
This file is for guiding code agents (like Claude Code, GitHub Copilot, OpenAI Codex, etc.) to work in LangBot project.
|
||||||
|
|
||||||
## Project Overview
|
## Project Overview
|
||||||
|
|
||||||
LangBot is an open-source, LLM-native instant-messaging bot development platform. It aims to provide an out-of-the-box IM bot development experience with Agent, RAG, MCP and other LLM application capabilities, supporting mainstream global IM platforms and exposing rich APIs for custom development.
|
LangBot is a open-source LLM native instant messaging bot development platform, aiming to provide an out-of-the-box IM robot development experience, with Agent, RAG, MCP and other LLM application functions, supporting global instant messaging platforms, and providing rich API interfaces, supporting custom development.
|
||||||
|
|
||||||
LangBot has a comprehensive web frontend — almost every operation can be performed through it.
|
LangBot has a comprehensive frontend, all operations can be performed through the frontend. The project splited into these major parts:
|
||||||
|
|
||||||
- **Python**: `>=3.11,<4.0`, dependencies managed by `uv`. Package version is in `pyproject.toml`.
|
- `./src/langbot`: The main python package of the project, below are the main modules in this package:
|
||||||
- **Frontend**: `web/` is a **Vite + React Router 7 + shadcn/ui + Tailwind CSS** SPA, managed by `pnpm`. (Note: this is NOT Next.js — the `dev` script is `vite`.)
|
- `./pkg`: The core python package of the project backend.
|
||||||
- **Backend framework**: Quart (the async flavour of Flask). The HTTP API and the pre-built web UI are both served by the backend on `http://127.0.0.1:5300`.
|
- `./pkg/platform`: The platform module of the project, containing the logic of message platform adapters, bot managers, message session managers, etc.
|
||||||
|
- `./pkg/provider`: The provider module of the project, containing the logic of LLM providers, tool providers, etc.
|
||||||
|
- `./pkg/pipeline`: The pipeline module of the project, containing the logic of pipelines, stages, query pool, etc.
|
||||||
|
- `./pkg/api`: The api module of the project, containing the http api controllers and services.
|
||||||
|
- `./pkg/plugin`: LangBot bridge for connecting with plugin system.
|
||||||
|
- `./libs`: Some SDKs we previously developed for the project, such as `qq_official_api`, `wecom_api`, etc.
|
||||||
|
- `./templates`: Templates of config files, components, etc.
|
||||||
|
- `./web`: Frontend codebase, built with Next.js + **shadcn** + **Tailwind CSS**.
|
||||||
|
- `./docker`: docker-compose deployment files.
|
||||||
|
|
||||||
## Repository Layout
|
## Backend Development
|
||||||
|
|
||||||
```
|
We use `uv` to manage dependencies.
|
||||||
LangBot/
|
|
||||||
├── main.py # Entrypoint shim -> langbot.__main__.main()
|
|
||||||
├── pyproject.toml # Python project + deps (uv), pins langbot-plugin==<x.y.z>
|
|
||||||
├── src/langbot/
|
|
||||||
│ ├── __main__.py # Real entrypoint, CLI args (--standalone-runtime, --standalone-box, --debug)
|
|
||||||
│ ├── pkg/ # Core backend package
|
|
||||||
│ │ ├── api/ # HTTP API controllers + services (Quart)
|
|
||||||
│ │ ├── core/ # App bootstrap, stages, task manager
|
|
||||||
│ │ ├── platform/ # IM platform adapters, bot managers, session managers
|
|
||||||
│ │ ├── provider/ # LLM providers, requesters, tool providers
|
|
||||||
│ │ ├── pipeline/ # Pipelines, stages, query pool
|
|
||||||
│ │ ├── plugin/ # Bridge connecting LangBot to the plugin runtime (see below)
|
|
||||||
│ │ ├── box/ # Code-sandbox subsystem (Docker / nsjail / E2B backends)
|
|
||||||
│ │ ├── skill/ # Skill subsystem
|
|
||||||
│ │ ├── rag/ , vector/ # RAG + vector store
|
|
||||||
│ │ ├── command/ # Built-in commands
|
|
||||||
│ │ ├── persistence/ # ORM models + Alembic migrations (SQLite & PostgreSQL)
|
|
||||||
│ │ ├── storage/ # Object/file storage abstractions
|
|
||||||
│ │ ├── config/, entity/, discover/, utils/, telemetry/, survey/
|
|
||||||
│ ├── libs/ # Vendored SDKs (qq_official_api, wecom_api, etc.)
|
|
||||||
│ └── templates/ # Config/component templates (e.g. templates/config.yaml)
|
|
||||||
├── web/ # Frontend SPA (Vite + React Router 7 + shadcn + Tailwind)
|
|
||||||
└── docker/ # docker-compose deployment files
|
|
||||||
```
|
|
||||||
|
|
||||||
## Development Environment Setup
|
|
||||||
|
|
||||||
Full guide lives in the wiki: **["开发配置" / Dev Config](https://docs.langbot.app/zh/develop/dev-config)**. Summary:
|
|
||||||
|
|
||||||
### Backend
|
|
||||||
|
|
||||||
```bash
|
```bash
|
||||||
pip install uv
|
pip install uv
|
||||||
uv sync --dev # uv creates a .venv/ for you; point your editor's interpreter at it
|
uv sync --dev
|
||||||
uv run main.py # serves API + web UI on http://127.0.0.1:5300
|
|
||||||
```
|
```
|
||||||
|
|
||||||
On first run the config file is generated at `data/config.yaml`. DB is SQLite by default (zero setup); PostgreSQL is supported. Migrations run automatically on startup.
|
Start the backend and run the project in development mode.
|
||||||
|
|
||||||
### Frontend
|
```bash
|
||||||
|
uv run main.py
|
||||||
|
```
|
||||||
|
|
||||||
Requires Node.js + [pnpm](https://pnpm.io/installation).
|
Then you can access the project at `http://127.0.0.1:5300`.
|
||||||
|
|
||||||
|
## Frontend Development
|
||||||
|
|
||||||
|
We use `pnpm` to manage dependencies.
|
||||||
|
|
||||||
```bash
|
```bash
|
||||||
cd web
|
cd web
|
||||||
cp .env.example .env # Windows: copy .env.example .env
|
cp .env.example .env
|
||||||
pnpm install
|
pnpm install
|
||||||
pnpm dev # http://127.0.0.1:3000 (npm install / npm run dev also work)
|
pnpm dev
|
||||||
```
|
```
|
||||||
|
|
||||||
`pnpm dev` reads `VITE_API_BASE_URL` from `web/.env` so the dev frontend can reach the backend on port `5300`. In production the frontend is pre-built into static files served by the backend on the same origin.
|
Then you can access the project at `http://127.0.0.1:3000`.
|
||||||
|
|
||||||
### Code formatting
|
## Plugin System Architecture
|
||||||
|
|
||||||
The repo runs lint + format checks in CI. Install the pre-commit hooks so the same checks run locally before each commit:
|
LangBot is composed of various internal components such as Large Language Model tools, commands, messaging platform adapters, LLM requesters, and more. To meet extensibility and flexibility requirements, we have implemented a production-grade plugin system.
|
||||||
|
|
||||||
```bash
|
Each plugin runs in an independent process, managed uniformly by the Plugin Runtime. It has two operating modes: `stdio` and `websocket`. When LangBot is started directly by users (not running in a container), it uses `stdio` mode, which is common for personal users or lightweight environments. When LangBot runs in a container, it uses `websocket` mode, designed specifically for production environments.
|
||||||
uv run pre-commit install
|
|
||||||
```
|
|
||||||
|
|
||||||
## Plugin System
|
Plugin Runtime automatically starts each installed plugin and interacts through stdio. In plugin development scenarios, developers can use the lbp command-line tool to start plugins and connect to the running Runtime via WebSocket for debugging.
|
||||||
|
|
||||||
LangBot's plugin system (Plugin SDK, CLI `lbp`, Plugin Runtime, and the shared entity/API definitions) lives in a **separate repository**: [`langbot-plugin-sdk`](https://github.com/langbot-app/langbot-plugin-sdk). LangBot depends on it via the pinned `langbot-plugin` package in `pyproject.toml`.
|
> Plugin SDK, CLI, Runtime, and entities definitions shared between LangBot and plugins are contained in the [`langbot-plugin-sdk`](https://github.com/langbot-app/langbot-plugin-sdk) repository.
|
||||||
|
|
||||||
### Architecture (what to know inside this repo)
|
## Some Development Tips and Standards
|
||||||
|
|
||||||
- Plugins run as independent processes managed by the **Plugin Runtime**. The Runtime supports two control transports: `stdio` and `websocket`.
|
- LangBot is a global project, any comments in code should be in English, and user experience should be considered in all aspects.
|
||||||
- When LangBot is started directly by a user (not in a container), it spawns and connects to the Runtime over **stdio** (lightweight/personal use).
|
- Thus you should consider the i18n support in all aspects.
|
||||||
- When LangBot runs in a container, it connects to a standalone Runtime over **WebSocket** (production).
|
- LangBot is widely adopted in both toC and toB scenarios, so you should consider the compatibility and security in all aspects.
|
||||||
- The bridge code lives in `src/langbot/pkg/plugin/` (`connector.py`, `handler.py`).
|
- If you were asked to make a commit, please follow the commit message format:
|
||||||
- Relevant config (`data/config.yaml`): `plugin.runtime_ws_url` (e.g. `ws://langbot_plugin_runtime:5400/control/ws`). Start LangBot with `--standalone-runtime` to make it connect to an externally-launched Runtime over WebSocket instead of spawning one over stdio.
|
- format: <type>(<scope>): <subject>
|
||||||
|
- type: must be a specific type, such as feat (new feature), fix (bug fix), docs (documentation), style (code style), refactor (refactoring), perf (performance optimization), etc.
|
||||||
### Debugging the Plugin Runtime / CLI / SDK
|
- scope: the scope of the commit, such as the package name, the file name, the function name, the class name, the module name, etc.
|
||||||
|
- subject: the subject of the commit, such as the description of the commit, the reason for the commit, the impact of the commit, etc.
|
||||||
This is documented in detail in the **SDK repo's `AGENTS.md`** and in the wiki page **["调试插件运行时、CLI、SDK" / Plugin Runtime](https://docs.langbot.app/zh/develop/plugin-runtime)**. The short version:
|
- If you changed the definition of database entities, please update the migration file in `src/langbot/pkg/persistence/migrations/` and update the constants.py file in `src/langbot/pkg/utils/constants.py` with the new migration number.
|
||||||
|
|
||||||
- Clone `LangBot` and `langbot-plugin-sdk` as siblings under one parent dir so the editor resolves shared entities.
|
|
||||||
- Start a standalone Runtime from the SDK repo: `uv run --no-sync lbp rt` (control port `5400`, debug port `5401`).
|
|
||||||
- To make LangBot use a locally-modified SDK: from the SDK dir, with LangBot's `.venv` active, run `uv pip install .`, then launch LangBot with `uv run --no-sync main.py --standalone-runtime` (keep `--no-sync` so your local SDK isn't overwritten).
|
|
||||||
|
|
||||||
### Debugging the Box (sandbox) runtime
|
|
||||||
|
|
||||||
The Box subsystem (`src/langbot/pkg/box/`) is the code sandbox. It picks the first available backend among **Docker / nsjail / E2B**. The standalone Box runtime is launched via the SDK CLI: `lbp box`. Backend selection details, the `lbp box` flags, and the SDK-side architecture are documented in the SDK repo's `AGENTS.md`.
|
|
||||||
|
|
||||||
Relevant config (`data/config.yaml`, `box:` section): `box.enabled` (master switch — disabling it also disables the native sandbox tools, skill add/edit, and stdio-mode MCP servers), `box.backend` (`'local'` = Docker/nsjail auto-pick, or `'docker'` / `'nsjail'` / `'e2b'`; also settable via `BOX__BACKEND`), and `box.runtime.endpoint` (external Box runtime base URL, e.g. `ws://127.0.0.1:5410`; empty = local auto-managed runtime). Like the plugin runtime, LangBot can connect to an externally-launched Box runtime by setting that endpoint and starting with `--standalone-box`.
|
|
||||||
|
|
||||||
> A common false "No supported sandbox backend (Docker / nsjail / E2B) is available" comes from Docker being installed and running but the current user not being in the `docker` group → `docker info` gets `permission denied` on the socket. Fix: `sudo usermod -aG docker <user>` and restart the backend in a shell that has the new group.
|
|
||||||
|
|
||||||
## Development Standards
|
|
||||||
|
|
||||||
- LangBot is a global project: **all code comments and docstrings must be in English**, and every user-facing string must support **i18n** (`en_US` + `zh_Hans` at minimum, plus `ja_JP` where the repo already has it).
|
|
||||||
- LangBot is adopted in both toC and toB scenarios — always consider compatibility and security.
|
|
||||||
- **Commit message format**: `<type>(<scope>): <subject>`
|
|
||||||
- `type`: one of `feat`, `fix`, `docs`, `style`, `refactor`, `perf`, `test`, `chore`, etc.
|
|
||||||
- `scope`: the affected package/module/file/class.
|
|
||||||
- `subject`: concise description of the change.
|
|
||||||
|
|
||||||
### Database migrations (Alembic)
|
|
||||||
|
|
||||||
LangBot uses [Alembic](https://alembic.sqlalchemy.org/) for migrations, supporting both SQLite and PostgreSQL from a single set of scripts. Migration files live in `src/langbot/pkg/persistence/alembic/versions/`.
|
|
||||||
|
|
||||||
If you change ORM model definitions, generate a migration:
|
|
||||||
|
|
||||||
```bash
|
|
||||||
# Run from the project root (requires data/config.yaml to exist)
|
|
||||||
uv run python -m langbot.pkg.persistence.alembic_runner autogenerate "description of your change"
|
|
||||||
```
|
|
||||||
|
|
||||||
Review and edit the generated script before committing. Migrations execute automatically on startup. `autogenerate` detects schema changes (add/drop columns, tables, type changes) but **data migrations** (e.g. mutating JSON field contents) must be hand-written into the generated script. `env.py` sets `render_as_batch=True`, so SQLite's ALTER TABLE limits are handled automatically — no need to branch per database. More in the wiki ["开发配置"](https://docs.langbot.app/zh/develop/dev-config#数据库迁移).
|
|
||||||
|
|
||||||
## Some Principles
|
## Some Principles
|
||||||
|
|
||||||
- Keep it simple, stupid.
|
- Keep it simple, stupid.
|
||||||
- Entities should not be multiplied unnecessarily.
|
- Entities should not be multiplied unnecessarily
|
||||||
- 八荣八耻
|
- 八荣八耻
|
||||||
|
|
||||||
以瞎猜接口为耻,以认真查询为荣。
|
以瞎猜接口为耻,以认真查询为荣。
|
||||||
|
|||||||
107
CLA.md
107
CLA.md
@@ -1,107 +0,0 @@
|
|||||||
# LangBot Individual Contributor License Agreement (v1.0)
|
|
||||||
|
|
||||||
Thank you for your interest in contributing to LangBot (the "Project"), stewarded by Beijing Langbo Intelligent Technology Co., Ltd. (北京浪波智能科技有限公司) ("We" or "Us").
|
|
||||||
|
|
||||||
This Individual Contributor License Agreement ("Agreement") documents the rights granted by contributors to Us. By signing this Agreement (see Section 9), You accept and agree to the following terms and conditions for Your present and future Contributions submitted to the Project. Except for the licenses granted herein to Us and recipients of software distributed by Us, You reserve all right, title, and interest in and to Your Contributions.
|
|
||||||
|
|
||||||
## 1. Definitions
|
|
||||||
|
|
||||||
"You" (or "Your") shall mean the copyright owner or legal entity authorized by the copyright owner that is making this Agreement with Us.
|
|
||||||
|
|
||||||
"Contribution" shall mean any original work of authorship, including any modifications or additions to an existing work, that is intentionally submitted by You to Us for inclusion in, or documentation of, any of the products or repositories owned or managed by Us (the "Work"). For the purposes of this definition, "submitted" means any form of electronic, verbal, or written communication sent to Us or our representatives, including but not limited to communication on electronic mailing lists, source code control systems, and issue tracking systems that are managed by, or on behalf of, Us for the purpose of discussing and improving the Work, but excluding communication that is conspicuously marked or otherwise designated in writing by You as "Not a Contribution."
|
|
||||||
|
|
||||||
## 2. Grant of Copyright License
|
|
||||||
|
|
||||||
Subject to the terms and conditions of this Agreement, You hereby grant to Us and to recipients of software distributed by Us a perpetual, worldwide, non-exclusive, no-charge, royalty-free, irrevocable copyright license to reproduce, prepare derivative works of, publicly display, publicly perform, sublicense, and distribute Your Contributions and such derivative works. For clarity, this includes the right for Us to distribute Your Contributions, alone or as part of the Work, under the terms of any license, including without limitation open source licenses and commercial or proprietary licenses.
|
|
||||||
|
|
||||||
## 3. Grant of Patent License
|
|
||||||
|
|
||||||
Subject to the terms and conditions of this Agreement, You hereby grant to Us and to recipients of software distributed by Us a perpetual, worldwide, non-exclusive, no-charge, royalty-free, irrevocable (except as stated in this section) patent license to make, have made, use, offer to sell, sell, import, and otherwise transfer the Work, where such license applies only to those patent claims licensable by You that are necessarily infringed by Your Contribution(s) alone or by combination of Your Contribution(s) with the Work to which such Contribution(s) was submitted. If any entity institutes patent litigation against You or any other entity (including a cross-claim or counterclaim in a lawsuit) alleging that Your Contribution, or the Work to which You have contributed, constitutes direct or contributory patent infringement, then any patent licenses granted to that entity under this Agreement for that Contribution or Work shall terminate as of the date such litigation is filed.
|
|
||||||
|
|
||||||
## 4. Authority; Employer
|
|
||||||
|
|
||||||
You represent that You are legally entitled to grant the above licenses. If Your employer(s) has rights to intellectual property that You create that includes Your Contributions, You represent that You have received permission to make Contributions on behalf of that employer, that Your employer has waived such rights for Your Contributions to Us, or that Your employer has executed a separate Corporate Contributor License Agreement with Us.
|
|
||||||
|
|
||||||
## 5. Original Creation; Disclosure
|
|
||||||
|
|
||||||
You represent that each of Your Contributions is Your original creation (see Section 7 for submissions on behalf of others). You represent that Your Contribution submissions include complete details of any third-party license or other restriction (including, but not limited to, related patents and trademarks) of which You are personally aware and which are associated with any part of Your Contributions.
|
|
||||||
|
|
||||||
## 6. No Obligation of Support; Disclaimer
|
|
||||||
|
|
||||||
You are not expected to provide support for Your Contributions, except to the extent You desire to provide support. You may provide support for free, for a fee, or not at all. Unless required by applicable law or agreed to in writing, You provide Your Contributions on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied, including, without limitation, any warranties or conditions of TITLE, NON-INFRINGEMENT, MERCHANTABILITY, or FITNESS FOR A PARTICULAR PURPOSE.
|
|
||||||
|
|
||||||
## 7. Third-Party Works
|
|
||||||
|
|
||||||
Should You wish to submit work that is not Your original creation, You may submit it to Us separately from any Contribution, identifying the complete details of its source and of any license or other restriction (including, but not limited to, related patents, trademarks, and license agreements) of which You are personally aware, and conspicuously marking the work as "Submitted on behalf of a third-party: [named here]".
|
|
||||||
|
|
||||||
## 8. Notification
|
|
||||||
|
|
||||||
You agree to notify Us of any facts or circumstances of which You become aware that would make these representations inaccurate in any respect.
|
|
||||||
|
|
||||||
## 9. Electronic Signature
|
|
||||||
|
|
||||||
This Agreement is accepted and signed electronically: posting a comment containing the exact phrase designated by Us (currently "I have read the CLA Document and I hereby sign the CLA") from Your GitHub account on a pull request in the Project's repositories constitutes Your binding electronic signature to this Agreement. You represent that the GitHub account used to sign belongs to You and that You are of legal age to form a binding contract. Your signature covers Your present and future Contributions to all repositories owned or managed by Us, until and unless You notify Us in writing that You withdraw from this Agreement for future Contributions (licenses already granted are irrevocable).
|
|
||||||
|
|
||||||
## 10. Our Commitment
|
|
||||||
|
|
||||||
We commit that the Project's main repository will continue to make an open source version of the Work publicly available.
|
|
||||||
|
|
||||||
## 11. Miscellaneous
|
|
||||||
|
|
||||||
This Agreement is the entire agreement between You and Us regarding Your Contributions and supersedes any prior agreements on this subject. If any provision is held unenforceable, the remaining provisions remain in effect. This Agreement is executed in English; the Chinese translation below is provided for reference only, and the English version shall prevail in case of any discrepancy.
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
# LangBot 个人贡献者许可协议(v1.0)中文参考译文
|
|
||||||
|
|
||||||
> 本译文仅供参考,如与英文版有任何歧义,以英文版为准。
|
|
||||||
|
|
||||||
感谢您有意为 LangBot(下称"本项目")作出贡献。本项目由北京浪波智能科技有限公司(下称"我方")运营管理。
|
|
||||||
|
|
||||||
本《个人贡献者许可协议》(下称"本协议")旨在记录贡献者授予我方的各项权利。您一经签署本协议(见第 9 条),即接受并同意以下条款与条件,适用于您向本项目提交的现在及未来的全部贡献。除本协议授予我方及我方分发软件之接收者的许可外,您保留对您的贡献的全部权利、所有权和利益。
|
|
||||||
|
|
||||||
## 1. 定义
|
|
||||||
|
|
||||||
"您"指与我方订立本协议的版权所有人,或经版权所有人授权的法律实体。
|
|
||||||
|
|
||||||
"贡献"指您有意提交给我方、用于纳入我方拥有或管理的任何产品或代码仓库(下称"作品")或其文档的任何原创作品,包括对既有作品的修改或增补。就本定义而言,"提交"指以任何电子、口头或书面形式向我方或我方代表发送的通信,包括但不限于在由我方或代表我方管理的电子邮件列表、源代码管理系统和问题跟踪系统中,为讨论和改进作品而进行的通信;但您以显著方式标注或以书面形式声明为"非贡献"(Not a Contribution)的通信除外。
|
|
||||||
|
|
||||||
## 2. 版权许可的授予
|
|
||||||
|
|
||||||
在遵守本协议条款与条件的前提下,您特此授予我方及我方分发软件之接收者一项永久的、全球范围的、非独占的、免费的、免版税的、不可撤销的版权许可,以复制您的贡献、基于其创作衍生作品、公开展示、公开表演、再许可以及分发您的贡献及上述衍生作品。为明确起见,上述许可包括我方有权以任何许可条款(包括但不限于开源许可证以及商业或专有许可证)单独或作为作品的一部分分发您的贡献。
|
|
||||||
|
|
||||||
## 3. 专利许可的授予
|
|
||||||
|
|
||||||
在遵守本协议条款与条件的前提下,您特此授予我方及我方分发软件之接收者一项永久的、全球范围的、非独占的、免费的、免版税的、不可撤销的(本条所述情形除外)专利许可,以制造、委托制造、使用、许诺销售、销售、进口及以其他方式转让作品;该许可仅适用于您可许可的、且因您的贡献本身或您的贡献与其所提交之作品的结合而必然受到侵犯的专利权利要求。如任何实体对您或任何其他实体提起专利诉讼(包括诉讼中的交叉请求或反诉),主张您的贡献或您所贡献的作品构成直接或帮助性专利侵权,则依据本协议就该贡献或作品授予该实体的任何专利许可,自该诉讼提起之日起终止。
|
|
||||||
|
|
||||||
## 4. 权利能力与雇主
|
|
||||||
|
|
||||||
您声明您在法律上有权授予上述许可。如您的雇主对您创作的、包含您的贡献在内的知识产权享有权利,您声明:您已获得该雇主代表其作出贡献的许可,或该雇主已就您向我方的贡献放弃上述权利,或该雇主已与我方另行签署《企业贡献者许可协议》。
|
|
||||||
|
|
||||||
## 5. 原创性声明与披露义务
|
|
||||||
|
|
||||||
您声明您的每项贡献均为您的原创作品(代表第三方提交的情形见第 7 条)。您声明您提交的贡献中已完整披露您本人知悉的、与您的贡献任何部分相关的任何第三方许可或其他限制(包括但不限于相关专利和商标)的全部细节。
|
|
||||||
|
|
||||||
## 6. 无支持义务;免责声明
|
|
||||||
|
|
||||||
您无义务为您的贡献提供支持,除非您自愿提供。您可以免费提供支持、收费提供支持或不提供支持。除非适用法律要求或另有书面约定,您的贡献按"现状"(AS IS)提供,不附带任何明示或默示的保证或条件,包括但不限于关于权属、不侵权、适销性或特定用途适用性的任何保证或条件。
|
|
||||||
|
|
||||||
## 7. 第三方作品
|
|
||||||
|
|
||||||
如您希望提交非您原创的作品,您可以将其与任何贡献分开单独提交给我方,并完整说明其来源以及您本人知悉的任何许可或其他限制(包括但不限于相关专利、商标和许可协议)的全部细节,同时以显著方式将该作品标注为"代表第三方提交:[此处注明第三方名称]"。
|
|
||||||
|
|
||||||
## 8. 通知义务
|
|
||||||
|
|
||||||
如您知悉任何事实或情况将导致上述声明在任何方面不准确,您同意通知我方。
|
|
||||||
|
|
||||||
## 9. 电子签署
|
|
||||||
|
|
||||||
本协议以电子方式接受并签署:您通过您的 GitHub 账号,在本项目代码仓库的拉取请求(pull request)中发表包含我方指定语句(现为 "I have read the CLA Document and I hereby sign the CLA")的评论,即构成您对本协议具有约束力的电子签名。您声明用于签署的 GitHub 账号归您本人所有,且您已达到订立有约束力合同的法定年龄。您的签署覆盖您对我方拥有或管理的全部代码仓库的现在及未来的贡献,直至您以书面形式通知我方就未来贡献退出本协议为止(已授予的许可不可撤销)。
|
|
||||||
|
|
||||||
## 10. 我方承诺
|
|
||||||
|
|
||||||
我方承诺本项目主仓库将持续公开提供作品的开源版本。
|
|
||||||
|
|
||||||
## 11. 其他
|
|
||||||
|
|
||||||
本协议构成您与我方之间就您的贡献达成的完整协议,并取代双方先前就此主题达成的任何协议。如本协议任何条款被认定为不可执行,其余条款仍然有效。本协议以英文签署,中文译文仅供参考,如有歧义以英文版为准。
|
|
||||||
@@ -14,12 +14,6 @@
|
|||||||
- 在 PR 和 Commit Message 中请使用全英文
|
- 在 PR 和 Commit Message 中请使用全英文
|
||||||
- 对于中文用户,issue 中可以使用中文
|
- 对于中文用户,issue 中可以使用中文
|
||||||
|
|
||||||
### 贡献者许可协议(CLA)
|
|
||||||
|
|
||||||
为了保护项目和每一位贡献者,我们要求所有代码贡献者签署[贡献者许可协议(CLA)](./CLA.md)。这是 Apache、Google、Grafana 等主流开源项目的标准做法:您保留自己代码的全部版权,仅授予项目使用、分发您贡献的许可。
|
|
||||||
|
|
||||||
签署只需 10 秒:首次提交 PR 时,机器人会自动评论提示,按提示回复一句话即完成签署,此后对本组织所有仓库永久有效。历史贡献不受影响。
|
|
||||||
|
|
||||||
<hr/>
|
<hr/>
|
||||||
|
|
||||||
## Guidelines
|
## Guidelines
|
||||||
@@ -35,9 +29,3 @@
|
|||||||
|
|
||||||
- Use English in PRs and Commit Messages
|
- Use English in PRs and Commit Messages
|
||||||
- For English users, you can use English in issues
|
- For English users, you can use English in issues
|
||||||
|
|
||||||
### Contributor License Agreement (CLA)
|
|
||||||
|
|
||||||
To protect the project and every contributor, we require all code contributors to sign our [Contributor License Agreement](./CLA.md). This is standard practice in major open source projects such as Apache, Google, and Grafana: you keep full copyright of your code — the CLA only grants us a license to use and distribute your contribution.
|
|
||||||
|
|
||||||
Signing takes 10 seconds: when you open your first PR, a bot will guide you to reply with a single comment. One signature covers all repositories in this organization, permanently. Past contributions are not affected.
|
|
||||||
|
|||||||
42
Dockerfile
42
Dockerfile
@@ -6,25 +6,6 @@ COPY web ./web
|
|||||||
|
|
||||||
RUN cd web && npm install && npx vite build
|
RUN cd web && npm install && npx vite build
|
||||||
|
|
||||||
# Build nsjail from source so the image ships a self-contained sandbox backend
|
|
||||||
# that needs no host Docker socket. Pinned to a release tag for reproducibility.
|
|
||||||
# Multi-stage keeps the compile toolchain (bison/flex/protobuf-dev/libnl-dev)
|
|
||||||
# out of the final image; only the nsjail binary and its small runtime libs
|
|
||||||
# (libprotobuf, libnl-route-3) are carried over.
|
|
||||||
FROM python:3.12.7-slim AS nsjail-build
|
|
||||||
|
|
||||||
ARG NSJAIL_VERSION=3.6
|
|
||||||
|
|
||||||
RUN apt-get update \
|
|
||||||
&& apt-get install -y --no-install-recommends \
|
|
||||||
ca-certificates git build-essential \
|
|
||||||
autoconf bison flex libtool pkg-config \
|
|
||||||
protobuf-compiler libprotobuf-dev libnl-route-3-dev \
|
|
||||||
&& git clone --depth 1 --branch "${NSJAIL_VERSION}" https://github.com/google/nsjail.git /nsjail \
|
|
||||||
&& make -C /nsjail \
|
|
||||||
&& install -m 0755 /nsjail/nsjail /usr/local/bin/nsjail \
|
|
||||||
&& rm -rf /var/lib/apt/lists/*
|
|
||||||
|
|
||||||
FROM python:3.12.7-slim
|
FROM python:3.12.7-slim
|
||||||
|
|
||||||
WORKDIR /app
|
WORKDIR /app
|
||||||
@@ -33,29 +14,10 @@ COPY . .
|
|||||||
|
|
||||||
COPY --from=node /app/web/dist ./web/dist
|
COPY --from=node /app/web/dist ./web/dist
|
||||||
|
|
||||||
# nsjail binary built in the dedicated stage above. Self-contained sandbox
|
RUN apt update \
|
||||||
# backend; lets the Box runtime isolate code without a host Docker socket.
|
&& apt install gcc -y \
|
||||||
COPY --from=nsjail-build /usr/local/bin/nsjail /usr/local/bin/nsjail
|
|
||||||
|
|
||||||
RUN apt-get update \
|
|
||||||
&& apt-get install -y --no-install-recommends gcc ca-certificates curl gnupg \
|
|
||||||
# nsjail runtime libraries (the build toolchain stays in the nsjail-build
|
|
||||||
# stage; only these shared libs are needed to execute the binary).
|
|
||||||
&& apt-get install -y --no-install-recommends libprotobuf32 libnl-route-3-200 \
|
|
||||||
# Install the Docker CLI (client only) so the optional langbot_box
|
|
||||||
# service can drive the mounted host Docker socket and create sandbox
|
|
||||||
# containers. The same image powers langbot / plugin_runtime / box; only
|
|
||||||
# box uses the client. Arch-aware via dpkg so multi-arch builds work.
|
|
||||||
&& install -m 0755 -d /etc/apt/keyrings \
|
|
||||||
&& curl -fsSL https://download.docker.com/linux/debian/gpg -o /etc/apt/keyrings/docker.asc \
|
|
||||||
&& chmod a+r /etc/apt/keyrings/docker.asc \
|
|
||||||
&& echo "deb [arch=$(dpkg --print-architecture) signed-by=/etc/apt/keyrings/docker.asc] https://download.docker.com/linux/debian $(. /etc/os-release && echo \"$VERSION_CODENAME\") stable" > /etc/apt/sources.list.d/docker.list \
|
|
||||||
&& apt-get update \
|
|
||||||
&& apt-get install -y --no-install-recommends docker-ce-cli \
|
|
||||||
&& python -m pip install --no-cache-dir uv \
|
&& python -m pip install --no-cache-dir uv \
|
||||||
&& uv sync \
|
&& uv sync \
|
||||||
&& apt-get purge -y --auto-remove curl gnupg \
|
|
||||||
&& rm -rf /var/lib/apt/lists/* \
|
|
||||||
&& touch /.dockerenv
|
&& touch /.dockerenv
|
||||||
|
|
||||||
CMD [ "uv", "run", "--no-sync", "main.py" ]
|
CMD [ "uv", "run", "--no-sync", "main.py" ]
|
||||||
36
Makefile
36
Makefile
@@ -1,36 +0,0 @@
|
|||||||
# LangBot Makefile
|
|
||||||
# Quick developer commands
|
|
||||||
|
|
||||||
.PHONY: test test-quick test-integration-fast test-coverage test-all-local lint
|
|
||||||
|
|
||||||
# Run all tests (full suite with coverage)
|
|
||||||
test:
|
|
||||||
bash run_tests.sh
|
|
||||||
|
|
||||||
# Quick self-test for developers (lint + unit + smoke, no real credentials needed)
|
|
||||||
test-quick:
|
|
||||||
bash scripts/test-quick.sh
|
|
||||||
|
|
||||||
# Fast integration tests (SQLite/API/Pipeline, no external services)
|
|
||||||
test-integration-fast:
|
|
||||||
bash scripts/test-integration-fast.sh
|
|
||||||
|
|
||||||
# Coverage gate (all tests, enforces minimum threshold)
|
|
||||||
test-coverage:
|
|
||||||
bash scripts/test-coverage.sh
|
|
||||||
|
|
||||||
# Full local quality gate (quick + integration + coverage)
|
|
||||||
test-all-local:
|
|
||||||
bash scripts/test-quick.sh
|
|
||||||
bash scripts/test-integration-fast.sh
|
|
||||||
bash scripts/test-coverage.sh
|
|
||||||
|
|
||||||
# Run linting only
|
|
||||||
lint:
|
|
||||||
ruff check src/langbot/ tests/
|
|
||||||
ruff format --check src/langbot/ tests/
|
|
||||||
|
|
||||||
# Fix linting issues
|
|
||||||
lint-fix:
|
|
||||||
ruff check --fix src/langbot/ tests/
|
|
||||||
ruff format src/langbot/ tests/
|
|
||||||
32
README.md
32
README.md
@@ -38,7 +38,7 @@ LangBot is an **open-source, production-grade platform** for building AI-powered
|
|||||||
|
|
||||||
### Key Capabilities
|
### Key Capabilities
|
||||||
|
|
||||||
- **AI Conversations & Agents** — Multi-turn dialogues, tool calling, multi-modal support, streaming output. Built-in RAG (knowledge base) with deep integration to [Dify](https://dify.ai), [Coze](https://coze.com), [n8n](https://n8n.io), [Langflow](https://langflow.org), [Deerflow](https://deerflow.tech), [Weknora](https://weknora.weixin.qq.com).
|
- **AI Conversations & Agents** — Multi-turn dialogues, tool calling, multi-modal support, streaming output. Built-in RAG (knowledge base) with deep integration to [Dify](https://dify.ai), [Coze](https://coze.com), [n8n](https://n8n.io), [Langflow](https://langflow.org).
|
||||||
- **Universal IM Platform Support** — One codebase for Discord, Telegram, Slack, LINE, QQ, WeChat, WeCom, Lark, DingTalk, KOOK.
|
- **Universal IM Platform Support** — One codebase for Discord, Telegram, Slack, LINE, QQ, WeChat, WeCom, Lark, DingTalk, KOOK.
|
||||||
- **Production-Ready** — Access control, rate limiting, sensitive word filtering, comprehensive monitoring, and exception handling. Trusted by enterprises.
|
- **Production-Ready** — Access control, rate limiting, sensitive word filtering, comprehensive monitoring, and exception handling. Trusted by enterprises.
|
||||||
- **Plugin Ecosystem** — Hundreds of plugins, event-driven architecture, component extensions, and [MCP protocol](https://modelcontextprotocol.io/) support.
|
- **Plugin Ecosystem** — Hundreds of plugins, event-driven architecture, component extensions, and [MCP protocol](https://modelcontextprotocol.io/) support.
|
||||||
@@ -47,8 +47,6 @@ LangBot is an **open-source, production-grade platform** for building AI-powered
|
|||||||
|
|
||||||
[→ Learn more about all features](https://link.langbot.app/en/docs/features)
|
[→ Learn more about all features](https://link.langbot.app/en/docs/features)
|
||||||
|
|
||||||
📍 Practical guides: [deploy a multi-platform AI bot in 5 minutes](https://blog.langbot.app/en/blog/deploy-ai-bot-in-5-minutes/), [connect DeepSeek to WeChat, Discord, and Telegram](https://blog.langbot.app/en/blog/connect-deepseek-to-wechat/), [run a Dify Agent in Discord, Telegram, and Slack](https://blog.langbot.app/en/blog/dify-agent-discord-telegram-slack/), and [build an n8n-powered chatbot](https://blog.langbot.app/en/blog/n8n-multi-platform-ai-chatbot/).
|
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
## Quick Start
|
## Quick Start
|
||||||
@@ -78,7 +76,7 @@ docker compose up -d
|
|||||||
[](https://zeabur.com/en-US/templates/ZKTBDH)
|
[](https://zeabur.com/en-US/templates/ZKTBDH)
|
||||||
[](https://railway.app/template/yRrAyL?referralCode=vogKPF)
|
[](https://railway.app/template/yRrAyL?referralCode=vogKPF)
|
||||||
|
|
||||||
**More options:** [Docker](https://link.langbot.app/en/docs/docker) · [Manual](https://link.langbot.app/en/docs/manual-deploy) · [BTPanel](https://link.langbot.app/en/docs/bt-panel) · [Kubernetes](https://docs.langbot.app/en/deploy/langbot/kubernetes)
|
**More options:** [Docker](https://link.langbot.app/en/docs/docker) · [Manual](https://link.langbot.app/en/docs/manual-deploy) · [BTPanel](https://link.langbot.app/en/docs/bt-panel) · [Kubernetes](./docker/README_K8S.md)
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
@@ -86,26 +84,24 @@ docker compose up -d
|
|||||||
|
|
||||||
| Platform | Status | Notes |
|
| Platform | Status | Notes |
|
||||||
|----------|--------|-------|
|
|----------|--------|-------|
|
||||||
| Discord | ✅ | Official |
|
| Discord | ✅ | |
|
||||||
| Telegram | ✅ | Official |
|
| Telegram | ✅ | |
|
||||||
| Slack | ✅ | Official |
|
| Slack | ✅ | |
|
||||||
| LINE | ✅ | Official |
|
| LINE | ✅ | |
|
||||||
| QQ | ✅ | Personal & Official API (Channel, DM, Group) |
|
| QQ | ✅ | Personal & Official API |
|
||||||
| WeCom | ✅ | Enterprise WeChat, External CS, AI Bot |
|
| WeCom | ✅ | Enterprise WeChat, External CS, AI Bot |
|
||||||
| WeChat | ✅ | Personal & Official Account |
|
| WeChat | ✅ | Personal & Official Account |
|
||||||
| Lark | ✅ | Official |
|
| Lark | ✅ | |
|
||||||
| DingTalk | ✅ | Official |
|
| DingTalk | ✅ | |
|
||||||
| KOOK | ✅ | Official |
|
| KOOK | ✅ | |
|
||||||
| Satori | ✅ | |
|
| Satori | ✅ | |
|
||||||
| Email | ✅ | Matrix, Satori |
|
|
||||||
| Matrix | ✅ | Supports multiple bridged platforms such as Signal, WhatsApp, Messenger, iMessage, Mattermost, Google Chat, IRC, XMPP, Zulip, and more |
|
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
## Supported LLMs & Integrations
|
## Supported LLMs & Integrations
|
||||||
|
|
||||||
| Provider | Type | Status |
|
| Provider | Type | Status |
|
||||||
| ----------------------------------------------------------------------------------------------------------------- | ------------ | ------ |
|
|----------|------|--------|
|
||||||
| [OpenAI](https://platform.openai.com/) | LLM | ✅ |
|
| [OpenAI](https://platform.openai.com/) | LLM | ✅ |
|
||||||
| [Anthropic](https://www.anthropic.com/) | LLM | ✅ |
|
| [Anthropic](https://www.anthropic.com/) | LLM | ✅ |
|
||||||
| [DeepSeek](https://www.deepseek.com/) | LLM | ✅ |
|
| [DeepSeek](https://www.deepseek.com/) | LLM | ✅ |
|
||||||
@@ -127,7 +123,6 @@ docker compose up -d
|
|||||||
| [ShengSuanYun](https://www.shengsuanyun.com/?from=CH_KYIPP758) | GPU Platform | ✅ |
|
| [ShengSuanYun](https://www.shengsuanyun.com/?from=CH_KYIPP758) | GPU Platform | ✅ |
|
||||||
| [接口 AI](https://jiekou.ai/) | Gateway | ✅ |
|
| [接口 AI](https://jiekou.ai/) | Gateway | ✅ |
|
||||||
| [302.AI](https://share.302.ai/SuTG99) | Gateway | ✅ |
|
| [302.AI](https://share.302.ai/SuTG99) | Gateway | ✅ |
|
||||||
| [Qiniu](https://www.qiniu.com/ai/agent) | Gateway | ✅ |
|
|
||||||
|
|
||||||
[→ View all integrations](https://link.langbot.app/en/docs/features)
|
[→ View all integrations](https://link.langbot.app/en/docs/features)
|
||||||
|
|
||||||
@@ -136,7 +131,7 @@ docker compose up -d
|
|||||||
## Why LangBot?
|
## Why LangBot?
|
||||||
|
|
||||||
| Use Case | How LangBot Helps |
|
| Use Case | How LangBot Helps |
|
||||||
| --------------------------- | ------------------------------------------------------------------------------------------ |
|
|----------|-------------------|
|
||||||
| **Customer Support** | Deploy AI agents to Slack/Discord/Telegram that answer questions using your knowledge base |
|
| **Customer Support** | Deploy AI agents to Slack/Discord/Telegram that answer questions using your knowledge base |
|
||||||
| **Internal Tools** | Connect n8n/Dify workflows to WeCom/DingTalk for automated business processes |
|
| **Internal Tools** | Connect n8n/Dify workflows to WeCom/DingTalk for automated business processes |
|
||||||
| **Community Management** | Moderate QQ/Discord groups with AI-powered content filtering and interaction |
|
| **Community Management** | Moderate QQ/Discord groups with AI-powered content filtering and interaction |
|
||||||
@@ -147,11 +142,10 @@ docker compose up -d
|
|||||||
## Live Demo
|
## Live Demo
|
||||||
|
|
||||||
**Try it now:** https://demo.langbot.dev/
|
**Try it now:** https://demo.langbot.dev/
|
||||||
|
|
||||||
- Email: `demo@langbot.app`
|
- Email: `demo@langbot.app`
|
||||||
- Password: `langbot123456`
|
- Password: `langbot123456`
|
||||||
|
|
||||||
_Note: Public demo environment. Do not enter sensitive information._
|
*Note: Public demo environment. Do not enter sensitive information.*
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
|
|||||||
28
README_CN.md
28
README_CN.md
@@ -13,7 +13,7 @@
|
|||||||
[English](README.md) / 简体中文 / [繁體中文](README_TW.md) / [日本語](README_JP.md) / [Español](README_ES.md) / [Français](README_FR.md) / [한국어](README_KO.md) / [Русский](README_RU.md) / [Tiếng Việt](README_VI.md)
|
[English](README.md) / 简体中文 / [繁體中文](README_TW.md) / [日本語](README_JP.md) / [Español](README_ES.md) / [Français](README_FR.md) / [한국어](README_KO.md) / [Русский](README_RU.md) / [Tiếng Việt](README_VI.md)
|
||||||
|
|
||||||
[](https://discord.gg/wdNEHETs87)
|
[](https://discord.gg/wdNEHETs87)
|
||||||
[](https://qm.qq.com/q/IrlV8QFacU)
|
[](https://qm.qq.com/q/DxZZcNxM1W)
|
||||||
[](https://deepwiki.com/langbot-app/LangBot)
|
[](https://deepwiki.com/langbot-app/LangBot)
|
||||||
[](https://github.com/langbot-app/LangBot/releases/latest)
|
[](https://github.com/langbot-app/LangBot/releases/latest)
|
||||||
<img src="https://img.shields.io/badge/python-3.10 ~ 3.13 -blue.svg" alt="python">
|
<img src="https://img.shields.io/badge/python-3.10 ~ 3.13 -blue.svg" alt="python">
|
||||||
@@ -25,7 +25,7 @@
|
|||||||
<a href="https://link.langbot.app/zh/docs/guide">文档</a> |
|
<a href="https://link.langbot.app/zh/docs/guide">文档</a> |
|
||||||
<a href="https://link.langbot.app/zh/docs/api">API</a> |
|
<a href="https://link.langbot.app/zh/docs/api">API</a> |
|
||||||
<a href="https://space.langbot.app/cloud">Cloud</a> |
|
<a href="https://space.langbot.app/cloud">Cloud</a> |
|
||||||
<a href="https://space.langbot.app">扩展市场</a> |
|
<a href="https://space.langbot.app">插件市场</a> |
|
||||||
<a href="https://langbot.featurebase.app/roadmap">路线图</a>
|
<a href="https://langbot.featurebase.app/roadmap">路线图</a>
|
||||||
|
|
||||||
</div>
|
</div>
|
||||||
@@ -38,7 +38,7 @@ LangBot 是一个**开源的生产级平台**,用于构建 AI 驱动的即时
|
|||||||
|
|
||||||
### 核心能力
|
### 核心能力
|
||||||
|
|
||||||
- **AI 对话与 Agent** — 多轮对话、工具调用、多模态、流式输出。自带 RAG(知识库),深度集成 [Dify](https://dify.ai)、[Coze](https://coze.com)、[n8n](https://n8n.io)、[Langflow](https://langflow.org)、[Deerflow](https://deerflow.tech)、[Weknora](https://weknora.weixin.qq.com)等 LLMOps 平台。
|
- **AI 对话与 Agent** — 多轮对话、工具调用、多模态、流式输出。自带 RAG(知识库),深度集成 [Dify](https://dify.ai)、[Coze](https://coze.com)、[n8n](https://n8n.io)、[Langflow](https://langflow.org) 等 LLMOps 平台。
|
||||||
- **全平台支持** — 一套代码,覆盖 QQ、微信、企业微信、飞书、钉钉、Discord、Telegram、Slack、LINE、KOOK 等平台。
|
- **全平台支持** — 一套代码,覆盖 QQ、微信、企业微信、飞书、钉钉、Discord、Telegram、Slack、LINE、KOOK 等平台。
|
||||||
- **生产就绪** — 访问控制、限速、敏感词过滤、全面监控与异常处理,已被多家企业采用。
|
- **生产就绪** — 访问控制、限速、敏感词过滤、全面监控与异常处理,已被多家企业采用。
|
||||||
- **插件生态** — 数百个插件,跨进程的事件驱动架构,组件扩展,适配 [MCP 协议](https://modelcontextprotocol.io/)。
|
- **插件生态** — 数百个插件,跨进程的事件驱动架构,组件扩展,适配 [MCP 协议](https://modelcontextprotocol.io/)。
|
||||||
@@ -47,8 +47,6 @@ LangBot 是一个**开源的生产级平台**,用于构建 AI 驱动的即时
|
|||||||
|
|
||||||
[→ 了解更多功能特性](https://link.langbot.app/zh/docs/features)
|
[→ 了解更多功能特性](https://link.langbot.app/zh/docs/features)
|
||||||
|
|
||||||
📍 实践指南:[5 分钟部署多平台 AI 机器人](https://blog.langbot.app/zh/blog/deploy-ai-bot-in-5-minutes/)、[将 DeepSeek 接入微信、企业微信与 Discord](https://blog.langbot.app/zh/blog/connect-deepseek-to-wechat/)、[让 Dify Agent 跑在 Discord、Telegram 和 Slack 上](https://blog.langbot.app/zh/blog/dify-agent-discord-telegram-slack/),以及[用 n8n 构建多平台 AI 聊天机器人](https://blog.langbot.app/zh/blog/n8n-multi-platform-ai-chatbot/)。
|
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
## 快速开始
|
## 快速开始
|
||||||
@@ -78,7 +76,7 @@ docker compose up -d
|
|||||||
[](https://zeabur.com/zh-CN/templates/ZKTBDH)
|
[](https://zeabur.com/zh-CN/templates/ZKTBDH)
|
||||||
[](https://railway.app/template/yRrAyL?referralCode=vogKPF)
|
[](https://railway.app/template/yRrAyL?referralCode=vogKPF)
|
||||||
|
|
||||||
**更多方式:** [Docker](https://link.langbot.app/zh/docs/docker) · [手动部署](https://link.langbot.app/zh/docs/manual-deploy) · [宝塔面板](https://link.langbot.app/zh/docs/bt-panel) · [Kubernetes](https://docs.langbot.app/zh/deploy/langbot/kubernetes)
|
**更多方式:** [Docker](https://link.langbot.app/zh/docs/docker) · [手动部署](https://link.langbot.app/zh/docs/manual-deploy) · [宝塔面板](https://link.langbot.app/zh/docs/bt-panel) · [Kubernetes](./docker/README_K8S.md)
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
@@ -89,16 +87,13 @@ docker compose up -d
|
|||||||
| QQ | ✅ | 个人号、官方机器人(频道、私聊、群聊) |
|
| QQ | ✅ | 个人号、官方机器人(频道、私聊、群聊) |
|
||||||
| 微信 | ✅ | 个人微信、微信公众号 |
|
| 微信 | ✅ | 个人微信、微信公众号 |
|
||||||
| 企业微信 | ✅ | 应用消息、对外客服、智能机器人 |
|
| 企业微信 | ✅ | 应用消息、对外客服、智能机器人 |
|
||||||
| 飞书 | ✅ | 官方 |
|
| 飞书 | ✅ | |
|
||||||
| 钉钉 | ✅ | 官方 |
|
| 钉钉 | ✅ | |
|
||||||
| Satori | ✅ | |
|
| Discord | ✅ | |
|
||||||
| Discord | ✅ | 官方 |
|
| Telegram | ✅ | |
|
||||||
| Telegram | ✅ | 官方 |
|
| Slack | ✅ | |
|
||||||
| Slack | ✅ | 官方 |
|
| LINE | ✅ | |
|
||||||
| LINE | ✅ | 官方 |
|
| KOOK | ✅ | |
|
||||||
| KOOK | ✅ | 官方 |
|
|
||||||
| Email | ✅ | 只 Matrix、Satori |
|
|
||||||
| Matrix | ✅ | 支持多种桥接平台,如 Signal、WhatsApp、Messenger、iMessage、Mattermost、Google Chat、IRC、XMPP、Zulip 等 |
|
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
@@ -129,7 +124,6 @@ docker compose up -d
|
|||||||
| [302.AI](https://share.302.ai/SuTG99) | 聚合平台 | ✅ |
|
| [302.AI](https://share.302.ai/SuTG99) | 聚合平台 | ✅ |
|
||||||
| [小马算力](https://www.tokenpony.cn/453z1) | 聚合平台 | ✅ |
|
| [小马算力](https://www.tokenpony.cn/453z1) | 聚合平台 | ✅ |
|
||||||
| [百宝箱Tbox](https://www.tbox.cn/open) | 智能体平台 | ✅ |
|
| [百宝箱Tbox](https://www.tbox.cn/open) | 智能体平台 | ✅ |
|
||||||
| [七牛云Qiniu](https://www.qiniu.com/ai/agent) | 聚合平台 | ✅ |
|
|
||||||
|
|
||||||
[→ 查看完整集成列表](https://link.langbot.app/zh/docs/features)
|
[→ 查看完整集成列表](https://link.langbot.app/zh/docs/features)
|
||||||
|
|
||||||
|
|||||||
25
README_ES.md
25
README_ES.md
@@ -37,7 +37,7 @@ LangBot es una **plataforma de código abierto y grado de producción** para con
|
|||||||
|
|
||||||
### Capacidades Clave
|
### Capacidades Clave
|
||||||
|
|
||||||
- **Conversaciones e Agentes IA** — Diálogos de múltiples turnos, llamadas a herramientas, soporte multimodal, salida en streaming. RAG (base de conocimientos) incorporado con integración profunda con [Dify](https://dify.ai), [Coze](https://coze.com), [n8n](https://n8n.io), [Langflow](https://langflow.org), [Deerflow](https://deerflow.tech)、[Weknora](https://weknora.weixin.qq.com).
|
- **Conversaciones e Agentes IA** — Diálogos de múltiples turnos, llamadas a herramientas, soporte multimodal, salida en streaming. RAG (base de conocimientos) incorporado con integración profunda con [Dify](https://dify.ai), [Coze](https://coze.com), [n8n](https://n8n.io), [Langflow](https://langflow.org).
|
||||||
- **Soporte Universal de Plataformas de MI** — Un solo código base para Discord, Telegram, Slack, LINE, QQ, WeChat, WeCom, Lark, DingTalk, KOOK.
|
- **Soporte Universal de Plataformas de MI** — Un solo código base para Discord, Telegram, Slack, LINE, QQ, WeChat, WeCom, Lark, DingTalk, KOOK.
|
||||||
- **Listo para Producción** — Control de acceso, limitación de velocidad, filtrado de palabras sensibles, monitoreo completo y manejo de excepciones. De confianza para empresas.
|
- **Listo para Producción** — Control de acceso, limitación de velocidad, filtrado de palabras sensibles, monitoreo completo y manejo de excepciones. De confianza para empresas.
|
||||||
- **Ecosistema de Plugins** — Cientos de plugins, arquitectura basada en eventos, extensiones de componentes y soporte del [protocolo MCP](https://modelcontextprotocol.io/).
|
- **Ecosistema de Plugins** — Cientos de plugins, arquitectura basada en eventos, extensiones de componentes y soporte del [protocolo MCP](https://modelcontextprotocol.io/).
|
||||||
@@ -46,8 +46,6 @@ LangBot es una **plataforma de código abierto y grado de producción** para con
|
|||||||
|
|
||||||
[→ Conocer más sobre todas las funcionalidades](https://link.langbot.app/en/docs/features)
|
[→ Conocer más sobre todas las funcionalidades](https://link.langbot.app/en/docs/features)
|
||||||
|
|
||||||
📍 Guías prácticas: [desplegar un bot de IA multiplataforma en 5 minutos](https://blog.langbot.app/en/blog/deploy-ai-bot-in-5-minutes/), [conectar DeepSeek a WeChat, Discord y Telegram](https://blog.langbot.app/en/blog/connect-deepseek-to-wechat/), [ejecutar un Dify Agent en Discord, Telegram y Slack](https://blog.langbot.app/en/blog/dify-agent-discord-telegram-slack/) y [crear un chatbot con n8n](https://blog.langbot.app/en/blog/n8n-multi-platform-ai-chatbot/).
|
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
## Inicio Rápido
|
## Inicio Rápido
|
||||||
@@ -77,7 +75,7 @@ docker compose up -d
|
|||||||
[](https://zeabur.com/en-US/templates/ZKTBDH)
|
[](https://zeabur.com/en-US/templates/ZKTBDH)
|
||||||
[](https://railway.app/template/yRrAyL?referralCode=vogKPF)
|
[](https://railway.app/template/yRrAyL?referralCode=vogKPF)
|
||||||
|
|
||||||
**Más opciones:** [Docker](https://link.langbot.app/en/docs/docker) · [Manual](https://link.langbot.app/en/docs/manual-deploy) · [BTPanel](https://link.langbot.app/en/docs/bt-panel) · [Kubernetes](https://docs.langbot.app/en/deploy/langbot/kubernetes)
|
**Más opciones:** [Docker](https://link.langbot.app/en/docs/docker) · [Manual](https://link.langbot.app/en/docs/manual-deploy) · [BTPanel](https://link.langbot.app/en/docs/bt-panel) · [Kubernetes](./docker/README_K8S.md)
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
@@ -85,19 +83,17 @@ docker compose up -d
|
|||||||
|
|
||||||
| Plataforma | Estado | Notas |
|
| Plataforma | Estado | Notas |
|
||||||
|----------|--------|-------|
|
|----------|--------|-------|
|
||||||
| Discord | ✅ | Oficial |
|
| Discord | ✅ | |
|
||||||
| Telegram | ✅ | Oficial |
|
| Telegram | ✅ | |
|
||||||
| Slack | ✅ | Oficial |
|
| Slack | ✅ | |
|
||||||
| LINE | ✅ | Oficial |
|
| LINE | ✅ | |
|
||||||
| QQ | ✅ | Personal y API Oficial (Canal, DM, Grupo) |
|
| QQ | ✅ | Personal y API Oficial |
|
||||||
| WeCom | ✅ | WeChat Empresarial, CS Externo, AI Bot |
|
| WeCom | ✅ | WeChat Empresarial, CS Externo, AI Bot |
|
||||||
| WeChat | ✅ | Personal y Cuenta Oficial |
|
| WeChat | ✅ | Personal y Cuenta Oficial |
|
||||||
| Lark | ✅ | Oficial |
|
| Lark | ✅ | |
|
||||||
| DingTalk | ✅ | Oficial |
|
| DingTalk | ✅ | |
|
||||||
| KOOK | ✅ | Oficial |
|
| KOOK | ✅ | |
|
||||||
| Satori | ✅ | |
|
| Satori | ✅ | |
|
||||||
| Email | ✅ | Matrix, Satori |
|
|
||||||
| Matrix | ✅ | Admite varias plataformas puenteadas como Signal, WhatsApp, Messenger, iMessage, Mattermost, Google Chat, IRC, XMPP, Zulip y más |
|
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
@@ -126,7 +122,6 @@ docker compose up -d
|
|||||||
| [ShengSuanYun](https://www.shengsuanyun.com/?from=CH_KYIPP758) | Plataforma GPU | ✅ |
|
| [ShengSuanYun](https://www.shengsuanyun.com/?from=CH_KYIPP758) | Plataforma GPU | ✅ |
|
||||||
| [接口 AI](https://jiekou.ai/) | Pasarela | ✅ |
|
| [接口 AI](https://jiekou.ai/) | Pasarela | ✅ |
|
||||||
| [302.AI](https://share.302.ai/SuTG99) | Pasarela | ✅ |
|
| [302.AI](https://share.302.ai/SuTG99) | Pasarela | ✅ |
|
||||||
| [Qiniu](https://www.qiniu.com/ai/agent) | Pasarela | ✅ |
|
|
||||||
|
|
||||||
[→ Ver todas las integraciones](https://link.langbot.app/en/docs/features)
|
[→ Ver todas las integraciones](https://link.langbot.app/en/docs/features)
|
||||||
|
|
||||||
|
|||||||
25
README_FR.md
25
README_FR.md
@@ -37,7 +37,7 @@ LangBot est une **plateforme open-source de niveau production** pour créer des
|
|||||||
|
|
||||||
### Capacités Clés
|
### Capacités Clés
|
||||||
|
|
||||||
- **Conversations IA & Agents** — Dialogues multi-tours, appels d'outils, support multimodal, sortie en streaming. RAG (base de connaissances) intégré avec intégration profonde de [Dify](https://dify.ai), [Coze](https://coze.com), [n8n](https://n8n.io), [Langflow](https://langflow.org), [Deerflow](https://deerflow.tech), [Weknora](https://weknora.weixin.qq.com).
|
- **Conversations IA & Agents** — Dialogues multi-tours, appels d'outils, support multimodal, sortie en streaming. RAG (base de connaissances) intégré avec intégration profonde de [Dify](https://dify.ai), [Coze](https://coze.com), [n8n](https://n8n.io), [Langflow](https://langflow.org).
|
||||||
- **Support Universel des Plateformes de MI** — Un seul code pour Discord, Telegram, Slack, LINE, QQ, WeChat, WeCom, Lark, DingTalk, KOOK.
|
- **Support Universel des Plateformes de MI** — Un seul code pour Discord, Telegram, Slack, LINE, QQ, WeChat, WeCom, Lark, DingTalk, KOOK.
|
||||||
- **Prêt pour la Production** — Contrôle d'accès, limitation de débit, filtrage de mots sensibles, surveillance complète et gestion des exceptions. Approuvé par les entreprises.
|
- **Prêt pour la Production** — Contrôle d'accès, limitation de débit, filtrage de mots sensibles, surveillance complète et gestion des exceptions. Approuvé par les entreprises.
|
||||||
- **Écosystème de Plugins** — Des centaines de plugins, architecture événementielle, extensions de composants, et support du [protocole MCP](https://modelcontextprotocol.io/).
|
- **Écosystème de Plugins** — Des centaines de plugins, architecture événementielle, extensions de composants, et support du [protocole MCP](https://modelcontextprotocol.io/).
|
||||||
@@ -46,8 +46,6 @@ LangBot est une **plateforme open-source de niveau production** pour créer des
|
|||||||
|
|
||||||
[→ En savoir plus sur toutes les fonctionnalités](https://link.langbot.app/en/docs/features)
|
[→ En savoir plus sur toutes les fonctionnalités](https://link.langbot.app/en/docs/features)
|
||||||
|
|
||||||
📍 Guides pratiques : [déployer un bot IA multiplateforme en 5 minutes](https://blog.langbot.app/en/blog/deploy-ai-bot-in-5-minutes/), [connecter DeepSeek à WeChat, Discord et Telegram](https://blog.langbot.app/en/blog/connect-deepseek-to-wechat/), [exécuter un Dify Agent dans Discord, Telegram et Slack](https://blog.langbot.app/en/blog/dify-agent-discord-telegram-slack/) et [créer un chatbot avec n8n](https://blog.langbot.app/en/blog/n8n-multi-platform-ai-chatbot/).
|
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
## Démarrage Rapide
|
## Démarrage Rapide
|
||||||
@@ -77,7 +75,7 @@ docker compose up -d
|
|||||||
[](https://zeabur.com/en-US/templates/ZKTBDH)
|
[](https://zeabur.com/en-US/templates/ZKTBDH)
|
||||||
[](https://railway.app/template/yRrAyL?referralCode=vogKPF)
|
[](https://railway.app/template/yRrAyL?referralCode=vogKPF)
|
||||||
|
|
||||||
**Plus d'options :** [Docker](https://link.langbot.app/en/docs/docker) · [Manuel](https://link.langbot.app/en/docs/manual-deploy) · [BTPanel](https://link.langbot.app/en/docs/bt-panel) · [Kubernetes](https://docs.langbot.app/en/deploy/langbot/kubernetes)
|
**Plus d'options :** [Docker](https://link.langbot.app/en/docs/docker) · [Manuel](https://link.langbot.app/en/docs/manual-deploy) · [BTPanel](https://link.langbot.app/en/docs/bt-panel) · [Kubernetes](./docker/README_K8S.md)
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
@@ -85,19 +83,17 @@ docker compose up -d
|
|||||||
|
|
||||||
| Plateforme | Statut | Notes |
|
| Plateforme | Statut | Notes |
|
||||||
|----------|--------|-------|
|
|----------|--------|-------|
|
||||||
| Discord | ✅ | Officiel |
|
| Discord | ✅ | |
|
||||||
| Telegram | ✅ | Officiel |
|
| Telegram | ✅ | |
|
||||||
| Slack | ✅ | Officiel |
|
| Slack | ✅ | |
|
||||||
| LINE | ✅ | Officiel |
|
| LINE | ✅ | |
|
||||||
| QQ | ✅ | Personnel & API Officielle (Canal, DM, Groupe) |
|
| QQ | ✅ | Personnel & API Officielle |
|
||||||
| WeCom | ✅ | WeChat Entreprise, CS Externe, AI Bot |
|
| WeCom | ✅ | WeChat Entreprise, CS Externe, AI Bot |
|
||||||
| WeChat | ✅ | Personnel & Compte Officiel |
|
| WeChat | ✅ | Personnel & Compte Officiel |
|
||||||
| Lark | ✅ | Officiel |
|
| Lark | ✅ | |
|
||||||
| DingTalk | ✅ | Officiel |
|
| DingTalk | ✅ | |
|
||||||
| KOOK | ✅ | Officiel |
|
| KOOK | ✅ | |
|
||||||
| Satori | ✅ | |
|
| Satori | ✅ | |
|
||||||
| Email | ✅ | Matrix, Satori |
|
|
||||||
| Matrix | ✅ | Prend en charge plusieurs plateformes via ponts, comme Signal, WhatsApp, Messenger, iMessage, Mattermost, Google Chat, IRC, XMPP, Zulip, etc. |
|
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
@@ -126,7 +122,6 @@ docker compose up -d
|
|||||||
| [CompShare](https://www.compshare.cn/?ytag=GPU_YY-gh_langbot) | Plateforme GPU | ✅ |
|
| [CompShare](https://www.compshare.cn/?ytag=GPU_YY-gh_langbot) | Plateforme GPU | ✅ |
|
||||||
| [PPIO](https://ppinfra.com/user/register?invited_by=QJKFYD&utm_source=github_langbot) | Plateforme GPU | ✅ |
|
| [PPIO](https://ppinfra.com/user/register?invited_by=QJKFYD&utm_source=github_langbot) | Plateforme GPU | ✅ |
|
||||||
| [ShengSuanYun](https://www.shengsuanyun.com/?from=CH_KYIPP758) | Plateforme GPU | ✅ |
|
| [ShengSuanYun](https://www.shengsuanyun.com/?from=CH_KYIPP758) | Plateforme GPU | ✅ |
|
||||||
| [Qiniu](https://www.qiniu.com/ai/agent) | Passerelle | ✅ |
|
|
||||||
|
|
||||||
[→ Voir toutes les intégrations](https://link.langbot.app/en/docs/features)
|
[→ Voir toutes les intégrations](https://link.langbot.app/en/docs/features)
|
||||||
|
|
||||||
|
|||||||
27
README_JP.md
27
README_JP.md
@@ -37,7 +37,7 @@ LangBot は、AI搭載のインスタントメッセージングボットを構
|
|||||||
|
|
||||||
### 主な機能
|
### 主な機能
|
||||||
|
|
||||||
- **AI対話とエージェント** — マルチターン対話、ツール呼び出し、マルチモーダル対応、ストリーミング出力。RAG(ナレッジベース)を内蔵し、[Dify](https://dify.ai)、[Coze](https://coze.com)、[n8n](https://n8n.io)、[Langflow](https://langflow.org)、[Deerflow](https://deerflow.tech)、[Weknora](https://weknora.weixin.qq.com) と深く統合。
|
- **AI対話とエージェント** — マルチターン対話、ツール呼び出し、マルチモーダル対応、ストリーミング出力。RAG(ナレッジベース)を内蔵し、[Dify](https://dify.ai)、[Coze](https://coze.com)、[n8n](https://n8n.io)、[Langflow](https://langflow.org) と深く統合。
|
||||||
- **ユニバーサルIMプラットフォーム対応** — 単一のコードベースで Discord、Telegram、Slack、LINE、QQ、WeChat、WeCom、Lark、DingTalk、KOOK に対応。
|
- **ユニバーサルIMプラットフォーム対応** — 単一のコードベースで Discord、Telegram、Slack、LINE、QQ、WeChat、WeCom、Lark、DingTalk、KOOK に対応。
|
||||||
- **本番環境対応** — アクセス制御、レート制限、センシティブワードフィルタリング、包括的な監視、例外処理を搭載。エンタープライズの信頼に応える品質。
|
- **本番環境対応** — アクセス制御、レート制限、センシティブワードフィルタリング、包括的な監視、例外処理を搭載。エンタープライズの信頼に応える品質。
|
||||||
- **プラグインエコシステム** — 数百のプラグイン、イベント駆動アーキテクチャ、コンポーネント拡張、[MCPプロトコル](https://modelcontextprotocol.io/)対応。
|
- **プラグインエコシステム** — 数百のプラグイン、イベント駆動アーキテクチャ、コンポーネント拡張、[MCPプロトコル](https://modelcontextprotocol.io/)対応。
|
||||||
@@ -46,8 +46,6 @@ LangBot は、AI搭載のインスタントメッセージングボットを構
|
|||||||
|
|
||||||
[→ すべての機能について詳しく見る](https://link.langbot.app/ja/docs/features)
|
[→ すべての機能について詳しく見る](https://link.langbot.app/ja/docs/features)
|
||||||
|
|
||||||
📍 実践ガイド: [5分でマルチプラットフォームAIボットをデプロイ](https://blog.langbot.app/en/blog/deploy-ai-bot-in-5-minutes/)、[DeepSeekをWeChat・Discord・Telegramに接続](https://blog.langbot.app/en/blog/connect-deepseek-to-wechat/)、[Dify AgentをDiscord・Telegram・Slackで動かす](https://blog.langbot.app/en/blog/dify-agent-discord-telegram-slack/)、[n8n連携チャットボットを構築](https://blog.langbot.app/en/blog/n8n-multi-platform-ai-chatbot/)。
|
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
## クイックスタート
|
## クイックスタート
|
||||||
@@ -77,7 +75,7 @@ docker compose up -d
|
|||||||
[](https://zeabur.com/en-US/templates/ZKTBDH)
|
[](https://zeabur.com/en-US/templates/ZKTBDH)
|
||||||
[](https://railway.app/template/yRrAyL?referralCode=vogKPF)
|
[](https://railway.app/template/yRrAyL?referralCode=vogKPF)
|
||||||
|
|
||||||
**その他:** [Docker](https://link.langbot.app/en/docs/docker) · [手動デプロイ](https://link.langbot.app/en/docs/manual-deploy) · [BTPanel](https://link.langbot.app/en/docs/bt-panel) · [Kubernetes](https://docs.langbot.app/en/deploy/langbot/kubernetes)
|
**その他:** [Docker](https://link.langbot.app/en/docs/docker) · [手動デプロイ](https://link.langbot.app/en/docs/manual-deploy) · [BTPanel](https://link.langbot.app/en/docs/bt-panel) · [Kubernetes](./docker/README_K8S.md)
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
@@ -85,19 +83,17 @@ docker compose up -d
|
|||||||
|
|
||||||
| プラットフォーム | ステータス | 備考 |
|
| プラットフォーム | ステータス | 備考 |
|
||||||
|----------|--------|-------|
|
|----------|--------|-------|
|
||||||
| Discord | ✅ | 公式 |
|
| Discord | ✅ | |
|
||||||
| Telegram | ✅ | 公式 |
|
| Telegram | ✅ | |
|
||||||
| Slack | ✅ | 公式 |
|
| Slack | ✅ | |
|
||||||
| LINE | ✅ | 公式 |
|
| LINE | ✅ | |
|
||||||
| QQ | ✅ | 個人・公式API(チャンネル・DM・グループ) |
|
| QQ | ✅ | 個人 & 公式API |
|
||||||
| WeCom | ✅ | 企業WeChat、外部CS、AIボット |
|
| WeCom | ✅ | 企業WeChat、外部CS、AIボット |
|
||||||
| WeChat | ✅ | 個人・公式アカウント |
|
| WeChat | ✅ | 個人 & 公式アカウント |
|
||||||
| Lark | ✅ | 公式 |
|
| Lark | ✅ | |
|
||||||
| DingTalk | ✅ | 公式 |
|
| DingTalk | ✅ | |
|
||||||
| KOOK | ✅ | 公式 |
|
| KOOK | ✅ | |
|
||||||
| Satori | ✅ | |
|
| Satori | ✅ | |
|
||||||
| Email | ✅ | Matrix、Satori |
|
|
||||||
| Matrix | ✅ | Signal、WhatsApp、Messenger、iMessage、Mattermost、Google Chat、IRC、XMPP、Zulip など複数のブリッジ先プラットフォームに対応 |
|
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
@@ -126,7 +122,6 @@ docker compose up -d
|
|||||||
| [ShengSuanYun](https://www.shengsuanyun.com/?from=CH_KYIPP758) | GPUプラットフォーム | ✅ |
|
| [ShengSuanYun](https://www.shengsuanyun.com/?from=CH_KYIPP758) | GPUプラットフォーム | ✅ |
|
||||||
| [接口 AI](https://jiekou.ai/) | ゲートウェイ | ✅ |
|
| [接口 AI](https://jiekou.ai/) | ゲートウェイ | ✅ |
|
||||||
| [302.AI](https://share.302.ai/SuTG99) | ゲートウェイ | ✅ |
|
| [302.AI](https://share.302.ai/SuTG99) | ゲートウェイ | ✅ |
|
||||||
| [Qiniu](https://www.qiniu.com/ai/agent) | ゲートウェイ | ✅ |
|
|
||||||
|
|
||||||
[→ すべての統合を表示](https://link.langbot.app/en/docs/features)
|
[→ すべての統合を表示](https://link.langbot.app/en/docs/features)
|
||||||
|
|
||||||
|
|||||||
25
README_KO.md
25
README_KO.md
@@ -37,7 +37,7 @@ LangBot은 AI 기반 인스턴트 메시징 봇을 구축하기 위한 **오픈
|
|||||||
|
|
||||||
### 핵심 기능
|
### 핵심 기능
|
||||||
|
|
||||||
- **AI 대화 및 에이전트** — 멀티턴 대화, 도구 호출, 멀티모달 지원, 스트리밍 출력. 내장 RAG(지식 베이스)와 [Dify](https://dify.ai), [Coze](https://coze.com), [n8n](https://n8n.io), [Langflow](https://langflow.org), [Deerflow](https://deerflow.tech), [Weknora](https://weknora.weixin.qq.com) 심층 통합.
|
- **AI 대화 및 에이전트** — 멀티턴 대화, 도구 호출, 멀티모달 지원, 스트리밍 출력. 내장 RAG(지식 베이스)와 [Dify](https://dify.ai), [Coze](https://coze.com), [n8n](https://n8n.io), [Langflow](https://langflow.org) 심층 통합.
|
||||||
- **유니버설 IM 플랫폼 지원** — 단일 코드베이스로 Discord, Telegram, Slack, LINE, QQ, WeChat, WeCom, Lark, DingTalk, KOOK 지원.
|
- **유니버설 IM 플랫폼 지원** — 단일 코드베이스로 Discord, Telegram, Slack, LINE, QQ, WeChat, WeCom, Lark, DingTalk, KOOK 지원.
|
||||||
- **프로덕션 레디** — 접근 제어, 속도 제한, 민감어 필터링, 종합 모니터링 및 예외 처리. 기업 환경에서 검증됨.
|
- **프로덕션 레디** — 접근 제어, 속도 제한, 민감어 필터링, 종합 모니터링 및 예외 처리. 기업 환경에서 검증됨.
|
||||||
- **플러그인 생태계** — 수백 개의 플러그인, 이벤트 기반 아키텍처, 컴포넌트 확장, [MCP 프로토콜](https://modelcontextprotocol.io/) 지원.
|
- **플러그인 생태계** — 수백 개의 플러그인, 이벤트 기반 아키텍처, 컴포넌트 확장, [MCP 프로토콜](https://modelcontextprotocol.io/) 지원.
|
||||||
@@ -46,8 +46,6 @@ LangBot은 AI 기반 인스턴트 메시징 봇을 구축하기 위한 **오픈
|
|||||||
|
|
||||||
[→ 모든 기능 자세히 보기](https://link.langbot.app/en/docs/features)
|
[→ 모든 기능 자세히 보기](https://link.langbot.app/en/docs/features)
|
||||||
|
|
||||||
📍 실전 가이드: [5분 만에 멀티 플랫폼 AI 봇 배포하기](https://blog.langbot.app/en/blog/deploy-ai-bot-in-5-minutes/), [DeepSeek를 WeChat, Discord, Telegram에 연결하기](https://blog.langbot.app/en/blog/connect-deepseek-to-wechat/), [Dify Agent를 Discord, Telegram, Slack에서 실행하기](https://blog.langbot.app/en/blog/dify-agent-discord-telegram-slack/), [n8n 기반 챗봇 만들기](https://blog.langbot.app/en/blog/n8n-multi-platform-ai-chatbot/).
|
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
## 빠른 시작
|
## 빠른 시작
|
||||||
@@ -77,7 +75,7 @@ docker compose up -d
|
|||||||
[](https://zeabur.com/en-US/templates/ZKTBDH)
|
[](https://zeabur.com/en-US/templates/ZKTBDH)
|
||||||
[](https://railway.app/template/yRrAyL?referralCode=vogKPF)
|
[](https://railway.app/template/yRrAyL?referralCode=vogKPF)
|
||||||
|
|
||||||
**더 많은 옵션:** [Docker](https://link.langbot.app/en/docs/docker) · [수동 배포](https://link.langbot.app/en/docs/manual-deploy) · [BTPanel](https://link.langbot.app/en/docs/bt-panel) · [Kubernetes](https://docs.langbot.app/en/deploy/langbot/kubernetes)
|
**더 많은 옵션:** [Docker](https://link.langbot.app/en/docs/docker) · [수동 배포](https://link.langbot.app/en/docs/manual-deploy) · [BTPanel](https://link.langbot.app/en/docs/bt-panel) · [Kubernetes](./docker/README_K8S.md)
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
@@ -85,19 +83,17 @@ docker compose up -d
|
|||||||
|
|
||||||
| 플랫폼 | 상태 | 비고 |
|
| 플랫폼 | 상태 | 비고 |
|
||||||
|--------|------|------|
|
|--------|------|------|
|
||||||
| Discord | ✅ | 공식 |
|
| Discord | ✅ | |
|
||||||
| Telegram | ✅ | 공식 |
|
| Telegram | ✅ | |
|
||||||
| Slack | ✅ | 공식 |
|
| Slack | ✅ | |
|
||||||
| LINE | ✅ | 공식 |
|
| LINE | ✅ | |
|
||||||
| QQ | ✅ | 개인 및 공식 API (채널, DM, 그룹) |
|
| QQ | ✅ | 개인 및 공식 API |
|
||||||
| WeCom | ✅ | 기업 WeChat, 외부 CS, AI Bot |
|
| WeCom | ✅ | 기업 WeChat, 외부 CS, AI Bot |
|
||||||
| WeChat | ✅ | 개인 및 공식 계정 |
|
| WeChat | ✅ | 개인 및 공식 계정 |
|
||||||
| Lark | ✅ | 공식 |
|
| Lark | ✅ | |
|
||||||
| DingTalk | ✅ | 공식 |
|
| DingTalk | ✅ | |
|
||||||
| KOOK | ✅ | 공식 |
|
| KOOK | ✅ | |
|
||||||
| Satori | ✅ | |
|
| Satori | ✅ | |
|
||||||
| Email | ✅ | Matrix, Satori |
|
|
||||||
| Matrix | ✅ | Signal, WhatsApp, Messenger, iMessage, Mattermost, Google Chat, IRC, XMPP, Zulip 등 여러 브리지 플랫폼 지원 |
|
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
@@ -126,7 +122,6 @@ docker compose up -d
|
|||||||
| [ShengSuanYun](https://www.shengsuanyun.com/?from=CH_KYIPP758) | GPU 플랫폼 | ✅ |
|
| [ShengSuanYun](https://www.shengsuanyun.com/?from=CH_KYIPP758) | GPU 플랫폼 | ✅ |
|
||||||
| [接口 AI](https://jiekou.ai/) | 게이트웨이 | ✅ |
|
| [接口 AI](https://jiekou.ai/) | 게이트웨이 | ✅ |
|
||||||
| [302.AI](https://share.302.ai/SuTG99) | 게이트웨이 | ✅ |
|
| [302.AI](https://share.302.ai/SuTG99) | 게이트웨이 | ✅ |
|
||||||
| [Qiniu](https://www.qiniu.com/ai/agent) | 게이트웨이 | ✅ |
|
|
||||||
|
|
||||||
[→ 모든 통합 보기](https://link.langbot.app/en/docs/features)
|
[→ 모든 통합 보기](https://link.langbot.app/en/docs/features)
|
||||||
|
|
||||||
|
|||||||
25
README_RU.md
25
README_RU.md
@@ -37,7 +37,7 @@ LangBot — это **платформа с открытым исходным к
|
|||||||
|
|
||||||
### Ключевые возможности
|
### Ключевые возможности
|
||||||
|
|
||||||
- **ИИ-диалоги и агенты** — Многораундовые диалоги, вызов инструментов, мультимодальная поддержка, потоковый вывод. Встроенная реализация RAG (база знаний) с глубокой интеграцией в [Dify](https://dify.ai), [Coze](https://coze.com), [n8n](https://n8n.io), [Langflow](https://langflow.org), [Deerflow](https://deerflow.tech), [Weknora](https://weknora.weixin.qq.com).
|
- **ИИ-диалоги и агенты** — Многораундовые диалоги, вызов инструментов, мультимодальная поддержка, потоковый вывод. Встроенная реализация RAG (база знаний) с глубокой интеграцией в [Dify](https://dify.ai), [Coze](https://coze.com), [n8n](https://n8n.io), [Langflow](https://langflow.org).
|
||||||
- **Универсальная поддержка IM-платформ** — Единая кодовая база для Discord, Telegram, Slack, LINE, QQ, WeChat, WeCom, Lark, DingTalk, KOOK.
|
- **Универсальная поддержка IM-платформ** — Единая кодовая база для Discord, Telegram, Slack, LINE, QQ, WeChat, WeCom, Lark, DingTalk, KOOK.
|
||||||
- **Готовность к продакшену** — Контроль доступа, ограничение скорости, фильтрация чувствительных слов, комплексный мониторинг и обработка исключений. Проверено в корпоративной среде.
|
- **Готовность к продакшену** — Контроль доступа, ограничение скорости, фильтрация чувствительных слов, комплексный мониторинг и обработка исключений. Проверено в корпоративной среде.
|
||||||
- **Экосистема плагинов** — Сотни плагинов, событийно-ориентированная архитектура, расширения компонентов и поддержка [протокола MCP](https://modelcontextprotocol.io/).
|
- **Экосистема плагинов** — Сотни плагинов, событийно-ориентированная архитектура, расширения компонентов и поддержка [протокола MCP](https://modelcontextprotocol.io/).
|
||||||
@@ -46,8 +46,6 @@ LangBot — это **платформа с открытым исходным к
|
|||||||
|
|
||||||
[→ Подробнее обо всех возможностях](https://link.langbot.app/en/docs/features)
|
[→ Подробнее обо всех возможностях](https://link.langbot.app/en/docs/features)
|
||||||
|
|
||||||
📍 Практические руководства: [развернуть мультиплатформенного ИИ-бота за 5 минут](https://blog.langbot.app/en/blog/deploy-ai-bot-in-5-minutes/), [подключить DeepSeek к WeChat, Discord и Telegram](https://blog.langbot.app/en/blog/connect-deepseek-to-wechat/), [запустить Dify Agent в Discord, Telegram и Slack](https://blog.langbot.app/en/blog/dify-agent-discord-telegram-slack/) и [создать чат-бота на n8n](https://blog.langbot.app/en/blog/n8n-multi-platform-ai-chatbot/).
|
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
## Быстрый старт
|
## Быстрый старт
|
||||||
@@ -77,7 +75,7 @@ docker compose up -d
|
|||||||
[](https://zeabur.com/en-US/templates/ZKTBDH)
|
[](https://zeabur.com/en-US/templates/ZKTBDH)
|
||||||
[](https://railway.app/template/yRrAyL?referralCode=vogKPF)
|
[](https://railway.app/template/yRrAyL?referralCode=vogKPF)
|
||||||
|
|
||||||
**Другие варианты:** [Docker](https://link.langbot.app/en/docs/docker) · [Ручная установка](https://link.langbot.app/en/docs/manual-deploy) · [BTPanel](https://link.langbot.app/en/docs/bt-panel) · [Kubernetes](https://docs.langbot.app/en/deploy/langbot/kubernetes)
|
**Другие варианты:** [Docker](https://link.langbot.app/en/docs/docker) · [Ручная установка](https://link.langbot.app/en/docs/manual-deploy) · [BTPanel](https://link.langbot.app/en/docs/bt-panel) · [Kubernetes](./docker/README_K8S.md)
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
@@ -85,19 +83,17 @@ docker compose up -d
|
|||||||
|
|
||||||
| Платформа | Статус | Примечания |
|
| Платформа | Статус | Примечания |
|
||||||
|-----------|--------|------------|
|
|-----------|--------|------------|
|
||||||
| Discord | ✅ | Официальный |
|
| Discord | ✅ | |
|
||||||
| Telegram | ✅ | Официальный |
|
| Telegram | ✅ | |
|
||||||
| Slack | ✅ | Официальный |
|
| Slack | ✅ | |
|
||||||
| LINE | ✅ | Официальный |
|
| LINE | ✅ | |
|
||||||
| QQ | ✅ | Личный и официальный API (Канал, ЛС, Группа) |
|
| QQ | ✅ | Личный и официальный API |
|
||||||
| WeCom | ✅ | Корпоративный WeChat, внешний CS, AI-бот |
|
| WeCom | ✅ | Корпоративный WeChat, внешний CS, AI-бот |
|
||||||
| WeChat | ✅ | Личный и официальный аккаунт |
|
| WeChat | ✅ | Личный и официальный аккаунт |
|
||||||
| Lark | ✅ | Официальный |
|
| Lark | ✅ | |
|
||||||
| DingTalk | ✅ | Официальный |
|
| DingTalk | ✅ | |
|
||||||
| KOOK | ✅ | Официальный |
|
| KOOK | ✅ | |
|
||||||
| Satori | ✅ | |
|
| Satori | ✅ | |
|
||||||
| Email | ✅ | Matrix, Satori |
|
|
||||||
| Matrix | ✅ | Поддерживает несколько платформ через мосты, включая Signal, WhatsApp, Messenger, iMessage, Mattermost, Google Chat, IRC, XMPP, Zulip и другие |
|
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
@@ -126,7 +122,6 @@ docker compose up -d
|
|||||||
| [CompShare](https://www.compshare.cn/?ytag=GPU_YY-gh_langbot) | Платформа GPU | ✅ |
|
| [CompShare](https://www.compshare.cn/?ytag=GPU_YY-gh_langbot) | Платформа GPU | ✅ |
|
||||||
| [PPIO](https://ppinfra.com/user/register?invited_by=QJKFYD&utm_source=github_langbot) | Платформа GPU | ✅ |
|
| [PPIO](https://ppinfra.com/user/register?invited_by=QJKFYD&utm_source=github_langbot) | Платформа GPU | ✅ |
|
||||||
| [ShengSuanYun](https://www.shengsuanyun.com/?from=CH_KYIPP758) | Платформа GPU | ✅ |
|
| [ShengSuanYun](https://www.shengsuanyun.com/?from=CH_KYIPP758) | Платформа GPU | ✅ |
|
||||||
| [Qiniu](https://www.qiniu.com/ai/agent) | Шлюз | ✅ |
|
|
||||||
|
|
||||||
[→ Смотреть все интеграции](https://link.langbot.app/en/docs/features)
|
[→ Смотреть все интеграции](https://link.langbot.app/en/docs/features)
|
||||||
|
|
||||||
|
|||||||
25
README_TW.md
25
README_TW.md
@@ -39,7 +39,7 @@ LangBot 是一個**開源的生產級平台**,用於建構 AI 驅動的即時
|
|||||||
|
|
||||||
### 核心能力
|
### 核心能力
|
||||||
|
|
||||||
- **AI 對話與 Agent** — 多輪對話、工具調用、多模態、流式輸出。自帶 RAG(知識庫),深度整合 [Dify](https://dify.ai)、[Coze](https://coze.com)、[n8n](https://n8n.io)、[Langflow](https://langflow.org)、 [Deerflow](https://deerflow.tech)、[Weknora](https://weknora.weixin.qq.com)等 LLMOps 平台。
|
- **AI 對話與 Agent** — 多輪對話、工具調用、多模態、流式輸出。自帶 RAG(知識庫),深度整合 [Dify](https://dify.ai)、[Coze](https://coze.com)、[n8n](https://n8n.io)、[Langflow](https://langflow.org) 等 LLMOps 平台。
|
||||||
- **全平台支援** — 一套程式碼,覆蓋 QQ、微信、企業微信、飛書、釘釘、Discord、Telegram、Slack、LINE、KOOK 等平台。
|
- **全平台支援** — 一套程式碼,覆蓋 QQ、微信、企業微信、飛書、釘釘、Discord、Telegram、Slack、LINE、KOOK 等平台。
|
||||||
- **生產就緒** — 存取控制、限速、敏感詞過濾、全面監控與異常處理,已被多家企業採用。
|
- **生產就緒** — 存取控制、限速、敏感詞過濾、全面監控與異常處理,已被多家企業採用。
|
||||||
- **外掛生態** — 數百個外掛,事件驅動架構,組件擴展,適配 [MCP 協議](https://modelcontextprotocol.io/)。
|
- **外掛生態** — 數百個外掛,事件驅動架構,組件擴展,適配 [MCP 協議](https://modelcontextprotocol.io/)。
|
||||||
@@ -48,8 +48,6 @@ LangBot 是一個**開源的生產級平台**,用於建構 AI 驅動的即時
|
|||||||
|
|
||||||
[→ 了解更多功能特性](https://link.langbot.app/zh/docs/features)
|
[→ 了解更多功能特性](https://link.langbot.app/zh/docs/features)
|
||||||
|
|
||||||
📍 實踐指南:[5 分鐘部署多平台 AI 機器人](https://blog.langbot.app/zh/blog/deploy-ai-bot-in-5-minutes/)、[將 DeepSeek 接入微信、企業微信與 Discord](https://blog.langbot.app/zh/blog/connect-deepseek-to-wechat/)、[讓 Dify Agent 跑在 Discord、Telegram 和 Slack 上](https://blog.langbot.app/zh/blog/dify-agent-discord-telegram-slack/),以及[用 n8n 建構多平台 AI 聊天機器人](https://blog.langbot.app/zh/blog/n8n-multi-platform-ai-chatbot/)。
|
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
## 快速開始
|
## 快速開始
|
||||||
@@ -79,7 +77,7 @@ docker compose up -d
|
|||||||
[](https://zeabur.com/zh-CN/templates/ZKTBDH)
|
[](https://zeabur.com/zh-CN/templates/ZKTBDH)
|
||||||
[](https://railway.app/template/yRrAyL?referralCode=vogKPF)
|
[](https://railway.app/template/yRrAyL?referralCode=vogKPF)
|
||||||
|
|
||||||
**更多方式:** [Docker](https://link.langbot.app/zh/docs/docker) · [手動部署](https://link.langbot.app/zh/docs/manual-deploy) · [寶塔面板](https://link.langbot.app/zh/docs/bt-panel) · [Kubernetes](https://docs.langbot.app/zh/deploy/langbot/kubernetes)
|
**更多方式:** [Docker](https://link.langbot.app/zh/docs/docker) · [手動部署](https://link.langbot.app/zh/docs/manual-deploy) · [寶塔面板](https://link.langbot.app/zh/docs/bt-panel) · [Kubernetes](./docker/README_K8S.md)
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
@@ -87,19 +85,17 @@ docker compose up -d
|
|||||||
|
|
||||||
| 平台 | 狀態 | 備註 |
|
| 平台 | 狀態 | 備註 |
|
||||||
|------|------|------|
|
|------|------|------|
|
||||||
| Discord | ✅ | 官方 |
|
|
||||||
| Telegram | ✅ | 官方 |
|
|
||||||
| Slack | ✅ | 官方 |
|
|
||||||
| LINE | ✅ | 官方 |
|
|
||||||
| QQ | ✅ | 個人號、官方機器人(頻道、私聊、群聊) |
|
| QQ | ✅ | 個人號、官方機器人(頻道、私聊、群聊) |
|
||||||
| 企業微信 | ✅ | 應用訊息、對外客服、智能機器人 |
|
|
||||||
| 微信 | ✅ | 個人微信、微信公眾號 |
|
| 微信 | ✅ | 個人微信、微信公眾號 |
|
||||||
| 飛書 | ✅ | 官方 |
|
| 企業微信 | ✅ | 應用訊息、對外客服、智能機器人 |
|
||||||
| 釘釘 | ✅ | 官方 |
|
| 飛書 | ✅ | |
|
||||||
| KOOK | ✅ | 官方 |
|
| 釘釘 | ✅ | |
|
||||||
|
| Discord | ✅ | |
|
||||||
|
| Telegram | ✅ | |
|
||||||
|
| Slack | ✅ | |
|
||||||
|
| LINE | ✅ | |
|
||||||
|
| KOOK | ✅ | |
|
||||||
| Satori | ✅ | |
|
| Satori | ✅ | |
|
||||||
| Email | ✅ | 只 Matrix、Satori |
|
|
||||||
| Matrix | ✅ | 支援多種橋接平台,如 Signal、WhatsApp、Messenger、iMessage、Mattermost、Google Chat、IRC、XMPP、Zulip 等 |
|
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
@@ -128,7 +124,6 @@ docker compose up -d
|
|||||||
| [PPIO](https://ppinfra.com/user/register?invited_by=QJKFYD&utm_source=github_langbot) | GPU 平台 | ✅ |
|
| [PPIO](https://ppinfra.com/user/register?invited_by=QJKFYD&utm_source=github_langbot) | GPU 平台 | ✅ |
|
||||||
| [接口 AI](https://jiekou.ai/) | 聚合平台 | ✅ |
|
| [接口 AI](https://jiekou.ai/) | 聚合平台 | ✅ |
|
||||||
| [302.AI](https://share.302.ai/SuTG99) | 聚合平台 | ✅ |
|
| [302.AI](https://share.302.ai/SuTG99) | 聚合平台 | ✅ |
|
||||||
| [Qiniu](https://www.qiniu.com/ai/agent) | 聚合平台 | ✅ |
|
|
||||||
|
|
||||||
### TTS(語音合成)
|
### TTS(語音合成)
|
||||||
|
|
||||||
|
|||||||
25
README_VI.md
25
README_VI.md
@@ -37,7 +37,7 @@ LangBot là một **nền tảng mã nguồn mở, cấp sản xuất** để x
|
|||||||
|
|
||||||
### Khả năng chính
|
### Khả năng chính
|
||||||
|
|
||||||
- **Hội thoại AI & Agent** — Đối thoại nhiều lượt, gọi công cụ, hỗ trợ đa phương thức, đầu ra streaming. RAG (cơ sở kiến thức) tích hợp sẵn với tích hợp sâu vào [Dify](https://dify.ai), [Coze](https://coze.com), [n8n](https://n8n.io), [Langflow](https://langflow.org), [Deerflow](https://deerflow.tech), [Weknora](https://weknora.weixin.qq.com).
|
- **Hội thoại AI & Agent** — Đối thoại nhiều lượt, gọi công cụ, hỗ trợ đa phương thức, đầu ra streaming. RAG (cơ sở kiến thức) tích hợp sẵn với tích hợp sâu vào [Dify](https://dify.ai), [Coze](https://coze.com), [n8n](https://n8n.io), [Langflow](https://langflow.org).
|
||||||
- **Hỗ trợ đa nền tảng IM** — Một mã nguồn cho Discord, Telegram, Slack, LINE, QQ, WeChat, WeCom, Lark, DingTalk, KOOK.
|
- **Hỗ trợ đa nền tảng IM** — Một mã nguồn cho Discord, Telegram, Slack, LINE, QQ, WeChat, WeCom, Lark, DingTalk, KOOK.
|
||||||
- **Sẵn sàng cho sản xuất** — Kiểm soát truy cập, giới hạn tốc độ, lọc từ nhạy cảm, giám sát toàn diện và xử lý ngoại lệ. Được doanh nghiệp tin dùng.
|
- **Sẵn sàng cho sản xuất** — Kiểm soát truy cập, giới hạn tốc độ, lọc từ nhạy cảm, giám sát toàn diện và xử lý ngoại lệ. Được doanh nghiệp tin dùng.
|
||||||
- **Hệ sinh thái Plugin** — Hàng trăm plugin, kiến trúc hướng sự kiện, mở rộng thành phần, và hỗ trợ [giao thức MCP](https://modelcontextprotocol.io/).
|
- **Hệ sinh thái Plugin** — Hàng trăm plugin, kiến trúc hướng sự kiện, mở rộng thành phần, và hỗ trợ [giao thức MCP](https://modelcontextprotocol.io/).
|
||||||
@@ -46,8 +46,6 @@ LangBot là một **nền tảng mã nguồn mở, cấp sản xuất** để x
|
|||||||
|
|
||||||
[→ Tìm hiểu thêm về tất cả tính năng](https://link.langbot.app/en/docs/features)
|
[→ Tìm hiểu thêm về tất cả tính năng](https://link.langbot.app/en/docs/features)
|
||||||
|
|
||||||
📍 Hướng dẫn thực hành: [triển khai bot AI đa nền tảng trong 5 phút](https://blog.langbot.app/en/blog/deploy-ai-bot-in-5-minutes/), [kết nối DeepSeek với WeChat, Discord và Telegram](https://blog.langbot.app/en/blog/connect-deepseek-to-wechat/), [chạy Dify Agent trên Discord, Telegram và Slack](https://blog.langbot.app/en/blog/dify-agent-discord-telegram-slack/) và [xây dựng chatbot với n8n](https://blog.langbot.app/en/blog/n8n-multi-platform-ai-chatbot/).
|
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
## Bắt đầu nhanh
|
## Bắt đầu nhanh
|
||||||
@@ -77,7 +75,7 @@ docker compose up -d
|
|||||||
[](https://zeabur.com/en-US/templates/ZKTBDH)
|
[](https://zeabur.com/en-US/templates/ZKTBDH)
|
||||||
[](https://railway.app/template/yRrAyL?referralCode=vogKPF)
|
[](https://railway.app/template/yRrAyL?referralCode=vogKPF)
|
||||||
|
|
||||||
**Thêm tùy chọn:** [Docker](https://link.langbot.app/en/docs/docker) · [Thủ công](https://link.langbot.app/en/docs/manual-deploy) · [BTPanel](https://link.langbot.app/en/docs/bt-panel) · [Kubernetes](https://docs.langbot.app/en/deploy/langbot/kubernetes)
|
**Thêm tùy chọn:** [Docker](https://link.langbot.app/en/docs/docker) · [Thủ công](https://link.langbot.app/en/docs/manual-deploy) · [BTPanel](https://link.langbot.app/en/docs/bt-panel) · [Kubernetes](./docker/README_K8S.md)
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
@@ -85,19 +83,17 @@ docker compose up -d
|
|||||||
|
|
||||||
| Nền tảng | Trạng thái | Ghi chú |
|
| Nền tảng | Trạng thái | Ghi chú |
|
||||||
|----------|--------|-------|
|
|----------|--------|-------|
|
||||||
| Discord | ✅ | Chính thức |
|
| Discord | ✅ | |
|
||||||
| Telegram | ✅ | Chính thức |
|
| Telegram | ✅ | |
|
||||||
| Slack | ✅ | Chính thức |
|
| Slack | ✅ | |
|
||||||
| LINE | ✅ | Chính thức |
|
| LINE | ✅ | |
|
||||||
| QQ | ✅ | Cá nhân & API chính thức (Kênh, DM, Nhóm) |
|
| QQ | ✅ | Cá nhân & API chính thức |
|
||||||
| WeCom | ✅ | WeChat doanh nghiệp, CS bên ngoài, AI Bot |
|
| WeCom | ✅ | WeChat doanh nghiệp, CS bên ngoài, AI Bot |
|
||||||
| WeChat | ✅ | Cá nhân & Tài khoản công khai |
|
| WeChat | ✅ | Cá nhân & Tài khoản công khai |
|
||||||
| Lark | ✅ | Chính thức |
|
| Lark | ✅ | |
|
||||||
| DingTalk | ✅ | Chính thức |
|
| DingTalk | ✅ | |
|
||||||
| KOOK | ✅ | Chính thức |
|
| KOOK | ✅ | |
|
||||||
| Satori | ✅ | |
|
| Satori | ✅ | |
|
||||||
| Email | ✅ | Matrix, Satori |
|
|
||||||
| Matrix | ✅ | Hỗ trợ nhiều nền tảng qua bridge như Signal, WhatsApp, Messenger, iMessage, Mattermost, Google Chat, IRC, XMPP, Zulip và hơn thế nữa |
|
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|
||||||
@@ -126,7 +122,6 @@ docker compose up -d
|
|||||||
| [ShengSuanYun](https://www.shengsuanyun.com/?from=CH_KYIPP758) | Nền tảng GPU | ✅ |
|
| [ShengSuanYun](https://www.shengsuanyun.com/?from=CH_KYIPP758) | Nền tảng GPU | ✅ |
|
||||||
| [接口 AI](https://jiekou.ai/) | Cổng | ✅ |
|
| [接口 AI](https://jiekou.ai/) | Cổng | ✅ |
|
||||||
| [302.AI](https://share.302.ai/SuTG99) | Cổng | ✅ |
|
| [302.AI](https://share.302.ai/SuTG99) | Cổng | ✅ |
|
||||||
| [Qiniu](https://www.qiniu.com/ai/agent) | Cổng | ✅ |
|
|
||||||
|
|
||||||
[→ Xem tất cả tích hợp](https://link.langbot.app/en/docs/features)
|
[→ Xem tất cả tích hợp](https://link.langbot.app/en/docs/features)
|
||||||
|
|
||||||
|
|||||||
629
docker/README_K8S.md
Normal file
629
docker/README_K8S.md
Normal file
@@ -0,0 +1,629 @@
|
|||||||
|
# LangBot Kubernetes 部署指南 / Kubernetes Deployment Guide
|
||||||
|
|
||||||
|
[简体中文](#简体中文) | [English](#english)
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## 简体中文
|
||||||
|
|
||||||
|
### 概述
|
||||||
|
|
||||||
|
本指南提供了在 Kubernetes 集群中部署 LangBot 的完整步骤。Kubernetes 部署配置基于 `docker-compose.yaml`,适用于生产环境的容器化部署。
|
||||||
|
|
||||||
|
### 前置要求
|
||||||
|
|
||||||
|
- Kubernetes 集群(版本 1.19+)
|
||||||
|
- `kubectl` 命令行工具已配置并可访问集群
|
||||||
|
- 集群中有可用的存储类(StorageClass)用于持久化存储(可选但推荐)
|
||||||
|
- 至少 2 vCPU 和 4GB RAM 的可用资源
|
||||||
|
|
||||||
|
### 架构说明
|
||||||
|
|
||||||
|
Kubernetes 部署包含以下组件:
|
||||||
|
|
||||||
|
1. **langbot**: 主应用服务
|
||||||
|
- 提供 Web UI(端口 5300)
|
||||||
|
- 处理平台 webhook(端口 2280-2290)
|
||||||
|
- 数据持久化卷
|
||||||
|
|
||||||
|
2. **langbot-plugin-runtime**: 插件运行时服务
|
||||||
|
- WebSocket 通信(端口 5400)
|
||||||
|
- 插件数据持久化卷
|
||||||
|
|
||||||
|
3. **持久化存储**:
|
||||||
|
- `langbot-data`: LangBot 主数据
|
||||||
|
- `langbot-plugins`: 插件文件
|
||||||
|
- `langbot-plugin-runtime-data`: 插件运行时数据
|
||||||
|
|
||||||
|
### 快速开始
|
||||||
|
|
||||||
|
#### 1. 下载部署文件
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# 克隆仓库
|
||||||
|
git clone https://github.com/langbot-app/LangBot
|
||||||
|
cd LangBot/docker
|
||||||
|
|
||||||
|
# 或直接下载 kubernetes.yaml
|
||||||
|
wget https://raw.githubusercontent.com/langbot-app/LangBot/main/docker/kubernetes.yaml
|
||||||
|
```
|
||||||
|
|
||||||
|
#### 2. 部署到 Kubernetes
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# 应用所有配置
|
||||||
|
kubectl apply -f kubernetes.yaml
|
||||||
|
|
||||||
|
# 检查部署状态
|
||||||
|
kubectl get all -n langbot
|
||||||
|
|
||||||
|
# 查看 Pod 日志
|
||||||
|
kubectl logs -n langbot -l app=langbot -f
|
||||||
|
```
|
||||||
|
|
||||||
|
#### 3. 访问 LangBot
|
||||||
|
|
||||||
|
默认情况下,LangBot 服务使用 ClusterIP 类型,只能在集群内部访问。您可以选择以下方式之一来访问:
|
||||||
|
|
||||||
|
**选项 A: 端口转发(推荐用于测试)**
|
||||||
|
|
||||||
|
```bash
|
||||||
|
kubectl port-forward -n langbot svc/langbot 5300:5300
|
||||||
|
```
|
||||||
|
|
||||||
|
然后访问 http://localhost:5300
|
||||||
|
|
||||||
|
**选项 B: NodePort(适用于开发环境)**
|
||||||
|
|
||||||
|
编辑 `kubernetes.yaml`,取消注释 NodePort Service 部分,然后:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
kubectl apply -f kubernetes.yaml
|
||||||
|
# 获取节点 IP
|
||||||
|
kubectl get nodes -o wide
|
||||||
|
# 访问 http://<NODE_IP>:30300
|
||||||
|
```
|
||||||
|
|
||||||
|
**选项 C: LoadBalancer(适用于云环境)**
|
||||||
|
|
||||||
|
编辑 `kubernetes.yaml`,取消注释 LoadBalancer Service 部分,然后:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
kubectl apply -f kubernetes.yaml
|
||||||
|
# 获取外部 IP
|
||||||
|
kubectl get svc -n langbot langbot-loadbalancer
|
||||||
|
# 访问 http://<EXTERNAL_IP>
|
||||||
|
```
|
||||||
|
|
||||||
|
**选项 D: Ingress(推荐用于生产环境)**
|
||||||
|
|
||||||
|
确保集群中已安装 Ingress Controller(如 nginx-ingress),然后:
|
||||||
|
|
||||||
|
1. 编辑 `kubernetes.yaml` 中的 Ingress 配置
|
||||||
|
2. 修改域名为您的实际域名
|
||||||
|
3. 应用配置:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
kubectl apply -f kubernetes.yaml
|
||||||
|
# 访问 http://langbot.yourdomain.com
|
||||||
|
```
|
||||||
|
|
||||||
|
### 配置说明
|
||||||
|
|
||||||
|
#### 环境变量
|
||||||
|
|
||||||
|
在 `ConfigMap` 中配置环境变量:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
apiVersion: v1
|
||||||
|
kind: ConfigMap
|
||||||
|
metadata:
|
||||||
|
name: langbot-config
|
||||||
|
namespace: langbot
|
||||||
|
data:
|
||||||
|
TZ: "Asia/Shanghai" # 修改为您的时区
|
||||||
|
```
|
||||||
|
|
||||||
|
#### 存储配置
|
||||||
|
|
||||||
|
默认使用动态存储分配。如果您有特定的 StorageClass,请在 PVC 中指定:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
spec:
|
||||||
|
storageClassName: your-storage-class-name
|
||||||
|
accessModes:
|
||||||
|
- ReadWriteOnce
|
||||||
|
resources:
|
||||||
|
requests:
|
||||||
|
storage: 10Gi
|
||||||
|
```
|
||||||
|
|
||||||
|
#### 资源限制
|
||||||
|
|
||||||
|
根据您的需求调整资源限制:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
resources:
|
||||||
|
requests:
|
||||||
|
memory: "1Gi"
|
||||||
|
cpu: "500m"
|
||||||
|
limits:
|
||||||
|
memory: "4Gi"
|
||||||
|
cpu: "2000m"
|
||||||
|
```
|
||||||
|
|
||||||
|
### 常用操作
|
||||||
|
|
||||||
|
#### 查看日志
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# 查看 LangBot 主服务日志
|
||||||
|
kubectl logs -n langbot -l app=langbot -f
|
||||||
|
|
||||||
|
# 查看插件运行时日志
|
||||||
|
kubectl logs -n langbot -l app=langbot-plugin-runtime -f
|
||||||
|
```
|
||||||
|
|
||||||
|
#### 重启服务
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# 重启 LangBot
|
||||||
|
kubectl rollout restart deployment/langbot -n langbot
|
||||||
|
|
||||||
|
# 重启插件运行时
|
||||||
|
kubectl rollout restart deployment/langbot-plugin-runtime -n langbot
|
||||||
|
```
|
||||||
|
|
||||||
|
#### 更新镜像
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# 更新到最新版本
|
||||||
|
kubectl set image deployment/langbot -n langbot langbot=rockchin/langbot:latest
|
||||||
|
kubectl set image deployment/langbot-plugin-runtime -n langbot langbot-plugin-runtime=rockchin/langbot:latest
|
||||||
|
|
||||||
|
# 检查更新状态
|
||||||
|
kubectl rollout status deployment/langbot -n langbot
|
||||||
|
```
|
||||||
|
|
||||||
|
#### 扩容(不推荐)
|
||||||
|
|
||||||
|
注意:由于 LangBot 使用 ReadWriteOnce 的持久化存储,不支持多副本扩容。如需高可用,请考虑使用 ReadWriteMany 存储或其他架构方案。
|
||||||
|
|
||||||
|
#### 备份数据
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# 备份 PVC 数据
|
||||||
|
kubectl exec -n langbot -it <langbot-pod-name> -- tar czf /tmp/backup.tar.gz /app/data
|
||||||
|
kubectl cp langbot/<langbot-pod-name>:/tmp/backup.tar.gz ./backup.tar.gz
|
||||||
|
```
|
||||||
|
|
||||||
|
### 卸载
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# 删除所有资源(保留 PVC)
|
||||||
|
kubectl delete deployment,service,configmap -n langbot --all
|
||||||
|
|
||||||
|
# 删除 PVC(会删除数据)
|
||||||
|
kubectl delete pvc -n langbot --all
|
||||||
|
|
||||||
|
# 删除命名空间
|
||||||
|
kubectl delete namespace langbot
|
||||||
|
```
|
||||||
|
|
||||||
|
### 故障排查
|
||||||
|
|
||||||
|
#### Pod 无法启动
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# 查看 Pod 状态
|
||||||
|
kubectl get pods -n langbot
|
||||||
|
|
||||||
|
# 查看详细信息
|
||||||
|
kubectl describe pod -n langbot <pod-name>
|
||||||
|
|
||||||
|
# 查看事件
|
||||||
|
kubectl get events -n langbot --sort-by='.lastTimestamp'
|
||||||
|
```
|
||||||
|
|
||||||
|
#### 存储问题
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# 检查 PVC 状态
|
||||||
|
kubectl get pvc -n langbot
|
||||||
|
|
||||||
|
# 检查 PV
|
||||||
|
kubectl get pv
|
||||||
|
```
|
||||||
|
|
||||||
|
#### 网络访问问题
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# 检查 Service
|
||||||
|
kubectl get svc -n langbot
|
||||||
|
|
||||||
|
# 检查端口转发
|
||||||
|
kubectl port-forward -n langbot svc/langbot 5300:5300
|
||||||
|
```
|
||||||
|
|
||||||
|
### 生产环境建议
|
||||||
|
|
||||||
|
1. **使用特定版本标签**:避免使用 `latest` 标签,使用具体版本号如 `rockchin/langbot:v1.0.0`
|
||||||
|
2. **配置资源限制**:根据实际负载调整 CPU 和内存限制
|
||||||
|
3. **使用 Ingress + TLS**:配置 HTTPS 访问和证书管理
|
||||||
|
4. **配置监控和告警**:集成 Prometheus、Grafana 等监控工具
|
||||||
|
5. **定期备份**:配置自动备份策略保护数据
|
||||||
|
6. **使用专用 StorageClass**:为生产环境配置高性能存储
|
||||||
|
7. **配置亲和性规则**:确保 Pod 调度到合适的节点
|
||||||
|
|
||||||
|
### 高级配置
|
||||||
|
|
||||||
|
#### 使用 Secrets 管理敏感信息
|
||||||
|
|
||||||
|
如果需要配置 API 密钥等敏感信息:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
apiVersion: v1
|
||||||
|
kind: Secret
|
||||||
|
metadata:
|
||||||
|
name: langbot-secrets
|
||||||
|
namespace: langbot
|
||||||
|
type: Opaque
|
||||||
|
data:
|
||||||
|
api_key: <base64-encoded-value>
|
||||||
|
```
|
||||||
|
|
||||||
|
然后在 Deployment 中引用:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
env:
|
||||||
|
- name: API_KEY
|
||||||
|
valueFrom:
|
||||||
|
secretKeyRef:
|
||||||
|
name: langbot-secrets
|
||||||
|
key: api_key
|
||||||
|
```
|
||||||
|
|
||||||
|
#### 配置水平自动扩缩容(HPA)
|
||||||
|
|
||||||
|
注意:需要确保使用 ReadWriteMany 存储类型
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
apiVersion: autoscaling/v2
|
||||||
|
kind: HorizontalPodAutoscaler
|
||||||
|
metadata:
|
||||||
|
name: langbot-hpa
|
||||||
|
namespace: langbot
|
||||||
|
spec:
|
||||||
|
scaleTargetRef:
|
||||||
|
apiVersion: apps/v1
|
||||||
|
kind: Deployment
|
||||||
|
name: langbot
|
||||||
|
minReplicas: 1
|
||||||
|
maxReplicas: 3
|
||||||
|
metrics:
|
||||||
|
- type: Resource
|
||||||
|
resource:
|
||||||
|
name: cpu
|
||||||
|
target:
|
||||||
|
type: Utilization
|
||||||
|
averageUtilization: 70
|
||||||
|
```
|
||||||
|
|
||||||
|
### 参考资源
|
||||||
|
|
||||||
|
- [LangBot 官方文档](https://docs.langbot.app)
|
||||||
|
- [Docker 部署文档](https://link.langbot.app/zh/docs/docker)
|
||||||
|
- [Kubernetes 官方文档](https://kubernetes.io/docs/)
|
||||||
|
|
||||||
|
---
|
||||||
|
|
||||||
|
## English
|
||||||
|
|
||||||
|
### Overview
|
||||||
|
|
||||||
|
This guide provides complete steps for deploying LangBot in a Kubernetes cluster. The Kubernetes deployment configuration is based on `docker-compose.yaml` and is suitable for production containerized deployments.
|
||||||
|
|
||||||
|
### Prerequisites
|
||||||
|
|
||||||
|
- Kubernetes cluster (version 1.19+)
|
||||||
|
- `kubectl` command-line tool configured with cluster access
|
||||||
|
- Available StorageClass in the cluster for persistent storage (optional but recommended)
|
||||||
|
- At least 2 vCPU and 4GB RAM of available resources
|
||||||
|
|
||||||
|
### Architecture
|
||||||
|
|
||||||
|
The Kubernetes deployment includes the following components:
|
||||||
|
|
||||||
|
1. **langbot**: Main application service
|
||||||
|
- Provides Web UI (port 5300)
|
||||||
|
- Handles platform webhooks (ports 2280-2290)
|
||||||
|
- Data persistence volume
|
||||||
|
|
||||||
|
2. **langbot-plugin-runtime**: Plugin runtime service
|
||||||
|
- WebSocket communication (port 5400)
|
||||||
|
- Plugin data persistence volume
|
||||||
|
|
||||||
|
3. **Persistent Storage**:
|
||||||
|
- `langbot-data`: LangBot main data
|
||||||
|
- `langbot-plugins`: Plugin files
|
||||||
|
- `langbot-plugin-runtime-data`: Plugin runtime data
|
||||||
|
|
||||||
|
### Quick Start
|
||||||
|
|
||||||
|
#### 1. Download Deployment Files
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# Clone repository
|
||||||
|
git clone https://github.com/langbot-app/LangBot
|
||||||
|
cd LangBot/docker
|
||||||
|
|
||||||
|
# Or download kubernetes.yaml directly
|
||||||
|
wget https://raw.githubusercontent.com/langbot-app/LangBot/main/docker/kubernetes.yaml
|
||||||
|
```
|
||||||
|
|
||||||
|
#### 2. Deploy to Kubernetes
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# Apply all configurations
|
||||||
|
kubectl apply -f kubernetes.yaml
|
||||||
|
|
||||||
|
# Check deployment status
|
||||||
|
kubectl get all -n langbot
|
||||||
|
|
||||||
|
# View Pod logs
|
||||||
|
kubectl logs -n langbot -l app=langbot -f
|
||||||
|
```
|
||||||
|
|
||||||
|
#### 3. Access LangBot
|
||||||
|
|
||||||
|
By default, LangBot service uses ClusterIP type, accessible only within the cluster. Choose one of the following methods to access:
|
||||||
|
|
||||||
|
**Option A: Port Forwarding (Recommended for testing)**
|
||||||
|
|
||||||
|
```bash
|
||||||
|
kubectl port-forward -n langbot svc/langbot 5300:5300
|
||||||
|
```
|
||||||
|
|
||||||
|
Then visit http://localhost:5300
|
||||||
|
|
||||||
|
**Option B: NodePort (Suitable for development)**
|
||||||
|
|
||||||
|
Edit `kubernetes.yaml`, uncomment the NodePort Service section, then:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
kubectl apply -f kubernetes.yaml
|
||||||
|
# Get node IP
|
||||||
|
kubectl get nodes -o wide
|
||||||
|
# Visit http://<NODE_IP>:30300
|
||||||
|
```
|
||||||
|
|
||||||
|
**Option C: LoadBalancer (Suitable for cloud environments)**
|
||||||
|
|
||||||
|
Edit `kubernetes.yaml`, uncomment the LoadBalancer Service section, then:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
kubectl apply -f kubernetes.yaml
|
||||||
|
# Get external IP
|
||||||
|
kubectl get svc -n langbot langbot-loadbalancer
|
||||||
|
# Visit http://<EXTERNAL_IP>
|
||||||
|
```
|
||||||
|
|
||||||
|
**Option D: Ingress (Recommended for production)**
|
||||||
|
|
||||||
|
Ensure an Ingress Controller (e.g., nginx-ingress) is installed in the cluster, then:
|
||||||
|
|
||||||
|
1. Edit the Ingress configuration in `kubernetes.yaml`
|
||||||
|
2. Change the domain to your actual domain
|
||||||
|
3. Apply configuration:
|
||||||
|
|
||||||
|
```bash
|
||||||
|
kubectl apply -f kubernetes.yaml
|
||||||
|
# Visit http://langbot.yourdomain.com
|
||||||
|
```
|
||||||
|
|
||||||
|
### Configuration
|
||||||
|
|
||||||
|
#### Environment Variables
|
||||||
|
|
||||||
|
Configure environment variables in ConfigMap:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
apiVersion: v1
|
||||||
|
kind: ConfigMap
|
||||||
|
metadata:
|
||||||
|
name: langbot-config
|
||||||
|
namespace: langbot
|
||||||
|
data:
|
||||||
|
TZ: "Asia/Shanghai" # Change to your timezone
|
||||||
|
```
|
||||||
|
|
||||||
|
#### Storage Configuration
|
||||||
|
|
||||||
|
Uses dynamic storage provisioning by default. If you have a specific StorageClass, specify it in PVC:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
spec:
|
||||||
|
storageClassName: your-storage-class-name
|
||||||
|
accessModes:
|
||||||
|
- ReadWriteOnce
|
||||||
|
resources:
|
||||||
|
requests:
|
||||||
|
storage: 10Gi
|
||||||
|
```
|
||||||
|
|
||||||
|
#### Resource Limits
|
||||||
|
|
||||||
|
Adjust resource limits based on your needs:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
resources:
|
||||||
|
requests:
|
||||||
|
memory: "1Gi"
|
||||||
|
cpu: "500m"
|
||||||
|
limits:
|
||||||
|
memory: "4Gi"
|
||||||
|
cpu: "2000m"
|
||||||
|
```
|
||||||
|
|
||||||
|
### Common Operations
|
||||||
|
|
||||||
|
#### View Logs
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# View LangBot main service logs
|
||||||
|
kubectl logs -n langbot -l app=langbot -f
|
||||||
|
|
||||||
|
# View plugin runtime logs
|
||||||
|
kubectl logs -n langbot -l app=langbot-plugin-runtime -f
|
||||||
|
```
|
||||||
|
|
||||||
|
#### Restart Services
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# Restart LangBot
|
||||||
|
kubectl rollout restart deployment/langbot -n langbot
|
||||||
|
|
||||||
|
# Restart plugin runtime
|
||||||
|
kubectl rollout restart deployment/langbot-plugin-runtime -n langbot
|
||||||
|
```
|
||||||
|
|
||||||
|
#### Update Images
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# Update to latest version
|
||||||
|
kubectl set image deployment/langbot -n langbot langbot=rockchin/langbot:latest
|
||||||
|
kubectl set image deployment/langbot-plugin-runtime -n langbot langbot-plugin-runtime=rockchin/langbot:latest
|
||||||
|
|
||||||
|
# Check update status
|
||||||
|
kubectl rollout status deployment/langbot -n langbot
|
||||||
|
```
|
||||||
|
|
||||||
|
#### Scaling (Not Recommended)
|
||||||
|
|
||||||
|
Note: Due to LangBot using ReadWriteOnce persistent storage, multi-replica scaling is not supported. For high availability, consider using ReadWriteMany storage or alternative architectures.
|
||||||
|
|
||||||
|
#### Backup Data
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# Backup PVC data
|
||||||
|
kubectl exec -n langbot -it <langbot-pod-name> -- tar czf /tmp/backup.tar.gz /app/data
|
||||||
|
kubectl cp langbot/<langbot-pod-name>:/tmp/backup.tar.gz ./backup.tar.gz
|
||||||
|
```
|
||||||
|
|
||||||
|
### Uninstall
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# Delete all resources (keep PVCs)
|
||||||
|
kubectl delete deployment,service,configmap -n langbot --all
|
||||||
|
|
||||||
|
# Delete PVCs (will delete data)
|
||||||
|
kubectl delete pvc -n langbot --all
|
||||||
|
|
||||||
|
# Delete namespace
|
||||||
|
kubectl delete namespace langbot
|
||||||
|
```
|
||||||
|
|
||||||
|
### Troubleshooting
|
||||||
|
|
||||||
|
#### Pods Not Starting
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# Check Pod status
|
||||||
|
kubectl get pods -n langbot
|
||||||
|
|
||||||
|
# View detailed information
|
||||||
|
kubectl describe pod -n langbot <pod-name>
|
||||||
|
|
||||||
|
# View events
|
||||||
|
kubectl get events -n langbot --sort-by='.lastTimestamp'
|
||||||
|
```
|
||||||
|
|
||||||
|
#### Storage Issues
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# Check PVC status
|
||||||
|
kubectl get pvc -n langbot
|
||||||
|
|
||||||
|
# Check PV
|
||||||
|
kubectl get pv
|
||||||
|
```
|
||||||
|
|
||||||
|
#### Network Access Issues
|
||||||
|
|
||||||
|
```bash
|
||||||
|
# Check Service
|
||||||
|
kubectl get svc -n langbot
|
||||||
|
|
||||||
|
# Test port forwarding
|
||||||
|
kubectl port-forward -n langbot svc/langbot 5300:5300
|
||||||
|
```
|
||||||
|
|
||||||
|
### Production Recommendations
|
||||||
|
|
||||||
|
1. **Use specific version tags**: Avoid using `latest` tag, use specific version like `rockchin/langbot:v1.0.0`
|
||||||
|
2. **Configure resource limits**: Adjust CPU and memory limits based on actual load
|
||||||
|
3. **Use Ingress + TLS**: Configure HTTPS access and certificate management
|
||||||
|
4. **Configure monitoring and alerts**: Integrate monitoring tools like Prometheus, Grafana
|
||||||
|
5. **Regular backups**: Configure automated backup strategy to protect data
|
||||||
|
6. **Use dedicated StorageClass**: Configure high-performance storage for production
|
||||||
|
7. **Configure affinity rules**: Ensure Pods are scheduled to appropriate nodes
|
||||||
|
|
||||||
|
### Advanced Configuration
|
||||||
|
|
||||||
|
#### Using Secrets for Sensitive Information
|
||||||
|
|
||||||
|
If you need to configure sensitive information like API keys:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
apiVersion: v1
|
||||||
|
kind: Secret
|
||||||
|
metadata:
|
||||||
|
name: langbot-secrets
|
||||||
|
namespace: langbot
|
||||||
|
type: Opaque
|
||||||
|
data:
|
||||||
|
api_key: <base64-encoded-value>
|
||||||
|
```
|
||||||
|
|
||||||
|
Then reference in Deployment:
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
env:
|
||||||
|
- name: API_KEY
|
||||||
|
valueFrom:
|
||||||
|
secretKeyRef:
|
||||||
|
name: langbot-secrets
|
||||||
|
key: api_key
|
||||||
|
```
|
||||||
|
|
||||||
|
#### Configure Horizontal Pod Autoscaling (HPA)
|
||||||
|
|
||||||
|
Note: Requires ReadWriteMany storage type
|
||||||
|
|
||||||
|
```yaml
|
||||||
|
apiVersion: autoscaling/v2
|
||||||
|
kind: HorizontalPodAutoscaler
|
||||||
|
metadata:
|
||||||
|
name: langbot-hpa
|
||||||
|
namespace: langbot
|
||||||
|
spec:
|
||||||
|
scaleTargetRef:
|
||||||
|
apiVersion: apps/v1
|
||||||
|
kind: Deployment
|
||||||
|
name: langbot
|
||||||
|
minReplicas: 1
|
||||||
|
maxReplicas: 3
|
||||||
|
metrics:
|
||||||
|
- type: Resource
|
||||||
|
resource:
|
||||||
|
name: cpu
|
||||||
|
target:
|
||||||
|
type: Utilization
|
||||||
|
averageUtilization: 70
|
||||||
|
```
|
||||||
|
|
||||||
|
### References
|
||||||
|
|
||||||
|
- [LangBot Official Documentation](https://docs.langbot.app)
|
||||||
|
- [Docker Deployment Guide](https://link.langbot.app/zh/docs/docker)
|
||||||
|
- [Kubernetes Official Documentation](https://kubernetes.io/docs/)
|
||||||
@@ -1,5 +1,5 @@
|
|||||||
# Docker Compose configuration for LangBot
|
# Docker Compose configuration for LangBot
|
||||||
# For Kubernetes deployment, see kubernetes.yaml and the deployment guide at https://docs.langbot.app
|
# For Kubernetes deployment, see kubernetes.yaml and README_K8S.md
|
||||||
version: "3"
|
version: "3"
|
||||||
|
|
||||||
services:
|
services:
|
||||||
@@ -18,40 +18,6 @@ services:
|
|||||||
networks:
|
networks:
|
||||||
- langbot_network
|
- langbot_network
|
||||||
|
|
||||||
# The Box sandbox runtime is optional. It is only started when you run
|
|
||||||
# ``docker compose --profile box up`` (or ``docker compose --profile all
|
|
||||||
# up``). With Box off, LangBot keeps the dashboard / skills list visible
|
|
||||||
# (read-only) but disables sandbox tools, skill add/edit and stdio MCP —
|
|
||||||
# set ``box.enabled: false`` in ``data/config.yaml`` (or
|
|
||||||
# ``BOX__ENABLED=false`` in the langbot service env below) to match.
|
|
||||||
langbot_box:
|
|
||||||
image: rockchin/langbot:latest
|
|
||||||
container_name: langbot_box
|
|
||||||
profiles: ["box", "all"]
|
|
||||||
volumes:
|
|
||||||
# Keep the source and target path identical because langbot_box uses the
|
|
||||||
# host Docker socket to create sandbox containers. Override
|
|
||||||
# LANGBOT_BOX_ROOT with an absolute path if you do not want the default.
|
|
||||||
- ${LANGBOT_BOX_ROOT:-${PWD}/data/box}:${LANGBOT_BOX_ROOT:-${PWD}/data/box}
|
|
||||||
# Mount container runtime socket for Box sandbox backend.
|
|
||||||
# Uncomment the one that matches your container runtime:
|
|
||||||
# - /var/run/podman/podman.sock:/var/run/podman/podman.sock # Podman
|
|
||||||
- /var/run/docker.sock:/var/run/docker.sock # Docker
|
|
||||||
restart: on-failure
|
|
||||||
environment:
|
|
||||||
- TZ=Asia/Shanghai
|
|
||||||
# The Box runtime does NOT read box.local.* from config.yaml or env; it
|
|
||||||
# receives its configuration from LangBot via the INIT RPC action.
|
|
||||||
# Do not add LANGBOT_BOX_* / BOX__* here — they would be silently ignored.
|
|
||||||
# Launched through the same CLI entry point as the plugin runtime
|
|
||||||
# (`langbot_plugin.cli.__init__ <subcommand>`). WebSocket is the default
|
|
||||||
# control transport — mirrors `rt`, which also runs with no flag. Pass
|
|
||||||
# `-s` / `--stdio-control` only for the stdio mode LangBot uses outside
|
|
||||||
# containers.
|
|
||||||
command: ["uv", "run", "--no-sync", "-m", "langbot_plugin.cli.__init__", "box"]
|
|
||||||
networks:
|
|
||||||
- langbot_network
|
|
||||||
|
|
||||||
langbot:
|
langbot:
|
||||||
image: rockchin/langbot:latest
|
image: rockchin/langbot:latest
|
||||||
container_name: langbot
|
container_name: langbot
|
||||||
@@ -60,13 +26,6 @@ services:
|
|||||||
restart: on-failure
|
restart: on-failure
|
||||||
environment:
|
environment:
|
||||||
- TZ=Asia/Shanghai
|
- TZ=Asia/Shanghai
|
||||||
# Unified env-override convention: SECTION__SUBSECTION__KEY overrides the
|
|
||||||
# matching config.yaml field (see LoadConfigStage). These map onto
|
|
||||||
# box.local.* and are forwarded to the Box runtime via INIT RPC.
|
|
||||||
- BOX__LOCAL__HOST_ROOT=${LANGBOT_BOX_ROOT:-${PWD}/data/box}
|
|
||||||
- BOX__LOCAL__DEFAULT_WORKSPACE=default
|
|
||||||
- BOX__LOCAL__SKILLS_ROOT=skills
|
|
||||||
- BOX__LOCAL__ALLOWED_MOUNT_ROOTS=${LANGBOT_BOX_ROOT:-${PWD}/data/box}
|
|
||||||
ports:
|
ports:
|
||||||
- 5300:5300 # For web ui and webhook callback
|
- 5300:5300 # For web ui and webhook callback
|
||||||
- 2280-2285:2280-2285 # For platform reverse connection
|
- 2280-2285:2280-2285 # For platform reverse connection
|
||||||
|
|||||||
@@ -1,8 +1,6 @@
|
|||||||
# Kubernetes Deployment for LangBot
|
# Kubernetes Deployment for LangBot
|
||||||
# This file provides Kubernetes deployment manifests for LangBot based on docker-compose.yaml
|
# This file provides Kubernetes deployment manifests for LangBot based on docker-compose.yaml
|
||||||
#
|
#
|
||||||
# Full deployment guide (zh/en/ja): https://docs.langbot.app -> Installation -> Kubernetes
|
|
||||||
#
|
|
||||||
# Usage:
|
# Usage:
|
||||||
# kubectl apply -f kubernetes.yaml
|
# kubectl apply -f kubernetes.yaml
|
||||||
#
|
#
|
||||||
@@ -10,15 +8,13 @@
|
|||||||
# - A Kubernetes cluster (1.19+)
|
# - A Kubernetes cluster (1.19+)
|
||||||
# - kubectl configured to communicate with your cluster
|
# - kubectl configured to communicate with your cluster
|
||||||
# - (Optional) A StorageClass for dynamic volume provisioning
|
# - (Optional) A StorageClass for dynamic volume provisioning
|
||||||
# - For the Box sandbox runtime: a node with a reachable Docker daemon
|
|
||||||
# (the box mounts the node's /var/run/docker.sock). See the deployment guide.
|
|
||||||
#
|
#
|
||||||
# Components:
|
# Components:
|
||||||
# - Namespace: langbot
|
# - Namespace: langbot
|
||||||
# - PersistentVolumeClaims for data persistence
|
# - PersistentVolumeClaims for data persistence
|
||||||
# - Deployments for langbot, langbot-plugin-runtime, and langbot-box (sandbox)
|
# - Deployments for langbot and langbot_plugin_runtime
|
||||||
# - Services for network access
|
# - Services for network access
|
||||||
# - ConfigMap for timezone + runtime endpoints
|
# - ConfigMap for timezone configuration
|
||||||
|
|
||||||
---
|
---
|
||||||
# Namespace
|
# Namespace
|
||||||
@@ -87,11 +83,6 @@ metadata:
|
|||||||
data:
|
data:
|
||||||
TZ: "Asia/Shanghai"
|
TZ: "Asia/Shanghai"
|
||||||
PLUGIN__RUNTIME_WS_URL: "ws://langbot-plugin-runtime:5400/control/ws"
|
PLUGIN__RUNTIME_WS_URL: "ws://langbot-plugin-runtime:5400/control/ws"
|
||||||
# Box sandbox runtime endpoint. LangBot connects to the Box runtime over
|
|
||||||
# WebSocket. The hostname MUST match the langbot-box Service name. Note the
|
|
||||||
# in-container default ("langbot_box") uses an underscore, which is an
|
|
||||||
# invalid Kubernetes DNS name — so the endpoint is always set explicitly here.
|
|
||||||
BOX__RUNTIME__ENDPOINT: "ws://langbot-box:5410"
|
|
||||||
|
|
||||||
---
|
---
|
||||||
# Deployment for LangBot Plugin Runtime
|
# Deployment for LangBot Plugin Runtime
|
||||||
@@ -178,136 +169,6 @@ spec:
|
|||||||
protocol: TCP
|
protocol: TCP
|
||||||
name: runtime
|
name: runtime
|
||||||
|
|
||||||
---
|
|
||||||
# Deployment for LangBot Box (sandbox) runtime
|
|
||||||
#
|
|
||||||
# The Box runtime backs LangBot's sandbox tools (exec / read / write / edit /
|
|
||||||
# glob / grep), the `activate` skill tool, skill add/edit, and stdio-mode MCP
|
|
||||||
# servers. It is OPTIONAL: if you do not deploy it, set `BOX__ENABLED=false` on
|
|
||||||
# the langbot Deployment (or `box.enabled: false` in config.yaml) so the
|
|
||||||
# dashboard renders cleanly with sandbox features disabled.
|
|
||||||
#
|
|
||||||
# IMPORTANT — how the sandbox actually runs:
|
|
||||||
# The bundled image ships only the Docker CLI (no dockerd, no nsjail). The Box
|
|
||||||
# runtime therefore creates sandbox containers by talking to a Docker daemon
|
|
||||||
# over the mounted socket (`/var/run/docker.sock`). Because that daemon
|
|
||||||
# resolves bind-mount paths on the NODE filesystem, the Box workspace root
|
|
||||||
# must be the SAME absolute path inside the box container, inside every
|
|
||||||
# sandbox container it spawns, AND on the node. That is why this manifest uses
|
|
||||||
# a hostPath at a fixed absolute path (/app/data/box) and pins langbot + box
|
|
||||||
# to the same node via podAffinity. A normal PVC will NOT work for the box
|
|
||||||
# workspace, because the node's dockerd cannot see paths that exist only
|
|
||||||
# inside the pod's mount namespace.
|
|
||||||
#
|
|
||||||
# Security note: mounting the host Docker socket grants the Box runtime (and any
|
|
||||||
# code executed in the sandbox) effective root on the node. Only deploy Box on
|
|
||||||
# nodes you trust for this workload, ideally a dedicated node pool. For a
|
|
||||||
# stronger isolation boundary, switch box.backend to 'e2b' (set E2B_API_KEY) and
|
|
||||||
# drop the docker.sock mount + hostPath entirely.
|
|
||||||
apiVersion: apps/v1
|
|
||||||
kind: Deployment
|
|
||||||
metadata:
|
|
||||||
name: langbot-box
|
|
||||||
namespace: langbot
|
|
||||||
labels:
|
|
||||||
app: langbot-box
|
|
||||||
spec:
|
|
||||||
replicas: 1
|
|
||||||
selector:
|
|
||||||
matchLabels:
|
|
||||||
app: langbot-box
|
|
||||||
template:
|
|
||||||
metadata:
|
|
||||||
labels:
|
|
||||||
app: langbot-box
|
|
||||||
spec:
|
|
||||||
# Pin to the same node as langbot so they share the hostPath box root.
|
|
||||||
affinity:
|
|
||||||
podAffinity:
|
|
||||||
requiredDuringSchedulingIgnoredDuringExecution:
|
|
||||||
- labelSelector:
|
|
||||||
matchLabels:
|
|
||||||
app: langbot
|
|
||||||
topologyKey: kubernetes.io/hostname
|
|
||||||
containers:
|
|
||||||
- name: langbot-box
|
|
||||||
image: rockchin/langbot:latest
|
|
||||||
imagePullPolicy: Always
|
|
||||||
# Launched through the same CLI entry point as the plugin runtime.
|
|
||||||
# No flag => WebSocket control transport (default), listening on 5410.
|
|
||||||
command: ["uv", "run", "--no-sync", "-m", "langbot_plugin.cli.__init__", "box"]
|
|
||||||
ports:
|
|
||||||
- containerPort: 5410
|
|
||||||
name: box-rpc
|
|
||||||
protocol: TCP
|
|
||||||
env:
|
|
||||||
- name: TZ
|
|
||||||
valueFrom:
|
|
||||||
configMapKeyRef:
|
|
||||||
name: langbot-config
|
|
||||||
key: TZ
|
|
||||||
# The Box runtime does NOT read box.local.* / BOX__* from its own env;
|
|
||||||
# it receives its configuration from LangBot via the INIT RPC action.
|
|
||||||
# Do not add BOX__* here — they would be silently ignored.
|
|
||||||
volumeMounts:
|
|
||||||
# Box workspace root — identical path on node, box, and sandbox
|
|
||||||
# containers (see the IMPORTANT note above).
|
|
||||||
- name: box-root
|
|
||||||
mountPath: /app/data/box
|
|
||||||
# Host Docker socket — the sandbox backend uses it to create containers.
|
|
||||||
- name: docker-sock
|
|
||||||
mountPath: /var/run/docker.sock
|
|
||||||
resources:
|
|
||||||
requests:
|
|
||||||
memory: "256Mi"
|
|
||||||
cpu: "100m"
|
|
||||||
limits:
|
|
||||||
memory: "1Gi"
|
|
||||||
cpu: "1000m"
|
|
||||||
livenessProbe:
|
|
||||||
tcpSocket:
|
|
||||||
port: 5410
|
|
||||||
initialDelaySeconds: 20
|
|
||||||
periodSeconds: 10
|
|
||||||
timeoutSeconds: 5
|
|
||||||
failureThreshold: 3
|
|
||||||
readinessProbe:
|
|
||||||
tcpSocket:
|
|
||||||
port: 5410
|
|
||||||
initialDelaySeconds: 10
|
|
||||||
periodSeconds: 5
|
|
||||||
timeoutSeconds: 3
|
|
||||||
failureThreshold: 3
|
|
||||||
volumes:
|
|
||||||
- name: box-root
|
|
||||||
hostPath:
|
|
||||||
path: /app/data/box
|
|
||||||
type: DirectoryOrCreate
|
|
||||||
- name: docker-sock
|
|
||||||
hostPath:
|
|
||||||
path: /var/run/docker.sock
|
|
||||||
type: Socket
|
|
||||||
restartPolicy: Always
|
|
||||||
|
|
||||||
---
|
|
||||||
# Service for LangBot Box runtime
|
|
||||||
apiVersion: v1
|
|
||||||
kind: Service
|
|
||||||
metadata:
|
|
||||||
name: langbot-box
|
|
||||||
namespace: langbot
|
|
||||||
labels:
|
|
||||||
app: langbot-box
|
|
||||||
spec:
|
|
||||||
type: ClusterIP
|
|
||||||
selector:
|
|
||||||
app: langbot-box
|
|
||||||
ports:
|
|
||||||
- port: 5410
|
|
||||||
targetPort: 5410
|
|
||||||
protocol: TCP
|
|
||||||
name: box-rpc
|
|
||||||
|
|
||||||
---
|
---
|
||||||
# Deployment for LangBot
|
# Deployment for LangBot
|
||||||
apiVersion: apps/v1
|
apiVersion: apps/v1
|
||||||
@@ -352,36 +213,11 @@ spec:
|
|||||||
configMapKeyRef:
|
configMapKeyRef:
|
||||||
name: langbot-config
|
name: langbot-config
|
||||||
key: PLUGIN__RUNTIME_WS_URL
|
key: PLUGIN__RUNTIME_WS_URL
|
||||||
# Box (sandbox) runtime endpoint. Connects LangBot to the langbot-box
|
|
||||||
# Service over WebSocket. Remove this (and the langbot-box Deployment)
|
|
||||||
# and set BOX__ENABLED=false if you do not want the sandbox.
|
|
||||||
- name: BOX__RUNTIME__ENDPOINT
|
|
||||||
valueFrom:
|
|
||||||
configMapKeyRef:
|
|
||||||
name: langbot-config
|
|
||||||
key: BOX__RUNTIME__ENDPOINT
|
|
||||||
# box.local.* config — forwarded to the Box runtime via INIT RPC. The
|
|
||||||
# host_root MUST match the box-root hostPath mountPath below AND the box
|
|
||||||
# Deployment's box-root mountPath, so that skill package paths resolve
|
|
||||||
# identically on both sides and on the node's Docker daemon.
|
|
||||||
- name: BOX__LOCAL__HOST_ROOT
|
|
||||||
value: "/app/data/box"
|
|
||||||
- name: BOX__LOCAL__DEFAULT_WORKSPACE
|
|
||||||
value: "default"
|
|
||||||
- name: BOX__LOCAL__SKILLS_ROOT
|
|
||||||
value: "skills"
|
|
||||||
- name: BOX__LOCAL__ALLOWED_MOUNT_ROOTS
|
|
||||||
value: "/app/data/box"
|
|
||||||
volumeMounts:
|
volumeMounts:
|
||||||
- name: data
|
- name: data
|
||||||
mountPath: /app/data
|
mountPath: /app/data
|
||||||
- name: plugins
|
- name: plugins
|
||||||
mountPath: /app/plugins
|
mountPath: /app/plugins
|
||||||
# Same node-level box root as the langbot-box Deployment. Mounted over
|
|
||||||
# the data PVC's /app/data/box subpath so both LangBot and the Box
|
|
||||||
# runtime (and the node's dockerd) agree on one absolute path.
|
|
||||||
- name: box-root
|
|
||||||
mountPath: /app/data/box
|
|
||||||
resources:
|
resources:
|
||||||
requests:
|
requests:
|
||||||
memory: "1Gi"
|
memory: "1Gi"
|
||||||
@@ -414,13 +250,6 @@ spec:
|
|||||||
- name: plugins
|
- name: plugins
|
||||||
persistentVolumeClaim:
|
persistentVolumeClaim:
|
||||||
claimName: langbot-plugins
|
claimName: langbot-plugins
|
||||||
# Node-level box workspace root, shared with the langbot-box Deployment.
|
|
||||||
# hostPath (not PVC) because the node's Docker daemon must see the same
|
|
||||||
# absolute path when bind-mounting workspaces into sandbox containers.
|
|
||||||
- name: box-root
|
|
||||||
hostPath:
|
|
||||||
path: /app/data/box
|
|
||||||
type: DirectoryOrCreate
|
|
||||||
restartPolicy: Always
|
restartPolicy: Always
|
||||||
|
|
||||||
---
|
---
|
||||||
|
|||||||
@@ -1,197 +0,0 @@
|
|||||||
# Event Based Agents 架构设计总览
|
|
||||||
|
|
||||||
## 1. 背景与动机
|
|
||||||
|
|
||||||
### 当前架构的局限性
|
|
||||||
|
|
||||||
LangBot 当前的平台适配器架构围绕**消息事件**单一场景设计:
|
|
||||||
|
|
||||||
- **事件层面**:只监听 `FriendMessage`(私聊消息)和 `GroupMessage`(群消息)两种事件
|
|
||||||
- **API 层面**:只暴露 `send_message` 和 `reply_message` 两个平台 API
|
|
||||||
- **处理层面**:所有消息统一进入 Pipeline 流水线处理,无法为不同事件类型配置不同处理逻辑
|
|
||||||
- **适配器结构**:每个适配器是单个 Python 文件(200-800 行),随着功能增加难以维护
|
|
||||||
|
|
||||||
这导致以下问题:
|
|
||||||
|
|
||||||
1. **无法处理非消息事件**:新成员入群、好友请求、消息撤回、消息编辑等大部分平台都支持的事件被完全忽略
|
|
||||||
2. **平台能力未充分利用**:编辑消息、撤回消息、获取群成员列表、管理群组等 API 无法使用
|
|
||||||
3. **插件能力受限**:插件只能监听消息事件、只能发送/回复消息,无法实现更丰富的交互
|
|
||||||
4. **处理逻辑不灵活**:所有消息走同一条 Pipeline,无法为入群欢迎、好友自动通过等场景配置独立的处理流程
|
|
||||||
|
|
||||||
### 设计目标
|
|
||||||
|
|
||||||
Event Based Agents(EBA)架构旨在将 LangBot 从"消息处理平台"升级为"事件驱动的智能代理平台":
|
|
||||||
|
|
||||||
- **丰富事件**:支持消息、群组、好友、Bot 状态等多种事件类型
|
|
||||||
- **丰富 API**:支持消息编辑/撤回、群组管理、用户信息查询等通用 API,以及适配器特有 API 的透传调用
|
|
||||||
- **灵活编排**:用户可在 WebUI 上为每个 Bot 的每种事件类型配置不同的处理器
|
|
||||||
- **可扩展**:适配器可声明自己支持的事件和 API,平台特有能力通过标准机制暴露
|
|
||||||
- **向后兼容**:现有插件无需修改即可在新架构下运行
|
|
||||||
|
|
||||||
## 2. 架构对比
|
|
||||||
|
|
||||||
### 现有架构
|
|
||||||
|
|
||||||
```
|
|
||||||
消息平台 (Telegram/Discord/...)
|
|
||||||
│
|
|
||||||
▼
|
|
||||||
平台适配器 (单文件, 只处理消息)
|
|
||||||
│ FriendMessage / GroupMessage
|
|
||||||
▼
|
|
||||||
RuntimeBot (注册 on_friend_message / on_group_message 回调)
|
|
||||||
│
|
|
||||||
▼
|
|
||||||
MessageAggregator (消息聚合)
|
|
||||||
│
|
|
||||||
▼
|
|
||||||
QueryPool → Controller → Pipeline (固定阶段链)
|
|
||||||
│ │
|
|
||||||
│ ▼
|
|
||||||
│ RequestRunner (local-agent / dify / n8n / ...)
|
|
||||||
│
|
|
||||||
▼
|
|
||||||
adapter.reply_message() / adapter.send_message()
|
|
||||||
```
|
|
||||||
|
|
||||||
关键代码路径:
|
|
||||||
- 适配器基类:`langbot-plugin-sdk/.../abstract/platform/adapter.py` — `AbstractMessagePlatformAdapter`
|
|
||||||
- 事件定义:`langbot-plugin-sdk/.../builtin/platform/events.py` — 仅 `FriendMessage` / `GroupMessage`
|
|
||||||
- Bot 管理:`LangBot/src/langbot/pkg/platform/botmgr.py` — `RuntimeBot` 只注册两个消息回调
|
|
||||||
- 流水线控制:`LangBot/src/langbot/pkg/pipeline/controller.py` — 从 QueryPool 消费并执行 Pipeline
|
|
||||||
|
|
||||||
### 新架构(Event Based Agents)
|
|
||||||
|
|
||||||
```
|
|
||||||
消息平台 (Telegram/Discord/...)
|
|
||||||
│
|
|
||||||
▼
|
|
||||||
平台适配器 (独立目录, 监听所有事件, 实现丰富 API)
|
|
||||||
│ MessageReceived / MemberJoined / FriendRequest / ...
|
|
||||||
▼
|
|
||||||
EventBus (统一事件总线)
|
|
||||||
│
|
|
||||||
▼
|
|
||||||
EventRouter (事件路由引擎, 读取 Bot 的 event_handlers 配置)
|
|
||||||
│
|
|
||||||
├─→ PipelineHandler — 现有流水线(完整 Stage 链)
|
|
||||||
├─→ AgentHandler — 直接调用 RequestRunner(轻量 AI 处理)
|
|
||||||
├─→ WebhookHandler — POST 到外部服务(Dify/n8n webhook 等)
|
|
||||||
└─→ PluginHandler — 分发给插件 EventListener
|
|
||||||
│
|
|
||||||
▼
|
|
||||||
统一平台 API
|
|
||||||
send / reply / edit / delete / getGroupInfo / getUserInfo / callPlatformApi / ...
|
|
||||||
```
|
|
||||||
|
|
||||||
## 3. 核心概念
|
|
||||||
|
|
||||||
### 3.1 统一事件体系
|
|
||||||
|
|
||||||
所有平台事件统一为命名空间式的事件类型:
|
|
||||||
|
|
||||||
| 命名空间 | 事件 | 说明 |
|
|
||||||
|----------|------|------|
|
|
||||||
| `message.*` | `message.received`, `message.edited`, `message.deleted`, `message.reaction` | 消息相关 |
|
|
||||||
| `feedback.*` | `feedback.received` | 用户对 Bot 回复的点赞、点踩、取消反馈等评价事件 |
|
|
||||||
| `group.*` | `group.member_joined`, `group.member_left`, `group.member_banned`, `group.info_updated` | 群组相关 |
|
|
||||||
| `friend.*` | `friend.request_received`, `friend.added`, `friend.removed` | 好友相关 |
|
|
||||||
| `bot.*` | `bot.invited_to_group`, `bot.removed_from_group`, `bot.muted`, `bot.unmuted` | Bot 状态 |
|
|
||||||
| `platform.*` | `platform.{adapter}.{action}` | 适配器特有事件 |
|
|
||||||
|
|
||||||
详见 [01-event-system.md](./01-event-system.md)。
|
|
||||||
|
|
||||||
### 3.2 统一平台 API
|
|
||||||
|
|
||||||
扩展适配器基类,提供通用 API + 透传机制:
|
|
||||||
|
|
||||||
| 类别 | API | 必需/可选 |
|
|
||||||
|------|-----|----------|
|
|
||||||
| 消息 | `send_message`, `reply_message`, `edit_message`, `delete_message`, `forward_message` | send/reply 必需,其余可选 |
|
|
||||||
| 群组 | `get_group_info`, `get_group_member_list`, `get_group_member_info`, `mute_member`, `kick_member` | 全部可选 |
|
|
||||||
| 用户 | `get_user_info`, `get_friend_list` | 全部可选 |
|
|
||||||
| 媒体 | `upload_file`, `get_file_url` | 全部可选 |
|
|
||||||
| 透传 | `call_platform_api(action, params)` | 可选 |
|
|
||||||
|
|
||||||
详见 [02-platform-api.md](./02-platform-api.md)。
|
|
||||||
|
|
||||||
### 3.3 适配器新结构
|
|
||||||
|
|
||||||
每个适配器从单文件迁移到独立目录:
|
|
||||||
|
|
||||||
```
|
|
||||||
pkg/platform/adapters/
|
|
||||||
├── _base/ # 基类和通用定义
|
|
||||||
│ ├── adapter.py
|
|
||||||
│ ├── events.py
|
|
||||||
│ ├── entities.py
|
|
||||||
│ └── api.py
|
|
||||||
├── telegram/
|
|
||||||
│ ├── __init__.py
|
|
||||||
│ ├── adapter.py # 主适配器类
|
|
||||||
│ ├── event_converter.py # 事件转换(多种事件类型)
|
|
||||||
│ ├── message_converter.py # 消息链转换
|
|
||||||
│ ├── api_impl.py # 通用 API 实现
|
|
||||||
│ ├── platform_api.py # 平台特有 API
|
|
||||||
│ ├── types.py # 平台特有类型
|
|
||||||
│ └── manifest.yaml
|
|
||||||
├── discord/
|
|
||||||
│ └── ...
|
|
||||||
```
|
|
||||||
|
|
||||||
详见 [03-adapter-structure.md](./03-adapter-structure.md)。
|
|
||||||
|
|
||||||
### 3.4 事件处理器(Event Handler)
|
|
||||||
|
|
||||||
四种处理器类型,用户在 WebUI 的 Bot 管理页面配置:
|
|
||||||
|
|
||||||
| 类型 | 说明 | 适用场景 |
|
|
||||||
|------|------|----------|
|
|
||||||
| **pipeline** | 现有流水线机制,完整的多 Stage 处理链(PreProcessor → MessageProcessor → PostProcessor 等) | 复杂消息处理,需要完整的预处理/后处理流程 |
|
|
||||||
| **agent** | 直接调用 RequestRunner(local-agent / dify / n8n / coze / dashscope / langflow / tbox),从 Pipeline 中解耦 | 轻量级 AI 处理、直接对接外部 LLMOps 平台处理各类事件 |
|
|
||||||
| **webhook** | 将事件 POST 到外部 URL,根据响应执行动作 | 对接自建服务、Dify/n8n 的 Webhook 触发器、自定义后端 |
|
|
||||||
| **plugin** | 分发给插件 EventListener 处理 | 插件自定义逻辑 |
|
|
||||||
|
|
||||||
配置存储在 Bot 表的 `event_handlers` JSON 字段中,通过 WebUI 编排面板管理。
|
|
||||||
|
|
||||||
详见 [04-event-routing.md](./04-event-routing.md)。
|
|
||||||
|
|
||||||
### 3.5 插件 SDK 改造
|
|
||||||
|
|
||||||
- 新事件类型全部暴露给插件
|
|
||||||
- 新 API 全部通过 `LangBotAPIProxy` 暴露
|
|
||||||
- 兼容层保证现有插件零修改运行
|
|
||||||
|
|
||||||
详见 [05-plugin-sdk.md](./05-plugin-sdk.md)。
|
|
||||||
|
|
||||||
## 4. 关键设计决策
|
|
||||||
|
|
||||||
| # | 决策点 | 选择 | 理由 |
|
|
||||||
|---|--------|------|------|
|
|
||||||
| 1 | 事件处理器配置粒度 | 每个 Bot 独立配置 | Bot 是用户操作的核心单元,不同 Bot 可能对接不同业务场景 |
|
|
||||||
| 2 | 适配器特有 API | 统一抽象 + `call_platform_api` 透传 | 通用 API 覆盖大部分场景,透传机制保证灵活性,避免每个适配器导出独立的类型化 API 包 |
|
|
||||||
| 3 | 向后兼容策略 | 兼容层适配 | 保留旧事件类型和 API 作为新系统的 alias/wrapper,现有插件无需修改 |
|
|
||||||
| 4 | 处理器配置存储 | Bot 表新增 `event_handlers` JSON 字段 | 简单直接,避免新增关联表;替代现有 `use_pipeline_uuid` |
|
|
||||||
| 5 | Agent 处理器定位 | 从 Pipeline 中解耦 RequestRunner | 不是所有事件都需要完整 Pipeline Stage 链;Agent 处理器提供轻量级 AI 处理路径,支持所有现有 Runner |
|
|
||||||
| 6 | 事件命名方式 | 命名空间式(`message.received`) | 清晰的分类层级,便于通配匹配(`message.*`),与 WebUI 配置天然对应 |
|
|
||||||
|
|
||||||
## 5. 文档索引
|
|
||||||
|
|
||||||
| 文档 | 内容 |
|
|
||||||
|------|------|
|
|
||||||
| [01-event-system.md](./01-event-system.md) | 统一事件体系:事件分类、定义、生命周期 |
|
|
||||||
| [02-platform-api.md](./02-platform-api.md) | 统一平台 API:通用 API、透传 API、实体定义 |
|
|
||||||
| [03-adapter-structure.md](./03-adapter-structure.md) | 适配器新结构:目录布局、基类、注册机制 |
|
|
||||||
| [04-event-routing.md](./04-event-routing.md) | 事件路由与编排:路由引擎、处理器类型、WebUI 数据模型 |
|
|
||||||
| [05-plugin-sdk.md](./05-plugin-sdk.md) | 插件 SDK 改造:新事件/API、兼容层 |
|
|
||||||
| [06-migration-plan.md](./06-migration-plan.md) | 分阶段迁移计划 |
|
|
||||||
|
|
||||||
## 6. 涉及的代码仓库
|
|
||||||
|
|
||||||
| 仓库 | 改动范围 |
|
|
||||||
|------|----------|
|
|
||||||
| **langbot-plugin-sdk** | 事件定义、实体模型、API 接口、适配器基类、通信协议扩展 |
|
|
||||||
| **LangBot**(后端) | 适配器实现、事件路由引擎、Bot 实体扩展、数据库迁移、RequestRunner 解耦 |
|
|
||||||
| **LangBot**(前端) | Bot 事件处理器编排面板 |
|
|
||||||
| **langbot-wiki** | 新架构文档、插件开发指南更新、适配器开发指南 |
|
|
||||||
| **langbot-plugin-demo** | 示例更新(使用新事件和 API) |
|
|
||||||
@@ -1,561 +0,0 @@
|
|||||||
# 统一事件体系
|
|
||||||
|
|
||||||
## 1. 设计原则
|
|
||||||
|
|
||||||
- **命名空间分类**:事件类型采用 `{namespace}.{action}` 格式,如 `message.received`
|
|
||||||
- **通用优先**:大部分平台都支持的事件抽象为通用事件,定义统一的字段格式
|
|
||||||
- **平台特有事件标准化**:各适配器的独有事件通过 `PlatformSpecificEvent` 承载,保留原始数据
|
|
||||||
- **向后兼容**:现有 `FriendMessage` / `GroupMessage` 通过兼容层映射到新的 `message.received` 事件
|
|
||||||
|
|
||||||
## 2. 事件基类层次
|
|
||||||
|
|
||||||
```
|
|
||||||
Event (事件基类)
|
|
||||||
├── MessageEvent (消息相关事件)
|
|
||||||
│ ├── MessageReceivedEvent # message.received
|
|
||||||
│ ├── MessageEditedEvent # message.edited
|
|
||||||
│ ├── MessageDeletedEvent # message.deleted
|
|
||||||
│ └── MessageReactionEvent # message.reaction
|
|
||||||
├── FeedbackEvent (用户反馈事件)
|
|
||||||
│ └── FeedbackReceivedEvent # feedback.received
|
|
||||||
├── GroupEvent (群组相关事件)
|
|
||||||
│ ├── MemberJoinedEvent # group.member_joined
|
|
||||||
│ ├── MemberLeftEvent # group.member_left
|
|
||||||
│ ├── MemberBannedEvent # group.member_banned
|
|
||||||
│ ├── MemberUnbannedEvent # group.member_unbanned
|
|
||||||
│ └── GroupInfoUpdatedEvent # group.info_updated
|
|
||||||
├── FriendEvent (好友相关事件)
|
|
||||||
│ ├── FriendRequestReceivedEvent # friend.request_received
|
|
||||||
│ ├── FriendAddedEvent # friend.added
|
|
||||||
│ └── FriendRemovedEvent # friend.removed
|
|
||||||
├── BotEvent (Bot 状态事件)
|
|
||||||
│ ├── BotInvitedToGroupEvent # bot.invited_to_group
|
|
||||||
│ ├── BotRemovedFromGroupEvent # bot.removed_from_group
|
|
||||||
│ ├── BotMutedEvent # bot.muted
|
|
||||||
│ └── BotUnmutedEvent # bot.unmuted
|
|
||||||
└── PlatformSpecificEvent # platform.{adapter}.{action}
|
|
||||||
```
|
|
||||||
|
|
||||||
## 3. 通用事件定义
|
|
||||||
|
|
||||||
### 3.1 事件基类
|
|
||||||
|
|
||||||
```python
|
|
||||||
class Event(pydantic.BaseModel):
|
|
||||||
"""事件基类"""
|
|
||||||
|
|
||||||
type: str
|
|
||||||
"""事件类型标识,如 'message.received'"""
|
|
||||||
|
|
||||||
timestamp: float
|
|
||||||
"""事件发生的时间戳"""
|
|
||||||
|
|
||||||
bot_uuid: str
|
|
||||||
"""接收到此事件的 Bot UUID"""
|
|
||||||
|
|
||||||
adapter_name: str
|
|
||||||
"""产生此事件的适配器名称"""
|
|
||||||
|
|
||||||
source_platform_object: typing.Optional[typing.Any] = None
|
|
||||||
"""原始平台事件对象,供适配器内部使用"""
|
|
||||||
```
|
|
||||||
|
|
||||||
### 3.2 消息事件
|
|
||||||
|
|
||||||
#### MessageReceivedEvent (`message.received`)
|
|
||||||
|
|
||||||
收到新消息。这是最核心的事件,替代现有的 `FriendMessage` / `GroupMessage`。
|
|
||||||
|
|
||||||
```python
|
|
||||||
class MessageReceivedEvent(Event):
|
|
||||||
"""收到新消息"""
|
|
||||||
|
|
||||||
type: str = "message.received"
|
|
||||||
|
|
||||||
message_id: typing.Union[int, str]
|
|
||||||
"""消息 ID"""
|
|
||||||
|
|
||||||
message_chain: MessageChain
|
|
||||||
"""消息内容"""
|
|
||||||
|
|
||||||
sender: User
|
|
||||||
"""发送者"""
|
|
||||||
|
|
||||||
chat_type: ChatType # "private" | "group"
|
|
||||||
"""会话类型"""
|
|
||||||
|
|
||||||
chat_id: typing.Union[int, str]
|
|
||||||
"""会话 ID(私聊为对方用户 ID,群聊为群 ID)"""
|
|
||||||
|
|
||||||
group: typing.Optional[Group] = None
|
|
||||||
"""群信息(仅群聊时存在)"""
|
|
||||||
```
|
|
||||||
|
|
||||||
与现有类型的映射关系:
|
|
||||||
- `chat_type == "private"` → 等价于现有 `FriendMessage`
|
|
||||||
- `chat_type == "group"` → 等价于现有 `GroupMessage`
|
|
||||||
|
|
||||||
`ChatType` 枚举:
|
|
||||||
|
|
||||||
```python
|
|
||||||
class ChatType(str, Enum):
|
|
||||||
PRIVATE = "private"
|
|
||||||
GROUP = "group"
|
|
||||||
```
|
|
||||||
|
|
||||||
#### MessageEditedEvent (`message.edited`)
|
|
||||||
|
|
||||||
消息被编辑。
|
|
||||||
|
|
||||||
```python
|
|
||||||
class MessageEditedEvent(Event):
|
|
||||||
"""消息被编辑"""
|
|
||||||
|
|
||||||
type: str = "message.edited"
|
|
||||||
|
|
||||||
message_id: typing.Union[int, str]
|
|
||||||
"""被编辑的消息 ID"""
|
|
||||||
|
|
||||||
new_content: MessageChain
|
|
||||||
"""编辑后的新内容"""
|
|
||||||
|
|
||||||
editor: User
|
|
||||||
"""编辑者"""
|
|
||||||
|
|
||||||
chat_type: ChatType
|
|
||||||
chat_id: typing.Union[int, str]
|
|
||||||
group: typing.Optional[Group] = None
|
|
||||||
```
|
|
||||||
|
|
||||||
#### MessageDeletedEvent (`message.deleted`)
|
|
||||||
|
|
||||||
消息被删除/撤回。
|
|
||||||
|
|
||||||
```python
|
|
||||||
class MessageDeletedEvent(Event):
|
|
||||||
"""消息被删除/撤回"""
|
|
||||||
|
|
||||||
type: str = "message.deleted"
|
|
||||||
|
|
||||||
message_id: typing.Union[int, str]
|
|
||||||
"""被删除的消息 ID"""
|
|
||||||
|
|
||||||
operator: typing.Optional[User] = None
|
|
||||||
"""操作者(可能是发送者自己撤回,也可能是管理员删除)"""
|
|
||||||
|
|
||||||
chat_type: ChatType
|
|
||||||
chat_id: typing.Union[int, str]
|
|
||||||
group: typing.Optional[Group] = None
|
|
||||||
```
|
|
||||||
|
|
||||||
#### MessageReactionEvent (`message.reaction`)
|
|
||||||
|
|
||||||
消息收到表情回应。
|
|
||||||
|
|
||||||
```python
|
|
||||||
class MessageReactionEvent(Event):
|
|
||||||
"""消息收到表情回应"""
|
|
||||||
|
|
||||||
type: str = "message.reaction"
|
|
||||||
|
|
||||||
message_id: typing.Union[int, str]
|
|
||||||
"""被回应的消息 ID"""
|
|
||||||
|
|
||||||
user: User
|
|
||||||
"""回应者"""
|
|
||||||
|
|
||||||
reaction: str
|
|
||||||
"""回应的表情标识(emoji 或平台特定表情 ID)"""
|
|
||||||
|
|
||||||
is_add: bool
|
|
||||||
"""True 为添加回应,False 为移除回应"""
|
|
||||||
|
|
||||||
chat_type: ChatType
|
|
||||||
chat_id: typing.Union[int, str]
|
|
||||||
group: typing.Optional[Group] = None
|
|
||||||
```
|
|
||||||
|
|
||||||
### 3.3 用户反馈事件
|
|
||||||
|
|
||||||
#### FeedbackReceivedEvent (`feedback.received`)
|
|
||||||
|
|
||||||
用户对 Bot 回复提交反馈。该事件用于承载平台提供的点赞、点踩、取消反馈以及点踩原因等评价信息;典型来源包括企业微信 AI Bot 的 `feedback_event`、飞书卡片按钮回调、Web Embed 的反馈入口等。
|
|
||||||
|
|
||||||
```python
|
|
||||||
class FeedbackReceivedEvent(Event):
|
|
||||||
"""收到用户反馈"""
|
|
||||||
|
|
||||||
type: str = "feedback.received"
|
|
||||||
|
|
||||||
feedback_id: str
|
|
||||||
"""平台侧反馈 ID,用于幂等记录或取消反馈"""
|
|
||||||
|
|
||||||
feedback_type: int
|
|
||||||
"""1 = like, 2 = dislike, 3 = cancel/remove feedback"""
|
|
||||||
|
|
||||||
feedback_content: typing.Optional[str] = None
|
|
||||||
"""用户填写的自由文本反馈"""
|
|
||||||
|
|
||||||
inaccurate_reasons: typing.Optional[list[str]] = None
|
|
||||||
"""点踩时平台提供的预设不准确原因"""
|
|
||||||
|
|
||||||
user_id: typing.Optional[str] = None
|
|
||||||
"""提交反馈的用户 ID"""
|
|
||||||
|
|
||||||
session_id: typing.Optional[str] = None
|
|
||||||
"""会话 ID,例如 person_xxx 或 group_xxx"""
|
|
||||||
|
|
||||||
message_id: typing.Optional[str] = None
|
|
||||||
"""被评价的 Bot 回复消息 ID"""
|
|
||||||
|
|
||||||
stream_id: typing.Optional[str] = None
|
|
||||||
"""流式回复 ID,用于关联 streaming response"""
|
|
||||||
```
|
|
||||||
|
|
||||||
设计约定:
|
|
||||||
|
|
||||||
- `feedback_id` 是幂等键;同一个 `feedback_id` 的后续事件应更新已有记录。
|
|
||||||
- `feedback_type == 3` 表示用户取消/移除反馈,处理器可删除对应记录或标记为取消。
|
|
||||||
- 如果平台只能给出原始回调 payload,差异字段保留在 `source_platform_object` 或 `PlatformSpecificEvent.data` 中;通用字段仍优先映射到 `FeedbackReceivedEvent`。
|
|
||||||
- 该事件保留向后兼容映射:EBA 事件可转换为旧的 `FeedbackEvent`,字段语义保持一致。
|
|
||||||
|
|
||||||
### 3.4 群组事件
|
|
||||||
|
|
||||||
#### MemberJoinedEvent (`group.member_joined`)
|
|
||||||
|
|
||||||
新成员加入群组。
|
|
||||||
|
|
||||||
```python
|
|
||||||
class MemberJoinedEvent(Event):
|
|
||||||
"""新成员加入群组"""
|
|
||||||
|
|
||||||
type: str = "group.member_joined"
|
|
||||||
|
|
||||||
group: Group
|
|
||||||
"""群组"""
|
|
||||||
|
|
||||||
member: User
|
|
||||||
"""加入的成员"""
|
|
||||||
|
|
||||||
inviter: typing.Optional[User] = None
|
|
||||||
"""邀请者(如有)"""
|
|
||||||
|
|
||||||
join_type: typing.Optional[str] = None
|
|
||||||
"""加入方式:'invite' / 'request' / 'direct' / None"""
|
|
||||||
```
|
|
||||||
|
|
||||||
#### MemberLeftEvent (`group.member_left`)
|
|
||||||
|
|
||||||
成员离开群组。
|
|
||||||
|
|
||||||
```python
|
|
||||||
class MemberLeftEvent(Event):
|
|
||||||
"""成员离开群组"""
|
|
||||||
|
|
||||||
type: str = "group.member_left"
|
|
||||||
|
|
||||||
group: Group
|
|
||||||
member: User
|
|
||||||
|
|
||||||
is_kicked: bool = False
|
|
||||||
"""是否被踢出"""
|
|
||||||
|
|
||||||
operator: typing.Optional[User] = None
|
|
||||||
"""操作者(踢出时为管理员)"""
|
|
||||||
```
|
|
||||||
|
|
||||||
#### MemberBannedEvent (`group.member_banned`)
|
|
||||||
|
|
||||||
成员被禁言。
|
|
||||||
|
|
||||||
```python
|
|
||||||
class MemberBannedEvent(Event):
|
|
||||||
"""成员被禁言"""
|
|
||||||
|
|
||||||
type: str = "group.member_banned"
|
|
||||||
|
|
||||||
group: Group
|
|
||||||
member: User
|
|
||||||
operator: typing.Optional[User] = None
|
|
||||||
duration: typing.Optional[int] = None
|
|
||||||
"""禁言时长(秒),None 表示永久"""
|
|
||||||
```
|
|
||||||
|
|
||||||
#### MemberUnbannedEvent (`group.member_unbanned`)
|
|
||||||
|
|
||||||
成员被解除禁言。
|
|
||||||
|
|
||||||
```python
|
|
||||||
class MemberUnbannedEvent(Event):
|
|
||||||
"""成员被解除禁言"""
|
|
||||||
|
|
||||||
type: str = "group.member_unbanned"
|
|
||||||
|
|
||||||
group: Group
|
|
||||||
member: User
|
|
||||||
operator: typing.Optional[User] = None
|
|
||||||
```
|
|
||||||
|
|
||||||
#### GroupInfoUpdatedEvent (`group.info_updated`)
|
|
||||||
|
|
||||||
群组信息被修改。
|
|
||||||
|
|
||||||
```python
|
|
||||||
class GroupInfoUpdatedEvent(Event):
|
|
||||||
"""群组信息被修改"""
|
|
||||||
|
|
||||||
type: str = "group.info_updated"
|
|
||||||
|
|
||||||
group: Group
|
|
||||||
"""更新后的群组信息"""
|
|
||||||
|
|
||||||
operator: typing.Optional[User] = None
|
|
||||||
"""操作者"""
|
|
||||||
|
|
||||||
changed_fields: list[str] = []
|
|
||||||
"""发生变更的字段名列表,如 ['name', 'description']"""
|
|
||||||
```
|
|
||||||
|
|
||||||
### 3.5 好友事件
|
|
||||||
|
|
||||||
#### FriendRequestReceivedEvent (`friend.request_received`)
|
|
||||||
|
|
||||||
收到好友请求。
|
|
||||||
|
|
||||||
```python
|
|
||||||
class FriendRequestReceivedEvent(Event):
|
|
||||||
"""收到好友请求"""
|
|
||||||
|
|
||||||
type: str = "friend.request_received"
|
|
||||||
|
|
||||||
request_id: typing.Union[int, str]
|
|
||||||
"""请求 ID,用于后续 approve/reject 操作"""
|
|
||||||
|
|
||||||
user: User
|
|
||||||
"""请求者"""
|
|
||||||
|
|
||||||
message: typing.Optional[str] = None
|
|
||||||
"""验证消息"""
|
|
||||||
```
|
|
||||||
|
|
||||||
#### FriendAddedEvent (`friend.added`)
|
|
||||||
|
|
||||||
成功添加好友。
|
|
||||||
|
|
||||||
```python
|
|
||||||
class FriendAddedEvent(Event):
|
|
||||||
"""成功添加好友"""
|
|
||||||
|
|
||||||
type: str = "friend.added"
|
|
||||||
|
|
||||||
user: User
|
|
||||||
"""新好友"""
|
|
||||||
```
|
|
||||||
|
|
||||||
#### FriendRemovedEvent (`friend.removed`)
|
|
||||||
|
|
||||||
好友被移除。
|
|
||||||
|
|
||||||
```python
|
|
||||||
class FriendRemovedEvent(Event):
|
|
||||||
"""好友被移除"""
|
|
||||||
|
|
||||||
type: str = "friend.removed"
|
|
||||||
|
|
||||||
user: User
|
|
||||||
"""被移除的好友"""
|
|
||||||
```
|
|
||||||
|
|
||||||
### 3.6 Bot 状态事件
|
|
||||||
|
|
||||||
#### BotInvitedToGroupEvent (`bot.invited_to_group`)
|
|
||||||
|
|
||||||
Bot 被邀请加入群组。
|
|
||||||
|
|
||||||
```python
|
|
||||||
class BotInvitedToGroupEvent(Event):
|
|
||||||
"""Bot 被邀请加入群组"""
|
|
||||||
|
|
||||||
type: str = "bot.invited_to_group"
|
|
||||||
|
|
||||||
group: Group
|
|
||||||
inviter: typing.Optional[User] = None
|
|
||||||
|
|
||||||
request_id: typing.Optional[typing.Union[int, str]] = None
|
|
||||||
"""邀请请求 ID,某些平台需要 Bot 确认才加入"""
|
|
||||||
```
|
|
||||||
|
|
||||||
#### BotRemovedFromGroupEvent (`bot.removed_from_group`)
|
|
||||||
|
|
||||||
Bot 被移出群组。
|
|
||||||
|
|
||||||
```python
|
|
||||||
class BotRemovedFromGroupEvent(Event):
|
|
||||||
"""Bot 被移出群组"""
|
|
||||||
|
|
||||||
type: str = "bot.removed_from_group"
|
|
||||||
|
|
||||||
group: Group
|
|
||||||
operator: typing.Optional[User] = None
|
|
||||||
```
|
|
||||||
|
|
||||||
#### BotMutedEvent / BotUnmutedEvent (`bot.muted` / `bot.unmuted`)
|
|
||||||
|
|
||||||
Bot 被禁言/解除禁言。
|
|
||||||
|
|
||||||
```python
|
|
||||||
class BotMutedEvent(Event):
|
|
||||||
"""Bot 被禁言"""
|
|
||||||
|
|
||||||
type: str = "bot.muted"
|
|
||||||
|
|
||||||
group: Group
|
|
||||||
operator: typing.Optional[User] = None
|
|
||||||
duration: typing.Optional[int] = None
|
|
||||||
|
|
||||||
|
|
||||||
class BotUnmutedEvent(Event):
|
|
||||||
"""Bot 被解除禁言"""
|
|
||||||
|
|
||||||
type: str = "bot.unmuted"
|
|
||||||
|
|
||||||
group: Group
|
|
||||||
operator: typing.Optional[User] = None
|
|
||||||
```
|
|
||||||
|
|
||||||
### 3.7 平台特有事件
|
|
||||||
|
|
||||||
对于无法抽象为通用事件的平台特有事件,使用统一的 `PlatformSpecificEvent` 承载:
|
|
||||||
|
|
||||||
```python
|
|
||||||
class PlatformSpecificEvent(Event):
|
|
||||||
"""平台特有事件
|
|
||||||
|
|
||||||
适配器无法映射到通用事件类型时,使用此类型承载。
|
|
||||||
插件可以通过 adapter_name + action 来识别和处理。
|
|
||||||
"""
|
|
||||||
|
|
||||||
type: str = "platform.specific"
|
|
||||||
|
|
||||||
action: str
|
|
||||||
"""平台特有的事件动作标识,如 'channel_created', 'pin_message'"""
|
|
||||||
|
|
||||||
data: dict = {}
|
|
||||||
"""事件数据,结构由具体适配器定义"""
|
|
||||||
```
|
|
||||||
|
|
||||||
事件类型字符串格式为 `platform.{adapter_name}.{action}`,例如:
|
|
||||||
- `platform.telegram.chat_member_updated` — Telegram 的群成员信息更新
|
|
||||||
- `platform.discord.channel_created` — Discord 的频道创建
|
|
||||||
- `platform.discord.voice_state_update` — Discord 的语音状态变更
|
|
||||||
- `platform.slack.app_home_opened` — Slack 的 App Home 打开
|
|
||||||
|
|
||||||
## 4. 各平台事件支持矩阵
|
|
||||||
|
|
||||||
下表标注各通用事件在主要平台上的支持情况:
|
|
||||||
|
|
||||||
| 事件 | Telegram | Discord | OneBot(QQ) | 飞书 | 钉钉 | Slack | 微信 | LINE | KOOK |
|
|
||||||
|------|----------|---------|-----------|------|------|-------|------|------|------|
|
|
||||||
| `message.received` | Y | Y | Y | Y | Y | Y | Y | Y | Y |
|
|
||||||
| `message.edited` | Y | Y | N | Y | N | Y | N | N | Y |
|
|
||||||
| `message.deleted` | Y | Y | Y | Y | N | Y | Y | N | Y |
|
|
||||||
| `message.reaction` | Y | Y | Y | Y | Y | Y | N | N | Y |
|
|
||||||
| `feedback.received` | N | N | N | Y | N | N | Y | N | N |
|
|
||||||
| `group.member_joined` | Y | Y | Y | Y | Y | Y | Y | Y | Y |
|
|
||||||
| `group.member_left` | Y | Y | Y | Y | Y | Y | Y | Y | Y |
|
|
||||||
| `group.member_banned` | Y | Y | Y | N | N | N | N | N | N |
|
|
||||||
| `group.info_updated` | Y | Y | Y | Y | Y | Y | N | N | Y |
|
|
||||||
| `friend.request_received` | N | Y | Y | N | N | N | Y | Y | Y |
|
|
||||||
| `friend.added` | N | Y | Y | N | N | N | Y | Y | N |
|
|
||||||
| `bot.invited_to_group` | Y | Y | Y | Y | Y | Y | Y | N | Y |
|
|
||||||
| `bot.removed_from_group` | Y | Y | Y | Y | N | N | Y | N | Y |
|
|
||||||
| `bot.muted` | Y | N | Y | N | N | N | N | N | N |
|
|
||||||
| `bot.unmuted` | Y | N | Y | N | N | N | N | N | N |
|
|
||||||
| `platform.specific` | Y | Y | Y | Y | Y | Y | Y | Y | Y |
|
|
||||||
|
|
||||||
> 注:此表为初步评估,具体以各平台 SDK/API 文档为准,实施时逐个确认。
|
|
||||||
|
|
||||||
## 5. 事件生命周期
|
|
||||||
|
|
||||||
```
|
|
||||||
1. 平台 SDK 回调触发
|
|
||||||
│
|
|
||||||
2. 适配器 EventConverter.target2yiri(raw_event)
|
|
||||||
│ 将平台原生事件转换为统一 Event 对象
|
|
||||||
│ 无法映射的事件 → PlatformSpecificEvent
|
|
||||||
│
|
|
||||||
3. 适配器回调注册的 listener(event, adapter)
|
|
||||||
│
|
|
||||||
4. RuntimeBot 接收事件
|
|
||||||
│
|
|
||||||
5. EventBus 分发
|
|
||||||
│
|
|
||||||
6. EventRouter 查询 Bot 的 event_handlers 配置
|
|
||||||
│ 匹配事件类型 → 找到对应的 Handler
|
|
||||||
│ 支持通配符:'message.*' 匹配所有消息事件
|
|
||||||
│ 未匹配到 → 走默认 Handler(plugin,保持向后兼容)
|
|
||||||
│
|
|
||||||
7. Handler 处理事件
|
|
||||||
│ PipelineHandler → 进入 Pipeline 流水线
|
|
||||||
│ AgentHandler → 调用 RequestRunner
|
|
||||||
│ WebhookHandler → POST 到外部 URL
|
|
||||||
│ PluginHandler → 分发给插件 EventListener
|
|
||||||
│
|
|
||||||
8. Handler 执行完毕,可能通过 API 执行响应动作
|
|
||||||
(发消息、编辑消息、踢人、同意好友请求等)
|
|
||||||
```
|
|
||||||
|
|
||||||
## 6. 与现有事件类型的兼容映射
|
|
||||||
|
|
||||||
为保证现有插件不受影响,建立以下映射关系:
|
|
||||||
|
|
||||||
| 新事件 | 条件 | 旧事件 |
|
|
||||||
|--------|------|--------|
|
|
||||||
| `MessageReceivedEvent` (chat_type=private) | — | `FriendMessage` |
|
|
||||||
| `MessageReceivedEvent` (chat_type=group) | — | `GroupMessage` |
|
|
||||||
|
|
||||||
在插件 SDK 层面:
|
|
||||||
|
|
||||||
| 新事件 | 旧插件事件 |
|
|
||||||
|--------|-----------|
|
|
||||||
| `MessageReceivedEvent` (chat_type=private, 非命令) | `PersonNormalMessageReceived` |
|
|
||||||
| `MessageReceivedEvent` (chat_type=group, 非命令) | `GroupNormalMessageReceived` |
|
|
||||||
| `MessageReceivedEvent` (chat_type=private, 命令) | `PersonCommandSent` |
|
|
||||||
| `MessageReceivedEvent` (chat_type=group, 命令) | `GroupCommandSent` |
|
|
||||||
| `MessageReceivedEvent` (处理完毕后) | `NormalMessageResponded` |
|
|
||||||
|
|
||||||
兼容层在事件分发给插件 EventListener 时自动生成旧格式事件,确保监听旧事件类型的插件仍能正常工作。
|
|
||||||
|
|
||||||
## 7. 事件类型注册表
|
|
||||||
|
|
||||||
适配器在 manifest.yaml 中声明自己支持的事件类型:
|
|
||||||
|
|
||||||
```yaml
|
|
||||||
kind: MessagePlatformAdapter
|
|
||||||
metadata:
|
|
||||||
name: telegram
|
|
||||||
spec:
|
|
||||||
supported_events:
|
|
||||||
- message.received
|
|
||||||
- message.edited
|
|
||||||
- message.deleted
|
|
||||||
- message.reaction
|
|
||||||
- feedback.received
|
|
||||||
- group.member_joined
|
|
||||||
- group.member_left
|
|
||||||
- group.member_banned
|
|
||||||
- group.info_updated
|
|
||||||
- bot.invited_to_group
|
|
||||||
- bot.removed_from_group
|
|
||||||
- bot.muted
|
|
||||||
- bot.unmuted
|
|
||||||
- platform.specific
|
|
||||||
platform_specific_events:
|
|
||||||
- chat_member_updated
|
|
||||||
- chat_join_request
|
|
||||||
```
|
|
||||||
|
|
||||||
这份声明用于:
|
|
||||||
1. WebUI 在配置事件处理器时,只显示当前 Bot 的适配器支持的事件类型
|
|
||||||
2. EventRouter 在路由时校验事件类型有效性
|
|
||||||
3. 文档自动生成
|
|
||||||
@@ -1,546 +0,0 @@
|
|||||||
# 统一平台 API 与实体定义
|
|
||||||
|
|
||||||
## 1. 设计原则
|
|
||||||
|
|
||||||
- **通用 API 抽象**:大部分平台都支持的操作(发消息、获取群信息等)定义为通用 API 方法
|
|
||||||
- **required / optional 标记**:每个 API 标记为必需或可选,适配器未实现可选 API 时抛出 `NotSupportedError`
|
|
||||||
- **透传机制**:适配器特有的操作通过 `call_platform_api(action, params)` 统一入口透传调用
|
|
||||||
- **能力声明**:适配器在 manifest 中声明自己支持的 API 列表,供 WebUI 和插件查询
|
|
||||||
- **实体统一**:通用实体(User、Group 等)在 SDK 层面统一定义,适配器负责转换
|
|
||||||
|
|
||||||
## 2. 通用实体定义
|
|
||||||
|
|
||||||
### 2.1 现有实体回顾
|
|
||||||
|
|
||||||
当前 SDK 已有以下实体(`langbot_plugin/api/entities/builtin/platform/entities.py`):
|
|
||||||
|
|
||||||
```python
|
|
||||||
Entity(id)
|
|
||||||
├── Friend(id, nickname, remark)
|
|
||||||
├── Group(id, name, permission)
|
|
||||||
└── GroupMember(id, member_name, permission, group, special_title)
|
|
||||||
```
|
|
||||||
|
|
||||||
### 2.2 新实体设计
|
|
||||||
|
|
||||||
扩展实体体系,保持向后兼容:
|
|
||||||
|
|
||||||
```python
|
|
||||||
class User(pydantic.BaseModel):
|
|
||||||
"""用户实体(统一表示)"""
|
|
||||||
|
|
||||||
id: typing.Union[int, str]
|
|
||||||
"""用户 ID"""
|
|
||||||
|
|
||||||
nickname: str = ""
|
|
||||||
"""昵称"""
|
|
||||||
|
|
||||||
avatar_url: typing.Optional[str] = None
|
|
||||||
"""头像 URL"""
|
|
||||||
|
|
||||||
is_bot: bool = False
|
|
||||||
"""是否为 Bot"""
|
|
||||||
|
|
||||||
# 以下为可选的扩展信息,不同平台可能部分为空
|
|
||||||
username: typing.Optional[str] = None
|
|
||||||
"""用户名(如 Telegram 的 @username)"""
|
|
||||||
|
|
||||||
remark: typing.Optional[str] = None
|
|
||||||
"""备注名"""
|
|
||||||
|
|
||||||
|
|
||||||
class Group(pydantic.BaseModel):
|
|
||||||
"""群组实体"""
|
|
||||||
|
|
||||||
id: typing.Union[int, str]
|
|
||||||
"""群组 ID"""
|
|
||||||
|
|
||||||
name: str = ""
|
|
||||||
"""群组名称"""
|
|
||||||
|
|
||||||
description: typing.Optional[str] = None
|
|
||||||
"""群组描述"""
|
|
||||||
|
|
||||||
member_count: typing.Optional[int] = None
|
|
||||||
"""成员数量"""
|
|
||||||
|
|
||||||
avatar_url: typing.Optional[str] = None
|
|
||||||
"""群组头像 URL"""
|
|
||||||
|
|
||||||
owner_id: typing.Optional[typing.Union[int, str]] = None
|
|
||||||
"""群主 ID"""
|
|
||||||
|
|
||||||
|
|
||||||
class GroupMember(pydantic.BaseModel):
|
|
||||||
"""群成员实体"""
|
|
||||||
|
|
||||||
user: User
|
|
||||||
"""用户信息"""
|
|
||||||
|
|
||||||
group_id: typing.Union[int, str]
|
|
||||||
"""所属群组 ID"""
|
|
||||||
|
|
||||||
role: MemberRole
|
|
||||||
"""群内角色"""
|
|
||||||
|
|
||||||
display_name: typing.Optional[str] = None
|
|
||||||
"""群内显示名"""
|
|
||||||
|
|
||||||
joined_at: typing.Optional[float] = None
|
|
||||||
"""加入群组的时间戳"""
|
|
||||||
|
|
||||||
title: typing.Optional[str] = None
|
|
||||||
"""群头衔/特殊称号"""
|
|
||||||
|
|
||||||
|
|
||||||
class MemberRole(str, Enum):
|
|
||||||
"""群成员角色"""
|
|
||||||
OWNER = "owner"
|
|
||||||
ADMIN = "admin"
|
|
||||||
MEMBER = "member"
|
|
||||||
```
|
|
||||||
|
|
||||||
### 2.3 与现有实体的兼容映射
|
|
||||||
|
|
||||||
| 新实体 | 旧实体 | 映射方式 |
|
|
||||||
|--------|--------|----------|
|
|
||||||
| `User` | `Friend` | `User(id=friend.id, nickname=friend.nickname, remark=friend.remark)` |
|
|
||||||
| `Group` | `Group`(旧) | `Group(id=old.id, name=old.name)` + `permission` 字段弃用 |
|
|
||||||
| `GroupMember` | `GroupMember`(旧) | `GroupMember(user=User(...), role=..., display_name=old.member_name)` |
|
|
||||||
| `MemberRole` | `Permission` | `OWNER↔Owner`, `ADMIN↔Administrator`, `MEMBER↔Member` |
|
|
||||||
|
|
||||||
旧实体类保留,标记为 `@deprecated`,内部通过转换方法桥接到新实体。
|
|
||||||
|
|
||||||
## 3. 通用 API 定义
|
|
||||||
|
|
||||||
### 3.1 API 方法一览
|
|
||||||
|
|
||||||
#### 消息 API
|
|
||||||
|
|
||||||
| 方法 | 必需/可选 | 说明 |
|
|
||||||
|------|----------|------|
|
|
||||||
| `send_message(target_type, target_id, message)` | **必需** | 主动发送消息 |
|
|
||||||
| `reply_message(event, message, quote_origin)` | **必需** | 回复一个消息事件 |
|
|
||||||
| `edit_message(chat_type, chat_id, message_id, new_content)` | 可选 | 编辑已发送的消息 |
|
|
||||||
| `delete_message(chat_type, chat_id, message_id)` | 可选 | 删除/撤回消息 |
|
|
||||||
| `forward_message(from_chat, message_id, to_chat_type, to_chat_id)` | 可选 | 转发消息到另一个会话 |
|
|
||||||
| `get_message(chat_type, chat_id, message_id)` | 可选 | 获取指定消息的内容 |
|
|
||||||
|
|
||||||
#### 群组 API
|
|
||||||
|
|
||||||
| 方法 | 必需/可选 | 说明 |
|
|
||||||
|------|----------|------|
|
|
||||||
| `get_group_info(group_id)` | 可选 | 获取群组信息 |
|
|
||||||
| `get_group_list()` | 可选 | 获取 Bot 加入的群组列表 |
|
|
||||||
| `get_group_member_list(group_id)` | 可选 | 获取群成员列表 |
|
|
||||||
| `get_group_member_info(group_id, user_id)` | 可选 | 获取指定群成员信息 |
|
|
||||||
| `set_group_name(group_id, name)` | 可选 | 修改群名称 |
|
|
||||||
| `mute_member(group_id, user_id, duration)` | 可选 | 禁言群成员 |
|
|
||||||
| `unmute_member(group_id, user_id)` | 可选 | 解除禁言 |
|
|
||||||
| `kick_member(group_id, user_id)` | 可选 | 踢出群成员 |
|
|
||||||
| `leave_group(group_id)` | 可选 | Bot 退出群组 |
|
|
||||||
|
|
||||||
#### 用户 API
|
|
||||||
|
|
||||||
| 方法 | 必需/可选 | 说明 |
|
|
||||||
|------|----------|------|
|
|
||||||
| `get_user_info(user_id)` | 可选 | 获取用户信息 |
|
|
||||||
| `get_friend_list()` | 可选 | 获取好友列表 |
|
|
||||||
| `approve_friend_request(request_id, approve, remark)` | 可选 | 处理好友请求 |
|
|
||||||
| `approve_group_invite(request_id, approve)` | 可选 | 处理入群邀请 |
|
|
||||||
|
|
||||||
#### 媒体 API
|
|
||||||
|
|
||||||
| 方法 | 必需/可选 | 说明 |
|
|
||||||
|------|----------|------|
|
|
||||||
| `upload_file(file_data, filename)` | 可选 | 上传文件,返回可引用的文件 ID 或 URL |
|
|
||||||
| `get_file_url(file_id)` | 可选 | 获取文件下载 URL |
|
|
||||||
|
|
||||||
#### 透传 API
|
|
||||||
|
|
||||||
| 方法 | 必需/可选 | 说明 |
|
|
||||||
|------|----------|------|
|
|
||||||
| `call_platform_api(action, params)` | 可选 | 调用适配器特有 API |
|
|
||||||
|
|
||||||
### 3.2 API 方法签名详解
|
|
||||||
|
|
||||||
```python
|
|
||||||
class AbstractPlatformAdapter(pydantic.BaseModel, metaclass=abc.ABCMeta):
|
|
||||||
"""平台适配器基类(新版)"""
|
|
||||||
|
|
||||||
# ======== 必需方法 ========
|
|
||||||
|
|
||||||
@abc.abstractmethod
|
|
||||||
async def send_message(
|
|
||||||
self,
|
|
||||||
target_type: str, # "private" | "group"
|
|
||||||
target_id: typing.Union[int, str],
|
|
||||||
message: MessageChain,
|
|
||||||
) -> MessageResult:
|
|
||||||
"""主动发送消息
|
|
||||||
|
|
||||||
Returns:
|
|
||||||
MessageResult: 包含 message_id 等发送结果
|
|
||||||
"""
|
|
||||||
...
|
|
||||||
|
|
||||||
@abc.abstractmethod
|
|
||||||
async def reply_message(
|
|
||||||
self,
|
|
||||||
event: MessageReceivedEvent,
|
|
||||||
message: MessageChain,
|
|
||||||
quote_origin: bool = False,
|
|
||||||
) -> MessageResult:
|
|
||||||
"""回复一个消息事件"""
|
|
||||||
...
|
|
||||||
|
|
||||||
# ======== 可选消息方法 ========
|
|
||||||
|
|
||||||
async def edit_message(
|
|
||||||
self,
|
|
||||||
chat_type: str,
|
|
||||||
chat_id: typing.Union[int, str],
|
|
||||||
message_id: typing.Union[int, str],
|
|
||||||
new_content: MessageChain,
|
|
||||||
) -> None:
|
|
||||||
"""编辑已发送的消息"""
|
|
||||||
raise NotSupportedError("edit_message")
|
|
||||||
|
|
||||||
async def delete_message(
|
|
||||||
self,
|
|
||||||
chat_type: str,
|
|
||||||
chat_id: typing.Union[int, str],
|
|
||||||
message_id: typing.Union[int, str],
|
|
||||||
) -> None:
|
|
||||||
"""删除/撤回消息"""
|
|
||||||
raise NotSupportedError("delete_message")
|
|
||||||
|
|
||||||
async def forward_message(
|
|
||||||
self,
|
|
||||||
from_chat_type: str,
|
|
||||||
from_chat_id: typing.Union[int, str],
|
|
||||||
message_id: typing.Union[int, str],
|
|
||||||
to_chat_type: str,
|
|
||||||
to_chat_id: typing.Union[int, str],
|
|
||||||
) -> MessageResult:
|
|
||||||
"""转发消息"""
|
|
||||||
raise NotSupportedError("forward_message")
|
|
||||||
|
|
||||||
async def get_message(
|
|
||||||
self,
|
|
||||||
chat_type: str,
|
|
||||||
chat_id: typing.Union[int, str],
|
|
||||||
message_id: typing.Union[int, str],
|
|
||||||
) -> MessageReceivedEvent:
|
|
||||||
"""获取指定消息"""
|
|
||||||
raise NotSupportedError("get_message")
|
|
||||||
|
|
||||||
# ======== 可选群组方法 ========
|
|
||||||
|
|
||||||
async def get_group_info(
|
|
||||||
self,
|
|
||||||
group_id: typing.Union[int, str],
|
|
||||||
) -> Group:
|
|
||||||
"""获取群组信息"""
|
|
||||||
raise NotSupportedError("get_group_info")
|
|
||||||
|
|
||||||
async def get_group_list(self) -> list[Group]:
|
|
||||||
"""获取 Bot 加入的群组列表"""
|
|
||||||
raise NotSupportedError("get_group_list")
|
|
||||||
|
|
||||||
async def get_group_member_list(
|
|
||||||
self,
|
|
||||||
group_id: typing.Union[int, str],
|
|
||||||
) -> list[GroupMember]:
|
|
||||||
"""获取群成员列表"""
|
|
||||||
raise NotSupportedError("get_group_member_list")
|
|
||||||
|
|
||||||
async def get_group_member_info(
|
|
||||||
self,
|
|
||||||
group_id: typing.Union[int, str],
|
|
||||||
user_id: typing.Union[int, str],
|
|
||||||
) -> GroupMember:
|
|
||||||
"""获取指定群成员信息"""
|
|
||||||
raise NotSupportedError("get_group_member_info")
|
|
||||||
|
|
||||||
async def set_group_name(
|
|
||||||
self,
|
|
||||||
group_id: typing.Union[int, str],
|
|
||||||
name: str,
|
|
||||||
) -> None:
|
|
||||||
"""修改群名称"""
|
|
||||||
raise NotSupportedError("set_group_name")
|
|
||||||
|
|
||||||
async def mute_member(
|
|
||||||
self,
|
|
||||||
group_id: typing.Union[int, str],
|
|
||||||
user_id: typing.Union[int, str],
|
|
||||||
duration: int = 0,
|
|
||||||
) -> None:
|
|
||||||
"""禁言群成员,duration 为秒数,0 表示永久"""
|
|
||||||
raise NotSupportedError("mute_member")
|
|
||||||
|
|
||||||
async def unmute_member(
|
|
||||||
self,
|
|
||||||
group_id: typing.Union[int, str],
|
|
||||||
user_id: typing.Union[int, str],
|
|
||||||
) -> None:
|
|
||||||
"""解除禁言"""
|
|
||||||
raise NotSupportedError("unmute_member")
|
|
||||||
|
|
||||||
async def kick_member(
|
|
||||||
self,
|
|
||||||
group_id: typing.Union[int, str],
|
|
||||||
user_id: typing.Union[int, str],
|
|
||||||
) -> None:
|
|
||||||
"""踢出群成员"""
|
|
||||||
raise NotSupportedError("kick_member")
|
|
||||||
|
|
||||||
async def leave_group(
|
|
||||||
self,
|
|
||||||
group_id: typing.Union[int, str],
|
|
||||||
) -> None:
|
|
||||||
"""Bot 退出群组"""
|
|
||||||
raise NotSupportedError("leave_group")
|
|
||||||
|
|
||||||
# ======== 可选用户方法 ========
|
|
||||||
|
|
||||||
async def get_user_info(
|
|
||||||
self,
|
|
||||||
user_id: typing.Union[int, str],
|
|
||||||
) -> User:
|
|
||||||
"""获取用户信息"""
|
|
||||||
raise NotSupportedError("get_user_info")
|
|
||||||
|
|
||||||
async def get_friend_list(self) -> list[User]:
|
|
||||||
"""获取好友列表"""
|
|
||||||
raise NotSupportedError("get_friend_list")
|
|
||||||
|
|
||||||
async def approve_friend_request(
|
|
||||||
self,
|
|
||||||
request_id: typing.Union[int, str],
|
|
||||||
approve: bool = True,
|
|
||||||
remark: typing.Optional[str] = None,
|
|
||||||
) -> None:
|
|
||||||
"""处理好友请求"""
|
|
||||||
raise NotSupportedError("approve_friend_request")
|
|
||||||
|
|
||||||
async def approve_group_invite(
|
|
||||||
self,
|
|
||||||
request_id: typing.Union[int, str],
|
|
||||||
approve: bool = True,
|
|
||||||
) -> None:
|
|
||||||
"""处理入群邀请"""
|
|
||||||
raise NotSupportedError("approve_group_invite")
|
|
||||||
|
|
||||||
# ======== 可选媒体方法 ========
|
|
||||||
|
|
||||||
async def upload_file(
|
|
||||||
self,
|
|
||||||
file_data: bytes,
|
|
||||||
filename: str,
|
|
||||||
) -> str:
|
|
||||||
"""上传文件,返回文件 ID 或 URL"""
|
|
||||||
raise NotSupportedError("upload_file")
|
|
||||||
|
|
||||||
async def get_file_url(
|
|
||||||
self,
|
|
||||||
file_id: str,
|
|
||||||
) -> str:
|
|
||||||
"""获取文件下载 URL"""
|
|
||||||
raise NotSupportedError("get_file_url")
|
|
||||||
|
|
||||||
# ======== 透传 API ========
|
|
||||||
|
|
||||||
async def call_platform_api(
|
|
||||||
self,
|
|
||||||
action: str,
|
|
||||||
params: dict = {},
|
|
||||||
) -> dict:
|
|
||||||
"""调用适配器特有 API
|
|
||||||
|
|
||||||
Args:
|
|
||||||
action: 平台特有的 API 动作标识
|
|
||||||
params: 参数字典
|
|
||||||
|
|
||||||
Returns:
|
|
||||||
dict: 返回结果
|
|
||||||
|
|
||||||
Examples:
|
|
||||||
# Telegram: pin 消息
|
|
||||||
await adapter.call_platform_api("pin_message", {
|
|
||||||
"chat_id": 123456,
|
|
||||||
"message_id": 789
|
|
||||||
})
|
|
||||||
|
|
||||||
# Discord: 创建频道
|
|
||||||
await adapter.call_platform_api("create_channel", {
|
|
||||||
"guild_id": "...",
|
|
||||||
"name": "new-channel",
|
|
||||||
"type": "text"
|
|
||||||
})
|
|
||||||
"""
|
|
||||||
raise NotSupportedError("call_platform_api")
|
|
||||||
|
|
||||||
# ======== 流式输出(保留现有机制) ========
|
|
||||||
|
|
||||||
async def reply_message_chunk(
|
|
||||||
self,
|
|
||||||
event: MessageReceivedEvent,
|
|
||||||
bot_message: dict,
|
|
||||||
message: MessageChain,
|
|
||||||
quote_origin: bool = False,
|
|
||||||
is_final: bool = False,
|
|
||||||
):
|
|
||||||
"""流式回复消息"""
|
|
||||||
raise NotSupportedError("reply_message_chunk")
|
|
||||||
|
|
||||||
async def is_stream_output_supported(self) -> bool:
|
|
||||||
"""是否支持流式输出"""
|
|
||||||
return False
|
|
||||||
|
|
||||||
# ======== 生命周期方法(保留现有) ========
|
|
||||||
|
|
||||||
@abc.abstractmethod
|
|
||||||
async def run_async(self):
|
|
||||||
"""启动适配器"""
|
|
||||||
...
|
|
||||||
|
|
||||||
@abc.abstractmethod
|
|
||||||
async def kill(self) -> bool:
|
|
||||||
"""停止适配器"""
|
|
||||||
...
|
|
||||||
|
|
||||||
@abc.abstractmethod
|
|
||||||
def register_listener(self, event_type, callback):
|
|
||||||
"""注册事件监听器"""
|
|
||||||
...
|
|
||||||
|
|
||||||
@abc.abstractmethod
|
|
||||||
def unregister_listener(self, event_type, callback):
|
|
||||||
"""注销事件监听器"""
|
|
||||||
...
|
|
||||||
```
|
|
||||||
|
|
||||||
### 3.3 返回值类型
|
|
||||||
|
|
||||||
```python
|
|
||||||
class MessageResult(pydantic.BaseModel):
|
|
||||||
"""消息发送结果"""
|
|
||||||
|
|
||||||
message_id: typing.Optional[typing.Union[int, str]] = None
|
|
||||||
"""发送成功后的消息 ID"""
|
|
||||||
|
|
||||||
raw: typing.Optional[dict] = None
|
|
||||||
"""平台原始返回数据"""
|
|
||||||
|
|
||||||
|
|
||||||
class NotSupportedError(Exception):
|
|
||||||
"""适配器未实现此 API"""
|
|
||||||
|
|
||||||
def __init__(self, api_name: str):
|
|
||||||
self.api_name = api_name
|
|
||||||
super().__init__(f"API not supported by this adapter: {api_name}")
|
|
||||||
```
|
|
||||||
|
|
||||||
## 4. API 能力声明
|
|
||||||
|
|
||||||
适配器在 manifest.yaml 中声明支持的 API:
|
|
||||||
|
|
||||||
```yaml
|
|
||||||
kind: MessagePlatformAdapter
|
|
||||||
metadata:
|
|
||||||
name: telegram
|
|
||||||
spec:
|
|
||||||
supported_apis:
|
|
||||||
required:
|
|
||||||
- send_message
|
|
||||||
- reply_message
|
|
||||||
optional:
|
|
||||||
- edit_message
|
|
||||||
- delete_message
|
|
||||||
- get_group_info
|
|
||||||
- get_group_member_list
|
|
||||||
- get_user_info
|
|
||||||
- upload_file
|
|
||||||
- get_file_url
|
|
||||||
- call_platform_api
|
|
||||||
platform_specific_apis:
|
|
||||||
- action: pin_message
|
|
||||||
description: "Pin a message in a chat"
|
|
||||||
params_schema:
|
|
||||||
chat_id: { type: "string", required: true }
|
|
||||||
message_id: { type: "string", required: true }
|
|
||||||
- action: unpin_message
|
|
||||||
description: "Unpin a message"
|
|
||||||
params_schema:
|
|
||||||
chat_id: { type: "string", required: true }
|
|
||||||
message_id: { type: "string", required: true }
|
|
||||||
```
|
|
||||||
|
|
||||||
用途:
|
|
||||||
1. **WebUI**:在配置界面展示当前 Bot 可用的 API 能力
|
|
||||||
2. **插件**:插件可查询某个 Bot 是否支持特定 API,据此决定行为
|
|
||||||
3. **文档**:自动生成各适配器的 API 支持矩阵
|
|
||||||
|
|
||||||
## 5. 各平台 API 支持矩阵
|
|
||||||
|
|
||||||
| API | Telegram | Discord | OneBot(QQ) | 飞书 | 钉钉 | Slack | 微信 | LINE | KOOK |
|
|
||||||
|-----|----------|---------|-----------|------|------|-------|------|------|------|
|
|
||||||
| `send_message` | Y | Y | Y | Y | Y | Y | Y | Y | Y |
|
|
||||||
| `reply_message` | Y | Y | Y | Y | Y | Y | Y | Y | Y |
|
|
||||||
| `edit_message` | Y | Y | N | Y | N | Y | N | N | Y |
|
|
||||||
| `delete_message` | Y | Y | Y | Y | N | Y | Y | N | Y |
|
|
||||||
| `forward_message` | Y | N | Y | Y | N | N | Y | N | N |
|
|
||||||
| `get_group_info` | Y | Y | Y | Y | Y | Y | N | Y | Y |
|
|
||||||
| `get_group_member_list` | Y | Y | Y | Y | Y | Y | N | Y | Y |
|
|
||||||
| `get_user_info` | Y | Y | Y | Y | Y | Y | N | Y | Y |
|
|
||||||
| `get_friend_list` | N | Y | Y | N | N | N | Y | N | N |
|
|
||||||
| `mute_member` | Y | Y | Y | N | N | N | N | N | N |
|
|
||||||
| `kick_member` | Y | Y | Y | N | N | N | N | N | Y |
|
|
||||||
| `upload_file` | Y | Y | Y | Y | Y | Y | Y | Y | Y |
|
|
||||||
| `call_platform_api` | Y | Y | Y | Y | Y | Y | Y | Y | Y |
|
|
||||||
|
|
||||||
> 注:此表为初步评估,具体以各平台 SDK/API 文档为准。
|
|
||||||
|
|
||||||
## 6. MessageChain 扩展
|
|
||||||
|
|
||||||
### 6.1 保留的通用组件
|
|
||||||
|
|
||||||
以下 MessageComponent 类型保持不变,继续作为通用消息元素:
|
|
||||||
|
|
||||||
- `Source` — 消息元信息
|
|
||||||
- `Plain` — 纯文本
|
|
||||||
- `Quote` — 引用回复
|
|
||||||
- `At` / `AtAll` — @提及
|
|
||||||
- `Image` — 图片
|
|
||||||
- `Voice` — 语音
|
|
||||||
- `File` — 文件
|
|
||||||
- `Forward` — 合并转发
|
|
||||||
- `Face` — 表情
|
|
||||||
- `Unknown` — 未知类型
|
|
||||||
|
|
||||||
### 6.2 平台特有组件处理
|
|
||||||
|
|
||||||
当前 MessageChain 中存在大量微信特有的组件类型(`WeChatMiniPrograms`, `WeChatEmoji`, `WeChatLink` 等)。在新架构下:
|
|
||||||
|
|
||||||
- 这些类型**继续保留**在 SDK 中以保持兼容
|
|
||||||
- 新增的平台特有消息组件统一使用 `PlatformComponent` 基类:
|
|
||||||
|
|
||||||
```python
|
|
||||||
class PlatformComponent(MessageComponent):
|
|
||||||
"""平台特有的消息组件"""
|
|
||||||
|
|
||||||
type: str = "Platform"
|
|
||||||
|
|
||||||
platform: str
|
|
||||||
"""平台标识"""
|
|
||||||
|
|
||||||
component_type: str
|
|
||||||
"""组件类型"""
|
|
||||||
|
|
||||||
data: dict = {}
|
|
||||||
"""组件数据"""
|
|
||||||
```
|
|
||||||
|
|
||||||
适配器在转换消息链时,对于无法映射到通用组件的平台特有内容,使用 `PlatformComponent` 承载。
|
|
||||||
@@ -1,483 +0,0 @@
|
|||||||
# 适配器新目录结构
|
|
||||||
|
|
||||||
## 1. 设计目标
|
|
||||||
|
|
||||||
- **模块化**:每个适配器从单文件拆分到独立目录,各模块职责清晰
|
|
||||||
- **可维护**:随着事件和 API 的增加,代码量会显著增长,目录结构有助于管理复杂度
|
|
||||||
- **一致性**:所有适配器遵循相同的目录布局和文件命名约定
|
|
||||||
- **兼容现有发现机制**:保持 YAML manifest + ComponentDiscoveryEngine 的注册体系
|
|
||||||
|
|
||||||
## 2. 新目录布局
|
|
||||||
|
|
||||||
### 2.1 整体结构
|
|
||||||
|
|
||||||
```
|
|
||||||
pkg/platform/
|
|
||||||
├── __init__.py
|
|
||||||
├── botmgr.py # PlatformManager + RuntimeBot(重构)
|
|
||||||
├── event_bus.py # EventBus(新增)
|
|
||||||
├── event_router.py # EventRouter(新增)
|
|
||||||
├── logger.py # EventLogger(保留)
|
|
||||||
├── webhook_pusher.py # WebhookPusher(重构为 WebhookHandler)
|
|
||||||
│
|
|
||||||
├── adapters/ # 适配器(新目录)
|
|
||||||
│ ├── __init__.py
|
|
||||||
│ │
|
|
||||||
│ ├── telegram/
|
|
||||||
│ │ ├── __init__.py
|
|
||||||
│ │ ├── adapter.py # TelegramAdapter 主类
|
|
||||||
│ │ ├── event_converter.py # 平台事件 → 统一事件
|
|
||||||
│ │ ├── message_converter.py # MessageChain 互转
|
|
||||||
│ │ ├── api_impl.py # 通用 API 实现
|
|
||||||
│ │ ├── platform_api.py # call_platform_api 的动作映射
|
|
||||||
│ │ ├── types.py # 平台特有类型定义
|
|
||||||
│ │ └── manifest.yaml # 适配器清单
|
|
||||||
│ │
|
|
||||||
│ ├── discord/
|
|
||||||
│ │ ├── __init__.py
|
|
||||||
│ │ ├── adapter.py
|
|
||||||
│ │ ├── event_converter.py
|
|
||||||
│ │ ├── message_converter.py
|
|
||||||
│ │ ├── api_impl.py
|
|
||||||
│ │ ├── platform_api.py
|
|
||||||
│ │ ├── types.py
|
|
||||||
│ │ ├── voice.py # Discord 语音连接管理(特有)
|
|
||||||
│ │ └── manifest.yaml
|
|
||||||
│ │
|
|
||||||
│ ├── aiocqhttp/ # OneBot v11 (QQ)
|
|
||||||
│ │ └── ...
|
|
||||||
│ ├── qqofficial/
|
|
||||||
│ │ └── ...
|
|
||||||
│ ├── lark/ # 飞书
|
|
||||||
│ │ └── ...
|
|
||||||
│ ├── dingtalk/
|
|
||||||
│ │ └── ...
|
|
||||||
│ ├── slack/
|
|
||||||
│ │ └── ...
|
|
||||||
│ ├── wechatpad/
|
|
||||||
│ │ └── ...
|
|
||||||
│ ├── officialaccount/ # 微信公众号
|
|
||||||
│ │ └── ...
|
|
||||||
│ ├── wecom/ # 企业微信
|
|
||||||
│ │ └── ...
|
|
||||||
│ ├── wecombot/
|
|
||||||
│ │ └── ...
|
|
||||||
│ ├── wecomcs/
|
|
||||||
│ │ └── ...
|
|
||||||
│ ├── kook/
|
|
||||||
│ │ └── ...
|
|
||||||
│ ├── line/
|
|
||||||
│ │ └── ...
|
|
||||||
│ ├── satori/
|
|
||||||
│ │ └── ...
|
|
||||||
│ ├── websocket/ # 内置 WebSocket 适配器
|
|
||||||
│ │ ├── __init__.py
|
|
||||||
│ │ ├── adapter.py
|
|
||||||
│ │ ├── manager.py # WebSocket 连接管理
|
|
||||||
│ │ └── manifest.yaml
|
|
||||||
│ │
|
|
||||||
│ └── legacy/ # 旧版适配器(保留一段时间后移除)
|
|
||||||
│ ├── gewechat/
|
|
||||||
│ ├── nakuru/
|
|
||||||
│ └── qqbotpy/
|
|
||||||
│
|
|
||||||
└── handlers/ # 事件处理器实现(新增)
|
|
||||||
├── __init__.py
|
|
||||||
├── base.py # AbstractEventHandler 基类
|
|
||||||
├── pipeline_handler.py # PipelineHandler
|
|
||||||
├── agent_handler.py # AgentHandler
|
|
||||||
├── webhook_handler.py # WebhookHandler
|
|
||||||
└── plugin_handler.py # PluginHandler
|
|
||||||
```
|
|
||||||
|
|
||||||
### 2.2 适配器目录内各文件职责
|
|
||||||
|
|
||||||
以 Telegram 为例:
|
|
||||||
|
|
||||||
| 文件 | 职责 | 关键类/函数 |
|
|
||||||
|------|------|------------|
|
|
||||||
| `adapter.py` | 主入口,继承 `AbstractPlatformAdapter`,组装其他模块 | `TelegramAdapter` |
|
|
||||||
| `event_converter.py` | 将 Telegram 原生事件转换为统一事件类型 | `TelegramEventConverter` — 支持 Message/Edit/Delete/Reaction/MemberJoin 等所有事件 |
|
|
||||||
| `message_converter.py` | `MessageChain` 与 Telegram 消息格式互转 | `TelegramMessageConverter.yiri2target()` / `target2yiri()` |
|
|
||||||
| `api_impl.py` | 实现通用 API 方法(edit_message, delete_message, get_group_info 等) | 各 API 方法的 Telegram 实现 |
|
|
||||||
| `platform_api.py` | 实现 `call_platform_api` 的动作分发表 | `PLATFORM_API_MAP = {"pin_message": ..., "unpin_message": ...}` |
|
|
||||||
| `types.py` | 平台特有的类型定义 | Telegram 特有的枚举、配置结构等 |
|
|
||||||
| `manifest.yaml` | 适配器清单:名称、配置 schema、支持的事件和 API 列表 | — |
|
|
||||||
|
|
||||||
## 3. 新基类设计
|
|
||||||
|
|
||||||
### 3.1 AbstractPlatformAdapter
|
|
||||||
|
|
||||||
新基类继承自现有 `AbstractMessagePlatformAdapter` 并扩展,位于 `langbot-plugin-sdk` 中:
|
|
||||||
|
|
||||||
```python
|
|
||||||
# langbot_plugin/api/definition/abstract/platform/adapter.py
|
|
||||||
|
|
||||||
class AbstractPlatformAdapter(pydantic.BaseModel, metaclass=abc.ABCMeta):
|
|
||||||
"""平台适配器基类(EBA 版本)
|
|
||||||
|
|
||||||
相比旧版 AbstractMessagePlatformAdapter:
|
|
||||||
- 新增通用 API 方法(edit_message, delete_message, get_group_info 等)
|
|
||||||
- 新增透传 API(call_platform_api)
|
|
||||||
- 新增能力声明(get_supported_events, get_supported_apis)
|
|
||||||
- 事件监听器支持所有事件类型,不仅限于消息事件
|
|
||||||
"""
|
|
||||||
|
|
||||||
bot_account_id: str = ""
|
|
||||||
config: dict
|
|
||||||
logger: AbstractEventLogger = pydantic.Field(exclude=True)
|
|
||||||
|
|
||||||
class Config:
|
|
||||||
arbitrary_types_allowed = True
|
|
||||||
|
|
||||||
# ---- 能力声明 ----
|
|
||||||
|
|
||||||
def get_supported_events(self) -> list[str]:
|
|
||||||
"""返回此适配器支持的事件类型列表
|
|
||||||
|
|
||||||
默认实现从 manifest.yaml 读取。
|
|
||||||
适配器也可以 override 此方法动态声明。
|
|
||||||
"""
|
|
||||||
return ["message.received"]
|
|
||||||
|
|
||||||
def get_supported_apis(self) -> list[str]:
|
|
||||||
"""返回此适配器支持的 API 列表
|
|
||||||
|
|
||||||
默认实现从 manifest.yaml 读取。
|
|
||||||
"""
|
|
||||||
return ["send_message", "reply_message"]
|
|
||||||
|
|
||||||
# ---- 必需方法(抽象) ----
|
|
||||||
|
|
||||||
@abc.abstractmethod
|
|
||||||
async def send_message(self, target_type, target_id, message) -> MessageResult:
|
|
||||||
...
|
|
||||||
|
|
||||||
@abc.abstractmethod
|
|
||||||
async def reply_message(self, event, message, quote_origin=False) -> MessageResult:
|
|
||||||
...
|
|
||||||
|
|
||||||
@abc.abstractmethod
|
|
||||||
async def run_async(self):
|
|
||||||
...
|
|
||||||
|
|
||||||
@abc.abstractmethod
|
|
||||||
async def kill(self) -> bool:
|
|
||||||
...
|
|
||||||
|
|
||||||
@abc.abstractmethod
|
|
||||||
def register_listener(self, event_type, callback):
|
|
||||||
...
|
|
||||||
|
|
||||||
@abc.abstractmethod
|
|
||||||
def unregister_listener(self, event_type, callback):
|
|
||||||
...
|
|
||||||
|
|
||||||
# ---- 可选方法(默认抛 NotSupportedError) ----
|
|
||||||
# edit_message, delete_message, forward_message,
|
|
||||||
# get_group_info, get_group_member_list, ...
|
|
||||||
# call_platform_api, ...
|
|
||||||
# (完整签名见 02-platform-api.md)
|
|
||||||
|
|
||||||
# ---- 流式输出(保留) ----
|
|
||||||
|
|
||||||
async def reply_message_chunk(self, event, bot_message, message,
|
|
||||||
quote_origin=False, is_final=False):
|
|
||||||
raise NotSupportedError("reply_message_chunk")
|
|
||||||
|
|
||||||
async def is_stream_output_supported(self) -> bool:
|
|
||||||
return False
|
|
||||||
|
|
||||||
# ---- 消息卡片(保留) ----
|
|
||||||
|
|
||||||
async def create_message_card(self, message_id, event) -> bool:
|
|
||||||
return False
|
|
||||||
|
|
||||||
async def is_muted(self, group_id) -> bool:
|
|
||||||
return False
|
|
||||||
```
|
|
||||||
|
|
||||||
### 3.2 AbstractMessagePlatformAdapter 兼容
|
|
||||||
|
|
||||||
旧的 `AbstractMessagePlatformAdapter` 保留为 `AbstractPlatformAdapter` 的类型别名:
|
|
||||||
|
|
||||||
```python
|
|
||||||
# 向后兼容
|
|
||||||
AbstractMessagePlatformAdapter = AbstractPlatformAdapter
|
|
||||||
```
|
|
||||||
|
|
||||||
现有适配器代码中的 `AbstractMessagePlatformAdapter` 引用不需要立即修改。
|
|
||||||
|
|
||||||
### 3.3 EventConverter 新设计
|
|
||||||
|
|
||||||
现有 `AbstractEventConverter` 只有 `target2yiri` 和 `yiri2target` 两个静态方法,且只处理消息事件。
|
|
||||||
|
|
||||||
新设计支持多种事件类型:
|
|
||||||
|
|
||||||
```python
|
|
||||||
class AbstractEventConverter:
|
|
||||||
"""事件转换器基类(EBA 版本)
|
|
||||||
|
|
||||||
适配器需要实现此转换器,将平台原生事件转换为统一事件。
|
|
||||||
"""
|
|
||||||
|
|
||||||
@staticmethod
|
|
||||||
def target2yiri(raw_event: typing.Any) -> typing.Optional[Event]:
|
|
||||||
"""将平台原生事件转换为统一事件
|
|
||||||
|
|
||||||
Args:
|
|
||||||
raw_event: 平台 SDK 回调传入的原始事件对象
|
|
||||||
|
|
||||||
Returns:
|
|
||||||
统一 Event 对象,如果无法转换或不需要处理则返回 None
|
|
||||||
"""
|
|
||||||
raise NotImplementedError
|
|
||||||
|
|
||||||
@staticmethod
|
|
||||||
def yiri2target(event: Event) -> typing.Any:
|
|
||||||
"""将统一事件转换为平台原生事件(一般不需要)"""
|
|
||||||
raise NotImplementedError
|
|
||||||
```
|
|
||||||
|
|
||||||
具体适配器的 EventConverter 实现会是一个分发式的结构:
|
|
||||||
|
|
||||||
```python
|
|
||||||
class TelegramEventConverter(AbstractEventConverter):
|
|
||||||
"""Telegram 事件转换器"""
|
|
||||||
|
|
||||||
@staticmethod
|
|
||||||
def target2yiri(update: telegram.Update) -> typing.Optional[Event]:
|
|
||||||
# 消息事件
|
|
||||||
if update.message:
|
|
||||||
return TelegramEventConverter._convert_message(update)
|
|
||||||
# 消息编辑
|
|
||||||
if update.edited_message:
|
|
||||||
return TelegramEventConverter._convert_edited_message(update)
|
|
||||||
# 成员变动
|
|
||||||
if update.chat_member:
|
|
||||||
return TelegramEventConverter._convert_chat_member(update)
|
|
||||||
# 回调查询(按钮点击等)
|
|
||||||
if update.callback_query:
|
|
||||||
return TelegramEventConverter._convert_callback_query(update)
|
|
||||||
# 其他 → PlatformSpecificEvent
|
|
||||||
return TelegramEventConverter._convert_platform_specific(update)
|
|
||||||
|
|
||||||
@staticmethod
|
|
||||||
def _convert_message(update) -> MessageReceivedEvent:
|
|
||||||
...
|
|
||||||
|
|
||||||
@staticmethod
|
|
||||||
def _convert_edited_message(update) -> MessageEditedEvent:
|
|
||||||
...
|
|
||||||
|
|
||||||
@staticmethod
|
|
||||||
def _convert_chat_member(update) -> typing.Union[
|
|
||||||
MemberJoinedEvent, MemberLeftEvent, ...
|
|
||||||
]:
|
|
||||||
...
|
|
||||||
|
|
||||||
@staticmethod
|
|
||||||
def _convert_platform_specific(update) -> PlatformSpecificEvent:
|
|
||||||
...
|
|
||||||
```
|
|
||||||
|
|
||||||
## 4. Manifest 文件格式扩展
|
|
||||||
|
|
||||||
现有 manifest.yaml 只声明 `kind`, `metadata`, `spec.config`, `execution`。
|
|
||||||
|
|
||||||
新增 `spec.supported_events` 和 `spec.supported_apis`:
|
|
||||||
|
|
||||||
```yaml
|
|
||||||
apiVersion: v1
|
|
||||||
kind: MessagePlatformAdapter
|
|
||||||
|
|
||||||
metadata:
|
|
||||||
name: telegram
|
|
||||||
label:
|
|
||||||
en_US: Telegram
|
|
||||||
zh_Hans: Telegram
|
|
||||||
icon: telegram.svg
|
|
||||||
description:
|
|
||||||
en_US: Telegram Bot adapter
|
|
||||||
zh_Hans: Telegram Bot 适配器
|
|
||||||
|
|
||||||
spec:
|
|
||||||
config:
|
|
||||||
# 现有配置 schema(保持不变)
|
|
||||||
- key: token
|
|
||||||
label: { en_US: "Bot Token", zh_Hans: "Bot Token" }
|
|
||||||
type: string
|
|
||||||
required: true
|
|
||||||
sensitive: true
|
|
||||||
# ...
|
|
||||||
|
|
||||||
supported_events:
|
|
||||||
- message.received
|
|
||||||
- message.edited
|
|
||||||
- message.deleted
|
|
||||||
- message.reaction
|
|
||||||
- feedback.received
|
|
||||||
- group.member_joined
|
|
||||||
- group.member_left
|
|
||||||
- group.member_banned
|
|
||||||
- group.info_updated
|
|
||||||
- bot.invited_to_group
|
|
||||||
- bot.removed_from_group
|
|
||||||
- bot.muted
|
|
||||||
- bot.unmuted
|
|
||||||
- platform.specific
|
|
||||||
|
|
||||||
supported_apis:
|
|
||||||
required:
|
|
||||||
- send_message
|
|
||||||
- reply_message
|
|
||||||
optional:
|
|
||||||
- edit_message
|
|
||||||
- delete_message
|
|
||||||
- get_group_info
|
|
||||||
- get_group_member_list
|
|
||||||
- get_group_member_info
|
|
||||||
- get_user_info
|
|
||||||
- upload_file
|
|
||||||
- get_file_url
|
|
||||||
- call_platform_api
|
|
||||||
|
|
||||||
platform_specific_apis:
|
|
||||||
- action: pin_message
|
|
||||||
description: { en_US: "Pin a message", zh_Hans: "置顶消息" }
|
|
||||||
- action: unpin_message
|
|
||||||
description: { en_US: "Unpin a message", zh_Hans: "取消置顶" }
|
|
||||||
- action: get_chat_administrators
|
|
||||||
description: { en_US: "Get chat admins", zh_Hans: "获取群管理员列表" }
|
|
||||||
|
|
||||||
execution:
|
|
||||||
python:
|
|
||||||
path: pkg/platform/adapters/telegram/adapter.py
|
|
||||||
attr: TelegramAdapter
|
|
||||||
```
|
|
||||||
|
|
||||||
## 5. 适配器注册与发现
|
|
||||||
|
|
||||||
### 5.1 Blueprint 更新
|
|
||||||
|
|
||||||
`templates/components.yaml` 中更新扫描路径:
|
|
||||||
|
|
||||||
```yaml
|
|
||||||
kind: Blueprint
|
|
||||||
spec:
|
|
||||||
components:
|
|
||||||
MessagePlatformAdapter:
|
|
||||||
fromDirs:
|
|
||||||
- path: pkg/platform/adapters/ # 新路径
|
|
||||||
```
|
|
||||||
|
|
||||||
`ComponentDiscoveryEngine` 的递归扫描逻辑不变——它会扫描所有子目录中的 `.yaml` 文件。因此每个适配器目录下的 `manifest.yaml` 会被自动发现。
|
|
||||||
|
|
||||||
### 5.2 PlatformManager 适配
|
|
||||||
|
|
||||||
`PlatformManager.initialize()` 的核心逻辑基本不变:
|
|
||||||
|
|
||||||
```python
|
|
||||||
async def initialize(self):
|
|
||||||
# 1. 发现适配器组件(自动扫描新目录结构)
|
|
||||||
self.adapter_components = self.ap.discover.get_components_by_kind('MessagePlatformAdapter')
|
|
||||||
|
|
||||||
# 2. 动态导入适配器类
|
|
||||||
for component in self.adapter_components:
|
|
||||||
self.adapter_dict[component.metadata.name] = component.get_python_component_class()
|
|
||||||
|
|
||||||
# 3. 从数据库加载 Bot 并实例化适配器(不变)
|
|
||||||
await self.load_bots_from_db()
|
|
||||||
```
|
|
||||||
|
|
||||||
变更点:
|
|
||||||
- `execution.python.path` 从 `pkg/platform/sources/telegram.py` 变为 `pkg/platform/adapters/telegram/adapter.py`
|
|
||||||
- `get_python_component_class()` 正常工作,因为它按路径动态导入
|
|
||||||
|
|
||||||
## 6. RuntimeBot 重构
|
|
||||||
|
|
||||||
### 6.1 现有问题
|
|
||||||
|
|
||||||
当前 `RuntimeBot.initialize()` 硬编码注册了两个回调:
|
|
||||||
|
|
||||||
```python
|
|
||||||
# 现有代码
|
|
||||||
self.adapter.register_listener(platform_events.FriendMessage, on_friend_message)
|
|
||||||
self.adapter.register_listener(platform_events.GroupMessage, on_group_message)
|
|
||||||
```
|
|
||||||
|
|
||||||
### 6.2 新设计
|
|
||||||
|
|
||||||
`RuntimeBot` 改为注册一个通用的事件回调:
|
|
||||||
|
|
||||||
```python
|
|
||||||
class RuntimeBot:
|
|
||||||
async def initialize(self):
|
|
||||||
# 注册通用事件回调,接收所有事件类型
|
|
||||||
self.adapter.register_listener(Event, self._on_event)
|
|
||||||
|
|
||||||
async def _on_event(
|
|
||||||
self,
|
|
||||||
event: Event,
|
|
||||||
adapter: AbstractPlatformAdapter,
|
|
||||||
):
|
|
||||||
"""统一事件入口"""
|
|
||||||
|
|
||||||
# 1. 设置事件的 bot_uuid 和 adapter_name
|
|
||||||
event.bot_uuid = self.bot_entity.uuid
|
|
||||||
event.adapter_name = self.bot_entity.adapter
|
|
||||||
|
|
||||||
# 2. 日志记录
|
|
||||||
await self._log_event(event)
|
|
||||||
|
|
||||||
# 3. 提交给 EventBus
|
|
||||||
await self.ap.event_bus.emit(event, adapter)
|
|
||||||
```
|
|
||||||
|
|
||||||
适配器侧的 `register_listener` 实现也需调整:
|
|
||||||
- 当 `event_type` 为 `Event`(基类)时,注册为"接收所有事件"的通配回调
|
|
||||||
- 适配器在收到平台原生事件时,通过 `EventConverter.target2yiri()` 转换后,调用所有匹配的回调
|
|
||||||
|
|
||||||
## 7. 从现有单文件适配器迁移
|
|
||||||
|
|
||||||
### 7.1 迁移模式
|
|
||||||
|
|
||||||
以 Telegram 为例,从 `sources/telegram.py`(445 行)拆分:
|
|
||||||
|
|
||||||
| 原代码位置 | → 新文件 |
|
|
||||||
|-----------|----------|
|
|
||||||
| `TelegramMessageConverter` 类 | `telegram/message_converter.py` |
|
|
||||||
| `TelegramEventConverter` 类 | `telegram/event_converter.py`(扩展,支持更多事件) |
|
|
||||||
| `TelegramAdapter.__init__` / `run_async` / `kill` / `register_listener` | `telegram/adapter.py` |
|
|
||||||
| `TelegramAdapter.send_message` / `reply_message` / `reply_message_chunk` | `telegram/adapter.py`(消息方法保留在主类)+ `telegram/api_impl.py`(新增 API) |
|
|
||||||
| 新增代码 | `telegram/api_impl.py`(edit_message, delete_message, get_group_info 等) |
|
|
||||||
| 新增代码 | `telegram/platform_api.py`(pin_message, unpin_message 等的映射) |
|
|
||||||
| `telegram.yaml` | `telegram/manifest.yaml`(扩展 supported_events/apis) |
|
|
||||||
|
|
||||||
### 7.2 迁移顺序建议
|
|
||||||
|
|
||||||
1. **Telegram** — 功能最完整的适配器之一,适合作为模板
|
|
||||||
2. **Discord** — 第二个迁移,验证模式的通用性
|
|
||||||
3. **AioCQHTTP (OneBot)** — 国内最常用,确保兼容
|
|
||||||
4. **其他适配器** — 按使用频率排序
|
|
||||||
|
|
||||||
### 7.3 渐进式迁移
|
|
||||||
|
|
||||||
不需要一次性迁移所有适配器。可以采用渐进策略:
|
|
||||||
|
|
||||||
1. 先在 `adapters/` 下建立新适配器
|
|
||||||
2. `Blueprint` 同时扫描 `sources/` 和 `adapters/` 两个目录
|
|
||||||
3. 旧适配器在 `sources/` 中继续工作
|
|
||||||
4. 逐个迁移到新结构
|
|
||||||
5. 全部迁移完成后移除 `sources/` 目录
|
|
||||||
|
|
||||||
```yaml
|
|
||||||
# 过渡期的 Blueprint
|
|
||||||
kind: Blueprint
|
|
||||||
spec:
|
|
||||||
components:
|
|
||||||
MessagePlatformAdapter:
|
|
||||||
fromDirs:
|
|
||||||
- path: pkg/platform/sources/ # 旧路径(尚未迁移的适配器)
|
|
||||||
- path: pkg/platform/adapters/ # 新路径(已迁移的适配器)
|
|
||||||
```
|
|
||||||
@@ -1,743 +0,0 @@
|
|||||||
# 事件路由与编排
|
|
||||||
|
|
||||||
## 1. 概述
|
|
||||||
|
|
||||||
事件路由是 EBA 架构的核心机制:事件从适配器产生后,经由 EventBus 进入 EventRouter,由 EventRouter 根据 Bot 的配置将事件分发到对应的处理器(Handler)。
|
|
||||||
|
|
||||||
**配置方式**:用户在 WebUI 的 Bot 管理页面通过可视化编排面板管理事件处理器配置,配置数据存储在数据库的 Bot 表 `event_handlers` JSON 字段中。
|
|
||||||
|
|
||||||
## 2. 数据模型
|
|
||||||
|
|
||||||
### 2.1 Bot 实体扩展
|
|
||||||
|
|
||||||
在 `bots` 表新增 `event_handlers` 字段:
|
|
||||||
|
|
||||||
```python
|
|
||||||
class Bot(Base):
|
|
||||||
__tablename__ = "bots"
|
|
||||||
|
|
||||||
uuid: str # 主键
|
|
||||||
name: str
|
|
||||||
description: str
|
|
||||||
adapter: str
|
|
||||||
adapter_config: dict # JSON
|
|
||||||
enable: bool
|
|
||||||
|
|
||||||
# 新增
|
|
||||||
event_handlers: list # JSON — 事件处理器配置列表
|
|
||||||
|
|
||||||
# 保留(过渡期后弃用)
|
|
||||||
use_pipeline_name: str # deprecated
|
|
||||||
use_pipeline_uuid: str # deprecated
|
|
||||||
|
|
||||||
created_at: datetime
|
|
||||||
updated_at: datetime
|
|
||||||
```
|
|
||||||
|
|
||||||
### 2.2 EventHandler 配置结构
|
|
||||||
|
|
||||||
`event_handlers` 字段存储一个 JSON 数组,每个元素定义一条事件路由规则:
|
|
||||||
|
|
||||||
```python
|
|
||||||
class EventHandlerConfig(pydantic.BaseModel):
|
|
||||||
"""单条事件处理器配置"""
|
|
||||||
|
|
||||||
event_type: str
|
|
||||||
"""匹配的事件类型
|
|
||||||
|
|
||||||
支持精确匹配和通配符:
|
|
||||||
- "message.received" — 精确匹配
|
|
||||||
- "message.*" — 匹配 message 命名空间下所有事件
|
|
||||||
- "group.*" — 匹配 group 命名空间下所有事件
|
|
||||||
- "*" — 匹配所有事件(兜底)
|
|
||||||
"""
|
|
||||||
|
|
||||||
handler_type: str
|
|
||||||
"""处理器类型: "pipeline" | "agent" | "webhook" | "plugin" """
|
|
||||||
|
|
||||||
handler_config: dict = {}
|
|
||||||
"""处理器的具体配置,结构取决于 handler_type"""
|
|
||||||
|
|
||||||
enabled: bool = True
|
|
||||||
"""是否启用此规则"""
|
|
||||||
|
|
||||||
priority: int = 0
|
|
||||||
"""优先级,数字越大越先匹配(同一事件类型有多条规则时)"""
|
|
||||||
|
|
||||||
description: str = ""
|
|
||||||
"""规则描述(供 WebUI 显示)"""
|
|
||||||
```
|
|
||||||
|
|
||||||
### 2.3 各 Handler 类型的 handler_config 结构
|
|
||||||
|
|
||||||
#### pipeline
|
|
||||||
|
|
||||||
```json
|
|
||||||
{
|
|
||||||
"handler_type": "pipeline",
|
|
||||||
"handler_config": {
|
|
||||||
"pipeline_uuid": "xxxxxxxx-xxxx-xxxx-xxxx-xxxxxxxxxxxx"
|
|
||||||
}
|
|
||||||
}
|
|
||||||
```
|
|
||||||
|
|
||||||
将事件作为消息事件传入现有 Pipeline 流水线。仅适用于 `message.received` 事件。
|
|
||||||
|
|
||||||
#### agent
|
|
||||||
|
|
||||||
```json
|
|
||||||
{
|
|
||||||
"handler_type": "agent",
|
|
||||||
"handler_config": {
|
|
||||||
"runner": "local-agent",
|
|
||||||
"runner_config": {
|
|
||||||
"model_uuid": "...",
|
|
||||||
"prompt": "你是一个群组助理,请处理以下事件:{event_summary}",
|
|
||||||
"tools_enabled": true
|
|
||||||
}
|
|
||||||
}
|
|
||||||
}
|
|
||||||
```
|
|
||||||
|
|
||||||
```json
|
|
||||||
{
|
|
||||||
"handler_type": "agent",
|
|
||||||
"handler_config": {
|
|
||||||
"runner": "dify-service-api",
|
|
||||||
"runner_config": {
|
|
||||||
"base_url": "https://api.dify.ai/v1",
|
|
||||||
"api_key": "...",
|
|
||||||
"app_type": "agent"
|
|
||||||
}
|
|
||||||
}
|
|
||||||
}
|
|
||||||
```
|
|
||||||
|
|
||||||
直接调用 RequestRunner 处理事件。可用的 runner 包括:
|
|
||||||
- `local-agent` — 内置 LLM Agent
|
|
||||||
- `dify-service-api` — Dify 平台
|
|
||||||
- `n8n-service-api` — n8n 工作流
|
|
||||||
- `coze-api` — Coze (扣子)
|
|
||||||
- `dashscope-app-api` — 阿里百炼
|
|
||||||
- `langflow-api` — Langflow
|
|
||||||
- `tbox-app-api` — 蚂蚁 Tbox
|
|
||||||
|
|
||||||
Agent 处理器不经过 Pipeline 的多 Stage 流程,而是直接构建上下文并调用 Runner。适用于所有事件类型。
|
|
||||||
|
|
||||||
**Agent Handler 与 Pipeline 的关系**:
|
|
||||||
- Pipeline 是完整的多 Stage 处理链(PreProcessor → MessageProcessor(内含Runner) → PostProcessor → ...),适合复杂消息处理
|
|
||||||
- Agent Handler 是轻量级的,直接调用 Runner,跳过 PreProcessor/PostProcessor 等阶段
|
|
||||||
- Pipeline 内部的 AI Stage 仍然使用 Runner,所以 Runner 本身被两种 Handler 共享
|
|
||||||
- 用户可以根据场景选择:消息处理用 Pipeline(更多控制),其他事件用 Agent(更直接)
|
|
||||||
|
|
||||||
#### webhook
|
|
||||||
|
|
||||||
```json
|
|
||||||
{
|
|
||||||
"handler_type": "webhook",
|
|
||||||
"handler_config": {
|
|
||||||
"url": "https://example.com/webhook/langbot-events",
|
|
||||||
"method": "POST",
|
|
||||||
"headers": {
|
|
||||||
"Authorization": "Bearer xxx"
|
|
||||||
},
|
|
||||||
"timeout": 30,
|
|
||||||
"retry_count": 3,
|
|
||||||
"retry_interval": 5,
|
|
||||||
"response_actions": true
|
|
||||||
}
|
|
||||||
}
|
|
||||||
```
|
|
||||||
|
|
||||||
将事件序列化为 JSON POST 到外部 URL。支持的特性:
|
|
||||||
- **认证**:通过 headers 配置(Bearer Token、API Key 等)
|
|
||||||
- **重试**:配置重试次数和间隔
|
|
||||||
- **响应动作**:如果 `response_actions` 为 true,解析响应 JSON 中的 `actions` 字段并执行(如发送消息、同意好友请求等)
|
|
||||||
|
|
||||||
Webhook 请求体格式:
|
|
||||||
|
|
||||||
```json
|
|
||||||
{
|
|
||||||
"event": {
|
|
||||||
"type": "group.member_joined",
|
|
||||||
"timestamp": 1700000000.0,
|
|
||||||
"bot_uuid": "...",
|
|
||||||
"adapter_name": "telegram",
|
|
||||||
"group": { "id": "...", "name": "..." },
|
|
||||||
"member": { "id": "...", "nickname": "..." }
|
|
||||||
},
|
|
||||||
"bot": {
|
|
||||||
"uuid": "...",
|
|
||||||
"name": "...",
|
|
||||||
"adapter": "telegram"
|
|
||||||
}
|
|
||||||
}
|
|
||||||
```
|
|
||||||
|
|
||||||
响应体格式(当 `response_actions` 为 true 时):
|
|
||||||
|
|
||||||
```json
|
|
||||||
{
|
|
||||||
"actions": [
|
|
||||||
{
|
|
||||||
"type": "send_message",
|
|
||||||
"params": {
|
|
||||||
"target_type": "group",
|
|
||||||
"target_id": "123456",
|
|
||||||
"message": [{ "type": "Plain", "text": "欢迎新成员!" }]
|
|
||||||
}
|
|
||||||
},
|
|
||||||
{
|
|
||||||
"type": "call_platform_api",
|
|
||||||
"params": {
|
|
||||||
"action": "pin_message",
|
|
||||||
"params": { "chat_id": "123456", "message_id": "789" }
|
|
||||||
}
|
|
||||||
}
|
|
||||||
]
|
|
||||||
}
|
|
||||||
```
|
|
||||||
|
|
||||||
#### plugin
|
|
||||||
|
|
||||||
```json
|
|
||||||
{
|
|
||||||
"handler_type": "plugin",
|
|
||||||
"handler_config": {
|
|
||||||
"plugin_filter": []
|
|
||||||
}
|
|
||||||
}
|
|
||||||
```
|
|
||||||
|
|
||||||
将事件分发给插件的 EventListener 处理。
|
|
||||||
|
|
||||||
- `plugin_filter`:可选的插件名过滤列表,为空表示分发给所有插件
|
|
||||||
- 沿用现有的插件事件分发机制(按优先级遍历插件,支持 `prevent_postorder`)
|
|
||||||
|
|
||||||
### 2.4 完整配置示例
|
|
||||||
|
|
||||||
一个 Bot 的 `event_handlers` 配置示例:
|
|
||||||
|
|
||||||
```json
|
|
||||||
[
|
|
||||||
{
|
|
||||||
"event_type": "message.received",
|
|
||||||
"handler_type": "pipeline",
|
|
||||||
"handler_config": {
|
|
||||||
"pipeline_uuid": "default-pipeline-uuid"
|
|
||||||
},
|
|
||||||
"enabled": true,
|
|
||||||
"priority": 10,
|
|
||||||
"description": "消息事件使用默认流水线处理"
|
|
||||||
},
|
|
||||||
{
|
|
||||||
"event_type": "group.member_joined",
|
|
||||||
"handler_type": "agent",
|
|
||||||
"handler_config": {
|
|
||||||
"runner": "local-agent",
|
|
||||||
"runner_config": {
|
|
||||||
"model_uuid": "gpt-4o-mini",
|
|
||||||
"prompt": "有新成员 {member_name} 加入了群组 {group_name},请生成一条欢迎消息。"
|
|
||||||
}
|
|
||||||
},
|
|
||||||
"enabled": true,
|
|
||||||
"priority": 0,
|
|
||||||
"description": "新成员入群时用 AI 生成欢迎消息"
|
|
||||||
},
|
|
||||||
{
|
|
||||||
"event_type": "friend.request_received",
|
|
||||||
"handler_type": "webhook",
|
|
||||||
"handler_config": {
|
|
||||||
"url": "https://my-server.com/api/friend-request",
|
|
||||||
"response_actions": true
|
|
||||||
},
|
|
||||||
"enabled": true,
|
|
||||||
"priority": 0,
|
|
||||||
"description": "好友请求转发到自建服务处理"
|
|
||||||
},
|
|
||||||
{
|
|
||||||
"event_type": "*",
|
|
||||||
"handler_type": "plugin",
|
|
||||||
"handler_config": {},
|
|
||||||
"enabled": true,
|
|
||||||
"priority": -100,
|
|
||||||
"description": "所有事件兜底发给插件处理"
|
|
||||||
}
|
|
||||||
]
|
|
||||||
```
|
|
||||||
|
|
||||||
## 3. EventBus 设计
|
|
||||||
|
|
||||||
EventBus 是事件的中转站,接收来自各个 RuntimeBot 的事件,交由 EventRouter 处理。
|
|
||||||
|
|
||||||
```python
|
|
||||||
class EventBus:
|
|
||||||
"""事件总线"""
|
|
||||||
|
|
||||||
def __init__(self, ap: Application):
|
|
||||||
self.ap = ap
|
|
||||||
self.event_router = EventRouter(ap)
|
|
||||||
|
|
||||||
async def emit(
|
|
||||||
self,
|
|
||||||
event: Event,
|
|
||||||
adapter: AbstractPlatformAdapter,
|
|
||||||
):
|
|
||||||
"""接收并分发事件
|
|
||||||
|
|
||||||
Args:
|
|
||||||
event: 统一事件对象
|
|
||||||
adapter: 产生此事件的适配器实例
|
|
||||||
"""
|
|
||||||
# 1. 全局事件日志
|
|
||||||
self.ap.logger.debug(
|
|
||||||
f"EventBus: {event.type} from bot {event.bot_uuid}"
|
|
||||||
)
|
|
||||||
|
|
||||||
# 2. 交由 EventRouter 路由处理
|
|
||||||
await self.event_router.route(event, adapter)
|
|
||||||
```
|
|
||||||
|
|
||||||
## 4. EventRouter 设计
|
|
||||||
|
|
||||||
EventRouter 是事件路由引擎,根据 Bot 的 `event_handlers` 配置决定事件的处理方式。
|
|
||||||
|
|
||||||
```python
|
|
||||||
class EventRouter:
|
|
||||||
"""事件路由引擎"""
|
|
||||||
|
|
||||||
def __init__(self, ap: Application):
|
|
||||||
self.ap = ap
|
|
||||||
self.handlers: dict[str, AbstractEventHandler] = {
|
|
||||||
"pipeline": PipelineHandler(ap),
|
|
||||||
"agent": AgentHandler(ap),
|
|
||||||
"webhook": WebhookHandler(ap),
|
|
||||||
"plugin": PluginHandler(ap),
|
|
||||||
}
|
|
||||||
|
|
||||||
async def route(
|
|
||||||
self,
|
|
||||||
event: Event,
|
|
||||||
adapter: AbstractPlatformAdapter,
|
|
||||||
):
|
|
||||||
"""路由事件到对应处理器"""
|
|
||||||
|
|
||||||
# 1. 获取 Bot 配置
|
|
||||||
bot = await self.ap.platform_mgr.get_bot_by_uuid(event.bot_uuid)
|
|
||||||
if not bot:
|
|
||||||
return
|
|
||||||
|
|
||||||
# 2. 获取事件处理器配置
|
|
||||||
event_handlers = bot.bot_entity.event_handlers or []
|
|
||||||
|
|
||||||
# 3. 匹配规则(按 priority 降序排列)
|
|
||||||
matched_handlers = self._match_handlers(event.type, event_handlers)
|
|
||||||
|
|
||||||
if not matched_handlers:
|
|
||||||
# 未匹配到任何规则 → 默认交给插件处理(向后兼容)
|
|
||||||
await self.handlers["plugin"].handle(event, adapter, {})
|
|
||||||
return
|
|
||||||
|
|
||||||
# 4. 执行第一个匹配的 Handler
|
|
||||||
# (未来可扩展为多个 Handler 串行/并行执行)
|
|
||||||
handler_config = matched_handlers[0]
|
|
||||||
handler = self.handlers.get(handler_config.handler_type)
|
|
||||||
|
|
||||||
if handler:
|
|
||||||
await handler.handle(event, adapter, handler_config.handler_config)
|
|
||||||
else:
|
|
||||||
self.ap.logger.warning(
|
|
||||||
f"Unknown handler type: {handler_config.handler_type}"
|
|
||||||
)
|
|
||||||
|
|
||||||
def _match_handlers(
|
|
||||||
self,
|
|
||||||
event_type: str,
|
|
||||||
handlers: list[EventHandlerConfig],
|
|
||||||
) -> list[EventHandlerConfig]:
|
|
||||||
"""匹配事件类型到处理器配置
|
|
||||||
|
|
||||||
匹配规则:
|
|
||||||
1. 精确匹配:event_type == handler.event_type
|
|
||||||
2. 命名空间通配:handler.event_type 为 "message.*" 时匹配所有 "message.xxx"
|
|
||||||
3. 全局通配:handler.event_type 为 "*" 时匹配所有事件
|
|
||||||
4. 按 priority 降序排列
|
|
||||||
5. 只返回 enabled=True 的规则
|
|
||||||
"""
|
|
||||||
matched = []
|
|
||||||
for handler in handlers:
|
|
||||||
if not handler.enabled:
|
|
||||||
continue
|
|
||||||
if self._event_type_matches(event_type, handler.event_type):
|
|
||||||
matched.append(handler)
|
|
||||||
|
|
||||||
matched.sort(key=lambda h: h.priority, reverse=True)
|
|
||||||
return matched
|
|
||||||
|
|
||||||
@staticmethod
|
|
||||||
def _event_type_matches(event_type: str, pattern: str) -> bool:
|
|
||||||
"""判断事件类型是否匹配模式"""
|
|
||||||
if pattern == "*":
|
|
||||||
return True
|
|
||||||
if pattern == event_type:
|
|
||||||
return True
|
|
||||||
if pattern.endswith(".*"):
|
|
||||||
namespace = pattern[:-2]
|
|
||||||
return event_type.startswith(namespace + ".")
|
|
||||||
return False
|
|
||||||
```
|
|
||||||
|
|
||||||
## 5. 事件处理器(Handler)实现
|
|
||||||
|
|
||||||
### 5.1 Handler 基类
|
|
||||||
|
|
||||||
```python
|
|
||||||
class AbstractEventHandler(abc.ABC):
|
|
||||||
"""事件处理器基类"""
|
|
||||||
|
|
||||||
def __init__(self, ap: Application):
|
|
||||||
self.ap = ap
|
|
||||||
|
|
||||||
@abc.abstractmethod
|
|
||||||
async def handle(
|
|
||||||
self,
|
|
||||||
event: Event,
|
|
||||||
adapter: AbstractPlatformAdapter,
|
|
||||||
config: dict,
|
|
||||||
) -> None:
|
|
||||||
"""处理事件
|
|
||||||
|
|
||||||
Args:
|
|
||||||
event: 统一事件对象
|
|
||||||
adapter: 适配器实例(用于调用平台 API 发送响应)
|
|
||||||
config: handler_config 配置
|
|
||||||
"""
|
|
||||||
...
|
|
||||||
```
|
|
||||||
|
|
||||||
### 5.2 PipelineHandler
|
|
||||||
|
|
||||||
将消息事件注入现有 Pipeline 流水线处理。
|
|
||||||
|
|
||||||
```python
|
|
||||||
class PipelineHandler(AbstractEventHandler):
|
|
||||||
"""Pipeline 处理器 — 将事件送入现有 Pipeline 流水线"""
|
|
||||||
|
|
||||||
async def handle(self, event, adapter, config):
|
|
||||||
pipeline_uuid = config.get("pipeline_uuid")
|
|
||||||
|
|
||||||
if not isinstance(event, MessageReceivedEvent):
|
|
||||||
self.ap.logger.warning(
|
|
||||||
f"PipelineHandler only supports MessageReceivedEvent, "
|
|
||||||
f"got {event.type}"
|
|
||||||
)
|
|
||||||
return
|
|
||||||
|
|
||||||
# 将 MessageReceivedEvent 转换为现有的 Query 并投入 QueryPool
|
|
||||||
# 复用现有的 MessageAggregator + QueryPool + Pipeline 机制
|
|
||||||
launcher_type = (
|
|
||||||
LauncherTypes.PERSON
|
|
||||||
if event.chat_type == ChatType.PRIVATE
|
|
||||||
else LauncherTypes.GROUP
|
|
||||||
)
|
|
||||||
|
|
||||||
await self.ap.msg_aggregator.add_message(
|
|
||||||
bot_uuid=event.bot_uuid,
|
|
||||||
launcher_type=launcher_type,
|
|
||||||
launcher_id=event.chat_id,
|
|
||||||
sender_id=event.sender.id,
|
|
||||||
message_event=event.to_legacy_event(), # 转换为 FriendMessage/GroupMessage
|
|
||||||
message_chain=event.message_chain,
|
|
||||||
adapter=adapter,
|
|
||||||
pipeline_uuid=pipeline_uuid,
|
|
||||||
)
|
|
||||||
```
|
|
||||||
|
|
||||||
### 5.3 AgentHandler
|
|
||||||
|
|
||||||
直接调用 RequestRunner 处理事件,不经过 Pipeline Stage 链。
|
|
||||||
|
|
||||||
```python
|
|
||||||
class AgentHandler(AbstractEventHandler):
|
|
||||||
"""Agent 处理器 — 直接调用 RequestRunner 处理事件"""
|
|
||||||
|
|
||||||
async def handle(self, event, adapter, config):
|
|
||||||
runner_name = config.get("runner", "local-agent")
|
|
||||||
runner_config = config.get("runner_config", {})
|
|
||||||
|
|
||||||
# 1. 查找 Runner 类
|
|
||||||
runner_cls = None
|
|
||||||
for r in preregistered_runners:
|
|
||||||
if r.name == runner_name:
|
|
||||||
runner_cls = r
|
|
||||||
break
|
|
||||||
|
|
||||||
if not runner_cls:
|
|
||||||
self.ap.logger.error(f"Runner not found: {runner_name}")
|
|
||||||
return
|
|
||||||
|
|
||||||
# 2. 构建事件上下文(将事件信息整理为 Runner 可处理的格式)
|
|
||||||
event_context = self._build_event_context(event, runner_config)
|
|
||||||
|
|
||||||
# 3. 实例化并调用 Runner
|
|
||||||
runner = runner_cls(self.ap, self._build_runner_pipeline_config(config))
|
|
||||||
|
|
||||||
response_messages = []
|
|
||||||
async for result in runner.run(event_context):
|
|
||||||
response_messages.append(result)
|
|
||||||
|
|
||||||
# 4. 发送响应(如果 Runner 产生了回复)
|
|
||||||
if response_messages and isinstance(event, MessageReceivedEvent):
|
|
||||||
# 将 Runner 输出转换为 MessageChain 并回复
|
|
||||||
reply_chain = self._build_reply_chain(response_messages)
|
|
||||||
await adapter.reply_message(event, reply_chain)
|
|
||||||
|
|
||||||
def _build_event_context(self, event, runner_config):
|
|
||||||
"""将事件构建为 Runner 可处理的上下文
|
|
||||||
|
|
||||||
对于消息事件,直接使用消息内容。
|
|
||||||
对于其他事件,根据 runner_config 中的 prompt 模板生成描述文本。
|
|
||||||
"""
|
|
||||||
...
|
|
||||||
|
|
||||||
def _build_runner_pipeline_config(self, config):
|
|
||||||
"""将 handler_config 转换为 Runner 需要的 pipeline_config 格式"""
|
|
||||||
...
|
|
||||||
```
|
|
||||||
|
|
||||||
### 5.4 WebhookHandler
|
|
||||||
|
|
||||||
将事件 POST 到外部 URL。
|
|
||||||
|
|
||||||
```python
|
|
||||||
class WebhookHandler(AbstractEventHandler):
|
|
||||||
"""Webhook 处理器 — 将事件 POST 到外部 URL"""
|
|
||||||
|
|
||||||
async def handle(self, event, adapter, config):
|
|
||||||
url = config.get("url")
|
|
||||||
method = config.get("method", "POST")
|
|
||||||
headers = config.get("headers", {})
|
|
||||||
timeout = config.get("timeout", 30)
|
|
||||||
retry_count = config.get("retry_count", 3)
|
|
||||||
response_actions = config.get("response_actions", False)
|
|
||||||
|
|
||||||
# 1. 构建请求体
|
|
||||||
bot = await self.ap.platform_mgr.get_bot_by_uuid(event.bot_uuid)
|
|
||||||
payload = {
|
|
||||||
"event": event.model_dump(),
|
|
||||||
"bot": {
|
|
||||||
"uuid": bot.bot_entity.uuid,
|
|
||||||
"name": bot.bot_entity.name,
|
|
||||||
"adapter": bot.bot_entity.adapter,
|
|
||||||
}
|
|
||||||
}
|
|
||||||
|
|
||||||
# 2. 发送请求(带重试)
|
|
||||||
response = await self._send_with_retry(
|
|
||||||
url, method, headers, payload, timeout, retry_count
|
|
||||||
)
|
|
||||||
|
|
||||||
# 3. 处理响应动作
|
|
||||||
if response_actions and response:
|
|
||||||
await self._execute_response_actions(
|
|
||||||
response, adapter, event
|
|
||||||
)
|
|
||||||
|
|
||||||
async def _execute_response_actions(self, response, adapter, event):
|
|
||||||
"""执行响应中的动作列表"""
|
|
||||||
actions = response.get("actions", [])
|
|
||||||
for action in actions:
|
|
||||||
action_type = action.get("type")
|
|
||||||
params = action.get("params", {})
|
|
||||||
|
|
||||||
if action_type == "send_message":
|
|
||||||
chain = MessageChain.model_validate(params.get("message", []))
|
|
||||||
await adapter.send_message(
|
|
||||||
params["target_type"],
|
|
||||||
params["target_id"],
|
|
||||||
chain,
|
|
||||||
)
|
|
||||||
elif action_type == "reply":
|
|
||||||
chain = MessageChain.model_validate(params.get("message", []))
|
|
||||||
await adapter.reply_message(event, chain)
|
|
||||||
elif action_type == "call_platform_api":
|
|
||||||
await adapter.call_platform_api(
|
|
||||||
params["action"],
|
|
||||||
params.get("params", {}),
|
|
||||||
)
|
|
||||||
elif action_type == "approve_friend_request":
|
|
||||||
await adapter.approve_friend_request(
|
|
||||||
params["request_id"],
|
|
||||||
params.get("approve", True),
|
|
||||||
)
|
|
||||||
# ... 更多动作类型
|
|
||||||
```
|
|
||||||
|
|
||||||
### 5.5 PluginHandler
|
|
||||||
|
|
||||||
将事件分发给插件的 EventListener。
|
|
||||||
|
|
||||||
```python
|
|
||||||
class PluginHandler(AbstractEventHandler):
|
|
||||||
"""Plugin 处理器 — 分发给插件 EventListener"""
|
|
||||||
|
|
||||||
async def handle(self, event, adapter, config):
|
|
||||||
plugin_filter = config.get("plugin_filter", [])
|
|
||||||
|
|
||||||
# 复用现有的插件事件分发机制
|
|
||||||
# 通过 plugin_connector 将事件发送给 Plugin Runtime
|
|
||||||
await self.ap.plugin_connector.emit_event(
|
|
||||||
event=event,
|
|
||||||
adapter=adapter,
|
|
||||||
plugin_filter=plugin_filter,
|
|
||||||
)
|
|
||||||
```
|
|
||||||
|
|
||||||
## 6. use_pipeline_uuid 迁移
|
|
||||||
|
|
||||||
### 6.1 自动迁移
|
|
||||||
|
|
||||||
数据库迁移脚本将现有的 `use_pipeline_uuid` 自动转换为 `event_handlers`:
|
|
||||||
|
|
||||||
```python
|
|
||||||
# 迁移逻辑
|
|
||||||
for bot in all_bots:
|
|
||||||
if bot.use_pipeline_uuid and not bot.event_handlers:
|
|
||||||
bot.event_handlers = [
|
|
||||||
{
|
|
||||||
"event_type": "message.received",
|
|
||||||
"handler_type": "pipeline",
|
|
||||||
"handler_config": {
|
|
||||||
"pipeline_uuid": bot.use_pipeline_uuid
|
|
||||||
},
|
|
||||||
"enabled": True,
|
|
||||||
"priority": 10,
|
|
||||||
"description": "Auto-migrated from use_pipeline_uuid"
|
|
||||||
},
|
|
||||||
{
|
|
||||||
"event_type": "*",
|
|
||||||
"handler_type": "plugin",
|
|
||||||
"handler_config": {},
|
|
||||||
"enabled": True,
|
|
||||||
"priority": -100,
|
|
||||||
"description": "Default plugin handler"
|
|
||||||
}
|
|
||||||
]
|
|
||||||
```
|
|
||||||
|
|
||||||
### 6.2 过渡期兼容
|
|
||||||
|
|
||||||
在过渡期内,如果 `event_handlers` 为空且 `use_pipeline_uuid` 非空,EventRouter 自动回退到旧行为:
|
|
||||||
|
|
||||||
```python
|
|
||||||
# EventRouter.route() 中的兼容逻辑
|
|
||||||
if not event_handlers and bot.bot_entity.use_pipeline_uuid:
|
|
||||||
# 回退:消息事件走 Pipeline,其他事件走 Plugin
|
|
||||||
if isinstance(event, MessageReceivedEvent):
|
|
||||||
await self.handlers["pipeline"].handle(
|
|
||||||
event, adapter,
|
|
||||||
{"pipeline_uuid": bot.bot_entity.use_pipeline_uuid}
|
|
||||||
)
|
|
||||||
else:
|
|
||||||
await self.handlers["plugin"].handle(event, adapter, {})
|
|
||||||
return
|
|
||||||
```
|
|
||||||
|
|
||||||
## 7. WebUI 编排面板数据模型
|
|
||||||
|
|
||||||
### 7.1 交互设计概要
|
|
||||||
|
|
||||||
在 WebUI 的 Bot 管理页面,新增"事件处理器"标签页(或区域),呈现为一个**规则列表**:
|
|
||||||
|
|
||||||
```
|
|
||||||
┌─────────────────────────────────────────────────────────────┐
|
|
||||||
│ 事件处理器 [+ 添加规则] │
|
|
||||||
├─────────────────────────────────────────────────────────────┤
|
|
||||||
│ │
|
|
||||||
│ ┌─ 规则 1 ─────────────────────────────────── [启用] [删除] ─┐ │
|
|
||||||
│ │ 事件类型: [message.received ▾] │ │
|
|
||||||
│ │ 处理器: [Pipeline ▾] │ │
|
|
||||||
│ │ Pipeline: [默认流水线 ▾] │ │
|
|
||||||
│ │ 优先级: [10] │ │
|
|
||||||
│ │ 描述: 消息事件使用默认流水线处理 │ │
|
|
||||||
│ └──────────────────────────────────────────────────────────┘ │
|
|
||||||
│ │
|
|
||||||
│ ┌─ 规则 2 ─────────────────────────────────── [启用] [删除] ─┐ │
|
|
||||||
│ │ 事件类型: [group.member_joined ▾] │ │
|
|
||||||
│ │ 处理器: [Agent ▾] │ │
|
|
||||||
│ │ Runner: [local-agent ▾] │ │
|
|
||||||
│ │ 模型: [gpt-4o-mini ▾] │ │
|
|
||||||
│ │ Prompt: [有新成员加入...] │ │
|
|
||||||
│ │ 优先级: [0] │ │
|
|
||||||
│ └──────────────────────────────────────────────────────────┘ │
|
|
||||||
│ │
|
|
||||||
│ ┌─ 规则 3 (兜底) ──────────────────────────── [启用] [删除] ─┐ │
|
|
||||||
│ │ 事件类型: [* ▾] │ │
|
|
||||||
│ │ 处理器: [Plugin ▾] │ │
|
|
||||||
│ │ 优先级: [-100] │ │
|
|
||||||
│ └──────────────────────────────────────────────────────────┘ │
|
|
||||||
│ │
|
|
||||||
└─────────────────────────────────────────────────────────────┘
|
|
||||||
```
|
|
||||||
|
|
||||||
### 7.2 前端数据结构
|
|
||||||
|
|
||||||
```typescript
|
|
||||||
interface EventHandlerRule {
|
|
||||||
event_type: string; // 下拉选择,选项从适配器 manifest 的 supported_events 获取
|
|
||||||
handler_type: string; // "pipeline" | "agent" | "webhook" | "plugin"
|
|
||||||
handler_config: Record<string, any>; // 根据 handler_type 动态渲染不同的配置表单
|
|
||||||
enabled: boolean;
|
|
||||||
priority: number;
|
|
||||||
description: string;
|
|
||||||
}
|
|
||||||
|
|
||||||
// Bot 编辑接口扩展
|
|
||||||
interface BotConfig {
|
|
||||||
uuid: string;
|
|
||||||
name: string;
|
|
||||||
adapter: string;
|
|
||||||
adapter_config: Record<string, any>;
|
|
||||||
enable: boolean;
|
|
||||||
event_handlers: EventHandlerRule[]; // 新增
|
|
||||||
}
|
|
||||||
```
|
|
||||||
|
|
||||||
### 7.3 事件类型下拉选项
|
|
||||||
|
|
||||||
从 Bot 关联的适配器 manifest 中获取 `supported_events`,加上通配符选项:
|
|
||||||
|
|
||||||
```
|
|
||||||
- message.received
|
|
||||||
- message.edited
|
|
||||||
- message.deleted
|
|
||||||
- message.reaction
|
|
||||||
- feedback.received
|
|
||||||
- group.member_joined
|
|
||||||
- group.member_left
|
|
||||||
- group.member_banned
|
|
||||||
- group.info_updated
|
|
||||||
- friend.request_received
|
|
||||||
- friend.added
|
|
||||||
- bot.invited_to_group
|
|
||||||
- bot.removed_from_group
|
|
||||||
- bot.muted
|
|
||||||
- bot.unmuted
|
|
||||||
- platform.specific
|
|
||||||
─────────────────
|
|
||||||
- message.* (所有消息事件)
|
|
||||||
- feedback.* (所有反馈事件)
|
|
||||||
- group.* (所有群组事件)
|
|
||||||
- friend.* (所有好友事件)
|
|
||||||
- bot.* (所有 Bot 事件)
|
|
||||||
- * (所有事件)
|
|
||||||
```
|
|
||||||
|
|
||||||
### 7.4 HTTP API
|
|
||||||
|
|
||||||
```
|
|
||||||
GET /api/v1/bots/{uuid}/event-handlers 获取 Bot 的事件处理器配置
|
|
||||||
PUT /api/v1/bots/{uuid}/event-handlers 更新 Bot 的事件处理器配置
|
|
||||||
GET /api/v1/adapters/{name}/supported-events 获取适配器支持的事件类型
|
|
||||||
GET /api/v1/adapters/{name}/supported-apis 获取适配器支持的 API
|
|
||||||
```
|
|
||||||
@@ -1,738 +0,0 @@
|
|||||||
# 插件 SDK 改造
|
|
||||||
|
|
||||||
## 1. 概述
|
|
||||||
|
|
||||||
插件 SDK 需要配合 EBA 架构进行以下改造:
|
|
||||||
|
|
||||||
1. **新事件类型**:将所有通用事件暴露给插件
|
|
||||||
2. **新 API**:将新增的平台 API 通过 `LangBotAPIProxy` 暴露给插件
|
|
||||||
3. **兼容层**:保证现有插件零修改运行
|
|
||||||
4. **通信协议扩展**:新增 action 枚举支持新 API
|
|
||||||
|
|
||||||
## 2. 新事件类型暴露
|
|
||||||
|
|
||||||
### 2.1 插件事件模型扩展
|
|
||||||
|
|
||||||
当前插件 SDK 的事件模型(`api/entities/events.py`)只有消息相关事件。需要新增所有通用事件的插件级包装:
|
|
||||||
|
|
||||||
```python
|
|
||||||
# api/entities/events.py — 新增事件
|
|
||||||
|
|
||||||
# ---- 消息事件(扩展) ----
|
|
||||||
|
|
||||||
class MessageEditedReceived(BaseEventModel):
|
|
||||||
"""消息被编辑事件"""
|
|
||||||
launcher_type: str
|
|
||||||
launcher_id: typing.Union[int, str]
|
|
||||||
message_id: typing.Union[int, str]
|
|
||||||
editor_id: typing.Union[int, str]
|
|
||||||
new_content: MessageChain
|
|
||||||
chat_type: str # "private" | "group"
|
|
||||||
|
|
||||||
class MessageDeletedReceived(BaseEventModel):
|
|
||||||
"""消息被删除/撤回事件"""
|
|
||||||
launcher_type: str
|
|
||||||
launcher_id: typing.Union[int, str]
|
|
||||||
message_id: typing.Union[int, str]
|
|
||||||
operator_id: typing.Optional[typing.Union[int, str]] = None
|
|
||||||
chat_type: str
|
|
||||||
|
|
||||||
class MessageReactionReceived(BaseEventModel):
|
|
||||||
"""消息表情回应事件"""
|
|
||||||
launcher_type: str
|
|
||||||
launcher_id: typing.Union[int, str]
|
|
||||||
message_id: typing.Union[int, str]
|
|
||||||
user_id: typing.Union[int, str]
|
|
||||||
reaction: str
|
|
||||||
is_add: bool
|
|
||||||
|
|
||||||
# ---- 用户反馈事件 ----
|
|
||||||
|
|
||||||
class FeedbackReceived(BaseEventModel):
|
|
||||||
"""用户对 Bot 回复提交反馈"""
|
|
||||||
feedback_id: str
|
|
||||||
feedback_type: int # 1=like, 2=dislike, 3=cancel/remove feedback
|
|
||||||
feedback_content: typing.Optional[str] = None
|
|
||||||
inaccurate_reasons: typing.Optional[list[str]] = None
|
|
||||||
user_id: typing.Optional[str] = None
|
|
||||||
session_id: typing.Optional[str] = None
|
|
||||||
message_id: typing.Optional[str] = None
|
|
||||||
stream_id: typing.Optional[str] = None
|
|
||||||
|
|
||||||
# ---- 群组事件 ----
|
|
||||||
|
|
||||||
class GroupMemberJoined(BaseEventModel):
|
|
||||||
"""新成员加入群组"""
|
|
||||||
group_id: typing.Union[int, str]
|
|
||||||
group_name: str
|
|
||||||
member_id: typing.Union[int, str]
|
|
||||||
member_name: str
|
|
||||||
inviter_id: typing.Optional[typing.Union[int, str]] = None
|
|
||||||
join_type: typing.Optional[str] = None
|
|
||||||
|
|
||||||
class GroupMemberLeft(BaseEventModel):
|
|
||||||
"""成员离开群组"""
|
|
||||||
group_id: typing.Union[int, str]
|
|
||||||
group_name: str
|
|
||||||
member_id: typing.Union[int, str]
|
|
||||||
member_name: str
|
|
||||||
is_kicked: bool = False
|
|
||||||
operator_id: typing.Optional[typing.Union[int, str]] = None
|
|
||||||
|
|
||||||
class GroupMemberBanned(BaseEventModel):
|
|
||||||
"""成员被禁言"""
|
|
||||||
group_id: typing.Union[int, str]
|
|
||||||
member_id: typing.Union[int, str]
|
|
||||||
operator_id: typing.Optional[typing.Union[int, str]] = None
|
|
||||||
duration: typing.Optional[int] = None
|
|
||||||
|
|
||||||
class GroupMemberUnbanned(BaseEventModel):
|
|
||||||
"""成员被解除禁言"""
|
|
||||||
group_id: typing.Union[int, str]
|
|
||||||
member_id: typing.Union[int, str]
|
|
||||||
operator_id: typing.Optional[typing.Union[int, str]] = None
|
|
||||||
|
|
||||||
class GroupInfoUpdated(BaseEventModel):
|
|
||||||
"""群组信息被修改"""
|
|
||||||
group_id: typing.Union[int, str]
|
|
||||||
group_name: str
|
|
||||||
operator_id: typing.Optional[typing.Union[int, str]] = None
|
|
||||||
changed_fields: list[str] = []
|
|
||||||
|
|
||||||
# ---- 好友事件 ----
|
|
||||||
|
|
||||||
class FriendRequestReceived(BaseEventModel):
|
|
||||||
"""收到好友请求"""
|
|
||||||
request_id: typing.Union[int, str]
|
|
||||||
user_id: typing.Union[int, str]
|
|
||||||
user_name: str
|
|
||||||
message: typing.Optional[str] = None
|
|
||||||
|
|
||||||
class FriendAdded(BaseEventModel):
|
|
||||||
"""成功添加好友"""
|
|
||||||
user_id: typing.Union[int, str]
|
|
||||||
user_name: str
|
|
||||||
|
|
||||||
class FriendRemoved(BaseEventModel):
|
|
||||||
"""好友被移除"""
|
|
||||||
user_id: typing.Union[int, str]
|
|
||||||
user_name: str
|
|
||||||
|
|
||||||
# ---- Bot 状态事件 ----
|
|
||||||
|
|
||||||
class BotInvitedToGroup(BaseEventModel):
|
|
||||||
"""Bot 被邀请加入群组"""
|
|
||||||
group_id: typing.Union[int, str]
|
|
||||||
group_name: str
|
|
||||||
inviter_id: typing.Optional[typing.Union[int, str]] = None
|
|
||||||
request_id: typing.Optional[typing.Union[int, str]] = None
|
|
||||||
|
|
||||||
class BotRemovedFromGroup(BaseEventModel):
|
|
||||||
"""Bot 被移出群组"""
|
|
||||||
group_id: typing.Union[int, str]
|
|
||||||
group_name: str
|
|
||||||
operator_id: typing.Optional[typing.Union[int, str]] = None
|
|
||||||
|
|
||||||
class BotMuted(BaseEventModel):
|
|
||||||
"""Bot 被禁言"""
|
|
||||||
group_id: typing.Union[int, str]
|
|
||||||
operator_id: typing.Optional[typing.Union[int, str]] = None
|
|
||||||
duration: typing.Optional[int] = None
|
|
||||||
|
|
||||||
class BotUnmuted(BaseEventModel):
|
|
||||||
"""Bot 被解除禁言"""
|
|
||||||
group_id: typing.Union[int, str]
|
|
||||||
operator_id: typing.Optional[typing.Union[int, str]] = None
|
|
||||||
|
|
||||||
# ---- 平台特有事件 ----
|
|
||||||
|
|
||||||
class PlatformSpecificEventReceived(BaseEventModel):
|
|
||||||
"""平台特有事件"""
|
|
||||||
adapter_name: str
|
|
||||||
action: str
|
|
||||||
data: dict = {}
|
|
||||||
```
|
|
||||||
|
|
||||||
### 2.2 EventListener 注册方式
|
|
||||||
|
|
||||||
插件的 EventListener 继续使用 `@self.handler(EventType)` 装饰器注册,只是可以注册的事件类型大幅增加:
|
|
||||||
|
|
||||||
```python
|
|
||||||
class MyEventListener(EventListener):
|
|
||||||
def __init__(self, host):
|
|
||||||
super().__init__(host)
|
|
||||||
|
|
||||||
# 现有方式(继续工作)
|
|
||||||
@self.handler(PersonNormalMessageReceived)
|
|
||||||
async def on_person_message(ctx: EventContext):
|
|
||||||
...
|
|
||||||
|
|
||||||
# 新事件类型
|
|
||||||
@self.handler(GroupMemberJoined)
|
|
||||||
async def on_member_joined(ctx: EventContext):
|
|
||||||
group_name = ctx.event.group_name
|
|
||||||
member_name = ctx.event.member_name
|
|
||||||
await ctx.reply(MessageChain([
|
|
||||||
Plain(f"欢迎 {member_name} 加入 {group_name}!")
|
|
||||||
]))
|
|
||||||
|
|
||||||
@self.handler(FriendRequestReceived)
|
|
||||||
async def on_friend_request(ctx: EventContext):
|
|
||||||
# 自动通过好友请求
|
|
||||||
await ctx.approve_friend_request(
|
|
||||||
ctx.event.request_id, approve=True
|
|
||||||
)
|
|
||||||
|
|
||||||
@self.handler(FeedbackReceived)
|
|
||||||
async def on_feedback(ctx: EventContext):
|
|
||||||
if ctx.event.feedback_type == 2:
|
|
||||||
await self.log_warning(
|
|
||||||
f"用户点踩了回复: {ctx.event.feedback_content or ''}"
|
|
||||||
)
|
|
||||||
|
|
||||||
@self.handler(PlatformSpecificEventReceived)
|
|
||||||
async def on_platform_event(ctx: EventContext):
|
|
||||||
if ctx.event.adapter_name == "telegram" and ctx.event.action == "chat_join_request":
|
|
||||||
...
|
|
||||||
```
|
|
||||||
|
|
||||||
## 3. 新 API 暴露
|
|
||||||
|
|
||||||
### 3.1 LangBotAPIProxy 扩展
|
|
||||||
|
|
||||||
在 `LangBotAPIProxy` 中新增以下方法,插件通过 `self.xxx()` 调用(在 BasePlugin 中继承):
|
|
||||||
|
|
||||||
```python
|
|
||||||
class LangBotAPIProxy:
|
|
||||||
# ---- 现有方法(保留) ----
|
|
||||||
# get_langbot_version, get_bots, get_bot_info,
|
|
||||||
# send_message, invoke_llm, get/set/delete_plugin_storage, ...
|
|
||||||
|
|
||||||
# ---- 新增消息 API ----
|
|
||||||
|
|
||||||
async def edit_message(
|
|
||||||
self,
|
|
||||||
bot_uuid: str,
|
|
||||||
chat_type: str,
|
|
||||||
chat_id: typing.Union[int, str],
|
|
||||||
message_id: typing.Union[int, str],
|
|
||||||
new_content: MessageChain,
|
|
||||||
) -> None:
|
|
||||||
"""编辑已发送的消息"""
|
|
||||||
...
|
|
||||||
|
|
||||||
async def delete_message(
|
|
||||||
self,
|
|
||||||
bot_uuid: str,
|
|
||||||
chat_type: str,
|
|
||||||
chat_id: typing.Union[int, str],
|
|
||||||
message_id: typing.Union[int, str],
|
|
||||||
) -> None:
|
|
||||||
"""删除/撤回消息"""
|
|
||||||
...
|
|
||||||
|
|
||||||
async def forward_message(
|
|
||||||
self,
|
|
||||||
bot_uuid: str,
|
|
||||||
from_chat_type: str,
|
|
||||||
from_chat_id: typing.Union[int, str],
|
|
||||||
message_id: typing.Union[int, str],
|
|
||||||
to_chat_type: str,
|
|
||||||
to_chat_id: typing.Union[int, str],
|
|
||||||
) -> dict:
|
|
||||||
"""转发消息"""
|
|
||||||
...
|
|
||||||
|
|
||||||
async def get_message(
|
|
||||||
self,
|
|
||||||
bot_uuid: str,
|
|
||||||
chat_type: str,
|
|
||||||
chat_id: typing.Union[int, str],
|
|
||||||
message_id: typing.Union[int, str],
|
|
||||||
) -> dict:
|
|
||||||
"""获取指定消息"""
|
|
||||||
...
|
|
||||||
|
|
||||||
# ---- 新增群组 API ----
|
|
||||||
|
|
||||||
async def get_group_info(
|
|
||||||
self,
|
|
||||||
bot_uuid: str,
|
|
||||||
group_id: typing.Union[int, str],
|
|
||||||
) -> dict:
|
|
||||||
"""获取群组信息"""
|
|
||||||
...
|
|
||||||
|
|
||||||
async def get_group_list(
|
|
||||||
self,
|
|
||||||
bot_uuid: str,
|
|
||||||
) -> list[dict]:
|
|
||||||
"""获取 Bot 加入的群组列表"""
|
|
||||||
...
|
|
||||||
|
|
||||||
async def get_group_member_list(
|
|
||||||
self,
|
|
||||||
bot_uuid: str,
|
|
||||||
group_id: typing.Union[int, str],
|
|
||||||
) -> list[dict]:
|
|
||||||
"""获取群成员列表"""
|
|
||||||
...
|
|
||||||
|
|
||||||
async def get_group_member_info(
|
|
||||||
self,
|
|
||||||
bot_uuid: str,
|
|
||||||
group_id: typing.Union[int, str],
|
|
||||||
user_id: typing.Union[int, str],
|
|
||||||
) -> dict:
|
|
||||||
"""获取指定群成员信息"""
|
|
||||||
...
|
|
||||||
|
|
||||||
async def mute_member(
|
|
||||||
self,
|
|
||||||
bot_uuid: str,
|
|
||||||
group_id: typing.Union[int, str],
|
|
||||||
user_id: typing.Union[int, str],
|
|
||||||
duration: int = 0,
|
|
||||||
) -> None:
|
|
||||||
"""禁言群成员"""
|
|
||||||
...
|
|
||||||
|
|
||||||
async def unmute_member(
|
|
||||||
self,
|
|
||||||
bot_uuid: str,
|
|
||||||
group_id: typing.Union[int, str],
|
|
||||||
user_id: typing.Union[int, str],
|
|
||||||
) -> None:
|
|
||||||
"""解除禁言"""
|
|
||||||
...
|
|
||||||
|
|
||||||
async def kick_member(
|
|
||||||
self,
|
|
||||||
bot_uuid: str,
|
|
||||||
group_id: typing.Union[int, str],
|
|
||||||
user_id: typing.Union[int, str],
|
|
||||||
) -> None:
|
|
||||||
"""踢出群成员"""
|
|
||||||
...
|
|
||||||
|
|
||||||
# ---- 新增用户 API ----
|
|
||||||
|
|
||||||
async def get_user_info(
|
|
||||||
self,
|
|
||||||
bot_uuid: str,
|
|
||||||
user_id: typing.Union[int, str],
|
|
||||||
) -> dict:
|
|
||||||
"""获取用户信息"""
|
|
||||||
...
|
|
||||||
|
|
||||||
async def get_friend_list(
|
|
||||||
self,
|
|
||||||
bot_uuid: str,
|
|
||||||
) -> list[dict]:
|
|
||||||
"""获取好友列表"""
|
|
||||||
...
|
|
||||||
|
|
||||||
async def approve_friend_request(
|
|
||||||
self,
|
|
||||||
bot_uuid: str,
|
|
||||||
request_id: typing.Union[int, str],
|
|
||||||
approve: bool = True,
|
|
||||||
remark: typing.Optional[str] = None,
|
|
||||||
) -> None:
|
|
||||||
"""处理好友请求"""
|
|
||||||
...
|
|
||||||
|
|
||||||
async def approve_group_invite(
|
|
||||||
self,
|
|
||||||
bot_uuid: str,
|
|
||||||
request_id: typing.Union[int, str],
|
|
||||||
approve: bool = True,
|
|
||||||
) -> None:
|
|
||||||
"""处理入群邀请"""
|
|
||||||
...
|
|
||||||
|
|
||||||
# ---- 新增透传 API ----
|
|
||||||
|
|
||||||
async def call_platform_api(
|
|
||||||
self,
|
|
||||||
bot_uuid: str,
|
|
||||||
action: str,
|
|
||||||
params: dict = {},
|
|
||||||
) -> dict:
|
|
||||||
"""调用适配器特有 API
|
|
||||||
|
|
||||||
Examples:
|
|
||||||
# Telegram: pin 消息
|
|
||||||
result = await self.call_platform_api(
|
|
||||||
bot_uuid, "pin_message",
|
|
||||||
{"chat_id": 123456, "message_id": 789}
|
|
||||||
)
|
|
||||||
|
|
||||||
# Discord: 创建频道
|
|
||||||
result = await self.call_platform_api(
|
|
||||||
bot_uuid, "create_channel",
|
|
||||||
{"guild_id": "...", "name": "new-channel"}
|
|
||||||
)
|
|
||||||
"""
|
|
||||||
...
|
|
||||||
|
|
||||||
# ---- 新增能力查询 API ----
|
|
||||||
|
|
||||||
async def get_supported_events(
|
|
||||||
self,
|
|
||||||
bot_uuid: str,
|
|
||||||
) -> list[str]:
|
|
||||||
"""获取指定 Bot 的适配器支持的事件类型"""
|
|
||||||
...
|
|
||||||
|
|
||||||
async def get_supported_apis(
|
|
||||||
self,
|
|
||||||
bot_uuid: str,
|
|
||||||
) -> list[str]:
|
|
||||||
"""获取指定 Bot 的适配器支持的 API"""
|
|
||||||
...
|
|
||||||
```
|
|
||||||
|
|
||||||
### 3.2 QueryBasedAPIProxy 扩展
|
|
||||||
|
|
||||||
在事件处理上下文中(EventContext),通过 `QueryBasedAPIProxy` 新增便捷方法:
|
|
||||||
|
|
||||||
```python
|
|
||||||
class QueryBasedAPIProxy:
|
|
||||||
# ---- 现有方法(保留) ----
|
|
||||||
# reply, get_bot_uuid, set_query_var, get_query_var,
|
|
||||||
# create_new_conversation, ...
|
|
||||||
|
|
||||||
# ---- 新增便捷方法 ----
|
|
||||||
|
|
||||||
async def edit_message(
|
|
||||||
self,
|
|
||||||
message_id: typing.Union[int, str],
|
|
||||||
new_content: MessageChain,
|
|
||||||
) -> None:
|
|
||||||
"""在当前会话中编辑消息(自动使用当前 bot_uuid 和 chat 信息)"""
|
|
||||||
...
|
|
||||||
|
|
||||||
async def delete_message(
|
|
||||||
self,
|
|
||||||
message_id: typing.Union[int, str],
|
|
||||||
) -> None:
|
|
||||||
"""在当前会话中删除消息"""
|
|
||||||
...
|
|
||||||
|
|
||||||
async def approve_friend_request(
|
|
||||||
self,
|
|
||||||
request_id: typing.Union[int, str],
|
|
||||||
approve: bool = True,
|
|
||||||
remark: typing.Optional[str] = None,
|
|
||||||
) -> None:
|
|
||||||
"""处理好友请求(上下文中自动获取 bot_uuid)"""
|
|
||||||
...
|
|
||||||
|
|
||||||
async def approve_group_invite(
|
|
||||||
self,
|
|
||||||
request_id: typing.Union[int, str],
|
|
||||||
approve: bool = True,
|
|
||||||
) -> None:
|
|
||||||
"""处理入群邀请"""
|
|
||||||
...
|
|
||||||
|
|
||||||
async def get_group_info(self) -> dict:
|
|
||||||
"""获取当前群组信息(仅群聊事件中可用)"""
|
|
||||||
...
|
|
||||||
|
|
||||||
async def get_group_member_list(self) -> list[dict]:
|
|
||||||
"""获取当前群组成员列表(仅群聊事件中可用)"""
|
|
||||||
...
|
|
||||||
|
|
||||||
async def call_platform_api(
|
|
||||||
self,
|
|
||||||
action: str,
|
|
||||||
params: dict = {},
|
|
||||||
) -> dict:
|
|
||||||
"""调用平台特有 API(自动使用当前 bot_uuid)"""
|
|
||||||
...
|
|
||||||
```
|
|
||||||
|
|
||||||
## 4. 兼容层设计
|
|
||||||
|
|
||||||
### 4.1 事件兼容层
|
|
||||||
|
|
||||||
当 PluginHandler 将新的 `MessageReceivedEvent` 分发给插件时,需要同时生成旧格式事件:
|
|
||||||
|
|
||||||
```python
|
|
||||||
class PluginEventCompatLayer:
|
|
||||||
"""插件事件兼容层
|
|
||||||
|
|
||||||
将新的统一事件转换为旧的插件事件格式,
|
|
||||||
确保监听旧事件类型的插件仍能正常工作。
|
|
||||||
"""
|
|
||||||
|
|
||||||
@staticmethod
|
|
||||||
def convert_to_legacy_events(
|
|
||||||
event: Event,
|
|
||||||
) -> list[BaseEventModel]:
|
|
||||||
"""将统一事件转换为旧插件事件列表
|
|
||||||
|
|
||||||
一个统一事件可能生成多个旧插件事件。
|
|
||||||
例如 MessageReceivedEvent 会同时生成:
|
|
||||||
- PersonMessageReceived / GroupMessageReceived(总是生成)
|
|
||||||
- PersonNormalMessageReceived / GroupNormalMessageReceived(非命令时)
|
|
||||||
- PersonCommandSent / GroupCommandSent(命令时)
|
|
||||||
"""
|
|
||||||
legacy_events = []
|
|
||||||
|
|
||||||
if isinstance(event, MessageReceivedEvent):
|
|
||||||
if event.chat_type == ChatType.PRIVATE:
|
|
||||||
legacy_events.append(
|
|
||||||
PersonMessageReceived(
|
|
||||||
launcher_type="person",
|
|
||||||
launcher_id=event.chat_id,
|
|
||||||
sender_id=event.sender.id,
|
|
||||||
message_event=event.to_legacy_friend_message(),
|
|
||||||
message_chain=event.message_chain,
|
|
||||||
)
|
|
||||||
)
|
|
||||||
# 命令检测后还会生成 PersonNormalMessageReceived
|
|
||||||
# 或 PersonCommandSent,在 Pipeline 阶段处理
|
|
||||||
elif event.chat_type == ChatType.GROUP:
|
|
||||||
legacy_events.append(
|
|
||||||
GroupMessageReceived(
|
|
||||||
launcher_type="group",
|
|
||||||
launcher_id=event.chat_id,
|
|
||||||
sender_id=event.sender.id,
|
|
||||||
message_event=event.to_legacy_group_message(),
|
|
||||||
message_chain=event.message_chain,
|
|
||||||
)
|
|
||||||
)
|
|
||||||
|
|
||||||
# 新事件类型没有旧的对应物,不生成兼容事件
|
|
||||||
# 只有监听了新事件类型的插件才会收到
|
|
||||||
|
|
||||||
return legacy_events
|
|
||||||
```
|
|
||||||
|
|
||||||
### 4.2 分发流程
|
|
||||||
|
|
||||||
```
|
|
||||||
统一事件 (MessageReceivedEvent)
|
|
||||||
│
|
|
||||||
├─→ 转换为旧格式 (PersonMessageReceived / GroupMessageReceived)
|
|
||||||
│ └─→ 分发给监听旧事件类型的插件 EventListener
|
|
||||||
│
|
|
||||||
└─→ 直接分发为新格式 (MessageReceivedEvent → 对应的插件事件)
|
|
||||||
└─→ 分发给监听新事件类型的插件 EventListener
|
|
||||||
```
|
|
||||||
|
|
||||||
插件 Runtime 在分发事件时检查每个 EventListener 注册的事件类型:
|
|
||||||
- 如果注册的是旧类型(`PersonMessageReceived` 等),发送兼容层生成的旧格式事件
|
|
||||||
- 如果注册的是新类型(`GroupMemberJoined` 等),发送新格式事件
|
|
||||||
- 两者可以共存,同一个插件可以同时监听新旧类型
|
|
||||||
|
|
||||||
### 4.3 API 兼容层
|
|
||||||
|
|
||||||
现有插件使用的 API 不受影响:
|
|
||||||
|
|
||||||
| 现有 API | 新架构行为 |
|
|
||||||
|---------|----------|
|
|
||||||
| `self.send_message(bot_uuid, target_type, target_id, message_chain)` | 不变,直接调用适配器的 `send_message` |
|
|
||||||
| `ctx.reply(message_chain, quote_origin)` | 不变,在 MessageReceivedEvent 上下文中调用适配器的 `reply_message` |
|
|
||||||
| `self.get_bots()` | 不变 |
|
|
||||||
| `self.get_bot_info(bot_uuid)` | 不变 |
|
|
||||||
|
|
||||||
新 API 只是额外新增的方法,不影响现有方法。
|
|
||||||
|
|
||||||
## 5. 通信协议扩展
|
|
||||||
|
|
||||||
### 5.1 新增 Action 枚举
|
|
||||||
|
|
||||||
在 `entities/io/actions/enums.py` 中新增 action:
|
|
||||||
|
|
||||||
```python
|
|
||||||
class PluginToRuntimeAction(str, Enum):
|
|
||||||
# ---- 现有 actions(保留) ----
|
|
||||||
REGISTER_PLUGIN = "register_plugin"
|
|
||||||
REPLY = "reply"
|
|
||||||
SEND_MESSAGE = "send_message"
|
|
||||||
# ...
|
|
||||||
|
|
||||||
# ---- 新增消息 API ----
|
|
||||||
EDIT_MESSAGE = "edit_message"
|
|
||||||
DELETE_MESSAGE = "delete_message"
|
|
||||||
FORWARD_MESSAGE = "forward_message"
|
|
||||||
GET_MESSAGE = "get_message"
|
|
||||||
|
|
||||||
# ---- 新增群组 API ----
|
|
||||||
GET_GROUP_INFO = "get_group_info"
|
|
||||||
GET_GROUP_LIST = "get_group_list"
|
|
||||||
GET_GROUP_MEMBER_LIST = "get_group_member_list"
|
|
||||||
GET_GROUP_MEMBER_INFO = "get_group_member_info"
|
|
||||||
MUTE_MEMBER = "mute_member"
|
|
||||||
UNMUTE_MEMBER = "unmute_member"
|
|
||||||
KICK_MEMBER = "kick_member"
|
|
||||||
|
|
||||||
# ---- 新增用户 API ----
|
|
||||||
GET_USER_INFO = "get_user_info"
|
|
||||||
GET_FRIEND_LIST = "get_friend_list"
|
|
||||||
APPROVE_FRIEND_REQUEST = "approve_friend_request"
|
|
||||||
APPROVE_GROUP_INVITE = "approve_group_invite"
|
|
||||||
|
|
||||||
# ---- 新增透传 API ----
|
|
||||||
CALL_PLATFORM_API = "call_platform_api"
|
|
||||||
|
|
||||||
# ---- 新增能力查询 ----
|
|
||||||
GET_SUPPORTED_EVENTS = "get_supported_events"
|
|
||||||
GET_SUPPORTED_APIS = "get_supported_apis"
|
|
||||||
|
|
||||||
|
|
||||||
class RuntimeToPluginAction(str, Enum):
|
|
||||||
# ---- 现有 actions(保留) ----
|
|
||||||
EMIT_EVENT = "emit_event"
|
|
||||||
# ...
|
|
||||||
# EMIT_EVENT 的 data 结构扩展以支持新事件类型
|
|
||||||
```
|
|
||||||
|
|
||||||
### 5.2 新增 Action 的请求/响应格式
|
|
||||||
|
|
||||||
以 `EDIT_MESSAGE` 为例:
|
|
||||||
|
|
||||||
```json
|
|
||||||
// 请求 (Plugin → Runtime)
|
|
||||||
{
|
|
||||||
"action": "edit_message",
|
|
||||||
"seq_id": 12345,
|
|
||||||
"data": {
|
|
||||||
"bot_uuid": "...",
|
|
||||||
"chat_type": "group",
|
|
||||||
"chat_id": "123456",
|
|
||||||
"message_id": "789",
|
|
||||||
"new_content": [
|
|
||||||
{ "type": "Plain", "text": "edited message" }
|
|
||||||
]
|
|
||||||
}
|
|
||||||
}
|
|
||||||
|
|
||||||
// 响应 (Runtime → Plugin)
|
|
||||||
{
|
|
||||||
"seq_id": 12345,
|
|
||||||
"code": 0,
|
|
||||||
"message": "ok",
|
|
||||||
"data": {}
|
|
||||||
}
|
|
||||||
```
|
|
||||||
|
|
||||||
以 `GET_GROUP_MEMBER_LIST` 为例:
|
|
||||||
|
|
||||||
```json
|
|
||||||
// 请求
|
|
||||||
{
|
|
||||||
"action": "get_group_member_list",
|
|
||||||
"seq_id": 12346,
|
|
||||||
"data": {
|
|
||||||
"bot_uuid": "...",
|
|
||||||
"group_id": "123456"
|
|
||||||
}
|
|
||||||
}
|
|
||||||
|
|
||||||
// 响应
|
|
||||||
{
|
|
||||||
"seq_id": 12346,
|
|
||||||
"code": 0,
|
|
||||||
"message": "ok",
|
|
||||||
"data": {
|
|
||||||
"members": [
|
|
||||||
{
|
|
||||||
"user": { "id": "111", "nickname": "Alice" },
|
|
||||||
"group_id": "123456",
|
|
||||||
"role": "admin",
|
|
||||||
"display_name": "管理员Alice"
|
|
||||||
},
|
|
||||||
...
|
|
||||||
]
|
|
||||||
}
|
|
||||||
}
|
|
||||||
```
|
|
||||||
|
|
||||||
以 `CALL_PLATFORM_API` 为例:
|
|
||||||
|
|
||||||
```json
|
|
||||||
// 请求
|
|
||||||
{
|
|
||||||
"action": "call_platform_api",
|
|
||||||
"seq_id": 12347,
|
|
||||||
"data": {
|
|
||||||
"bot_uuid": "...",
|
|
||||||
"action": "pin_message",
|
|
||||||
"params": {
|
|
||||||
"chat_id": "123456",
|
|
||||||
"message_id": "789"
|
|
||||||
}
|
|
||||||
}
|
|
||||||
}
|
|
||||||
|
|
||||||
// 响应
|
|
||||||
{
|
|
||||||
"seq_id": 12347,
|
|
||||||
"code": 0,
|
|
||||||
"message": "ok",
|
|
||||||
"data": {
|
|
||||||
"result": { ... }
|
|
||||||
}
|
|
||||||
}
|
|
||||||
```
|
|
||||||
|
|
||||||
### 5.3 LangBot 侧 Handler 实现
|
|
||||||
|
|
||||||
在 `ControlConnectionHandler`(LangBot → Runtime 侧)和 `PluginConnectionHandler`(Runtime → Plugin 侧)中新增对应的 action 处理逻辑:
|
|
||||||
|
|
||||||
```python
|
|
||||||
# PluginConnectionHandler 中新增
|
|
||||||
async def _handle_edit_message(self, data):
|
|
||||||
bot_uuid = data["bot_uuid"]
|
|
||||||
bot = await self.ap.platform_mgr.get_bot_by_uuid(bot_uuid)
|
|
||||||
await bot.adapter.edit_message(
|
|
||||||
chat_type=data["chat_type"],
|
|
||||||
chat_id=data["chat_id"],
|
|
||||||
message_id=data["message_id"],
|
|
||||||
new_content=MessageChain.model_validate(data["new_content"]),
|
|
||||||
)
|
|
||||||
return {}
|
|
||||||
|
|
||||||
async def _handle_call_platform_api(self, data):
|
|
||||||
bot_uuid = data["bot_uuid"]
|
|
||||||
bot = await self.ap.platform_mgr.get_bot_by_uuid(bot_uuid)
|
|
||||||
result = await bot.adapter.call_platform_api(
|
|
||||||
action=data["action"],
|
|
||||||
params=data.get("params", {}),
|
|
||||||
)
|
|
||||||
return {"result": result}
|
|
||||||
```
|
|
||||||
|
|
||||||
## 6. 插件开发者迁移指南
|
|
||||||
|
|
||||||
### 6.1 无需迁移(零修改运行)
|
|
||||||
|
|
||||||
以下场景的现有插件**不需要任何修改**:
|
|
||||||
|
|
||||||
- 使用 `PersonNormalMessageReceived` / `GroupNormalMessageReceived` 监听消息
|
|
||||||
- 使用 `PersonCommandSent` / `GroupCommandSent` 处理命令
|
|
||||||
- 使用 `ctx.reply()` 回复消息
|
|
||||||
- 使用 `self.send_message()` 主动发消息
|
|
||||||
- 使用 LLM / 存储 / RAG 等现有 API
|
|
||||||
|
|
||||||
### 6.2 推荐迁移(获得新能力)
|
|
||||||
|
|
||||||
如果插件希望利用新功能,可以:
|
|
||||||
|
|
||||||
1. **监听新事件类型**:在 EventListener 中注册新事件类型的 handler
|
|
||||||
2. **使用新 API**:调用 `self.edit_message()`, `self.get_group_info()` 等
|
|
||||||
3. **使用透传 API**:调用 `self.call_platform_api()` 使用平台特有功能
|
|
||||||
|
|
||||||
### 6.3 SDK 版本号
|
|
||||||
|
|
||||||
新功能通过提升 SDK minor 版本发布:
|
|
||||||
|
|
||||||
- 现有版本:`langbot-plugin-sdk >= x.y.z`
|
|
||||||
- 新版本:`langbot-plugin-sdk >= x.(y+1).0`
|
|
||||||
|
|
||||||
插件的 `manifest.yaml` 中的 `min_sdk_version` 决定是否能使用新 API。使用旧 SDK 版本的插件在新 LangBot 上正常运行(兼容层保证),只是无法调用新 API。
|
|
||||||
@@ -1,429 +0,0 @@
|
|||||||
# 分阶段迁移计划
|
|
||||||
|
|
||||||
## 1. 概述
|
|
||||||
|
|
||||||
EBA 架构涉及 langbot-plugin-sdk、LangBot 后端、LangBot 前端、文档和示例插件等多个仓库的改动。为降低风险、保证系统稳定性,采用分阶段渐进式迁移策略。
|
|
||||||
|
|
||||||
### 1.1 阶段总览
|
|
||||||
|
|
||||||
| 阶段 | 名称 | 范围 | 依赖 |
|
|
||||||
|------|------|------|------|
|
|
||||||
| Phase 1 | SDK 实体层 | langbot-plugin-sdk | 无 |
|
|
||||||
| Phase 2 | 适配器重构 | LangBot 后端 | Phase 1 |
|
|
||||||
| Phase 3 | 核心系统 | LangBot 后端 | Phase 2 |
|
|
||||||
| Phase 4 | 插件 SDK 集成 | langbot-plugin-sdk + LangBot | Phase 3 |
|
|
||||||
| Phase 5 | WebUI 编排面板 | LangBot 前端 | Phase 3 |
|
|
||||||
| Phase 6 | 文档与示例 | langbot-wiki + langbot-plugin-demo | Phase 4, 5 |
|
|
||||||
|
|
||||||
### 1.2 核心原则
|
|
||||||
|
|
||||||
- **每个阶段结束后系统可运行**:任何阶段完成后,现有功能不受影响
|
|
||||||
- **向后兼容贯穿全程**:旧接口在整个迁移期间保持可用
|
|
||||||
- **先 SDK 后实现**:先定义好接口和模型,再做具体实现
|
|
||||||
- **先核心适配器后边缘**:优先迁移用户量大的适配器
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 2. Phase 1:SDK 实体层
|
|
||||||
|
|
||||||
**目标**:在 langbot-plugin-sdk 中定义新的事件体系、通用实体、API 接口和适配器基类。
|
|
||||||
|
|
||||||
**仓库**:`langbot-plugin-sdk`
|
|
||||||
|
|
||||||
### 2.1 任务清单
|
|
||||||
|
|
||||||
| # | 任务 | 文件/模块 | 说明 |
|
|
||||||
|---|------|----------|------|
|
|
||||||
| 1.1 | 定义通用事件基类层次 | `api/entities/builtin/platform/events.py` | 新增 `MessageReceivedEvent`, `MessageEditedEvent`, `GroupMemberJoinedEvent` 等,保留现有 `FriendMessage`/`GroupMessage` |
|
|
||||||
| 1.2 | 定义平台特有事件基类 | `api/entities/builtin/platform/events.py` | 新增 `PlatformSpecificEvent` |
|
|
||||||
| 1.3 | 扩展通用实体 | `api/entities/builtin/platform/entities.py` | 新增 `User`(统一 Friend/GroupMember 的基础)、`Channel` 等,保留现有实体 |
|
|
||||||
| 1.4 | 清理消息组件 | `api/entities/builtin/platform/message.py` | 将 `WeChatMiniPrograms` 等 WeChat 特有组件标记为 platform-specific,不再作为通用组件 |
|
|
||||||
| 1.5 | 定义新适配器基类 | `api/definition/abstract/platform/adapter.py` | 新增 `AbstractPlatformAdapter`(继承现有 `AbstractMessagePlatformAdapter` 并扩展通用 API 方法),保留旧基类 |
|
|
||||||
| 1.6 | 定义 API 能力声明 | `api/definition/abstract/platform/capabilities.py`(新文件) | `AdapterCapabilities` 数据类,声明适配器支持的事件和 API |
|
|
||||||
| 1.7 | 定义 `NotSupportedError` | `api/entities/builtin/platform/errors.py`(新文件) | 可选 API 未实现时抛出的异常 |
|
|
||||||
|
|
||||||
### 2.2 关键设计约束
|
|
||||||
|
|
||||||
- 所有新增定义以**新增文件或新增类**的方式引入,**不修改**现有类的字段和方法签名
|
|
||||||
- 现有 `AbstractMessagePlatformAdapter` 保留不动,新基类 `AbstractPlatformAdapter` 继承它
|
|
||||||
- 新事件类与旧事件类并存,通过 `event_type` 字段(命名空间字符串)区分
|
|
||||||
|
|
||||||
### 2.3 验收标准
|
|
||||||
|
|
||||||
- [ ] 所有新增类可正常 import 且通过类型检查
|
|
||||||
- [ ] 现有 `FriendMessage`, `GroupMessage`, `AbstractMessagePlatformAdapter` 等类行为不变
|
|
||||||
- [ ] 新增单元测试覆盖事件序列化/反序列化、实体构造
|
|
||||||
- [ ] SDK 版本号 minor bump(如 `0.x.0` → `0.x+1.0`)
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 3. Phase 2:适配器重构
|
|
||||||
|
|
||||||
**目标**:将现有单文件适配器迁移到独立目录结构,实现新事件监听和通用 API。
|
|
||||||
|
|
||||||
**仓库**:`LangBot`(后端)
|
|
||||||
|
|
||||||
### 3.1 适配器迁移优先级
|
|
||||||
|
|
||||||
根据用户量和代表性,建议按以下顺序迁移:
|
|
||||||
|
|
||||||
| 优先级 | 适配器 | 理由 |
|
|
||||||
|--------|--------|------|
|
|
||||||
| P0 | **Telegram** | 用户量大,API 最完善,适合作为参考实现 |
|
|
||||||
| P0 | **Discord** | 国际用户主要平台,事件类型丰富 |
|
|
||||||
| P1 | **aiocqhttp**(OneBot v11) | 国内 QQ 用户主要适配器 |
|
|
||||||
| P1 | **Satori** | 通用协议适配器,覆盖多个平台 |
|
|
||||||
| P2 | **Lark** / **DingTalk** / **Slack** | 企业平台,用户量中等 |
|
|
||||||
| P2 | **qqofficial** / **WeChat 系列** | 国内用户 |
|
|
||||||
| P3 | **Kook** / **LINE** / **WeCom 系列** | 用户量较小 |
|
|
||||||
| P3 | **WebSocket** | 内置适配器,相对简单 |
|
|
||||||
| P4 | **legacy/*** | 遗留适配器,按需决定是否迁移或废弃 |
|
|
||||||
|
|
||||||
### 3.2 单个适配器迁移步骤(以 Telegram 为例)
|
|
||||||
|
|
||||||
| # | 任务 | 说明 |
|
|
||||||
|---|------|------|
|
|
||||||
| 2.1 | 创建目录结构 | `pkg/platform/adapters/telegram/` 下创建 `__init__.py`, `adapter.py`, `event_converter.py`, `message_converter.py`, `api_impl.py`, `types.py`, `manifest.yaml` |
|
|
||||||
| 2.2 | 迁移消息转换器 | 将 `TelegramMessageConverter` 从 `sources/telegram.py` 搬到 `adapters/telegram/message_converter.py`,逻辑不变 |
|
|
||||||
| 2.3 | 重写事件转换器 | 新的 `TelegramEventConverter` 支持将 Telegram Update 转换为所有通用事件类型(不只是消息),不支持的事件转为 `PlatformSpecificEvent` |
|
|
||||||
| 2.4 | 实现通用 API | 在 `api_impl.py` 中实现 `edit_message`, `delete_message`, `get_group_info` 等 Telegram 支持的通用 API |
|
|
||||||
| 2.5 | 实现透传 API | 在 `adapter.py` 中实现 `call_platform_api`,将 action 映射到 Telegram Bot API 调用 |
|
|
||||||
| 2.6 | 声明能力 | 在 `manifest.yaml` 或适配器类中声明支持的事件和 API 列表 |
|
|
||||||
| 2.7 | 新建 Adapter 主类 | `TelegramAdapter` 继承 `AbstractPlatformAdapter`(新基类),委托各模块实现 |
|
|
||||||
| 2.8 | 更新 manifest.yaml | 更新 `execution.python.path` 指向新位置 |
|
|
||||||
| 2.9 | 验证 | 确保新适配器通过现有消息收发流程的测试 |
|
|
||||||
|
|
||||||
### 3.3 基础设施任务
|
|
||||||
|
|
||||||
| # | 任务 | 说明 |
|
|
||||||
|---|------|------|
|
|
||||||
| 2.A | 创建 `adapters/_base/` | 将 SDK 中新基类的运行时辅助代码放在此处(如事件分发辅助函数) |
|
|
||||||
| 2.B | 更新 ComponentDiscovery | 使 `discover_blueprint` 支持扫描 `adapters/` 子目录中的 YAML |
|
|
||||||
| 2.C | 更新 `templates/components.yaml` | 将 `fromDirs` 从 `pkg/platform/sources/` 改为 `pkg/platform/adapters/`(过渡期两个都扫描) |
|
|
||||||
| 2.D | 保留旧 sources/ | 过渡期不删除旧文件,通过 manifest 的 `deprecated: true` 标记 |
|
|
||||||
|
|
||||||
### 3.4 验收标准
|
|
||||||
|
|
||||||
- [ ] 已迁移的适配器在新目录结构下正常启动和收发消息
|
|
||||||
- [ ] 新事件(如 `message.edited`)在支持的平台上正确触发
|
|
||||||
- [ ] 通用 API(如 `edit_message`)在支持的平台上正确执行
|
|
||||||
- [ ] 未迁移的适配器(仍在 `sources/`)继续正常工作
|
|
||||||
- [ ] ComponentDiscovery 同时扫描新旧目录
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 4. Phase 3:核心系统
|
|
||||||
|
|
||||||
**目标**:实现 EventBus、EventRouter 和事件处理器框架,将事件从适配器分发到不同的处理器。
|
|
||||||
|
|
||||||
**仓库**:`LangBot`(后端)
|
|
||||||
|
|
||||||
### 4.1 任务清单
|
|
||||||
|
|
||||||
| # | 任务 | 文件/模块 | 说明 |
|
|
||||||
|---|------|----------|------|
|
|
||||||
| 3.1 | 实现 EventBus | `pkg/platform/event_bus.py`(新文件) | 事件总线:接收适配器事件,进行日志记录,分发给 EventRouter |
|
|
||||||
| 3.2 | 实现 EventRouter | `pkg/platform/event_router.py`(新文件) | 事件路由引擎:读取 Bot 的 `event_handlers` 配置,匹配事件类型,分发到对应 Handler |
|
|
||||||
| 3.3 | 实现 PipelineHandler | `pkg/platform/handlers/pipeline_handler.py` | 将 `message.received` 事件转为现有 Query,进入 Pipeline 流水线 |
|
|
||||||
| 3.4 | 实现 AgentHandler | `pkg/platform/handlers/agent_handler.py` | 直接调用 RequestRunner 处理事件,不经过 Pipeline 多 Stage 流程 |
|
|
||||||
| 3.5 | 实现 WebhookHandler | `pkg/platform/handlers/webhook_handler.py` | 将事件 POST 到外部 URL,解析响应执行动作(重构现有 WebhookPusher) |
|
|
||||||
| 3.6 | 实现 PluginHandler | `pkg/platform/handlers/plugin_handler.py` | 将事件分发给插件 EventListener(复用现有 plugin_connector 机制) |
|
|
||||||
| 3.7 | Bot 实体扩展 | `pkg/entity/persistence/bot.py` | 新增 `event_handlers` JSON 字段 |
|
|
||||||
| 3.8 | 数据库迁移 | `pkg/persistence/migrations/` | 新增迁移脚本:添加 `event_handlers` 列,将现有 `use_pipeline_uuid` 数据迁移为 `event_handlers` 格式 |
|
|
||||||
| 3.9 | 重构 RuntimeBot | `pkg/platform/botmgr.py` | 将 `initialize()` 中硬编码的 `on_friend_message`/`on_group_message` 回调替换为通过 EventBus 分发所有事件 |
|
|
||||||
| 3.10 | 重构 MessageAggregator | `pkg/pipeline/aggregator.py` | 从 RuntimeBot 解耦,作为 PipelineHandler 的内部机制(只对 `message.received` 事件生效) |
|
|
||||||
| 3.11 | Agent Handler 中 RequestRunner 解耦 | `pkg/provider/runner.py` + handlers | RequestRunner 需要能独立于 Pipeline Stage 运行,为 Agent Handler 提供轻量调用路径 |
|
|
||||||
| 3.12 | HTTP API 扩展 | `pkg/api/http/controller/` | 新增/更新 Bot API 端点以支持 `event_handlers` 的 CRUD |
|
|
||||||
|
|
||||||
### 4.2 数据迁移策略
|
|
||||||
|
|
||||||
现有 Bot 表有 `use_pipeline_uuid` 字段,需要自动迁移为 `event_handlers`:
|
|
||||||
|
|
||||||
```python
|
|
||||||
# 迁移逻辑伪代码
|
|
||||||
for bot in all_bots:
|
|
||||||
if bot.use_pipeline_uuid:
|
|
||||||
bot.event_handlers = [
|
|
||||||
{
|
|
||||||
"event_type": "message.received",
|
|
||||||
"handler_type": "pipeline",
|
|
||||||
"handler_config": {
|
|
||||||
"pipeline_uuid": bot.use_pipeline_uuid
|
|
||||||
}
|
|
||||||
}
|
|
||||||
]
|
|
||||||
else:
|
|
||||||
bot.event_handlers = []
|
|
||||||
```
|
|
||||||
|
|
||||||
### 4.3 RuntimeBot 重构要点
|
|
||||||
|
|
||||||
当前 `RuntimeBot.initialize()` 硬编码注册两个回调:
|
|
||||||
|
|
||||||
```python
|
|
||||||
# 现有代码 (botmgr.py)
|
|
||||||
self.adapter.register_listener(FriendMessage, on_friend_message)
|
|
||||||
self.adapter.register_listener(GroupMessage, on_group_message)
|
|
||||||
```
|
|
||||||
|
|
||||||
重构后改为注册通用事件回调:
|
|
||||||
|
|
||||||
```python
|
|
||||||
# 新代码
|
|
||||||
async def on_event(event: Event, adapter: AbstractPlatformAdapter):
|
|
||||||
await self.event_bus.emit(
|
|
||||||
bot_uuid=self.bot_entity.uuid,
|
|
||||||
event=event,
|
|
||||||
adapter=adapter,
|
|
||||||
)
|
|
||||||
|
|
||||||
# 注册所有事件类型的统一回调
|
|
||||||
self.adapter.register_listener(Event, on_event)
|
|
||||||
```
|
|
||||||
|
|
||||||
EventBus 接收事件后,调用 EventRouter 按配置分发。
|
|
||||||
|
|
||||||
### 4.4 事件处理器执行流程
|
|
||||||
|
|
||||||
```
|
|
||||||
EventBus.emit(bot_uuid, event, adapter)
|
|
||||||
│
|
|
||||||
▼
|
|
||||||
EventRouter.route(bot_uuid, event)
|
|
||||||
│ 查询 bot.event_handlers 配置
|
|
||||||
│ 匹配 event_type(精确匹配 > 通配符 *)
|
|
||||||
▼
|
|
||||||
匹配到的 Handler(s)
|
|
||||||
│
|
|
||||||
├── PipelineHandler.handle(event, adapter)
|
|
||||||
│ │ 仅支持 message.received
|
|
||||||
│ │ 构造 Query → MessageAggregator → QueryPool → Pipeline
|
|
||||||
│ └── 沿用现有完整流水线机制
|
|
||||||
│
|
|
||||||
├── AgentHandler.handle(event, adapter)
|
|
||||||
│ │ 根据 handler_config 选择 RequestRunner
|
|
||||||
│ │ 直接调用 runner.run() 处理事件
|
|
||||||
│ └── 将结果通过 adapter API 回复
|
|
||||||
│
|
|
||||||
├── WebhookHandler.handle(event, adapter)
|
|
||||||
│ │ 序列化事件为 JSON
|
|
||||||
│ │ POST 到 handler_config.url
|
|
||||||
│ └── 解析响应,执行动作(回复消息、调用 API 等)
|
|
||||||
│
|
|
||||||
└── PluginHandler.handle(event, adapter)
|
|
||||||
│ 通过 plugin_connector 分发给插件
|
|
||||||
└── 插件 EventListener 处理
|
|
||||||
```
|
|
||||||
|
|
||||||
### 4.5 验收标准
|
|
||||||
|
|
||||||
- [ ] `message.received` 事件通过 PipelineHandler 正确进入现有 Pipeline(与旧行为一致)
|
|
||||||
- [ ] 新增事件(如 `group.member_joined`)能通过 PluginHandler 分发给插件
|
|
||||||
- [ ] AgentHandler 能直接调用 RequestRunner(至少 `local-agent`)处理事件并回复
|
|
||||||
- [ ] WebhookHandler 能将事件 POST 到外部 URL
|
|
||||||
- [ ] 数据库迁移正确执行,`use_pipeline_uuid` 数据迁移到 `event_handlers`
|
|
||||||
- [ ] 现有 Bot 在不修改配置的情况下行为不变(自动迁移保证)
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 5. Phase 4:插件 SDK 集成
|
|
||||||
|
|
||||||
**目标**:将新事件和 API 通过插件 SDK 暴露给插件开发者,同时实现兼容层。
|
|
||||||
|
|
||||||
**仓库**:`langbot-plugin-sdk` + `LangBot`
|
|
||||||
|
|
||||||
### 5.1 任务清单
|
|
||||||
|
|
||||||
| # | 任务 | 说明 |
|
|
||||||
|---|------|------|
|
|
||||||
| 4.1 | 新增插件事件包装 | 在 `api/entities/events.py` 中为每个通用事件新增插件级事件类(如 `MessageEditedReceived`, `MemberJoinedReceived`) |
|
|
||||||
| 4.2 | 兼容层实现 | `PersonMessageReceived` / `GroupMessageReceived` 由新的 `MessageReceivedEvent` 自动生成,旧事件作为新事件的 alias |
|
|
||||||
| 4.3 | 新 API 暴露 | 在 `LangBotAPIProxy` 中新增方法:`edit_message`, `delete_message`, `get_group_info`, `get_user_info`, `call_platform_api` 等 |
|
|
||||||
| 4.4 | 通信协议扩展 | 在 `entities/io/actions/enums.py` 中新增 action 枚举(如 `EDIT_MESSAGE`, `DELETE_MESSAGE`, `GET_GROUP_INFO`, `CALL_PLATFORM_API`) |
|
|
||||||
| 4.5 | Runtime Handler 扩展 | 在 PluginConnectionHandler / ControlConnectionHandler 中添加新 action 的处理逻辑 |
|
|
||||||
| 4.6 | EventListener 扩展 | 确保 `@handler()` 装饰器支持注册新事件类型 |
|
|
||||||
| 4.7 | QueryBasedAPI 扩展 | 在 `QueryBasedAPIProxy` 中新增事件上下文相关的 API(如 `get_event_source_adapter`) |
|
|
||||||
|
|
||||||
### 5.2 兼容层详细设计
|
|
||||||
|
|
||||||
```
|
|
||||||
新事件系统 旧事件系统(兼容层)
|
|
||||||
───────────── ─────────────────
|
|
||||||
MessageReceivedEvent ┌→ PersonMessageReceived (chat_type == "private")
|
|
||||||
(chat_type: "private"|"group") ┤
|
|
||||||
└→ GroupMessageReceived (chat_type == "group")
|
|
||||||
```
|
|
||||||
|
|
||||||
**实现方式**:在 RuntimeEventDispatcher 中,当分发 `MessageReceivedEvent` 给插件时,同时生成对应的旧事件类实例。插件可以用新事件类或旧事件类注册 handler,都能收到。
|
|
||||||
|
|
||||||
### 5.3 验收标准
|
|
||||||
|
|
||||||
- [ ] 现有插件(使用旧事件和 API)无需修改即可运行
|
|
||||||
- [ ] 新插件可以使用新事件类型(如 `MemberJoinedReceived`)注册 handler
|
|
||||||
- [ ] 新 API(如 `edit_message`)可通过 `self.edit_message()` 或 `event_context.edit_message()` 调用
|
|
||||||
- [ ] 透传 API `call_platform_api` 可正常调用适配器特有功能
|
|
||||||
- [ ] 所有新 action 的通信协议正确工作(stdio / WebSocket)
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 6. Phase 5:WebUI 编排面板
|
|
||||||
|
|
||||||
**目标**:在 WebUI 的 Bot 管理页面实现事件处理器的可视化编排。
|
|
||||||
|
|
||||||
**仓库**:`LangBot`(前端 `web/`)
|
|
||||||
|
|
||||||
### 6.1 任务清单
|
|
||||||
|
|
||||||
| # | 任务 | 说明 |
|
|
||||||
|---|------|------|
|
|
||||||
| 5.1 | Bot 编辑页面扩展 | 在 Bot 编辑页面新增「事件处理」面板 |
|
|
||||||
| 5.2 | 事件处理器列表组件 | 可视化展示当前 Bot 的 `event_handlers` 列表,支持增删改排序 |
|
|
||||||
| 5.3 | 事件类型选择器 | 下拉选择事件类型(命名空间分组展示),支持通配符 `*` |
|
|
||||||
| 5.4 | Handler 类型选择与配置 | 选择 handler 类型后展示对应的配置表单(Pipeline 选择器、Runner 选择器、Webhook URL 等) |
|
|
||||||
| 5.5 | Pipeline Handler 配置 | 复用现有的 Pipeline 选择 UI(从现有 `use_pipeline_uuid` 选择器迁移) |
|
|
||||||
| 5.6 | Agent Handler 配置 | Runner 选择器(local-agent / dify / n8n / coze 等)+ Runner 参数配置表单 |
|
|
||||||
| 5.7 | Webhook Handler 配置 | URL 输入、认证方式选择、Header 配置 |
|
|
||||||
| 5.8 | Plugin Handler 配置 | 通常无需额外配置,分发给所有匹配的插件 EventListener |
|
|
||||||
| 5.9 | HTTP API 对接 | 前端调用后端 API 保存/读取 `event_handlers` 配置 |
|
|
||||||
| 5.10 | 迁移提示 | 对于从旧版本升级的用户,如果检测到 `use_pipeline_uuid` 已自动迁移,展示提示说明 |
|
|
||||||
|
|
||||||
### 6.2 UI 交互设计概要
|
|
||||||
|
|
||||||
```
|
|
||||||
┌─ Bot 编辑页面 ─────────────────────────────────────┐
|
|
||||||
│ │
|
|
||||||
│ 基本信息 │ 适配器配置 │ ★ 事件处理 │ │
|
|
||||||
│ │
|
|
||||||
│ ┌─ 事件处理器列表 ────────────────────────────┐ │
|
|
||||||
│ │ │ │
|
|
||||||
│ │ ① message.received → Pipeline: "主流水线" │ │
|
|
||||||
│ │ [编辑] [删除] │ │
|
|
||||||
│ │ │ │
|
|
||||||
│ │ ② group.member_joined → Agent: local-agent │ │
|
|
||||||
│ │ [编辑] [删除] │ │
|
|
||||||
│ │ │ │
|
|
||||||
│ │ ③ * (默认) → Plugin │ │
|
|
||||||
│ │ [编辑] [删除] │ │
|
|
||||||
│ │ │ │
|
|
||||||
│ │ [+ 添加事件处理器] │ │
|
|
||||||
│ │ │ │
|
|
||||||
│ └──────────────────────────────────────────────┘ │
|
|
||||||
│ │
|
|
||||||
│ [保存] [取消] │
|
|
||||||
└─────────────────────────────────────────────────────┘
|
|
||||||
```
|
|
||||||
|
|
||||||
### 6.3 验收标准
|
|
||||||
|
|
||||||
- [ ] 用户可以在 WebUI 上为 Bot 添加/编辑/删除事件处理器
|
|
||||||
- [ ] 四种 Handler 类型均有对应的配置表单
|
|
||||||
- [ ] 配置保存后正确写入数据库 `event_handlers` 字段
|
|
||||||
- [ ] 旧版本升级后,自动迁移的配置在 UI 上正确展示
|
|
||||||
- [ ] Pipeline Handler 的行为与旧的 `use_pipeline_uuid` 完全一致
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 7. Phase 6:文档与示例
|
|
||||||
|
|
||||||
**目标**:更新所有面向开发者的文档和示例。
|
|
||||||
|
|
||||||
**仓库**:`langbot-wiki`, `langbot-plugin-demo`
|
|
||||||
|
|
||||||
### 7.1 任务清单
|
|
||||||
|
|
||||||
| # | 任务 | 仓库 | 说明 |
|
|
||||||
|---|------|------|------|
|
|
||||||
| 6.1 | EBA 架构概览文档 | langbot-wiki | 面向用户的新架构说明 |
|
|
||||||
| 6.2 | 适配器开发指南更新 | langbot-wiki | 如何开发一个新的适配器(新目录结构、新基类、事件转换等) |
|
|
||||||
| 6.3 | 插件开发指南更新 | langbot-wiki | 新事件类型、新 API 的使用说明 |
|
|
||||||
| 6.4 | 插件迁移指南 | langbot-wiki | 现有插件如何迁移到新事件/API(如果需要使用新能力) |
|
|
||||||
| 6.5 | 事件处理器配置指南 | langbot-wiki | WebUI 上如何配置事件处理器 |
|
|
||||||
| 6.6 | 示例插件更新 | langbot-plugin-demo | HelloPlugin 增加新事件监听示例、新 API 调用示例 |
|
|
||||||
| 6.7 | 新示例插件 | langbot-plugin-demo | 新建一个示例展示非消息事件处理(如入群欢迎) |
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 8. 风险评估与缓解
|
|
||||||
|
|
||||||
### 8.1 技术风险
|
|
||||||
|
|
||||||
| 风险 | 影响 | 概率 | 缓解措施 |
|
|
||||||
|------|------|------|----------|
|
|
||||||
| 适配器迁移中断现有功能 | 高 | 中 | 新旧目录并存,ComponentDiscovery 同时扫描两个目录,逐个适配器迁移验证 |
|
|
||||||
| 事件模型不兼容导致插件崩溃 | 高 | 低 | 兼容层保证旧事件类型继续工作,新增类不修改旧类 |
|
|
||||||
| 数据库迁移失败 | 高 | 低 | 迁移脚本做前置校验,`use_pipeline_uuid` 在过渡期保留不删除 |
|
|
||||||
| RequestRunner 解耦破坏 Pipeline | 高 | 中 | Agent Handler 调用 Runner 的路径独立于 Pipeline,不修改现有 Pipeline Stage 中的 Runner 调用逻辑 |
|
|
||||||
| 性能回退(EventBus 额外开销) | 中 | 低 | EventBus 在进程内同步分发,无额外序列化/网络开销 |
|
|
||||||
| 各平台事件差异大难以统一 | 中 | 中 | 通用事件只抽象最大公约数字段,差异部分保留在 `source_platform_object`;不支持的事件走 `PlatformSpecificEvent` |
|
|
||||||
|
|
||||||
### 8.2 兼容性风险
|
|
||||||
|
|
||||||
| 风险 | 缓解措施 |
|
|
||||||
|------|----------|
|
|
||||||
| 现有插件使用旧事件类 | 兼容层自动将新事件转为旧事件分发,两种事件类都能注册 handler |
|
|
||||||
| 现有插件调用 `reply()` / `send_message()` | 这两个 API 保持不变,只是底层实现可能微调 |
|
|
||||||
| 第三方基于 `AbstractMessagePlatformAdapter` 开发的适配器 | 旧基类保留,新基类继承旧基类,第三方适配器无需立即迁移 |
|
|
||||||
| 用户自定义 Pipeline 配置 | Pipeline 机制完整保留,PipelineHandler 只是入口变了(从 RuntimeBot 硬编码变为 EventRouter 配置) |
|
|
||||||
|
|
||||||
### 8.3 回滚策略
|
|
||||||
|
|
||||||
每个 Phase 独立可回滚:
|
|
||||||
|
|
||||||
- **Phase 1**(SDK 新增类):删除新增文件,回退 SDK 版本号
|
|
||||||
- **Phase 2**(适配器目录):恢复 `components.yaml` 的 `fromDirs` 指向旧目录,旧 sources/ 未删除
|
|
||||||
- **Phase 3**(核心系统):回退数据库迁移,恢复 RuntimeBot 旧的硬编码回调
|
|
||||||
- **Phase 4**(插件集成):回退 SDK 版本,插件使用旧版 SDK
|
|
||||||
- **Phase 5**(WebUI):前端回退,Bot 编辑页面隐藏事件处理面板
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 9. 里程碑与时间线建议
|
|
||||||
|
|
||||||
| 里程碑 | 阶段 | 预期产出 |
|
|
||||||
|--------|------|----------|
|
|
||||||
| M1 | Phase 1 完成 | SDK 新版本发布,包含新事件/实体/基类定义 |
|
|
||||||
| M2 | Phase 2 首批适配器(Telegram + Discord) | 两个参考实现,验证目录结构和事件/API 体系 |
|
|
||||||
| M3 | Phase 3 核心系统 | EventBus + EventRouter + 四种 Handler 可用 |
|
|
||||||
| M4 | Phase 2 剩余适配器 | 所有活跃适配器迁移完成 |
|
|
||||||
| M5 | Phase 4 插件集成 | 新 SDK 发布,插件可使用新事件和 API |
|
|
||||||
| M6 | Phase 5 WebUI | 事件处理器编排面板上线 |
|
|
||||||
| M7 | Phase 6 文档 | 开发者文档和示例更新完毕 |
|
|
||||||
|
|
||||||
建议 M1-M3 作为第一个大版本发布(如 v5.0),M4-M7 在后续小版本迭代中完成。
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 10. 开发指引
|
|
||||||
|
|
||||||
### 10.1 分支策略
|
|
||||||
|
|
||||||
建议在主仓库创建 `feature/eba` 长期特性分支,各 Phase 在子分支上开发后合入特性分支:
|
|
||||||
|
|
||||||
```
|
|
||||||
main
|
|
||||||
└── feature/eba
|
|
||||||
├── feature/eba-sdk-entities (Phase 1)
|
|
||||||
├── feature/eba-adapter-telegram (Phase 2)
|
|
||||||
├── feature/eba-adapter-discord (Phase 2)
|
|
||||||
├── feature/eba-core-system (Phase 3)
|
|
||||||
├── feature/eba-plugin-sdk (Phase 4)
|
|
||||||
└── feature/eba-webui (Phase 5)
|
|
||||||
```
|
|
||||||
|
|
||||||
### 10.2 测试策略
|
|
||||||
|
|
||||||
| 层次 | 测试内容 | 工具 |
|
|
||||||
|------|----------|------|
|
|
||||||
| 单元测试 | 事件序列化/反序列化、实体构造、API 调用 mock | pytest |
|
|
||||||
| 集成测试 | EventBus → EventRouter → Handler 全链路 | pytest + asyncio |
|
|
||||||
| 适配器测试 | 各适配器的事件转换、消息转换、API 调用 | pytest + mock SDK |
|
|
||||||
| 端到端测试 | 从模拟平台事件到完整处理流程 | staging 环境 |
|
|
||||||
| 插件兼容性测试 | 旧插件在新系统下的行为 | langbot-plugin-demo |
|
|
||||||
|
|
||||||
### 10.3 代码审查关注点
|
|
||||||
|
|
||||||
- 新增代码是否影响现有行为
|
|
||||||
- 兼容层是否正确映射所有旧事件/API 场景
|
|
||||||
- 数据库迁移是否可逆
|
|
||||||
- 新 API 的错误处理(`NotSupportedError`)是否一致
|
|
||||||
- 事件模型的序列化在 stdio/WebSocket 通信中是否正确
|
|
||||||
@@ -1,39 +0,0 @@
|
|||||||
# EBA Adapter Migration Records
|
|
||||||
|
|
||||||
This directory records adapter-level migration details for the Event-Based Agents architecture. Each adapter document should be kept close to the implementation and must answer four questions:
|
|
||||||
|
|
||||||
1. What changed in the adapter structure.
|
|
||||||
2. Which configuration fields are required.
|
|
||||||
3. Which events and APIs are supported.
|
|
||||||
4. What has been verified end to end.
|
|
||||||
|
|
||||||
## Adapter Documents
|
|
||||||
|
|
||||||
General acceptance checklist: [EBA Adapter Acceptance Checklist](./acceptance-checklist.md)
|
|
||||||
|
|
||||||
Current acceptance report: [EBA Adapter Acceptance Report](./acceptance-report.md)
|
|
||||||
|
|
||||||
| Adapter | Status | Document |
|
|
||||||
|---------|--------|----------|
|
|
||||||
| Telegram | Migrated; partial plugin E2E, real UI inbound image/file verified | [Telegram](./telegram.md) |
|
|
||||||
| Discord | Migrated; partial plugin E2E, media-inbound gaps remain | [Discord](./discord.md) |
|
|
||||||
| OneBot v11 / aiocqhttp | Migrated; Matcha UI plus protocol-level multi-component coverage | [OneBot v11 / aiocqhttp](./aiocqhttp.md) |
|
|
||||||
| DingTalk | Migrated; partial plugin E2E, real UI inbound image/file verified; group gap remains | [DingTalk](./dingtalk.md) |
|
|
||||||
| Lark / Feishu | Migrated; partial live text E2E, media-inbound gap remains | [Lark / Feishu](./lark.md) |
|
|
||||||
| WeCom | Migrated; private text plugin E2E verified, media/group gaps remain | [WeCom](./wecom.md) |
|
|
||||||
| WeComBot | Migrated; private text and outbound/API plugin E2E verified, feedback/group gaps remain | [WeComBot](./wecombot.md) |
|
|
||||||
| Official Account | Migrated; private text plugin E2E verified, proactive outbound not supported | [Official Account](./officialaccount.md) |
|
|
||||||
| QQ Official API | Migrated; WebSocket inbound reached LangBot, model config blocked reply | [QQ Official API](./qqofficial.md) |
|
|
||||||
| Slack | Migrated; private text and outbound/API plugin E2E verified | [Slack](./slack.md) |
|
|
||||||
|
|
||||||
## Documentation Checklist
|
|
||||||
|
|
||||||
When migrating a new adapter, add one document here with:
|
|
||||||
|
|
||||||
- Configuration table matching the adapter manifest.
|
|
||||||
- Supported event list.
|
|
||||||
- Supported common API list.
|
|
||||||
- Supported `call_platform_api` action list.
|
|
||||||
- Known unsupported APIs and the reason.
|
|
||||||
- Live test notes, including platform, channel type, destructive operations, and residual risks.
|
|
||||||
- A clear distinction between real UI inbound media, protocol-level injected inbound media, and bot outbound media.
|
|
||||||
@@ -1,208 +0,0 @@
|
|||||||
# EBA Adapter Acceptance Checklist
|
|
||||||
|
|
||||||
This checklist is the architecture-level acceptance standard for every Event-Based Agents platform adapter. It is not platform-specific. Adapter migration is not complete until the adapter has a written result against this checklist.
|
|
||||||
|
|
||||||
## Evidence Levels
|
|
||||||
|
|
||||||
Use these evidence levels consistently in adapter records:
|
|
||||||
|
|
||||||
| Level | Meaning | Can Mark Complete |
|
|
||||||
|-------|---------|-------------------|
|
|
||||||
| `plugin-e2e-ui` | Real SDK plugin running through standalone runtime, LangBot core, the migrated adapter, and a real platform/simulator UI action. | Yes |
|
|
||||||
| `plugin-e2e-protocol` | Real SDK plugin running through standalone runtime, LangBot core, and the migrated adapter from a protocol-boundary event injection, such as a OneBot reverse WebSocket event. | Partial; must not be claimed as UI coverage |
|
|
||||||
| `plugin-e2e-outbound` | Real SDK plugin calls an API and the bot output is visible in the real platform/simulator UI. | Yes for send/API coverage only |
|
|
||||||
| `adapter-live` | Direct adapter probe connected to a real or simulator platform endpoint, bypassing plugin runtime. | No, auxiliary only |
|
|
||||||
| `unit` | Unit/API-shape tests with mocked platform SDK objects or mocked APIs. | No, auxiliary only |
|
|
||||||
| `not-supported` | Platform protocol or SDK has no equivalent capability. Must include reason and source. | Yes, as explicitly unsupported |
|
|
||||||
| `blocked` | Intended capability could not be verified because of credentials, permissions, endpoint gaps, or simulator gaps. | No |
|
|
||||||
|
|
||||||
The primary acceptance path must be `plugin-e2e-ui` for inbound UI-triggered behavior and `plugin-e2e-outbound` for bot send/API behavior. `adapter-live`, `plugin-e2e-protocol`, and `unit` tests are useful, but they must be labelled precisely.
|
|
||||||
|
|
||||||
## Required Architecture Path
|
|
||||||
|
|
||||||
Every adapter must prove this full path:
|
|
||||||
|
|
||||||
```text
|
|
||||||
Real platform / simulator UI
|
|
||||||
-> platform SDK native event
|
|
||||||
-> adapter event converter
|
|
||||||
-> unified EBA event/entity/message types
|
|
||||||
-> LangBot core event dispatch
|
|
||||||
-> standalone SDK runtime
|
|
||||||
-> real test plugin listener
|
|
||||||
-> plugin calls platform APIs through SDK
|
|
||||||
-> LangBot core API dispatch
|
|
||||||
-> adapter API implementation
|
|
||||||
-> real platform / simulator UI
|
|
||||||
```
|
|
||||||
|
|
||||||
The test plugin must record JSONL evidence containing:
|
|
||||||
|
|
||||||
- event class and `event.type`
|
|
||||||
- `bot_uuid` and `adapter_name` as received by the plugin
|
|
||||||
- adapter name
|
|
||||||
- chat type and chat ID
|
|
||||||
- sender/user/group IDs with secrets redacted
|
|
||||||
- message component list for received messages
|
|
||||||
- API action name, input summary, result or error
|
|
||||||
- raw unsupported/blocked reason when an item is skipped
|
|
||||||
|
|
||||||
## Required Message Receive Tests
|
|
||||||
|
|
||||||
For every adapter, inbound message conversion must be tested through `plugin-e2e-ui` for each component the platform can receive. If a protocol-level injection is used, label it `plugin-e2e-protocol`; it proves the adapter/core/plugin path, but it does not prove that the user-facing platform UI can send that component. If the platform UI/simulator cannot create a component, record it as `blocked` with the endpoint limitation.
|
|
||||||
|
|
||||||
| Component | Required Receive Assertion |
|
|
||||||
|-----------|----------------------------|
|
|
||||||
| `Source` | Message ID and timestamp are present and stable enough for reply/get/delete APIs. |
|
|
||||||
| `Plain` | Text is preserved exactly, including spaces and multi-line content. |
|
|
||||||
| `At` | Mentioned user ID is converted to common `At.target`. |
|
|
||||||
| `AtAll` | Broadcast mention is converted to common `AtAll`, if platform supports it. |
|
|
||||||
| `Image` | Image ID, URL, path, or base64 is represented without leaking platform-native segment shape. |
|
|
||||||
| `Voice` | Voice/audio component is represented as `Voice` when the platform exposes it. |
|
|
||||||
| `File` | File name, ID/URL, and size are represented as `File` when available. |
|
|
||||||
| `Quote` | Reply/quote source ID and origin content are represented when the platform exposes it. |
|
|
||||||
| `Face` | Native emoji/sticker/dice/rps-like components are represented as `Face` or documented as platform-specific. |
|
|
||||||
| `Forward` | Merged/forwarded messages are represented as `Forward` when the platform exposes structured content. |
|
|
||||||
| `Unknown` | Unsupported native segments become `Unknown` or `PlatformSpecificEvent` data, not crashes. |
|
|
||||||
| Mixed chain | A message containing multiple component types preserves order. |
|
|
||||||
|
|
||||||
The plugin must subscribe to `MessageReceivedEvent` and assert that `message_chain` contains common `langbot_plugin.api.entities.builtin.platform.message` components, not platform-native SDK objects.
|
|
||||||
|
|
||||||
## Required Message Send Tests
|
|
||||||
|
|
||||||
For every adapter, outbound message conversion must be tested through `plugin-e2e-outbound` by having the plugin call SDK platform APIs and verifying the platform UI/simulator receives the expected message.
|
|
||||||
|
|
||||||
| Component | Required Send Assertion |
|
|
||||||
|-----------|-------------------------|
|
|
||||||
| `Plain` | Text appears exactly on the platform. |
|
|
||||||
| `At` | User mention renders as a mention or platform equivalent. |
|
|
||||||
| `AtAll` | Broadcast mention renders or is explicitly unsupported. |
|
|
||||||
| `Image` | URL, path, or base64 image sends and renders/downloads correctly. |
|
|
||||||
| `Voice` | Voice/audio sends when supported. |
|
|
||||||
| `File` | File sends with name and content/link when supported. |
|
|
||||||
| `Quote` | Quoted reply points to the original message when supported. |
|
|
||||||
| `Face` | Native emoji/sticker/dice/rps sends or is explicitly unsupported. |
|
|
||||||
| `Forward` | Forward/merged-forward sends when supported; otherwise fallback behavior is documented. |
|
|
||||||
| Mixed chain | A mixed chain preserves component order as closely as the platform allows. |
|
|
||||||
|
|
||||||
If a platform supports a component only in one direction, the adapter record must say so explicitly.
|
|
||||||
|
|
||||||
## Required Event Tests
|
|
||||||
|
|
||||||
The plugin must subscribe to every event declared in `manifest.yaml -> spec.supported_events` and record one of `plugin-e2e-ui`, `plugin-e2e-protocol`, `not-supported`, or `blocked`.
|
|
||||||
|
|
||||||
| Event | Required Assertion |
|
|
||||||
|-------|--------------------|
|
|
||||||
| `message.received` | Real message reaches plugin as `MessageReceivedEvent`. |
|
|
||||||
| `message.edited` | Edited message reaches plugin with message ID and new content, if declared. |
|
|
||||||
| `message.deleted` | Deleted/recalled message reaches plugin with message ID and operator when available, if declared. |
|
|
||||||
| `message.reaction` | Reaction add/remove reaches plugin with message ID, user, reaction, and direction, if declared. |
|
|
||||||
| `feedback.received` | Feedback payload reaches plugin with feedback type and message/session IDs, if declared. |
|
|
||||||
| `group.member_joined` | Join event reaches plugin with group and member. |
|
|
||||||
| `group.member_left` | Leave/kick event reaches plugin with group, member, and kick flag. |
|
|
||||||
| `group.member_banned` | Mute/ban event reaches plugin with group, member, operator, and duration. |
|
|
||||||
| `group.info_updated` | Group metadata update reaches plugin with changed fields, if declared. |
|
|
||||||
| `friend.request_received` | Friend request reaches plugin with request ID and message. |
|
|
||||||
| `friend.added` | Friend-added event reaches plugin. |
|
|
||||||
| `friend.removed` | Friend-removed event reaches plugin, if declared. |
|
|
||||||
| `bot.invited_to_group` | Bot invite/join request reaches plugin with group and inviter/request ID. |
|
|
||||||
| `bot.removed_from_group` | Bot removal reaches plugin with group and operator when available. |
|
|
||||||
| `bot.muted` | Bot mute reaches plugin with duration. |
|
|
||||||
| `bot.unmuted` | Bot unmute reaches plugin. |
|
|
||||||
| `platform.specific` | At least one unmapped native event is delivered as structured platform-specific data, if declared. |
|
|
||||||
|
|
||||||
Do not declare an event in the manifest unless there is an implementation path and an acceptance entry.
|
|
||||||
|
|
||||||
## Required Common API Tests
|
|
||||||
|
|
||||||
The plugin must call every common API declared in `manifest.yaml -> spec.supported_apis.required` and `optional`. Each call must be recorded with input summary and result.
|
|
||||||
|
|
||||||
| API | Required Assertion |
|
|
||||||
|-----|--------------------|
|
|
||||||
| `send_message` | Plugin sends to private and group/channel targets where supported. |
|
|
||||||
| `reply_message` | Plugin replies to the triggering message, with quoted mode tested when supported. |
|
|
||||||
| `edit_message` | Plugin edits a bot-sent message, if declared. |
|
|
||||||
| `delete_message` | Plugin deletes/recalls a bot-sent message, if declared and permissions allow. |
|
|
||||||
| `forward_message` | Plugin forwards or emulates forwarding a real message, if declared. |
|
|
||||||
| `get_message` | Plugin retrieves a real message and receives common `MessageReceivedEvent` shape. |
|
|
||||||
| `get_group_info` | Plugin receives `UserGroup` with ID/name/count where available. |
|
|
||||||
| `get_group_list` | Plugin receives joined groups/channels list where supported. |
|
|
||||||
| `get_group_member_list` | Plugin receives list of `UserGroupMember` where supported. |
|
|
||||||
| `get_group_member_info` | Plugin receives one member with role/display name where available. |
|
|
||||||
| `set_group_name` | Plugin changes and restores a disposable group name, if declared. |
|
|
||||||
| `mute_member` | Plugin mutes a disposable target, if declared. |
|
|
||||||
| `unmute_member` | Plugin unmutes the same target, if declared. |
|
|
||||||
| `kick_member` | Plugin kicks a disposable target only in destructive test mode, if declared. |
|
|
||||||
| `leave_group` | Plugin leaves only in destructive test mode and only at the end, if declared. |
|
|
||||||
| `get_user_info` | Plugin receives common `User` shape. |
|
|
||||||
| `get_friend_list` | Plugin receives friend/contact list where supported. |
|
|
||||||
| `approve_friend_request` | Plugin accepts/rejects a disposable friend request, if declared. |
|
|
||||||
| `approve_group_invite` | Plugin accepts/rejects a disposable group invite, if declared. |
|
|
||||||
| `upload_file` | Plugin uploads a real small file, if declared. |
|
|
||||||
| `get_file_url` | Plugin resolves a real file ID to a URL, if declared. |
|
|
||||||
| `call_platform_api` | Plugin calls every declared platform-specific action with safe parameters. |
|
|
||||||
|
|
||||||
Destructive APIs must be opt-in and documented with the exact target used.
|
|
||||||
|
|
||||||
The SDK must expose a plugin-side platform API escape hatch for adapter-specific actions. The acceptance plugin should call it from the same EBA event handler that received the real platform event, so the evidence proves both directions of the path:
|
|
||||||
|
|
||||||
```text
|
|
||||||
plugin -> SDK call_platform_api -> LangBot core -> adapter call_platform_api -> platform SDK/API
|
|
||||||
```
|
|
||||||
|
|
||||||
The result must be serialized into JSON-safe values before it is returned to the plugin runtime.
|
|
||||||
|
|
||||||
## Platform-Specific API Tests
|
|
||||||
|
|
||||||
Every action listed in `manifest.yaml -> spec.platform_specific_apis` must have one acceptance entry:
|
|
||||||
|
|
||||||
- `plugin-e2e-ui` or `plugin-e2e-outbound`: called by the plugin against the live/simulator endpoint.
|
|
||||||
- `plugin-e2e-protocol`: called by the plugin after a protocol-boundary injected event; useful for endpoint-specific simulators but must be labelled.
|
|
||||||
- `not-supported`: removed from manifest or explained if the platform SDK exposes it but this adapter intentionally does not.
|
|
||||||
- `blocked`: endpoint did not implement it, permissions missing, or safe fixture unavailable.
|
|
||||||
|
|
||||||
Do not leave a platform-specific API in the manifest without a corresponding test record.
|
|
||||||
|
|
||||||
## Required Compatibility Tests
|
|
||||||
|
|
||||||
Each migrated adapter must also prove:
|
|
||||||
|
|
||||||
- Manifest supported events match `adapter.get_supported_events()`.
|
|
||||||
- Manifest supported APIs match `adapter.get_supported_apis()`.
|
|
||||||
- Manifest platform-specific actions match `PLATFORM_API_MAP`.
|
|
||||||
- Legacy `FriendMessage` / `GroupMessage` listeners still work when the core registers them.
|
|
||||||
- EBA listener dispatch prefers the most specific event class, then `EBAEvent`, then base `Event`.
|
|
||||||
- Self-message filtering prevents bot echo loops without dropping edit/delete/moderation events needed for API tests.
|
|
||||||
- `source_platform_object` is present for reply/debug but not required by plugins for common behavior.
|
|
||||||
|
|
||||||
## Required Documentation Per Adapter
|
|
||||||
|
|
||||||
Each adapter document must include:
|
|
||||||
|
|
||||||
- adapter directory and manifest name
|
|
||||||
- config table
|
|
||||||
- supported event table with evidence level per event
|
|
||||||
- supported common API table with evidence level per API
|
|
||||||
- platform-specific API table with evidence level per action
|
|
||||||
- receive component table with evidence level per component
|
|
||||||
- send component table with evidence level per component
|
|
||||||
- exact test date
|
|
||||||
- exact platform endpoint or simulator used
|
|
||||||
- standalone runtime command
|
|
||||||
- plugin path/name used for testing
|
|
||||||
- evidence JSONL path
|
|
||||||
- destructive operations performed or explicitly skipped
|
|
||||||
- blocked items and reasons
|
|
||||||
|
|
||||||
## Acceptance Rule
|
|
||||||
|
|
||||||
An adapter can be marked migrated only when:
|
|
||||||
|
|
||||||
1. All declared events have `plugin-e2e-ui`, justified `plugin-e2e-protocol`, or `not-supported` evidence.
|
|
||||||
2. All declared APIs have `plugin-e2e-outbound` or `not-supported` evidence.
|
|
||||||
3. All platform-supported receive components have `plugin-e2e-ui` evidence; protocol-only receive coverage keeps the status partial.
|
|
||||||
4. All platform-supported send components have `plugin-e2e-outbound` evidence.
|
|
||||||
5. Unit tests cover conversion and API-shape boundaries.
|
|
||||||
6. The adapter document lists every blocked or skipped item honestly.
|
|
||||||
|
|
||||||
If any declared capability is only covered by `adapter-live` or `unit`, the adapter status must remain partial.
|
|
||||||
@@ -1,171 +0,0 @@
|
|||||||
# EBA Adapter Acceptance Report
|
|
||||||
|
|
||||||
Date: May 10, 2026
|
|
||||||
|
|
||||||
Scope:
|
|
||||||
|
|
||||||
- `telegram-eba`
|
|
||||||
- `discord-eba`
|
|
||||||
- `aiocqhttp-eba`
|
|
||||||
- `dingtalk-eba`
|
|
||||||
- `lark-eba`
|
|
||||||
- `wecom-eba`
|
|
||||||
- `wecombot-eba`
|
|
||||||
- `wecomcs-eba`
|
|
||||||
- `officialaccount-eba`
|
|
||||||
- `qqofficial-eba`
|
|
||||||
- `slack-eba`
|
|
||||||
|
|
||||||
This report follows `acceptance-checklist.md`. Evidence levels are intentionally strict:
|
|
||||||
|
|
||||||
- `plugin-e2e-ui`: real platform or simulator UI event reached LangBot, standalone runtime, and `EBAEventProbe`.
|
|
||||||
- `plugin-e2e-protocol`: real adapter endpoint event reached LangBot, standalone runtime, and `EBAEventProbe`, but the event was injected at the platform protocol boundary rather than sent through the UI.
|
|
||||||
- `plugin-e2e-outbound`: the plugin called SDK APIs and the resulting bot message was visible on the platform.
|
|
||||||
- `unit`: mocked converter/API coverage only.
|
|
||||||
- `blocked`: not completed, either because the platform/simulator/client could not trigger it or because a safe disposable fixture was unavailable.
|
|
||||||
- `not-supported`: the platform has no equivalent capability.
|
|
||||||
|
|
||||||
## Summary
|
|
||||||
|
|
||||||
| Adapter | Status | Honest acceptance summary |
|
|
||||||
|---------|--------|---------------------------|
|
|
||||||
| Telegram | Partial EBA acceptance | Real Telegram UI covered private text, group mention text, bot invite, inbound private image/file, outbound component sweep, safe SDK APIs, and safe Telegram platform APIs. Real UI inbound voice/quote was not completed in the latest plugin run. |
|
|
||||||
| Discord | Partial EBA acceptance | Real Discord UI covered group text, outbound image/file/quote/mention components, safe SDK APIs, and safe Discord platform APIs. Real UI inbound attachment/image/file/reply/mention was not completed. A later UI retry was blocked because the Discord client kept the send button disabled. |
|
|
||||||
| OneBot v11 / aiocqhttp | Partial EBA acceptance | Matcha UI covered real group text and outbound supported components/APIs. Multi-component inbound `Source/Plain/At/Face/Image/Voice/File/Quote` was verified through the real OneBot reverse WebSocket adapter endpoint, but not through Matcha UI upload/send. Matcha blocks file-send and merged-forward APIs. |
|
|
||||||
| DingTalk | Partial EBA acceptance | Real DingTalk UI covered private text, emoji-as-text inbound, private inbound image/file, outbound image/file/quote/mention fallback components, safe SDK APIs, and safe DingTalk platform APIs. Real UI inbound voice/quote and group trigger were not completed. |
|
|
||||||
| Lark / Feishu | Partial EBA acceptance | EBA adapter structure, self-built/store app config, WebSocket/Webhook mode handling, converters, common APIs, platform APIs, and unit tests are in place. One real LangBot organization WebSocket private text event reached `EBAEventProbe`; outbound component sweep was visible in Feishu. Latest real UI image/file sends did not reach local plugin evidence, so media receive remains blocked. |
|
|
||||||
| WeCom | Partial EBA acceptance | Regular WeCom application-message adapter is split into the EBA directory with manifest, converters, API mixin, platform API map, and unit tests. Private text reached `EBAEventProbe` through standalone runtime and the real WeCom client; safe plugin APIs passed. Real inbound media and broader event coverage remain pending. |
|
|
||||||
| WeComBot | Partial EBA acceptance | WeCom AI Bot is split into the EBA directory with WebSocket long connection mode and optional webhook mode, EBA message/feedback/platform-specific conversion, cache-backed common APIs, platform API map, unit tests, and a direct live probe. Private text, outbound component sweep, safe common APIs, and all declared WeComBot platform APIs reached `EBAEventProbe`; group, real inbound media, and feedback callback evidence remain pending. |
|
|
||||||
| WeCom Customer Service | Partial EBA acceptance | WeCom Customer Service is split into the EBA directory with manifest, converters, API mixin, platform API map, unit tests, docs, and a direct live probe scaffold. Real WeChat customer-side UI text reached `EBAEventProbe`; plugin outbound text/image and safe cache-backed common APIs passed. Inbound media and platform-specific API live coverage remain pending; later fallback text sends were blocked by WeCom `95001 send msg count limit`. |
|
|
||||||
| Official Account | Partial EBA acceptance | WeChat Official Account is split into the EBA directory with manifest, converters, cache-backed safe APIs, platform API map, unit tests, and a direct live probe scaffold. Real WeChat Official Account UI private text reached `EBAEventProbe`; safe cache-backed common APIs and declared platform APIs passed. Proactive outbound `send_message` is not supported because replies must be tied to inbound webhook windows; inbound image/voice live UI evidence remains pending. |
|
|
||||||
| QQ Official API | Partial EBA acceptance | QQ Official API is split into the EBA directory with manifest, converters, cache-backed safe APIs, platform API map, unit tests, docs, and a direct live probe scaffold. A real WebSocket-mode QQ Official bot reached the LangBot pipeline on `dev.rockchin.top`; reply/outbound evidence is blocked by the test model provider returning `model_not_found` for `deepseek-v3`. |
|
|
||||||
| Slack | Partial EBA acceptance | Slack is split into the EBA directory with manifest, converters, cache-backed safe APIs, platform API map, unit tests, docs, and a direct live probe scaffold. Real Slack private text reached `EBAEventProbe`; safe common APIs, outbound component fallback sweep, and declared Slack platform APIs passed. Channel mention and real inbound media evidence remain pending. |
|
|
||||||
|
|
||||||
Telegram and DingTalk now have real user-side UI image/file upload evidence in plugin JSONL. Discord and aiocqhttp do not yet have real UI inbound image/file evidence.
|
|
||||||
|
|
||||||
## Evidence Files
|
|
||||||
|
|
||||||
| Adapter | Endpoint | Evidence |
|
|
||||||
|---------|----------|----------|
|
|
||||||
| Telegram private | Telegram Lite, `@rockchinq_bot` private chat | `data/temp/telegram-plugin-e2e-rerun.jsonl` |
|
|
||||||
| Telegram private media | Telegram Lite, `@rockchinq_bot` private chat | `data/temp/telegram-plugin-e2e-media-ui.jsonl` |
|
|
||||||
| Telegram group | Telegram Lite, `Rock'sBotGroup` | `data/temp/telegram-plugin-e2e-group.jsonl` |
|
|
||||||
| Discord | Discord client, LangBot server, `#debugging` | `data/temp/discord-plugin-e2e-20260510-final.jsonl` |
|
|
||||||
| aiocqhttp UI | local Matcha, group `test group` | `data/temp/aiocqhttp-plugin-e2e-20260510-multiformat.jsonl` |
|
|
||||||
| aiocqhttp protocol | OneBot reverse WebSocket endpoint `127.0.0.1:2280/ws` | `data/temp/aiocqhttp-plugin-e2e-20260510-multiformat.jsonl` |
|
|
||||||
| DingTalk | DingTalk Mac, `LangBot Team` org private chat | `data/temp/dingtalk-plugin-e2e-20260510-rerun.jsonl` |
|
|
||||||
| DingTalk private media | DingTalk Mac, `LangBot Team` org private chat | `data/temp/dingtalk-plugin-e2e-media-ui.jsonl` |
|
|
||||||
| Lark / Feishu unit | local mocked Feishu SDK/client paths | `tests/unit_tests/platform/test_lark_eba_adapter.py` |
|
|
||||||
| Lark / Feishu partial live | Feishu Mac, LangBot organization `LangBotDev` private chat | `data/temp/lark-plugin-e2e-ws.jsonl` |
|
|
||||||
| WeCom Customer Service | WeChat customer-side UI, `客服消息 -> 浪波智能客服` on `dev.rockchin.top` | `/home/wgc/LangBotxg/LangBotEbaTest/data/temp/wecomcs_eba_plugin_probe.jsonl` |
|
|
||||||
| Official Account | WeChat desktop client, subscribed Official Account on `dev.rockchin.top` | `/home/wgc/LangBotxg/LangBotEbaTest/data/temp/officialaccount_eba_plugin_probe.jsonl` |
|
|
||||||
| QQ Official API unit | local mocked QQ Official client paths | `tests/unit_tests/platform/test_qqofficial_eba_adapter.py` |
|
|
||||||
| Slack unit | local mocked Slack client paths | `tests/unit_tests/platform/test_slack_eba_adapter.py` |
|
|
||||||
| Slack private | Slack workspace private DM on `dev.rockchin.top` | `/home/wgc/LangBotxg/LangBotEbaTest/data/temp/slack_eba_plugin_probe.jsonl` |
|
|
||||||
|
|
||||||
All plugin runs used SDK standalone runtime ports `5400/5401`, LangBot `--standalone-runtime`, and the real plugin at `langbot-plugin-demo/EBAEventProbe`.
|
|
||||||
|
|
||||||
## Unified Shape Verification
|
|
||||||
|
|
||||||
All four adapters deliver common SDK entities to plugins before LangBot core/plugin logic handles the event.
|
|
||||||
|
|
||||||
| Requirement | Telegram | Discord | aiocqhttp | DingTalk | Lark / Feishu |
|
|
||||||
|-------------|----------|---------|-----------|----------|---------------|
|
|
||||||
| `bot_uuid` filled | plugin-e2e | plugin-e2e | plugin-e2e | plugin-e2e | live plugin-e2e pending |
|
|
||||||
| `adapter_name` filled | `telegram` | `discord` | `aiocqhttp` | `dingtalk` | `lark-eba` in current unit/code; older live text evidence recorded `lark` before the naming fix |
|
|
||||||
| common `MessageChain` delivered | `Plain`, group `At + Plain`, private `Image`, private `File` | `Source + Plain` | UI `Source + Plain`; protocol `Source + Plain + At + Face + Image + Voice + File + Quote + Plain` | `Source + Plain`, private `Source + Image`, private `Source + File` | live private `Source + Plain`; unit `Source + Plain + At/Image/File`; latest live image/file blocked |
|
|
||||||
| common user/group entities | plugin-e2e | plugin-e2e | plugin-e2e | plugin-e2e private user; group not completed | live private user; unit private/group |
|
|
||||||
| raw native object isolation | raw data stays in `source_platform_object` | raw data stays in `source_platform_object` | raw data stays in `source_platform_object` | raw data stays in `source_platform_object` | raw data stays in `source_platform_object` |
|
|
||||||
|
|
||||||
## Message Receive Components
|
|
||||||
|
|
||||||
| Component | Telegram | Discord | aiocqhttp | DingTalk | Lark / Feishu |
|
|
||||||
|-----------|----------|---------|-----------|----------|---------------|
|
|
||||||
| `Source` | design gap: event has message id but chain omits `Source` | plugin-e2e-ui | plugin-e2e-ui/protocol | plugin-e2e-ui | plugin-e2e-ui private text |
|
|
||||||
| `Plain` | plugin-e2e-ui private/group | plugin-e2e-ui | plugin-e2e-ui/protocol | plugin-e2e-ui | plugin-e2e-ui private text |
|
|
||||||
| `At` | plugin-e2e-ui group mention | unit; real UI mention not completed in latest run | plugin-e2e-protocol; unit | unit; group trigger not completed | unit; group trigger not completed |
|
|
||||||
| `AtAll` | not-supported | unit only | unit only | unit/send fallback only | unit only |
|
|
||||||
| `Image` | plugin-e2e-ui private | converter/unit; real UI attachment not completed | plugin-e2e-protocol, not Matcha UI | plugin-e2e-ui private | unit; real UI image sent but not observed in plugin evidence |
|
|
||||||
| `Voice` | converter/unit; real UI inbound not completed | not-supported as native voice; audio is attachment/file | plugin-e2e-protocol, not Matcha UI | converter/unit; real UI inbound not completed | unit; real UI inbound not completed |
|
|
||||||
| `File` | plugin-e2e-ui private | converter/unit; real UI attachment not completed | plugin-e2e-protocol, not Matcha UI | plugin-e2e-ui private | unit; real UI file sent but not observed in plugin evidence |
|
|
||||||
| `Quote` | converter/unit; real UI reply not completed | unit; real UI reply not completed | plugin-e2e-protocol | converter/unit; real UI quote not completed | unit/API-backed quote lookup; real UI quote not completed |
|
|
||||||
| `Face` | not-supported as common `Face` | not-supported as common `Face` | plugin-e2e-protocol | UI emoji becomes `Plain` (`[smile]` text), not `Face` | not-supported as common `Face` |
|
|
||||||
| `Forward` | not-supported inbound | not-supported inbound | unit; Matcha forward UI/action blocked | not-supported inbound | not-supported inbound |
|
|
||||||
| Mixed chain | group `At + Plain`; media tested as separate messages | not completed inbound | plugin-e2e-protocol | media tested as separate messages; mixed inbound not completed | unit only |
|
|
||||||
|
|
||||||
## Message Send Components
|
|
||||||
|
|
||||||
| Component | Telegram | Discord | aiocqhttp | DingTalk | Lark / Feishu |
|
|
||||||
|-----------|----------|---------|-----------|----------|---------------|
|
|
||||||
| `Plain` | plugin-e2e-outbound | plugin-e2e-outbound | plugin-e2e-outbound | plugin-e2e-outbound | plugin-e2e-outbound |
|
|
||||||
| `At` | plugin-e2e-outbound equivalent | plugin-e2e-outbound | plugin-e2e-outbound | plugin-e2e-outbound fallback/equivalent | plugin-e2e-outbound |
|
|
||||||
| `AtAll` | plugin-e2e-outbound fallback | plugin-e2e-outbound | plugin-e2e-outbound | plugin-e2e-outbound fallback | unit; group live not completed |
|
|
||||||
| `Image` | plugin-e2e-outbound | plugin-e2e-outbound | plugin-e2e-outbound | plugin-e2e-outbound | plugin-e2e-outbound |
|
|
||||||
| `Voice` | not-supported in current send converter | not-supported as native voice | converter path; not completed against Matcha UI | fallback as file/text depending DingTalk media support | converter path; live not completed |
|
|
||||||
| `File` | plugin-e2e-outbound | plugin-e2e-outbound | blocked by Matcha endpoint error | plugin-e2e-outbound | plugin-e2e-outbound |
|
|
||||||
| `Quote` | plugin-e2e-outbound | plugin-e2e-outbound | plugin-e2e-outbound | plugin-e2e-outbound fallback | plugin-e2e-outbound fallback |
|
|
||||||
| `Face` | not-supported | not-supported | plugin-e2e-outbound attempted in mixed chain | fallback text | not-supported |
|
|
||||||
| `Forward` | flattened fallback | flattened fallback | blocked by Matcha unsupported action | flattened fallback | plugin-e2e-outbound flattened fallback |
|
|
||||||
| Mixed chain | plugin-e2e-outbound | plugin-e2e-outbound | plugin-e2e-outbound except blocked file/forward | plugin-e2e-outbound | plugin-e2e-outbound |
|
|
||||||
|
|
||||||
## Event Acceptance
|
|
||||||
|
|
||||||
| Event category | Telegram | Discord | aiocqhttp | DingTalk |
|
|
||||||
|----------------|----------|---------|-----------|----------|
|
|
||||||
| `message.received` | plugin-e2e-ui | plugin-e2e-ui | plugin-e2e-ui and plugin-e2e-protocol | plugin-e2e-ui private |
|
|
||||||
| `message.edited` | implemented/unit, not plugin-e2e-ui | historical/direct only, not latest plugin-e2e | unit | not declared |
|
|
||||||
| `message.deleted` | implemented/unit, not plugin-e2e-ui | historical/direct only, not latest plugin-e2e | unit | not declared |
|
|
||||||
| `message.reaction` | implemented/unit, not plugin-e2e-ui | historical/direct only, not latest plugin-e2e | not-supported in standard OneBot message path | not declared |
|
|
||||||
| member join/left/ban | implemented/unit or blocked without disposable users | blocked without disposable users | unit; Matcha fixture unavailable | not declared |
|
|
||||||
| bot invited/removed | invite plugin-e2e-ui for Telegram; removal blocked | invite historical/plugin-series; removal blocked | unit; Matcha fixture unavailable | not declared |
|
|
||||||
| requests/friend events | not applicable | not applicable | unit; Matcha fixture unavailable | not declared |
|
|
||||||
| `platform.specific` | implemented; not latest plugin-e2e | not latest plugin-e2e | adapter lifecycle observed; plugin focus was message path | declared for fallback; not reproduced in UI run |
|
|
||||||
|
|
||||||
## Common API Acceptance
|
|
||||||
|
|
||||||
| API area | Telegram | Discord | aiocqhttp | DingTalk |
|
|
||||||
|----------|----------|---------|-----------|----------|
|
|
||||||
| send/reply | plugin-e2e-outbound | plugin-e2e-outbound | plugin-e2e-outbound, with Matcha file/forward gaps | plugin-e2e-outbound |
|
|
||||||
| edit/delete | historical/direct or unit; destructive/current UI not repeated | historical/direct; destructive/current UI not repeated | unit/destructive blocked | not declared or blocked |
|
|
||||||
| message lookup | not-supported | not-supported | plugin-e2e | inbound cache-backed where available; limited live coverage |
|
|
||||||
| group info/member info | plugin-e2e safe subset | plugin-e2e safe subset | plugin-e2e safe subset | private path only; group not completed |
|
|
||||||
| user/friend info | plugin-e2e where platform allows | plugin-e2e where platform allows | plugin-e2e | plugin-e2e private user |
|
|
||||||
| moderation/leave | blocked without disposable safe targets | blocked without disposable safe targets | blocked without disposable safe targets | blocked/not declared |
|
|
||||||
| `get_file_url` | implemented; latest inbound `File` carried downloadable file data in plugin evidence | URL passthrough for attachments; inbound attachment not completed | not portable/endpoint-dependent | implemented through DingTalk media API; latest inbound `File` carried a platform file URL |
|
|
||||||
| `call_platform_api` | plugin-e2e safe actions | plugin-e2e safe actions | plugin-e2e safe actions, Matcha gaps documented | plugin-e2e safe `check_access_token` |
|
|
||||||
|
|
||||||
## Platform-Specific API Acceptance
|
|
||||||
|
|
||||||
| Adapter | plugin-e2e verified | Blocked or not reproduced |
|
|
||||||
|---------|---------------------|---------------------------|
|
|
||||||
| Telegram | safe chat/admin/member count/chat-action actions | mutating actions and callback-only actions were not repeated |
|
|
||||||
| Discord | safe channel/guild/role/typing actions | mutating pin/reaction/invite actions were not repeated in the latest plugin run; inbound attachment paths not completed |
|
|
||||||
| aiocqhttp | safe OneBot actions such as status/version/can-send checks | `get_group_honor_info` unsupported by Matcha; admin/card/title/ban/record/file/forward require better endpoint fixtures |
|
|
||||||
| DingTalk | `check_access_token`; real inbound file produced a file URL in the common `File` component | separate media-download replay APIs and group actions need a working follow-up fixture |
|
|
||||||
|
|
||||||
## SDK API Acceptance
|
|
||||||
|
|
||||||
`EBAEventProbe` exercised the standalone runtime path for:
|
|
||||||
|
|
||||||
- bot discovery and bot info lookup
|
|
||||||
- send message
|
|
||||||
- component sweep where enabled
|
|
||||||
- platform API sweep where enabled
|
|
||||||
- plugin storage
|
|
||||||
- workspace storage
|
|
||||||
- plugin/command/tool/knowledge-base list APIs
|
|
||||||
|
|
||||||
The probe logs set `ok=true` when the sweep completed with only expected unsupported/blocked items. Individual call details are stored in the JSONL evidence files.
|
|
||||||
|
|
||||||
## Residual Risks And Required Follow-Up
|
|
||||||
|
|
||||||
- Discord still requires real UI inbound image/file upload evidence before it can be called media-complete.
|
|
||||||
- aiocqhttp has rich inbound component evidence only at the OneBot reverse WebSocket boundary; Matcha UI did not provide image/file upload coverage.
|
|
||||||
- DingTalk group trigger remains unclosed; current evidence is private chat only.
|
|
||||||
- Lark / Feishu requires a clean follow-up live pass: the latest LangBot organization WebSocket run connected, but UI-sent text/image/file after the loop-scheduling fix did not append plugin events.
|
|
||||||
- Discord UI retry on May 10, 2026 was blocked by the client keeping the send button disabled even after text was entered.
|
|
||||||
- Destructive moderation and leave APIs are intentionally blocked until disposable users/groups are available.
|
|
||||||
|
|
||||||
## Conclusion
|
|
||||||
|
|
||||||
The EBA conversion path is implemented and partially proven for the migrated adapters. Telegram and DingTalk now have real UI private-chat image/file inbound evidence. Discord, aiocqhttp, and Lark / Feishu still have explicit UI-level media gaps, so the overall adapter set remains partial acceptance rather than production-complete media acceptance.
|
|
||||||
@@ -1,162 +0,0 @@
|
|||||||
# OneBot v11 / aiocqhttp EBA Adapter
|
|
||||||
|
|
||||||
## Status
|
|
||||||
|
|
||||||
OneBot v11 has been migrated to the EBA adapter directory:
|
|
||||||
|
|
||||||
```text
|
|
||||||
src/langbot/pkg/platform/adapters/aiocqhttp/
|
|
||||||
├── adapter.py
|
|
||||||
├── api_impl.py
|
|
||||||
├── event_converter.py
|
|
||||||
├── manifest.yaml
|
|
||||||
├── message_converter.py
|
|
||||||
├── platform_api.py
|
|
||||||
├── types.py
|
|
||||||
└── onebot.svg
|
|
||||||
```
|
|
||||||
|
|
||||||
The EBA adapter is registered as `aiocqhttp-eba`. The legacy adapter remains at `src/langbot/pkg/platform/sources/aiocqhttp.py`.
|
|
||||||
|
|
||||||
## Configuration
|
|
||||||
|
|
||||||
| Field | Required | Default | Description |
|
|
||||||
|-------|----------|---------|-------------|
|
|
||||||
| `host` | Yes | `0.0.0.0` | Host for the reverse WebSocket server that the OneBot endpoint connects to. |
|
|
||||||
| `port` | Yes | `2280` | Reverse WebSocket listen port. |
|
|
||||||
| `access-token` | No | `""` | OneBot access token, if the endpoint is configured to use one. |
|
|
||||||
|
|
||||||
## Events
|
|
||||||
|
|
||||||
The adapter declares these EBA events:
|
|
||||||
|
|
||||||
- `message.received`
|
|
||||||
- `message.deleted`
|
|
||||||
- `group.member_joined`
|
|
||||||
- `group.member_left`
|
|
||||||
- `group.member_banned`
|
|
||||||
- `friend.request_received`
|
|
||||||
- `friend.added`
|
|
||||||
- `bot.invited_to_group`
|
|
||||||
- `bot.removed_from_group`
|
|
||||||
- `bot.muted`
|
|
||||||
- `bot.unmuted`
|
|
||||||
- `platform.specific`
|
|
||||||
|
|
||||||
`platform.specific` is used for OneBot notice/request/meta events that do not yet have a common EBA event type, such as group admin changes, group file uploads, pokes, honor changes, and group join requests from non-bot users.
|
|
||||||
|
|
||||||
## Common APIs
|
|
||||||
|
|
||||||
| API | Status | Notes |
|
|
||||||
|-----|--------|-------|
|
|
||||||
| `send_message` | Supported | Supports private and group text, mentions, images, voice, files, faces, and flattened forwards. Group merged forwards are sent through OneBot forward APIs when possible. |
|
|
||||||
| `reply_message` | Supported | Uses the original OneBot event and can prepend a reply segment. |
|
|
||||||
| `edit_message` | Not supported | OneBot v11 has no standard message edit action. |
|
|
||||||
| `delete_message` | Supported | Uses `delete_msg`; permission depends on endpoint and group role. |
|
|
||||||
| `forward_message` | Supported | Emulates forward by fetching the source message with `get_msg` and sending its content to the target chat. |
|
|
||||||
| `get_message` | Supported | Uses `get_msg` and converts the response into `MessageReceivedEvent`. |
|
|
||||||
| `get_group_info` | Supported | Uses `get_group_info`. |
|
|
||||||
| `get_group_list` | Supported | Uses `get_group_list`. |
|
|
||||||
| `get_group_member_list` | Supported | Uses `get_group_member_list`. |
|
|
||||||
| `get_group_member_info` | Supported | Uses `get_group_member_info`. |
|
|
||||||
| `set_group_name` | Supported | Uses `set_group_name`; may be unsupported by mock endpoints. |
|
|
||||||
| `get_user_info` | Supported | Uses `get_stranger_info`. |
|
|
||||||
| `get_friend_list` | Supported | Uses `get_friend_list`. |
|
|
||||||
| `approve_friend_request` | Supported | Uses `set_friend_add_request`. |
|
|
||||||
| `approve_group_invite` | Supported | Uses `set_group_add_request` with `sub_type=invite`. |
|
|
||||||
| `upload_file` | Not supported | OneBot v11 has endpoint-specific file upload extensions but no portable standalone upload action. |
|
|
||||||
| `get_file_url` | Not supported | OneBot v11 file URL resolution is endpoint-specific. Use `call_platform_api("get_image")`, `get_record`, or endpoint extensions when available. |
|
|
||||||
| `mute_member` | Supported | Uses `set_group_ban`. |
|
|
||||||
| `unmute_member` | Supported | Uses `set_group_ban` with duration `0`. |
|
|
||||||
| `kick_member` | Supported | Destructive; test only with disposable members. |
|
|
||||||
| `leave_group` | Supported | Destructive; should run last in live tests. |
|
|
||||||
| `call_platform_api` | Supported | See below. |
|
|
||||||
|
|
||||||
## Platform-Specific APIs
|
|
||||||
|
|
||||||
`call_platform_api(action, params)` supports:
|
|
||||||
|
|
||||||
- `get_login_info`
|
|
||||||
- `get_status`
|
|
||||||
- `get_version_info`
|
|
||||||
- `get_group_honor_info`
|
|
||||||
- `set_group_card`
|
|
||||||
- `set_group_special_title`
|
|
||||||
- `set_group_admin`
|
|
||||||
- `set_group_whole_ban`
|
|
||||||
- `send_group_forward_msg`
|
|
||||||
- `get_forward_msg`
|
|
||||||
- `get_record`
|
|
||||||
- `get_image`
|
|
||||||
- `can_send_image`
|
|
||||||
- `can_send_record`
|
|
||||||
|
|
||||||
## Message Conversion Notes
|
|
||||||
|
|
||||||
Incoming OneBot segments are converted into common `MessageChain` components before LangBot core/plugin dispatch:
|
|
||||||
|
|
||||||
- `text` -> `Plain`
|
|
||||||
- `at` -> `At` / `AtAll`
|
|
||||||
- `image` -> `Image` or `Face` for OneBot emoji-package images
|
|
||||||
- `record` -> `Voice`
|
|
||||||
- `file` -> `File`
|
|
||||||
- `reply` -> `Quote`
|
|
||||||
- `face`, `rps`, `dice` -> `Face`
|
|
||||||
- unsupported segments -> `Unknown`
|
|
||||||
|
|
||||||
Outgoing `MessageChain` components are converted back into `aiocqhttp.Message` segments. Base64 media strings are normalized to OneBot `base64://...` format.
|
|
||||||
|
|
||||||
## Live Test Record
|
|
||||||
|
|
||||||
The direct live probe is:
|
|
||||||
|
|
||||||
```bash
|
|
||||||
PYTHONPATH=/Users/qinjunyan/code/projects/langbot/langbot-plugin-sdk/src \
|
|
||||||
uv run python tests/e2e/live_aiocqhttp_eba_probe.py --host 127.0.0.1 --port 2280
|
|
||||||
```
|
|
||||||
|
|
||||||
It starts the reverse WebSocket adapter directly, records observed EBA events to `data/temp/aiocqhttp_eba_live_probe.jsonl`, waits for a real Matcha or OneBot message, then tries reply/send/get/delete/group/user/platform API calls as far as the endpoint supports them.
|
|
||||||
|
|
||||||
Verified on May 10, 2026 with local Matcha connected to `ws://127.0.0.1:2280/ws`:
|
|
||||||
|
|
||||||
- Real inbound group message converted to `MessageReceivedEvent`.
|
|
||||||
- Real lifecycle connection converted to `PlatformSpecificEvent`.
|
|
||||||
- Real reply API succeeded and rendered a quoted bot reply in Matcha.
|
|
||||||
- Real proactive send API succeeded and rendered a bot group message in Matcha.
|
|
||||||
- Real outgoing component sweep succeeded for text, `At`, `AtAll`, `Face`, and base64 `Image`.
|
|
||||||
- Real `get_message`, `get_group_info`, `get_login_info`, `get_status`, `get_version_info`, `can_send_image`, and `can_send_record` calls succeeded against Matcha.
|
|
||||||
- Unit conversion and API-shape tests passed for `Plain`, `At`, `AtAll`, `Image`, `Voice`, `File`, `Quote`, `Face`, `rps`, `dice`, `Forward`, `Unknown`, private/group message events, delete notices, group join/leave/ban notices, bot mute notices, friend requests, group invites, friend added notices, dispatch specificity, send, reply, delete, forward, get message, group APIs, user APIs, request approval APIs, moderation APIs, leave group, unsupported file APIs, and all declared `call_platform_api` actions.
|
|
||||||
|
|
||||||
Skipped or residual live-test items:
|
|
||||||
|
|
||||||
- `edit_message`: not implemented because OneBot v11 has no standard edit action.
|
|
||||||
- `upload_file` and `get_file_url`: not implemented as common APIs because portable OneBot v11 file upload/download URL semantics are endpoint-specific.
|
|
||||||
- `kick_member` and `leave_group`: destructive; run only with explicit `--destructive` and disposable Matcha/OneBot state.
|
|
||||||
- `group.info_updated`, message reactions, and message edits are not declared because OneBot v11 does not provide standard equivalents for them.
|
|
||||||
- Matcha returned `ActionFailed` for outgoing `File` segment rendering and did not support merged-forward actions in this run. The adapter keeps the conversion/API implementations because they are valid OneBot/NapCat-style capabilities, but the Matcha live probe records them as skipped.
|
|
||||||
- Matcha returned an empty `get_group_member_list` for the test group, so `get_group_member_info`, mute/unmute, kick, and leave were covered by unit/API-shape tests only in this run.
|
|
||||||
|
|
||||||
## Standalone Runtime Plugin E2E Record
|
|
||||||
|
|
||||||
Verified on May 10, 2026 with `EBAEventProbe`, SDK standalone runtime, LangBot `--standalone-runtime`, local Matcha, and group `测试群`.
|
|
||||||
|
|
||||||
Evidence:
|
|
||||||
|
|
||||||
- Plugin JSONL: `data/temp/aiocqhttp-plugin-e2e-20260510-multiformat.jsonl`
|
|
||||||
|
|
||||||
Observed and verified:
|
|
||||||
|
|
||||||
- A real Matcha group message reached the plugin as `MessageReceived` with `bot_uuid=eba-aiocqhttp-matcha`, `adapter_name=aiocqhttp`, common `Source`/`Plain` message components, common sender, and common group identifiers.
|
|
||||||
- A protocol-level OneBot reverse WebSocket event reached the plugin as `MessageReceived` with a mixed common chain: `Source`, `Plain`, `At`, `Face`, `Image`, `Voice`, `File`, `Quote`, and trailing `Plain`. This proves the real adapter + LangBot + standalone runtime + plugin path for mixed inbound OneBot payloads, but it was not sent through Matcha UI.
|
|
||||||
- SDK API calls succeeded: `get_langbot_version`, `get_bots`, `get_bot_info`, `send_message`, plugin storage, workspace storage, `list_plugins_manifest`, `list_commands`, `list_tools`, and `list_knowledge_bases`.
|
|
||||||
- Outbound component sweep succeeded for plain text plus `At`/`Face`, `AtAll`, base64 `Image`, and quoted reply.
|
|
||||||
- Common APIs succeeded through the plugin path: `get_message`, `get_user_info`, `get_friend_list`, `get_group_info`, `get_group_list`, `get_group_member_list`, and `get_group_member_info`.
|
|
||||||
- Safe OneBot platform APIs succeeded through `call_platform_api`: `get_login_info`, `get_status`, `get_version_info`, `can_send_image`, and `can_send_record`.
|
|
||||||
|
|
||||||
Documented Matcha limits in this E2E run:
|
|
||||||
|
|
||||||
- Matcha UI did not provide a completed image/file upload/send path for inbound media. The rich inbound media evidence is `plugin-e2e-protocol`, not UI-level media upload evidence.
|
|
||||||
- Outbound `File` failed in Matcha even after the adapter emitted an official `file` segment shape.
|
|
||||||
- Outbound `Forward` failed because Matcha returned unsupported action for merged-forward.
|
|
||||||
- `get_group_honor_info` failed because Matcha returned unsupported action.
|
|
||||||
- Destructive/admin APIs such as mute, unmute, kick, leave, group rename, card/title/admin/whole-ban changes, and request approvals were not run without disposable fixtures.
|
|
||||||
@@ -1,114 +0,0 @@
|
|||||||
# DingTalk EBA Adapter Migration Record
|
|
||||||
|
|
||||||
Status: migrated with partial plugin E2E evidence.
|
|
||||||
|
|
||||||
Adapter directory: `src/langbot/pkg/platform/adapters/dingtalk/`
|
|
||||||
|
|
||||||
## What Changed
|
|
||||||
|
|
||||||
The DingTalk adapter now has an Event-Based Agents adapter package with:
|
|
||||||
|
|
||||||
- `manifest.yaml` for adapter metadata, configuration, events, common APIs, and platform-specific APIs.
|
|
||||||
- `adapter.py` for DingTalk client startup, native callback handling, legacy compatibility, and EBA dispatch.
|
|
||||||
- `event_converter.py` for native DingTalk events to common EBA events.
|
|
||||||
- `message_converter.py` for DingTalk message payloads to/from common `MessageChain` components.
|
|
||||||
- `api_impl.py` for common EBA API implementations.
|
|
||||||
- `platform_api.py` for DingTalk-specific `call_platform_api` actions.
|
|
||||||
|
|
||||||
The legacy DingTalk HTTP client now returns successful JSON response bodies from proactive send methods and raises with response details on non-200 responses.
|
|
||||||
|
|
||||||
## Configuration
|
|
||||||
|
|
||||||
| Field | Required | Notes |
|
|
||||||
|-------|----------|-------|
|
|
||||||
| `client-id` | yes | DingTalk robot/client identifier. |
|
|
||||||
| `client-secret` | yes | DingTalk client secret. |
|
|
||||||
| `robot-code` | yes | Robot code used for send APIs. |
|
|
||||||
| `robot-name` | no | Used for bot mention/self filtering and display. |
|
|
||||||
| `encrypt-key` | no | DingTalk callback encryption key when configured. |
|
|
||||||
| `verification-token` | no | DingTalk callback verification token when configured. |
|
|
||||||
|
|
||||||
## Supported Events
|
|
||||||
|
|
||||||
| Event | Support | Evidence |
|
|
||||||
|-------|---------|----------|
|
|
||||||
| `message.received` | implemented | `plugin-e2e-ui` private text and emoji-as-text. |
|
|
||||||
| `platform.specific` | implemented | Not reproduced in the latest UI run. |
|
|
||||||
|
|
||||||
## Receive Components
|
|
||||||
|
|
||||||
| Component | Support | Evidence |
|
|
||||||
|-----------|---------|----------|
|
|
||||||
| `Source` | supported | `plugin-e2e-ui` private message. |
|
|
||||||
| `Plain` | supported | `plugin-e2e-ui` private text. DingTalk emoji currently arrives as plain text such as `[smile]`. |
|
|
||||||
| `At` | converter path | Group trigger was not completed in the latest run. |
|
|
||||||
| `AtAll` | fallback/send-side only | Not completed inbound. |
|
|
||||||
| `Image` | supported | Real DingTalk Mac private-chat image upload reached the plugin as common `Image`. |
|
|
||||||
| `Voice` | converter path | Real UI inbound voice was not completed. |
|
|
||||||
| `File` | supported | Real DingTalk Mac private-chat file upload reached the plugin as common `File`. |
|
|
||||||
| `Quote` | converter path | Real UI inbound quote was not completed. |
|
|
||||||
| `Face` | not native common mapping | DingTalk emoji was observed as `Plain`, not `Face`. |
|
|
||||||
| `Forward` | not-supported inbound | DingTalk does not expose a portable structured forward event in this adapter. |
|
|
||||||
|
|
||||||
## Send Components
|
|
||||||
|
|
||||||
| Component | Support | Evidence |
|
|
||||||
|-----------|---------|----------|
|
|
||||||
| `Plain` | supported | `plugin-e2e-outbound`. |
|
|
||||||
| `At` | supported or text fallback | `plugin-e2e-outbound`. |
|
|
||||||
| `AtAll` | fallback | `plugin-e2e-outbound`. |
|
|
||||||
| `Image` | supported | `plugin-e2e-outbound`. |
|
|
||||||
| `File` | supported | `plugin-e2e-outbound`. |
|
|
||||||
| `Quote` | fallback | `plugin-e2e-outbound`. |
|
|
||||||
| `Face` | fallback | `plugin-e2e-outbound` as text fallback. |
|
|
||||||
| `Forward` | flattened fallback | `plugin-e2e-outbound`. |
|
|
||||||
| `Voice` | fallback/endpoint-dependent | Not separately verified as a native DingTalk voice send. |
|
|
||||||
|
|
||||||
## Common APIs
|
|
||||||
|
|
||||||
| API | Support | Notes |
|
|
||||||
|-----|---------|-------|
|
|
||||||
| `send_message` | supported | Verified through `EBAEventProbe`. |
|
|
||||||
| `reply_message` | supported | Verified through quoted/fallback send path. |
|
|
||||||
| `get_message` | cache-backed | Requires the message to have been observed by this adapter process. |
|
|
||||||
| `get_group_info` | cache-backed/API-backed where available | Group path not completed in latest UI run. |
|
|
||||||
| `get_group_list` | supported where DingTalk API allows | Limited live coverage. |
|
|
||||||
| `get_group_member_info` | supported where DingTalk API allows | Limited live coverage. |
|
|
||||||
| `get_user_info` | supported | Private sender path verified. |
|
|
||||||
| `get_friend_list` | limited | DingTalk does not expose a portable friend-list equivalent. |
|
|
||||||
| `get_file_url` | supported with media/file identifiers | Real inbound file yielded a platform file URL in the converted `File` component. |
|
|
||||||
| `call_platform_api` | supported | Safe action `check_access_token` verified. |
|
|
||||||
|
|
||||||
## Platform-Specific APIs
|
|
||||||
|
|
||||||
| Action | Support | Evidence |
|
|
||||||
|--------|---------|----------|
|
|
||||||
| `check_access_token` | supported | `plugin-e2e`. |
|
|
||||||
| `refresh_access_token` | supported | Implemented; not separately reproduced in the latest plugin run. |
|
|
||||||
| `get_file_url` | supported | Real inbound file yielded a platform file URL in the converted `File` component. |
|
|
||||||
| `get_audio_base64` | supported | Needs real inbound audio/media ID. |
|
|
||||||
| `download_image_base64` | supported | Real inbound image reached the plugin as `Image`; separate image-download API replay was not completed. |
|
|
||||||
|
|
||||||
## End-to-End Evidence
|
|
||||||
|
|
||||||
Evidence files:
|
|
||||||
|
|
||||||
- Text/API/component JSONL: `data/temp/dingtalk-plugin-e2e-20260510-rerun.jsonl`
|
|
||||||
- Real UI inbound media JSONL: `data/temp/dingtalk-plugin-e2e-media-ui.jsonl`
|
|
||||||
|
|
||||||
Verified:
|
|
||||||
|
|
||||||
- DingTalk Mac private chat in the `LangBot Team` organization produced `MessageReceived` through LangBot standalone runtime and `EBAEventProbe`.
|
|
||||||
- The common chain was `Source + Plain` for normal text.
|
|
||||||
- DingTalk emoji was received as `Source + Plain`, not common `Face`.
|
|
||||||
- Real DingTalk Mac private-chat image upload was received as `Source + Image`.
|
|
||||||
- Real DingTalk Mac private-chat file upload was received as `Source + File`.
|
|
||||||
- The plugin sent outbound text, mention/fallback, image, quote/fallback, file, and forward/fallback messages visible in DingTalk.
|
|
||||||
- The plugin called safe SDK and DingTalk platform APIs.
|
|
||||||
|
|
||||||
Not completed:
|
|
||||||
|
|
||||||
- Real UI inbound voice.
|
|
||||||
- Real UI inbound quote.
|
|
||||||
- Group trigger with a real robot mention.
|
|
||||||
- Destructive or organization-mutating APIs.
|
|
||||||
@@ -1,147 +0,0 @@
|
|||||||
# Discord EBA Adapter
|
|
||||||
|
|
||||||
## Status
|
|
||||||
|
|
||||||
Discord has been migrated from the legacy source adapter:
|
|
||||||
|
|
||||||
```text
|
|
||||||
src/langbot/pkg/platform/sources/discord.py
|
|
||||||
src/langbot/pkg/platform/sources/discord.yaml
|
|
||||||
```
|
|
||||||
|
|
||||||
EBA adapter directory:
|
|
||||||
|
|
||||||
```text
|
|
||||||
src/langbot/pkg/platform/adapters/discord/
|
|
||||||
├── adapter.py
|
|
||||||
├── api_impl.py
|
|
||||||
├── event_converter.py
|
|
||||||
├── manifest.yaml
|
|
||||||
├── message_converter.py
|
|
||||||
├── platform_api.py
|
|
||||||
├── types.py
|
|
||||||
└── voice.py
|
|
||||||
```
|
|
||||||
|
|
||||||
The adapter is registered as `discord-eba`.
|
|
||||||
|
|
||||||
## Configuration
|
|
||||||
|
|
||||||
| Field | Required | Default | Description |
|
|
||||||
|-------|----------|---------|-------------|
|
|
||||||
| `client_id` | Yes | `""` | Discord application client ID. |
|
|
||||||
| `token` | Yes | `""` | Discord bot token. |
|
|
||||||
|
|
||||||
The bot needs gateway permissions and intents for the target test server. Message Content intent is required for message bodies, Server Members intent is required for member APIs/events, and reaction events require the Reactions intent and channel permissions.
|
|
||||||
|
|
||||||
## Events
|
|
||||||
|
|
||||||
Discord declares these EBA events:
|
|
||||||
|
|
||||||
- `message.received`
|
|
||||||
- `message.edited`
|
|
||||||
- `message.deleted`
|
|
||||||
- `message.reaction`
|
|
||||||
- `group.member_joined`
|
|
||||||
- `group.member_left`
|
|
||||||
- `group.member_banned`
|
|
||||||
- `bot.invited_to_group`
|
|
||||||
- `bot.removed_from_group`
|
|
||||||
- `platform.specific`
|
|
||||||
|
|
||||||
Discord-specific events that do not map cleanly to common events should be surfaced as `platform.specific`.
|
|
||||||
|
|
||||||
## Common APIs
|
|
||||||
|
|
||||||
| API | Status | Notes |
|
|
||||||
|-----|-----------------|-------|
|
|
||||||
| `send_message` | Supported | Supports text, image, file, and mixed message chains through Discord messages and attachments. |
|
|
||||||
| `reply_message` | Supported | Uses Discord message references when replying to a received EBA message event. |
|
|
||||||
| `edit_message` | Supported | Bot can edit its own messages. File edits are implemented by clearing old attachments and sending replacement files when needed. |
|
|
||||||
| `delete_message` | Supported | Requires message management permissions for non-bot messages. |
|
|
||||||
| `forward_message` | Emulated | Discord has no native forward API; the adapter copies content and attachments. |
|
|
||||||
| `get_group_info` | Supported | Maps Discord guild metadata to EBA group info. |
|
|
||||||
| `get_group_member_list` | Supported | Requires member cache or the Server Members intent/fetch permission. |
|
|
||||||
| `get_group_member_info` | Supported | Maps Discord roles/permissions into EBA member roles. |
|
|
||||||
| `get_user_info` | Supported | Uses Discord user fetch/cache. |
|
|
||||||
| `upload_file` | Not supported | Discord uploads files as message attachments; standalone upload raises `NotSupportedError`. |
|
|
||||||
| `get_file_url` | Supported | Discord attachment URLs are already downloadable URLs, so the adapter returns the input URL. |
|
|
||||||
| `mute_member` | Supported where possible | Uses Discord timeout API and requires guild moderation permission. |
|
|
||||||
| `unmute_member` | Supported where possible | Clears timeout and requires guild moderation permission. |
|
|
||||||
| `kick_member` | Supported | Destructive; test only with a disposable account/bot. |
|
|
||||||
| `leave_group` | Supported | Bot leaves a guild; destructive and should run last. |
|
|
||||||
| `call_platform_api` | Supported | Discord-specific actions live here. |
|
|
||||||
|
|
||||||
## Platform-Specific APIs
|
|
||||||
|
|
||||||
`call_platform_api(action, params)` supports:
|
|
||||||
|
|
||||||
- `get_channel`
|
|
||||||
- `get_guild`
|
|
||||||
- `get_guild_channels`
|
|
||||||
- `get_guild_roles`
|
|
||||||
- `create_invite`
|
|
||||||
- `pin_message`
|
|
||||||
- `unpin_message`
|
|
||||||
- `add_reaction`
|
|
||||||
- `remove_reaction`
|
|
||||||
- `typing`
|
|
||||||
|
|
||||||
Voice helpers are intentionally kept Discord-specific:
|
|
||||||
|
|
||||||
- `join_voice_channel`
|
|
||||||
- `leave_voice_channel`
|
|
||||||
- `get_voice_connection_status`
|
|
||||||
- `list_active_voice_connections`
|
|
||||||
- `get_voice_channel_info`
|
|
||||||
|
|
||||||
## Live Test Record
|
|
||||||
|
|
||||||
The live probe is:
|
|
||||||
|
|
||||||
```bash
|
|
||||||
uv run python tests/e2e/live_discord_eba_probe.py --help
|
|
||||||
```
|
|
||||||
|
|
||||||
Verified on May 7, 2026 with a newly created Discord application/bot named `LangBot EBA Test 0507`, the LangBot Discord server, and the `#🐞-debugging` channel:
|
|
||||||
|
|
||||||
- SDK standalone runtime started with WebSocket control/debug ports, and the `EBAEventProbe` plugin connected through `lbp run`.
|
|
||||||
- Plugin runtime received real Discord events through LangBot: `BotInvitedToGroup`, `MessageReceived`, `MessageReactionReceived` add/remove, `MessageEdited`, and `MessageDeleted`.
|
|
||||||
- Plugin runtime API calls succeeded through the standalone runtime: `get_langbot_version`, `get_bots`, `get_bot_info`, `send_message`, plugin storage APIs, workspace storage APIs, `list_plugins_manifest`, `list_commands`, `list_tools`, and `list_knowledge_bases`.
|
|
||||||
- Direct live adapter probe observed `message.received`, `message.edited`, `message.deleted`, and `bot.removed_from_group`.
|
|
||||||
- Message APIs verified: send, reply, edit, delete, forward, text/image/file mixed message chains.
|
|
||||||
- User and guild APIs verified: `get_user_info`, `get_group_info`, `get_group_member_list`, `get_group_member_info`.
|
|
||||||
- Platform-specific APIs verified: `get_channel`, `get_guild`, `get_guild_channels`, `get_guild_roles`, `create_invite`, `typing`, `pin_message`, `unpin_message`, `add_reaction`, `remove_reaction`.
|
|
||||||
- Unsupported API behavior verified: `upload_file` raises `NotSupportedError`.
|
|
||||||
- Destructive API verified at the end: `leave_group`, which emitted `bot.removed_from_group`.
|
|
||||||
|
|
||||||
Not verified in the shared LangBot server live run: `mute_member`, `unmute_member`, and `kick_member`, because the run did not use a disposable target member. They are implemented through Discord timeout/kick APIs and should only be exercised against a disposable account or bot.
|
|
||||||
|
|
||||||
The test fixed one real test-fixture issue: `EBAEventProbe` previously assumed `get_bots()` returned UUID strings. The current standalone runtime returns bot dictionaries, so the probe now selects an enabled bot dictionary and passes its `uuid` to `get_bot_info` and `send_message`. The probe also now subscribes to `MessageDeleted`.
|
|
||||||
|
|
||||||
## Standalone Runtime Plugin E2E Record
|
|
||||||
|
|
||||||
Verified again on May 10, 2026 with SDK standalone runtime, LangBot `--standalone-runtime`, Discord web client, the LangBot server, and `#🐞-debugging`.
|
|
||||||
|
|
||||||
Evidence:
|
|
||||||
|
|
||||||
- Main plugin JSONL: `data/temp/discord-plugin-e2e-20260510-final.jsonl`
|
|
||||||
- LangBot runtime log: `data/temp/discord-langbot-e2e-20260510-rerun.log`
|
|
||||||
|
|
||||||
Observed and verified:
|
|
||||||
|
|
||||||
- A newly invited Discord bot connected to the LangBot server and received a real web-client message in `#🐞-debugging`.
|
|
||||||
- `MessageReceived` reached the plugin with `bot_uuid=eba-discord-live`, `adapter_name=discord`, common `Source`/`Plain` message components, common `User`, and common `UserGroup` for the guild.
|
|
||||||
- SDK API calls succeeded: `get_langbot_version`, `get_bots`, `get_bot_info`, `send_message`, plugin storage, workspace storage, `list_plugins_manifest`, `list_commands`, `list_tools`, and `list_knowledge_bases`.
|
|
||||||
- Outbound component sweep succeeded: plain text plus user mention, `AtAll`/`@everyone`, base64 image, quoted reply, file attachment, and flattened forward fallback.
|
|
||||||
- Common APIs succeeded: `get_user_info`, `get_group_info`, `get_group_member_list`, and `get_group_member_info`.
|
|
||||||
- Discord platform APIs succeeded through `call_platform_api`: `get_channel`, `typing`, `get_guild`, `get_guild_channels`, and `get_guild_roles`.
|
|
||||||
|
|
||||||
Documented limits in this E2E run:
|
|
||||||
|
|
||||||
- Real Discord UI inbound attachment/image/file, reply/quote, and fresh mention-chain messages were not completed in the plugin E2E evidence. Outbound image/file attachments from the bot do not prove inbound attachment conversion.
|
|
||||||
- A later May 10 UI retry could write text into the Discord message box, but the client kept the send button disabled and did not send the message, so it produced no new plugin evidence.
|
|
||||||
- `get_message`, `get_friend_list`, and `get_group_list` are not supported by this Discord adapter.
|
|
||||||
- Destructive moderation and guild-leave APIs were not repeated against the shared LangBot server.
|
|
||||||
- Native Discord voice is not represented as common `Voice`; audio-like payloads are treated as file attachments.
|
|
||||||
- `create_invite`, pin/unpin, and reaction mutation were covered by prior direct live probes but were not repeated by the final plugin run to avoid extra shared-server side effects.
|
|
||||||
@@ -1,108 +0,0 @@
|
|||||||
# KOOK EBA Adapter
|
|
||||||
|
|
||||||
## Status
|
|
||||||
|
|
||||||
KOOK has been migrated to the EBA adapter directory:
|
|
||||||
|
|
||||||
```text
|
|
||||||
src/langbot/pkg/platform/adapters/kook/
|
|
||||||
├── adapter.py
|
|
||||||
├── api_impl.py
|
|
||||||
├── event_converter.py
|
|
||||||
├── manifest.yaml
|
|
||||||
├── message_converter.py
|
|
||||||
├── platform_api.py
|
|
||||||
└── types.py
|
|
||||||
```
|
|
||||||
|
|
||||||
The adapter is registered as `kook-eba`.
|
|
||||||
|
|
||||||
## Configuration
|
|
||||||
|
|
||||||
| Field | Required | Default | Description |
|
|
||||||
|-------|----------|---------|-------------|
|
|
||||||
| `token` | Yes | `""` | KOOK bot token. |
|
|
||||||
| `enable-stream-reply` | Yes | `false` | Reserved for shared platform configuration compatibility. |
|
|
||||||
|
|
||||||
## Events
|
|
||||||
|
|
||||||
| Event | Evidence | Notes |
|
|
||||||
|-------|----------|-------|
|
|
||||||
| `message.received` | `plugin-e2e-ui` | Real KOOK UI channel message reached `EBAEventProbe` as `MessageReceivedEvent`. |
|
|
||||||
| `platform.specific` | `plugin-e2e-ui` | KOOK gateway event without a common EBA mapping reached `EBAEventProbe` as `PlatformSpecificEventReceived`. |
|
|
||||||
|
|
||||||
## Common APIs
|
|
||||||
|
|
||||||
| API | Evidence | Notes |
|
|
||||||
|-----|----------|-------|
|
|
||||||
| `send_message` | `plugin-e2e-outbound` | Probe plugin sent channel messages through SDK `send_message`; KOOK returned message IDs. |
|
|
||||||
| `reply_message` | `unit` | Supports `reply_msg_id` and optional quoted replies when the source message ID is available. |
|
|
||||||
| `get_message` | `plugin-e2e-outbound` | Probe plugin fetched the cached triggering message. |
|
|
||||||
| `get_group_info` | `plugin-e2e-outbound` | Probe plugin received cached KOOK channel info. |
|
|
||||||
| `get_group_list` | `plugin-e2e-outbound` | Probe plugin received cached channel/group entities observed by the adapter. |
|
|
||||||
| `get_group_member_info` | `plugin-e2e-outbound` | Probe plugin received cached sender info as a group member. |
|
|
||||||
| `get_user_info` | `plugin-e2e-outbound` | Probe plugin received cached sender user info. |
|
|
||||||
| `get_friend_list` | `plugin-e2e-outbound` | Probe plugin received cached users. |
|
|
||||||
| `upload_file` | `unit` | Uses KOOK `asset/create` and returns URL/ID. |
|
|
||||||
| `get_file_url` | `unit` | KOOK media IDs are URL-like in the adapter path; returns the ID unchanged. |
|
|
||||||
| `delete_message` | `unit` | Calls KOOK delete endpoints. Live permission verification is still required. |
|
|
||||||
| `forward_message` | `plugin-e2e-outbound` | Probe plugin sent flattened forward content through SDK `send_message`. |
|
|
||||||
| `call_platform_api` | `plugin-e2e-outbound` | Probe plugin called safe KOOK platform-specific APIs through SDK `call_platform_api`. |
|
|
||||||
|
|
||||||
## Platform-Specific APIs
|
|
||||||
|
|
||||||
| Action | Evidence | Notes |
|
|
||||||
|--------|----------|-------|
|
|
||||||
| `get_current_user` | `plugin-e2e-outbound` | Probe plugin called `user/me`. |
|
|
||||||
| `get_user` | `plugin-e2e-outbound` | Probe plugin called `user/view` for the triggering sender. |
|
|
||||||
| `get_channel` | `plugin-e2e-outbound` | Probe plugin called `channel/view` for the triggering channel. |
|
|
||||||
| `get_guild` | `plugin-e2e-outbound` | Probe plugin called `guild/view`; gateway URLs redact token query values. |
|
|
||||||
| `get_gateway` | `plugin-e2e-outbound` | Probe plugin called `gateway/index`; returned token query values are redacted. |
|
|
||||||
| `send_direct_message` | `unit` | Calls `direct-message/create`. |
|
|
||||||
|
|
||||||
## Components
|
|
||||||
|
|
||||||
| Component | Receive Evidence | Send Evidence | Notes |
|
|
||||||
|-----------|------------------|---------------|-------|
|
|
||||||
| `Source` | `plugin-e2e-ui` | N/A | KOOK message ID and timestamp are preserved. |
|
|
||||||
| `Plain` | `plugin-e2e-ui` | `plugin-e2e-outbound` | Text and KMarkdown are represented as plain common text. |
|
|
||||||
| `At` | `plugin-e2e-ui` | `plugin-e2e-outbound` | KOOK `(met)<id>(met)` mentions map to common `At`. |
|
|
||||||
| `AtAll` | `unit` | `plugin-e2e-outbound` | KOOK `(met)all(met)` maps to common `AtAll`; real inbound UI AtAll was not tested. |
|
|
||||||
| `Image` | `unit` | `unit` | URL/image ID based path only; live rendering still needs verification. |
|
|
||||||
| `Voice` | `unit` | `unit` | URL based path only; live rendering still needs verification. |
|
|
||||||
| `File` | `unit` | `unit` | URL based path only; upload API is exposed separately. |
|
|
||||||
| `Forward` | `unit` | `unit` | Outbound forwards are flattened; inbound structured forwards are not exposed by current legacy implementation. |
|
|
||||||
| `Unknown` | `unit` | N/A | Unsupported KOOK message types become `Unknown` or `PlatformSpecificEvent`. |
|
|
||||||
|
|
||||||
## Acceptance Record
|
|
||||||
|
|
||||||
Test date: June 4, 2026.
|
|
||||||
|
|
||||||
Plugin E2E verified on June 4, 2026 with `EBAEventProbe`, SDK standalone runtime, KOOK WebSocket adapter, and a real KOOK channel UI message.
|
|
||||||
|
|
||||||
Evidence:
|
|
||||||
|
|
||||||
- JSONL: `data/temp/kook_eba_plugin_probe.jsonl`
|
|
||||||
- Plugin log: `data/logs/eba-probe-kook.log`
|
|
||||||
|
|
||||||
Observed and verified:
|
|
||||||
|
|
||||||
- A real KOOK UI channel message reached the plugin as `MessageReceived` with `bot_uuid=7ab5b065-6e4e-4def-95f0-3c265366e26f`, `adapter_name=kook`, common sender/group/chat fields, and common `MessageChain` components.
|
|
||||||
- KOOK gateway-specific event reached the plugin as `PlatformSpecificEventReceived`.
|
|
||||||
- Probe plugin called SDK `send_message`; KOOK returned message IDs for text, At, AtAll, image URL/base64 fallback path, quote fallback, file fallback, and flattened forward cases.
|
|
||||||
- Probe plugin called common API methods through the SDK path: `get_message`, `get_user_info`, `get_friend_list`, `get_group_info`, `get_group_list`, and `get_group_member_info`.
|
|
||||||
- Probe plugin called safe KOOK platform-specific APIs through SDK `call_platform_api`: `get_current_user`, `get_user`, `get_channel`, `get_gateway`, and `get_guild`.
|
|
||||||
|
|
||||||
Run:
|
|
||||||
|
|
||||||
```bash
|
|
||||||
uv run pytest tests/unit_tests/platform/test_kook_eba_adapter.py
|
|
||||||
git diff --check
|
|
||||||
```
|
|
||||||
|
|
||||||
Blocked or partial items:
|
|
||||||
|
|
||||||
- `plugin-e2e-ui` inbound coverage for image, file, voice, AtAll, quote, and forward.
|
|
||||||
- `plugin-e2e-outbound` visual verification in KOOK UI for image/file/voice rendering. KOOK returned message IDs, but UI inspection was not performed in this run.
|
|
||||||
- `reply_message` and `delete_message` live permission verification.
|
|
||||||
- Destructive or permission-sensitive APIs were not declared beyond delete; KOOK mute/kick/leave remain explicit `NotSupportedError` paths until a safe fixture is available.
|
|
||||||
@@ -1,135 +0,0 @@
|
|||||||
# Lark / Feishu EBA Adapter Migration Record
|
|
||||||
|
|
||||||
Status: migrated with unit coverage and partial live plugin E2E. WebSocket text reached the standalone runtime once in the LangBot organization test app, but the latest real UI image/file inbound attempts did not reach the local adapter log, so media receive is not release-complete yet.
|
|
||||||
|
|
||||||
Adapter directory: `src/langbot/pkg/platform/adapters/lark/`
|
|
||||||
|
|
||||||
## What Changed
|
|
||||||
|
|
||||||
The Lark/Feishu adapter now has an Event-Based Agents adapter package with:
|
|
||||||
|
|
||||||
- `manifest.yaml` for adapter metadata, configuration, events, common APIs, platform-specific APIs, app type, and communication mode.
|
|
||||||
- `adapter.py` for self-built/store app token handling, WebSocket long connection startup, Webhook callback handling, card feedback, streaming-card replies, and EBA dispatch.
|
|
||||||
- `event_converter.py` for native Feishu events to common EBA events.
|
|
||||||
- `message_converter.py` for Feishu text/post/image/file/audio payloads to/from common `MessageChain` components.
|
|
||||||
- `api_impl.py` for common EBA API implementations.
|
|
||||||
- `platform_api.py` for Feishu-specific `call_platform_api` actions.
|
|
||||||
|
|
||||||
The legacy `lark` adapter remains available while the EBA adapter is registered separately as `lark-eba`.
|
|
||||||
|
|
||||||
## Configuration
|
|
||||||
|
|
||||||
| Field | Required | Notes |
|
|
||||||
|-------|----------|-------|
|
|
||||||
| `app_id` | yes | Feishu/Lark application App ID. |
|
|
||||||
| `app_secret` | yes | Feishu/Lark application App Secret. |
|
|
||||||
| `bot_name` | yes | Must match the bot name so group mentions can be recognized. |
|
|
||||||
| `enable-webhook` | yes | `false` uses WebSocket long connection; `true` uses Request URL/Webhook callbacks. |
|
|
||||||
| `webhook_url` | no | Generated callback URL for Webhook mode. |
|
|
||||||
| `encrypt-key` | no | Webhook decrypt key when event encryption is enabled. |
|
|
||||||
| `enable-stream-reply` | yes | Enables streaming replies through an updating Feishu card. |
|
|
||||||
| `app_type` | no | `self` for self-built apps; `isv` for store apps. |
|
|
||||||
| `bot_added_welcome` | no | Optional group welcome message sent after bot-added events. |
|
|
||||||
|
|
||||||
## Application And Communication Modes
|
|
||||||
|
|
||||||
| Mode | Support | Implementation |
|
|
||||||
|------|---------|----------------|
|
|
||||||
| Self-built application | implemented | Uses standard app credentials and tenant token behavior from the Feishu SDK client. |
|
|
||||||
| Store application | implemented | Builds an ISV client, requests app tickets, and resolves app/tenant access tokens with per-tenant caching. |
|
|
||||||
| WebSocket long connection | implemented | Registers `im.message.receive_v1` and card-action callbacks through `lark_oapi.ws.Client`. |
|
|
||||||
| Webhook Request URL | implemented | Handles URL verification, encrypted payloads, message events, app-ticket events, bot-added events, and card-action feedback. |
|
|
||||||
|
|
||||||
## Supported Events
|
|
||||||
|
|
||||||
| Event | Support | Evidence |
|
|
||||||
|-------|---------|----------|
|
|
||||||
| `message.received` | implemented | Unit coverage for private and group native events to common EBA events. |
|
|
||||||
| `bot.invited_to_group` | implemented | Webhook bot-added event maps to common bot invite event and optional welcome send. |
|
|
||||||
| `platform.specific` | implemented | Unknown callback events are preserved as `platform.specific`. |
|
|
||||||
| `FeedbackEvent` | compatibility event | Card button feedback is still dispatched through the existing SDK `FeedbackEvent` type. |
|
|
||||||
|
|
||||||
## Receive Components
|
|
||||||
|
|
||||||
| Component | Support | Evidence |
|
|
||||||
|-----------|---------|----------|
|
|
||||||
| `Source` | supported | Unit coverage; live private text evidence. |
|
|
||||||
| `Plain` | supported | Text and post payloads convert to common text; live private text evidence. |
|
|
||||||
| `At` | supported | Feishu mentions map to common `At` with user ID and display name. |
|
|
||||||
| `AtAll` | supported | `user_id=all` maps to common `AtAll`. |
|
|
||||||
| `Image` | supported | Image payloads download through message resource API and map to common `Image`; real UI image send attempted, but not observed in local plugin evidence yet. |
|
|
||||||
| `Voice` | supported | Audio payloads download through message resource API and map to common `Voice`. |
|
|
||||||
| `File` | supported | File payloads download through message resource API and map to common `File`; real UI file send attempted, but not observed in local plugin evidence yet. |
|
|
||||||
| `Quote` | supported | Parent/thread reply lookup maps quoted content into common `Quote`. |
|
|
||||||
| `Face` | not native common mapping | Feishu emoji/stickers are not exposed as a portable common `Face` component here. |
|
|
||||||
| `Forward` | not-supported inbound | Feishu does not expose a portable structured forward event in this adapter. |
|
|
||||||
|
|
||||||
## Send Components
|
|
||||||
|
|
||||||
| Component | Support | Evidence |
|
|
||||||
|-----------|---------|----------|
|
|
||||||
| `Plain` | supported | Unit coverage; sends Feishu `text`. |
|
|
||||||
| `At` | supported | Unit coverage; sends Feishu `post` at element. |
|
|
||||||
| `AtAll` | supported | Unit coverage; sends Feishu `post` at-all element. |
|
|
||||||
| `Image` | supported | Uploads image resource and sends Feishu `image`. |
|
|
||||||
| `Voice` | supported | Uploads OPUS/audio resource and sends Feishu `audio`. |
|
|
||||||
| `File` | supported | Uploads file resource and sends Feishu `file`. |
|
|
||||||
| `Quote` | supported/fallback | Sends quote marker plus origin content. |
|
|
||||||
| `Face` | not-supported | No portable send mapping. |
|
|
||||||
| `Forward` | flattened fallback | Flattens forward nodes into text/media messages. |
|
|
||||||
|
|
||||||
## Common APIs
|
|
||||||
|
|
||||||
| API | Support | Notes |
|
|
||||||
|-----|---------|-------|
|
|
||||||
| `send_message` | supported | Supports private/open_id and group/chat_id targets; live plugin outbound component sweep produced visible Feishu messages. |
|
|
||||||
| `reply_message` | supported | Replies to the source Feishu message; fixed to recover the native Feishu message ID from legacy-wrapped source events. |
|
|
||||||
| `get_message` | cache-backed/API-backed | Returns cached inbound event where possible and converts uncached Feishu message API items into common `MessageReceivedEvent`. |
|
|
||||||
| `get_group_info` | supported | Uses cached group or Feishu chat metadata. |
|
|
||||||
| `get_group_member_info` | limited | Uses cached user data when available. |
|
|
||||||
| `get_user_info` | limited | Uses cached user data when available. |
|
|
||||||
| `get_file_url` | limited | Returns `file://` paths from downloaded inbound resources; remote Feishu resource download uses platform-specific API params. |
|
|
||||||
| `call_platform_api` | supported | See below. |
|
|
||||||
|
|
||||||
## Platform-Specific APIs
|
|
||||||
|
|
||||||
| Action | Support | Evidence |
|
|
||||||
|--------|---------|----------|
|
|
||||||
| `check_tenant_access_token` | supported | Unit coverage. |
|
|
||||||
| `refresh_app_access_token` | supported | Store-app token path implemented. |
|
|
||||||
| `refresh_tenant_access_token` | supported | Store-app tenant token path implemented. |
|
|
||||||
| `get_chat` | supported | Feishu chat metadata API wrapper. |
|
|
||||||
| `get_message` | supported | Feishu message API wrapper with JSON-safe return values for plugin calls. |
|
|
||||||
| `get_message_resource` | supported | Feishu message resource download wrapper. |
|
|
||||||
|
|
||||||
## End-to-End Evidence
|
|
||||||
|
|
||||||
Current code-level evidence:
|
|
||||||
|
|
||||||
- `tests/unit_tests/platform/test_lark_eba_adapter.py`
|
|
||||||
- `PYTHONPATH=../langbot-plugin-sdk/src uv run pytest tests/unit_tests/platform/test_lark_eba_adapter.py -q`
|
|
||||||
|
|
||||||
Live evidence collected on May 11, 2026:
|
|
||||||
|
|
||||||
- Standalone runtime: `uv run lbp rt --ws-control-port 5400 --ws-debug-port 5401 --skip-deps-check`
|
|
||||||
- LangBot: `uv run main.py --standalone-runtime --debug`
|
|
||||||
- Plugin: `LangBot__EBAEventProbe`
|
|
||||||
- Feishu org/app: LangBot organization, `LangBotDev` private chat.
|
|
||||||
- Observed plugin JSONL: one private `MessageReceived` event with `Source + Plain`; plugin API probe then exercised bot discovery, bot info, `send_message`, outbound component sweep, storage/list APIs, and safe platform API calls.
|
|
||||||
- Real UI sends attempted after the fixes: private text, local file, and image/video image upload. These appeared in the Feishu client but did not append new `EBAEventProbe` records in the local JSONL during this run.
|
|
||||||
- Fixes from live testing: reply path now extracts the native Feishu `message_id` from legacy-wrapped source events; WebSocket callbacks are scheduled onto the adapter event loop instead of assuming the SDK callback has a running asyncio loop; platform API results are converted to JSON-safe values.
|
|
||||||
|
|
||||||
Live E2E items still required before marking release-complete:
|
|
||||||
|
|
||||||
- WebSocket self-built app in LangBot organization: repeat private text after callback-loop fix, plus private image/file/audio and group mention message received by `EBAEventProbe`.
|
|
||||||
- Webhook self-built app in LangBot organization: URL verification plus text/image/file message received by `EBAEventProbe`.
|
|
||||||
- Store app token path: at least token acquisition/tenant-token safe API through `call_platform_api`; full message E2E if a LangBot organization store-app fixture is available.
|
|
||||||
- Outbound component sweep: text, mention, at-all, image, file, voice where Feishu accepts the fixture, quote/fallback, and forward/fallback.
|
|
||||||
- Safe platform API sweep: token check, chat metadata, message lookup, and message resource download using real inbound IDs.
|
|
||||||
|
|
||||||
## Known Limits
|
|
||||||
|
|
||||||
- Store-app live E2E requires a real ISV app ticket/tenant installation fixture.
|
|
||||||
- Current LangBot organization WebSocket run connected successfully but did not deliver the latest UI-sent image/file attempts to local plugin evidence; this blocks release-complete media acceptance.
|
|
||||||
- Feishu native emoji/sticker semantics are not represented as common `Face`.
|
|
||||||
- Destructive org or chat mutations are not declared in this adapter.
|
|
||||||
@@ -1,101 +0,0 @@
|
|||||||
# OfficialAccount EBA Adapter
|
|
||||||
|
|
||||||
Adapter directory: `src/langbot/pkg/platform/adapters/officialaccount/`
|
|
||||||
|
|
||||||
Manifest name: `officialaccount-eba`
|
|
||||||
|
|
||||||
Status: partial migration. Unit/API-shape coverage is present, and private text `plugin-e2e-ui` plus safe API evidence has been verified against the `dev.rockchin.top` Official Account fixture. Proactive outbound `send_message` remains not supported by this adapter because WeChat Official Account replies must be tied to inbound webhook windows.
|
|
||||||
|
|
||||||
## Config
|
|
||||||
|
|
||||||
| Field | Required | Notes |
|
|
||||||
| --- | --- | --- |
|
|
||||||
| `webhook_url` | no | Generated by LangBot and copied into the Official Account callback settings. |
|
|
||||||
| `token` | yes | WeChat callback token. |
|
|
||||||
| `EncodingAESKey` | yes | WeChat message encryption key. |
|
|
||||||
| `AppID` | yes | Official Account app ID. |
|
|
||||||
| `AppSecret` | yes | Official Account app secret. |
|
|
||||||
| `Mode` | yes | `drop` waits for an in-callback reply; `passive` returns the loading text first and queues the answer for the user's next message. |
|
|
||||||
| `LoadingMessage` | no | Only used by `passive` mode. |
|
|
||||||
| `api_base_url` | no | Optional API base URL for proxy deployments. |
|
|
||||||
|
|
||||||
## Events
|
|
||||||
|
|
||||||
| Event | Evidence | Notes |
|
|
||||||
| --- | --- | --- |
|
|
||||||
| `message.received` | plugin-e2e-ui, unit | Text UI message verified through WeChat Official Account on `dev.rockchin.top`; image and voice webhook payloads are covered by unit tests. |
|
|
||||||
| `platform.specific` | unit | Subscribe/menu/etc. native events are emitted as structured `PlatformSpecificEvent`. |
|
|
||||||
|
|
||||||
## Common APIs
|
|
||||||
|
|
||||||
| API | Evidence | Notes |
|
|
||||||
| --- | --- | --- |
|
|
||||||
| `reply_message` | unit | Queues/passively returns text through the inbound webhook source event. |
|
|
||||||
| `get_message` | plugin-e2e-ui, unit | Cached inbound message retrieved by `EBAEventProbe` platform API sweep. |
|
|
||||||
| `get_user_info` | plugin-e2e-ui, unit | Cached inbound sender retrieved by `EBAEventProbe` platform API sweep. |
|
|
||||||
| `get_friend_list` | plugin-e2e-ui, unit | Cached inbound sender list retrieved by `EBAEventProbe` platform API sweep. |
|
|
||||||
| `call_platform_api` | plugin-e2e-ui, unit | Safe diagnostic actions verified through `get_mode` and `get_cached_response_status`. |
|
|
||||||
| `send_message` | not-supported | Official Account customer-service proactive messaging is not implemented by the existing SDK adapter; only webhook reply is supported here. |
|
|
||||||
|
|
||||||
## Platform APIs
|
|
||||||
|
|
||||||
| Action | Evidence | Notes |
|
|
||||||
| --- | --- | --- |
|
|
||||||
| `get_mode` | plugin-e2e-ui, unit | Returned `{"mode": "drop", "longer_response": false}` in live probe. |
|
|
||||||
| `get_cached_response_status` | plugin-e2e-ui, unit | Returned `{"pending": false}` in live probe. |
|
|
||||||
|
|
||||||
## Components
|
|
||||||
|
|
||||||
| Receive Component | Evidence | Notes |
|
|
||||||
| --- | --- | --- |
|
|
||||||
| `Source` | plugin-e2e-ui, unit | Uses `MsgId` and `CreateTime`; live UI text message included `Source`. |
|
|
||||||
| `Plain` | plugin-e2e-ui, unit | Live UI text message mapped to `Plain`. |
|
|
||||||
| `Image` | unit | `PicUrl` and `MediaId` map to common `Image`. |
|
|
||||||
| `Voice` | unit | `MediaId` maps to common `Voice`. |
|
|
||||||
| `Unknown` | unit | Unsupported message/event types do not crash. |
|
|
||||||
| `At`, `AtAll`, `File`, `Quote`, `Face`, `Forward`, mixed chain | not-supported | WeChat Official Account inbound webhook payloads used by the current SDK do not expose these as common structured components. |
|
|
||||||
|
|
||||||
| Send Component | Evidence | Notes |
|
|
||||||
| --- | --- | --- |
|
|
||||||
| `Plain` | unit | Sent as webhook reply text. |
|
|
||||||
| `Image`, `Voice`, `File`, `Quote`, `At`, `AtAll`, `Face`, `Forward`, mixed chain | not-supported | Existing SDK reply path is text XML only; non-text components degrade to readable placeholders in tests and are not declared as supported outbound components. |
|
|
||||||
|
|
||||||
## Verification Record
|
|
||||||
|
|
||||||
Test date: 2026-05-28
|
|
||||||
|
|
||||||
Endpoint/simulator: `dev.rockchin.top` with WeChat desktop client and a real subscribed Official Account conversation. The running EBA test stack used SDK standalone runtime ports `5400/5401`, LangBot from `/home/wgc/LangBotxg/LangBotEbaTest`, and `EBAEventProbe`.
|
|
||||||
|
|
||||||
Verified UI message: `EBA officialaccount single probe 2026-05-28 16:53`
|
|
||||||
|
|
||||||
Observed event/API evidence:
|
|
||||||
|
|
||||||
- `MessageReceived`: `bot_uuid=d7c46880-a9f8-431a-9172-5d3e0d663dbc`, `adapter_name=officialaccount-eba`, `chat_type=private`, `chat_id=ovH9L7OW6hNpWZWvp_NMmypVh26w`, `message_chain=[Source, Plain]`.
|
|
||||||
- Common safe APIs through probe platform sweep: `get_message`, `get_user_info`, `get_friend_list`.
|
|
||||||
- Platform APIs through `call_platform_api`: `get_mode`, `get_cached_response_status`.
|
|
||||||
- `send_message` and outbound component sweep returned explicit `NotSupportedError: send_message:official_account_requires_inbound_webhook_reply`, as expected for this adapter.
|
|
||||||
|
|
||||||
Standalone runtime command:
|
|
||||||
|
|
||||||
```bash
|
|
||||||
cd langbot-plugin-sdk
|
|
||||||
uv run python -m langbot_plugin.cli.__init__ rt --debug-only --ws-control-port 5400 --ws-debug-port 5401 --skip-deps-check
|
|
||||||
```
|
|
||||||
|
|
||||||
Probe plugin: `data/plugins/LangBot__EBAEventProbe` when live credentials are available.
|
|
||||||
|
|
||||||
Adapter live probe:
|
|
||||||
|
|
||||||
```bash
|
|
||||||
uv run python -m py_compile tests/e2e/live_officialaccount_eba_probe.py
|
|
||||||
OFFICIALACCOUNT_TOKEN=... OFFICIALACCOUNT_ENCODING_AES_KEY=... OFFICIALACCOUNT_APP_SECRET=... OFFICIALACCOUNT_APP_ID=... uv run python tests/e2e/live_officialaccount_eba_probe.py
|
|
||||||
```
|
|
||||||
|
|
||||||
Evidence JSONL path: `/home/wgc/LangBotxg/LangBotEbaTest/data/temp/officialaccount_eba_plugin_probe.jsonl` for plugin E2E, or `data/temp/officialaccount_eba_probe.jsonl` for direct adapter live probe.
|
|
||||||
|
|
||||||
Destructive operations: none.
|
|
||||||
|
|
||||||
Blocked items:
|
|
||||||
|
|
||||||
- `plugin-e2e-outbound`: proactive `send_message` is not supported for this adapter; Official Account responses must be produced through the inbound webhook reply window.
|
|
||||||
- Inbound image and voice live UI evidence remains pending; webhook conversion is covered by unit tests.
|
|
||||||
@@ -1,114 +0,0 @@
|
|||||||
# QQOfficial EBA Adapter
|
|
||||||
|
|
||||||
Adapter directory: `src/langbot/pkg/platform/adapters/qqofficial/`
|
|
||||||
|
|
||||||
Manifest name: `qqofficial-eba`
|
|
||||||
|
|
||||||
Status: partial migration. The EBA adapter structure, manifest, converters, cache-backed safe APIs, platform API map, unit tests, and direct live probe scaffold are in place. A real QQ Official WebSocket bot on `dev.rockchin.top` received an inbound user message and drove LangBot into the normal pipeline path; the response path was blocked by the test environment model service returning `model_not_found` for `deepseek-v3`.
|
|
||||||
|
|
||||||
## Config
|
|
||||||
|
|
||||||
| Field | Required | Notes |
|
|
||||||
| --- | --- | --- |
|
|
||||||
| `appid` | yes | QQ Official app ID. |
|
|
||||||
| `secret` | yes | QQ Official app secret. |
|
|
||||||
| `token` | yes | QQ Official callback token. |
|
|
||||||
| `enable-webhook` | yes | Uses LangBot unified webhook when true; otherwise uses the QQ WebSocket gateway. |
|
|
||||||
| `enable-stream-reply` | yes | Enables C2C streaming replies when supported by the QQ Official endpoint. |
|
|
||||||
| `webhook_url` | no | Generated by LangBot and copied into the QQ Official callback settings in webhook mode. |
|
|
||||||
|
|
||||||
## Events
|
|
||||||
|
|
||||||
| Event | Evidence | Notes |
|
|
||||||
| --- | --- | --- |
|
|
||||||
| `message.received` | adapter-live, unit | `C2C_MESSAGE_CREATE`, `DIRECT_MESSAGE_CREATE`, `GROUP_AT_MESSAGE_CREATE`, and `AT_MESSAGE_CREATE` map to common `MessageReceivedEvent`. A real WebSocket-mode QQ Official bot reached the LangBot pipeline on `dev.rockchin.top`; plugin JSONL evidence remains pending. |
|
|
||||||
| `platform.specific` | unit, blocked | Unmapped gateway events are emitted as structured `PlatformSpecificEvent`; live evidence is pending. |
|
|
||||||
|
|
||||||
## Common APIs
|
|
||||||
|
|
||||||
| API | Evidence | Notes |
|
|
||||||
| --- | --- | --- |
|
|
||||||
| `send_message` | unit, blocked | Sends private C2C, group, and text-only channel messages through the existing QQ Official client. Live outbound UI verification is pending because the test pipeline failed before producing a bot response. |
|
|
||||||
| `reply_message` | unit, blocked | Replies using the source `QQOfficialEvent` message ID when available. Live reply was blocked by the test environment model service returning `model_not_found`. |
|
|
||||||
| `get_message` | unit | Returns cached inbound `MessageReceivedEvent`. |
|
|
||||||
| `get_user_info` | unit | Returns cached inbound sender. |
|
|
||||||
| `get_friend_list` | unit | Returns cached private senders. |
|
|
||||||
| `get_group_info` | unit | Returns cached group/channel metadata from inbound events. |
|
|
||||||
| `get_group_member_info` | unit | Returns cached group sender as a common member. |
|
|
||||||
| `get_group_member_list` | unit | Returns cached group members observed by the adapter. |
|
|
||||||
| `call_platform_api` | unit, blocked | Safe diagnostic actions are implemented; live calls are pending credentials. |
|
|
||||||
|
|
||||||
## Platform APIs
|
|
||||||
|
|
||||||
| Action | Evidence | Notes |
|
|
||||||
| --- | --- | --- |
|
|
||||||
| `check_access_token` | unit, blocked | Calls the existing client token check. |
|
|
||||||
| `refresh_access_token` | unit, blocked | Forces token refresh. |
|
|
||||||
| `get_gateway_url` | unit, blocked | Fetches the WebSocket gateway URL. |
|
|
||||||
| `get_mode` | unit | Returns webhook and stream-reply mode. |
|
|
||||||
|
|
||||||
## Components
|
|
||||||
|
|
||||||
| Receive Component | Evidence | Notes |
|
|
||||||
| --- | --- | --- |
|
|
||||||
| `Source` | unit | Uses QQ message/event IDs and timestamp. |
|
|
||||||
| `Plain` | unit | Preserves text content. |
|
|
||||||
| `At` | unit | Group and channel mention events insert an adapter bot mention marker. |
|
|
||||||
| `Image` | unit | QQ image attachment URL is converted to common `Image`; falls back to URL if download fails. |
|
|
||||||
| `Unknown` | unit | Unsupported/empty native payloads become `Unknown`. |
|
|
||||||
| `Voice`, `File`, `Quote`, `Face`, `Forward`, mixed chain | blocked | Current native parser only exposes text and image attachments; live endpoint behavior still needs verification. |
|
|
||||||
|
|
||||||
| Send Component | Evidence | Notes |
|
|
||||||
| --- | --- | --- |
|
|
||||||
| `Plain` | unit, blocked | Sends through private, group, or channel text APIs. |
|
|
||||||
| `At`, `AtAll` | unit, blocked | Converted to readable mention text. |
|
|
||||||
| `Image` | unit, blocked | Sends through the QQ Official rich media upload/send path for C2C and group targets. |
|
|
||||||
| `Voice` | unit, blocked | Sends through the QQ Official rich media upload/send path for C2C and group targets. |
|
|
||||||
| `File` | unit, blocked | Sends through the QQ Official rich media upload/send path for C2C and group targets. |
|
|
||||||
| `Quote`, `Forward`, mixed chain | unit, blocked | Flattened to ordered send payloads where possible. |
|
|
||||||
| `Face` | not-supported | No common QQ Official face mapping is implemented. |
|
|
||||||
|
|
||||||
## Verification Record
|
|
||||||
|
|
||||||
Test date: 2026-06-02
|
|
||||||
|
|
||||||
Endpoint/simulator: `dev.rockchin.top` with a real QQ Official WebSocket bot (`qqofficial-eba`, bot UUID `80a5560b-52b1-40e7-b7d6-4a2341eb4780`) and LangBot running from `/home/wgc/LangBotxg/LangBotEbaTest`.
|
|
||||||
|
|
||||||
Observed evidence:
|
|
||||||
|
|
||||||
- The QQ Official WebSocket bot was enabled with `enable-webhook=false`.
|
|
||||||
- A real user message reached LangBot and entered the standard pipeline path.
|
|
||||||
- The response path stopped at the model layer with `model_not_found` for `deepseek-v3`; this is a model/provider configuration issue, not an adapter conversion failure.
|
|
||||||
- `qq-webhook.langbot.dev` was temporarily routed through Caddy to `127.0.0.1:5301` for webhook checks, but the observed EBA bot used WebSocket mode.
|
|
||||||
|
|
||||||
Standalone runtime command:
|
|
||||||
|
|
||||||
```bash
|
|
||||||
cd langbot-plugin-sdk
|
|
||||||
uv run python -m langbot_plugin.cli.__init__ rt --debug-only --ws-control-port 5400 --ws-debug-port 5401 --skip-deps-check
|
|
||||||
```
|
|
||||||
|
|
||||||
Probe plugin: `data/plugins/LangBot__EBAEventProbe` when live credentials are available.
|
|
||||||
|
|
||||||
Adapter live probe:
|
|
||||||
|
|
||||||
```bash
|
|
||||||
uv run python -m py_compile tests/e2e/live_qqofficial_eba_probe.py
|
|
||||||
QQOFFICIAL_APPID=... QQOFFICIAL_SECRET=... QQOFFICIAL_TOKEN=... uv run python tests/e2e/live_qqofficial_eba_probe.py
|
|
||||||
```
|
|
||||||
|
|
||||||
Webhook-mode probe:
|
|
||||||
|
|
||||||
```bash
|
|
||||||
QQOFFICIAL_APPID=... QQOFFICIAL_SECRET=... QQOFFICIAL_TOKEN=... uv run python tests/e2e/live_qqofficial_eba_probe.py --webhook --host 0.0.0.0 --port 5312
|
|
||||||
```
|
|
||||||
|
|
||||||
Evidence JSONL path: `data/temp/qqofficial_eba_probe.jsonl` for direct adapter live probe; plugin E2E evidence should use `data/temp/qqofficial_eba_plugin_probe.jsonl`.
|
|
||||||
|
|
||||||
Destructive operations: none implemented.
|
|
||||||
|
|
||||||
Blocked items:
|
|
||||||
|
|
||||||
- `plugin-e2e-ui`: standalone probe plugin JSONL evidence is still pending; the observed live run reached LangBot core/pipeline but was not recorded by the EBA probe plugin.
|
|
||||||
- `plugin-e2e-outbound`: waiting for visible QQ client verification of plugin `send_message`/`reply_message` output after a working model/provider is configured.
|
|
||||||
- Inbound non-text media and platform lifecycle events require endpoint evidence before they can be marked complete.
|
|
||||||
@@ -1,84 +0,0 @@
|
|||||||
# Slack EBA Adapter
|
|
||||||
|
|
||||||
## Structure
|
|
||||||
|
|
||||||
Slack is migrated into `src/langbot/pkg/platform/adapters/slack/` with the standard EBA adapter layout:
|
|
||||||
|
|
||||||
- `adapter.py` owns lifecycle, listener dispatch, unified webhook handling, outbound send/reply, and event caches.
|
|
||||||
- `event_converter.py` maps Slack `im` and `app_mention` channel events to `message.received`.
|
|
||||||
- `message_converter.py` maps common `MessageChain` components to Slack text fallback and maps inbound Slack text/image payloads back to EBA components.
|
|
||||||
- `api_impl.py` provides cache-backed common read APIs.
|
|
||||||
- `platform_api.py` declares safe Slack-specific API actions.
|
|
||||||
- `manifest.yaml` declares `slack-eba`.
|
|
||||||
|
|
||||||
The legacy `src/langbot/pkg/platform/sources/slack.py` adapter is kept unchanged.
|
|
||||||
|
|
||||||
## Configuration
|
|
||||||
|
|
||||||
| Field | Required | Notes |
|
|
||||||
|-------|----------|-------|
|
|
||||||
| `webhook_url` | No | Generated by LangBot. Paste it into Slack Event Subscriptions. |
|
|
||||||
| `bot_token` | Yes | Slack bot token, usually `xoxb-...`. |
|
|
||||||
| `signing_secret` | Yes | Slack app signing secret. |
|
|
||||||
|
|
||||||
## Events
|
|
||||||
|
|
||||||
| Event | Notes |
|
|
||||||
|-------|-------|
|
|
||||||
| `message.received` | Emitted for private `im` messages and channel `app_mention` events. Channel messages are mapped to group chats. |
|
|
||||||
| `platform.specific` | Reserved for Slack event types that are not converted into common message events. |
|
|
||||||
|
|
||||||
## Common APIs
|
|
||||||
|
|
||||||
Required:
|
|
||||||
|
|
||||||
- `send_message`
|
|
||||||
- `reply_message`
|
|
||||||
|
|
||||||
Optional:
|
|
||||||
|
|
||||||
- `get_message`
|
|
||||||
- `get_user_info`
|
|
||||||
- `get_friend_list`
|
|
||||||
- `get_group_info`
|
|
||||||
- `get_group_list`
|
|
||||||
- `get_group_member_list`
|
|
||||||
- `get_group_member_info`
|
|
||||||
- `call_platform_api`
|
|
||||||
|
|
||||||
Cache-backed APIs are only available after the relevant inbound event has been observed.
|
|
||||||
|
|
||||||
## Platform APIs
|
|
||||||
|
|
||||||
| Action | Notes |
|
|
||||||
|--------|-------|
|
|
||||||
| `get_mode` | Returns webhook mode and configured bot account id. |
|
|
||||||
| `auth_test` | Calls Slack `auth.test` with the configured bot token. |
|
|
||||||
|
|
||||||
## Known Limits
|
|
||||||
|
|
||||||
- Slack file/image outbound is currently represented as text fallback because the existing Slack SDK wrapper only exposes `chat_postMessage`.
|
|
||||||
- Inbound channel coverage follows the legacy adapter behavior: only `app_mention` events are treated as group messages.
|
|
||||||
- Real live testing requires a public callback URL configured in Slack Event Subscriptions.
|
|
||||||
|
|
||||||
## Verification
|
|
||||||
|
|
||||||
Local mocked unit coverage validates manifest parity, event conversion, legacy listener compatibility, cache-backed APIs, send/reply routing, and declared platform APIs.
|
|
||||||
|
|
||||||
Plugin E2E evidence was captured on June 2, 2026 against `dev.rockchin.top` with Slack private DM input and `EBAEventProbe` through the standalone runtime.
|
|
||||||
|
|
||||||
Evidence file: `/home/wgc/LangBotxg/LangBotEbaTest/data/temp/slack_eba_plugin_probe.jsonl`.
|
|
||||||
|
|
||||||
Observed:
|
|
||||||
|
|
||||||
- Real Slack private text produced `MessageReceived` with `adapter_name=slack-eba`, `Source + Plain`, private chat type, and filled `bot_uuid`.
|
|
||||||
- Safe common APIs passed: `get_message`, `get_user_info`, `get_friend_list`.
|
|
||||||
- Outbound component fallback sweep passed through `send_message`: plain/at/face, image, quote, file, and forward.
|
|
||||||
- Declared Slack platform APIs passed: `get_mode`, `auth_test`.
|
|
||||||
|
|
||||||
Still pending:
|
|
||||||
|
|
||||||
- Channel `app_mention` plugin E2E.
|
|
||||||
- Real inbound Slack file/image UI evidence.
|
|
||||||
|
|
||||||
Live probe scaffold: `tests/e2e/live_slack_eba_probe.py`.
|
|
||||||
@@ -1,139 +0,0 @@
|
|||||||
# Telegram EBA Adapter
|
|
||||||
|
|
||||||
## Status
|
|
||||||
|
|
||||||
Telegram has been migrated to the EBA adapter directory:
|
|
||||||
|
|
||||||
```text
|
|
||||||
src/langbot/pkg/platform/adapters/telegram/
|
|
||||||
├── adapter.py
|
|
||||||
├── api_impl.py
|
|
||||||
├── event_converter.py
|
|
||||||
├── manifest.yaml
|
|
||||||
├── message_converter.py
|
|
||||||
├── platform_api.py
|
|
||||||
└── types.py
|
|
||||||
```
|
|
||||||
|
|
||||||
The adapter is registered as `telegram-eba`.
|
|
||||||
|
|
||||||
## Configuration
|
|
||||||
|
|
||||||
| Field | Required | Default | Description |
|
|
||||||
|-------|----------|---------|-------------|
|
|
||||||
| `token` | Yes | `""` | Telegram Bot API token from BotFather. |
|
|
||||||
| `markdown_card` | No | `true` | Whether to render Markdown card style replies. |
|
|
||||||
| `enable-stream-reply` | Yes | `false` | Whether to use Telegram streaming reply mode. |
|
|
||||||
|
|
||||||
## Events
|
|
||||||
|
|
||||||
Telegram declares these EBA events:
|
|
||||||
|
|
||||||
- `message.received`
|
|
||||||
- `message.edited`
|
|
||||||
- `message.reaction`
|
|
||||||
- `group.member_joined`
|
|
||||||
- `group.member_left`
|
|
||||||
- `group.member_banned`
|
|
||||||
- `bot.invited_to_group`
|
|
||||||
- `bot.removed_from_group`
|
|
||||||
- `bot.muted`
|
|
||||||
- `bot.unmuted`
|
|
||||||
- `platform.specific`
|
|
||||||
|
|
||||||
`platform.specific` is currently used for Telegram-only callback and chat-member update payloads that do not yet have a more specific common event type.
|
|
||||||
|
|
||||||
## Common APIs
|
|
||||||
|
|
||||||
| API | Status | Notes |
|
|
||||||
|-----|--------|-------|
|
|
||||||
| `send_message` | Supported | Supports text, image, file, and mixed message chains. |
|
|
||||||
| `reply_message` | Supported | Supports quoted replies through the original message event. |
|
|
||||||
| `edit_message` | Supported | Uses Telegram message editing APIs. |
|
|
||||||
| `delete_message` | Supported | Deletes messages where bot permissions allow it. |
|
|
||||||
| `forward_message` | Supported | Forwards a message between Telegram chats. |
|
|
||||||
| `get_group_info` | Supported | Uses Telegram chat metadata. |
|
|
||||||
| `get_group_member_list` | Supported | Telegram only exposes administrators through the Bot API; this returns the available member set. |
|
|
||||||
| `get_group_member_info` | Supported | Maps Telegram member status to EBA member roles. |
|
|
||||||
| `get_user_info` | Supported | Uses Telegram `get_chat` for user chat metadata. |
|
|
||||||
| `upload_file` | Not supported | Telegram has no standalone upload endpoint; files are uploaded as part of messages. The adapter raises `NotSupportedError`. |
|
|
||||||
| `get_file_url` | Supported | Returns the Bot API file URL. Test output redacts the bot token. |
|
|
||||||
| `mute_member` | Supported | Requires a supergroup and bot moderation permission. |
|
|
||||||
| `unmute_member` | Supported | Uses current `telegram.ChatPermissions` fields. |
|
|
||||||
| `kick_member` | Supported | Destructive; should only be run against disposable users/bots in tests. |
|
|
||||||
| `leave_group` | Supported | Destructive; should run at the end of a live test. |
|
|
||||||
| `call_platform_api` | Supported | See below. |
|
|
||||||
|
|
||||||
## Platform-Specific APIs
|
|
||||||
|
|
||||||
`call_platform_api(action, params)` supports:
|
|
||||||
|
|
||||||
- `pin_message`
|
|
||||||
- `unpin_message`
|
|
||||||
- `unpin_all_messages`
|
|
||||||
- `get_chat_administrators`
|
|
||||||
- `set_chat_title`
|
|
||||||
- `set_chat_description`
|
|
||||||
- `get_chat_member_count`
|
|
||||||
- `send_chat_action`
|
|
||||||
- `create_chat_invite_link`
|
|
||||||
- `answer_callback_query`
|
|
||||||
|
|
||||||
## Live Test Record
|
|
||||||
|
|
||||||
The live probe is:
|
|
||||||
|
|
||||||
```bash
|
|
||||||
uv run python tests/e2e/live_telegram_eba_probe.py --help
|
|
||||||
```
|
|
||||||
|
|
||||||
It supports private chat tests, group/supergroup tests, moderation tests, destructive tests, and a callback-only mode.
|
|
||||||
|
|
||||||
Verified on May 7, 2026:
|
|
||||||
|
|
||||||
- Private chat message APIs: send, reply, edit, delete, forward.
|
|
||||||
- Private chat media APIs: image/file sending and `get_file_url`.
|
|
||||||
- User API: `get_user_info`.
|
|
||||||
- Supergroup APIs: group info, member list, member info, administrators, member count, invite link.
|
|
||||||
- Supergroup mutation APIs: pin, unpin, unpin all, set title, restore title, set description, restore description.
|
|
||||||
- Moderation APIs: mute and unmute against a non-owner target bot.
|
|
||||||
- Destructive APIs: kick a disposable target bot, then make the test bot leave the test group.
|
|
||||||
- Event conversion observed for `message.received`, `group.member_banned`, `group.member_left`, `bot.removed_from_group`, and Telegram-specific chat-member updates.
|
|
||||||
|
|
||||||
The test fixed one real compatibility issue: `unmute_member` previously used Telegram's removed `can_send_media_messages` permission field. It now uses the split media permission fields required by current `python-telegram-bot`.
|
|
||||||
|
|
||||||
## Standalone Runtime Plugin E2E Record
|
|
||||||
|
|
||||||
Verified on May 10, 2026 with `EBAEventProbe`, SDK standalone runtime, Telegram Lite, `@rockchinq_bot`, and `Rock'sBotGroup`.
|
|
||||||
|
|
||||||
Evidence:
|
|
||||||
|
|
||||||
- Private chat JSONL: `data/temp/telegram-plugin-e2e-rerun.jsonl`
|
|
||||||
- Group chat JSONL: `data/temp/telegram-plugin-e2e-group.jsonl`
|
|
||||||
- Private media JSONL: `data/temp/telegram-plugin-e2e-media-ui.jsonl`
|
|
||||||
|
|
||||||
Observed and verified:
|
|
||||||
|
|
||||||
- `MessageReceived` reached the plugin with `bot_uuid=eba-telegram-live`, `adapter_name=telegram`, common sender/chat fields, and common `MessageChain` content.
|
|
||||||
- `BotInvitedToGroup` reached the plugin after adding the bot to `Rock'sBotGroup`.
|
|
||||||
- SDK API calls succeeded: `get_langbot_version`, `get_bots`, `get_bot_info`, `send_message`, plugin storage, workspace storage, `list_plugins_manifest`, `list_commands`, `list_tools`, and `list_knowledge_bases`.
|
|
||||||
- Outbound component sweep succeeded in private and group chats: plain text, mention text/equivalent, base64 image, quoted reply, file/document, and flattened forward fallback. Group mode also covered `AtAll` fallback behavior.
|
|
||||||
- Real Telegram Lite private-chat inbound media was verified through the plugin path: a sent document arrived as common `File`, and a sent photo arrived as common `Image`.
|
|
||||||
- Telegram platform API sweep succeeded for safe group actions: `get_chat_administrators`, `get_chat_member_count`, and `send_chat_action`.
|
|
||||||
- Common group/user APIs succeeded in group mode: `get_user_info`, `get_group_info`, `get_group_member_list`, and `get_group_member_info`.
|
|
||||||
|
|
||||||
Documented limits in this E2E run:
|
|
||||||
|
|
||||||
- Real Telegram UI inbound voice, sticker/emoji-as-common-component, and reply/quote messages were not completed in the plugin E2E evidence.
|
|
||||||
- `get_message`, `get_friend_list`, and `get_group_list` are not supported by this Telegram adapter.
|
|
||||||
- Mutating/destructive Telegram-specific actions such as pin/unpin, title/description changes, invite-link creation, moderation, kick, and leave were not repeated in the plugin run. They remain opt-in live-probe cases.
|
|
||||||
- Telegram does not expose a portable common `Face` component for native sticker/emoji semantics in the current adapter.
|
|
||||||
|
|
||||||
## Notes for Future Adapters
|
|
||||||
|
|
||||||
Telegram is the reference implementation for:
|
|
||||||
|
|
||||||
- Keeping platform-specific actions behind `call_platform_api`.
|
|
||||||
- Treating unsupported common APIs as explicit `NotSupportedError`.
|
|
||||||
- Marking destructive live test operations behind CLI flags.
|
|
||||||
- Redacting access tokens from live probe output.
|
|
||||||
@@ -1,130 +0,0 @@
|
|||||||
# WeCom EBA Adapter
|
|
||||||
|
|
||||||
## Status
|
|
||||||
|
|
||||||
WeCom application messages now have an EBA adapter directory:
|
|
||||||
|
|
||||||
```text
|
|
||||||
src/langbot/pkg/platform/adapters/wecom/
|
|
||||||
├── adapter.py
|
|
||||||
├── api_impl.py
|
|
||||||
├── event_converter.py
|
|
||||||
├── manifest.yaml
|
|
||||||
├── message_converter.py
|
|
||||||
├── platform_api.py
|
|
||||||
└── types.py
|
|
||||||
```
|
|
||||||
|
|
||||||
The adapter is registered as `wecom-eba`.
|
|
||||||
|
|
||||||
This record covers the regular WeCom application-message adapter. WeCom AI Bot (`wecombot-eba`) uses a different protocol flow and is documented separately in `wecombot.md`. WeCom Customer Service (`wecomcs`) remains a separate follow-up migration.
|
|
||||||
|
|
||||||
## Configuration
|
|
||||||
|
|
||||||
| Field | Required | Default | Description |
|
|
||||||
|-------|----------|---------|-------------|
|
|
||||||
| `webhook_url` | No | `""` | Unified webhook URL copied into the WeCom application callback settings. |
|
|
||||||
| `corpid` | Yes | `""` | WeCom corporate ID. |
|
|
||||||
| `secret` | Yes | `""` | WeCom application secret. |
|
|
||||||
| `token` | Yes | `""` | WeCom callback token. |
|
|
||||||
| `EncodingAESKey` | Yes | `""` | WeCom callback encryption key. |
|
|
||||||
| `contacts_secret` | No | `""` | Contacts secret for contact-list based helper APIs. |
|
|
||||||
| `api_base_url` | No | `https://qyapi.weixin.qq.com/cgi-bin` | WeCom API base URL, overrideable for proxy/private-network deployments. |
|
|
||||||
|
|
||||||
## Events
|
|
||||||
|
|
||||||
WeCom declares these EBA events:
|
|
||||||
|
|
||||||
- `message.received`
|
|
||||||
- `platform.specific`
|
|
||||||
|
|
||||||
`message.received` currently covers text and image application callbacks. Other WeCom callback types are surfaced as `platform.specific` so plugins can inspect the raw structured payload without crashing the common message path.
|
|
||||||
|
|
||||||
## Common APIs
|
|
||||||
|
|
||||||
| API | Status | Notes |
|
|
||||||
|-----|--------|-------|
|
|
||||||
| `send_message` | Supported | Private/person target only. `target_id` must be `user_id|agent_id`. Supports text, image, voice, file, flattened forward, and quote fallback. |
|
|
||||||
| `reply_message` | Supported | Replies to the original WeCom sender and application agent from `source_platform_object`. |
|
|
||||||
| `get_message` | Supported from cache | Returns cached inbound `MessageReceivedEvent` by message ID. |
|
|
||||||
| `get_user_info` | Supported | Uses cached event users first, then WeCom `user/get`. |
|
|
||||||
| `get_friend_list` | Partial | Returns users seen by this adapter instance. Full contacts listing is not declared as common coverage. |
|
|
||||||
| `call_platform_api` | Supported | See below. |
|
|
||||||
| `edit_message` | Not supported | WeCom application messages do not expose a general edit endpoint for sent messages. |
|
|
||||||
| `delete_message` | Not supported | WeCom application messages do not expose a general delete endpoint for sent messages. |
|
|
||||||
| `get_group_info` / member APIs | Not supported | Regular WeCom application callbacks handled here are private user messages, not group-chat bot messages. |
|
|
||||||
| `upload_file` / `get_file_url` | Not supported as common APIs | WeCom media upload is used internally while sending image/voice/file components; no portable standalone common file URL is exposed. |
|
|
||||||
|
|
||||||
## Platform-Specific APIs
|
|
||||||
|
|
||||||
`call_platform_api(action, params)` supports:
|
|
||||||
|
|
||||||
- `check_access_token`
|
|
||||||
- `refresh_access_token`
|
|
||||||
- `get_user_info`
|
|
||||||
- `send_to_all`
|
|
||||||
|
|
||||||
`send_to_all` requires a configured `contacts_secret` with suitable contact visibility and should be treated as a broad-send operation in live testing.
|
|
||||||
|
|
||||||
## Unit Verification
|
|
||||||
|
|
||||||
Covered by:
|
|
||||||
|
|
||||||
```bash
|
|
||||||
uv run pytest tests/unit_tests/platform/test_wecom_eba_adapter.py
|
|
||||||
```
|
|
||||||
|
|
||||||
The unit tests cover:
|
|
||||||
|
|
||||||
- Manifest events/APIs/platform actions match adapter declarations.
|
|
||||||
- Outbound component conversion for text, image, voice, file, quote fallback, and byte-safe text splitting.
|
|
||||||
- Text callback conversion to `MessageReceivedEvent`.
|
|
||||||
- Legacy `FriendMessage` compatibility.
|
|
||||||
- EBA listener dispatch and inbound message/user cache.
|
|
||||||
- `send_message`, `reply_message`, and safe platform API dispatch against a mocked WeCom client.
|
|
||||||
|
|
||||||
## Standalone Runtime Plugin E2E Record
|
|
||||||
|
|
||||||
Verified on May 27, 2026 with `EBAEventProbe`, SDK standalone runtime, LangBot core, and a real WeCom desktop client against the server test environment.
|
|
||||||
|
|
||||||
```bash
|
|
||||||
cd langbot-plugin-sdk
|
|
||||||
uv run python -m langbot_plugin.cli.__init__ rt --debug-only --ws-control-port 5400 --ws-debug-port 5401 --skip-deps-check
|
|
||||||
|
|
||||||
cd LangBot
|
|
||||||
uv run main.py --standalone-runtime
|
|
||||||
|
|
||||||
cd data/plugins/LangBot__EBAEventProbe
|
|
||||||
EBA_PROBE_API=1 EBA_PROBE_COMPONENT_SWEEP=1 EBA_PROBE_PLATFORM_API=1 \
|
|
||||||
uv --project /absolute/path/to/langbot-plugin-sdk run python -m langbot_plugin.cli.__init__ run
|
|
||||||
```
|
|
||||||
|
|
||||||
Evidence:
|
|
||||||
|
|
||||||
- JSONL: `data/temp/wecom_eba_plugin_probe.jsonl`
|
|
||||||
- Bot: `wecom-eba`
|
|
||||||
- Client: real WeCom desktop client
|
|
||||||
- Environment: `dev.rockchin.top` test server
|
|
||||||
|
|
||||||
Observed and verified:
|
|
||||||
|
|
||||||
- A real private WeCom user message reached the plugin as `MessageReceived` with `adapter_name=wecom-eba`, common sender/chat fields, and `Source + Plain`.
|
|
||||||
- SDK API calls succeeded through the standalone runtime, including `get_langbot_version`, `get_bots`, `get_bot_info`, `send_message`, plugin/workspace storage, and manifest/list APIs.
|
|
||||||
- Safe adapter API checks succeeded through the plugin path for cached message/user data and declared safe platform API actions.
|
|
||||||
|
|
||||||
Still required for stricter acceptance:
|
|
||||||
|
|
||||||
- Send a private image and confirm common `Image` reaches the plugin.
|
|
||||||
- Have the plugin call `send_message` and `reply_message` for text and one media component, then verify the WeCom client receives the bot output.
|
|
||||||
- Exercise `send_to_all` only with a disposable visible-contact scope.
|
|
||||||
- Trigger one non-text/image callback, if available, and confirm it becomes `PlatformSpecificEventReceived`.
|
|
||||||
|
|
||||||
## Current Acceptance
|
|
||||||
|
|
||||||
Current status is **partial EBA acceptance**.
|
|
||||||
|
|
||||||
Blocked items:
|
|
||||||
|
|
||||||
- Real inbound image/voice/file evidence was not completed in this run.
|
|
||||||
- Inbound voice/file callback parsing is not present in the legacy `WecomClient.get_message()` path, so the EBA adapter does not claim those receive components yet.
|
|
||||||
- Group/member/moderation APIs do not apply to this regular WeCom application-message adapter.
|
|
||||||
@@ -1,148 +0,0 @@
|
|||||||
# WeComBot EBA Adapter
|
|
||||||
|
|
||||||
## Status
|
|
||||||
|
|
||||||
WeCom AI Bot now has an EBA adapter directory:
|
|
||||||
|
|
||||||
```text
|
|
||||||
src/langbot/pkg/platform/adapters/wecombot/
|
|
||||||
├── adapter.py
|
|
||||||
├── api_impl.py
|
|
||||||
├── event_converter.py
|
|
||||||
├── manifest.yaml
|
|
||||||
├── message_converter.py
|
|
||||||
├── platform_api.py
|
|
||||||
└── types.py
|
|
||||||
```
|
|
||||||
|
|
||||||
The adapter is registered as `wecombot-eba`.
|
|
||||||
|
|
||||||
This is separate from regular WeCom internal applications (`wecom-eba`). WeComBot supports WebSocket long connection mode, which does not require a webhook URL. Webhook mode remains available when `enable-webhook=true`.
|
|
||||||
|
|
||||||
## Configuration
|
|
||||||
|
|
||||||
| Field | Required | Default | Description |
|
|
||||||
|-------|----------|---------|-------------|
|
|
||||||
| `BotId` | Yes for WebSocket mode | `""` | WeCom AI Bot ID. |
|
|
||||||
| `robot_name` | Yes | `""` | Bot display name used to strip bot mentions from incoming group text. |
|
|
||||||
| `enable-webhook` | Yes | `false` | `false` uses WebSocket long connection mode; `true` uses webhook callback mode. |
|
|
||||||
| `webhook_url` | No | `""` | Unified webhook URL, only needed when webhook mode is enabled. |
|
|
||||||
| `Secret` | Yes for WebSocket mode | `""` | WeCom AI Bot secret for long connection mode. |
|
|
||||||
| `Corpid` | Yes for webhook mode | `""` | WeCom corporate ID for webhook callback mode. |
|
|
||||||
| `Token` | Yes for webhook mode | `""` | WeCom callback token. |
|
|
||||||
| `EncodingAESKey` | Yes for webhook mode; optional for WebSocket media decrypt | `""` | Message encryption/decryption key. |
|
|
||||||
| `enable-stream-reply` | No | `true` | Enables WeComBot streaming replies. |
|
|
||||||
|
|
||||||
## Events
|
|
||||||
|
|
||||||
WeComBot declares these EBA events:
|
|
||||||
|
|
||||||
- `message.received`
|
|
||||||
- `feedback.received`
|
|
||||||
- `platform.specific`
|
|
||||||
|
|
||||||
`message.received` covers private and group messages from the WeComBot SDK. `feedback.received` covers WeComBot like/dislike feedback callbacks. Native SDK events without a common EBA equivalent are emitted as `platform.specific`.
|
|
||||||
|
|
||||||
## Common APIs
|
|
||||||
|
|
||||||
| API | Status | Notes |
|
|
||||||
|-----|--------|-------|
|
|
||||||
| `send_message` | Supported in WebSocket mode | Sends proactive markdown/text to a person or group chat ID. Webhook mode raises `NotSupportedError` because the platform callback flow has no proactive send path here. |
|
|
||||||
| `reply_message` | Supported | Replies through native `req_id` in WebSocket mode or stream finalization/cache in webhook mode. |
|
|
||||||
| `get_message` | Supported from cache | Returns cached inbound `MessageReceivedEvent` by message ID. |
|
|
||||||
| `get_user_info` | Supported from cache | WeComBot events carry user info; no full user lookup endpoint is declared. |
|
|
||||||
| `get_friend_list` | Partial | Returns users observed by this adapter instance. |
|
|
||||||
| `get_group_info` | Supported from cache | Returns groups observed from inbound group messages. |
|
|
||||||
| `get_group_member_info` | Supported from cache | Returns observed sender/group-member pairs. |
|
|
||||||
| `get_group_member_list` | Partial | Returns observed members for the cached group only. |
|
|
||||||
| `call_platform_api` | Supported | See below. |
|
|
||||||
| `edit_message` / `delete_message` / `forward_message` | Not supported | WeComBot does not expose portable common APIs for these operations in the current SDK wrapper. |
|
|
||||||
| `upload_file` / `get_file_url` | Not supported as common APIs | Media is represented inside messages; no portable standalone file upload/URL API is declared. |
|
|
||||||
| moderation / leave APIs | Not supported | WeComBot does not expose equivalent common moderation operations through this adapter. |
|
|
||||||
|
|
||||||
## Platform-Specific APIs
|
|
||||||
|
|
||||||
`call_platform_api(action, params)` supports:
|
|
||||||
|
|
||||||
- `is_websocket_mode`
|
|
||||||
- `get_stream_session_status`
|
|
||||||
- `send_markdown`
|
|
||||||
|
|
||||||
`send_markdown` is only available in WebSocket mode.
|
|
||||||
|
|
||||||
## Unit Verification
|
|
||||||
|
|
||||||
Covered by:
|
|
||||||
|
|
||||||
```bash
|
|
||||||
PYTHONPATH=/Users/wangqiang/code/python/langbot-plugin-sdk/src uv run pytest tests/unit_tests/platform/test_wecombot_eba_adapter.py
|
|
||||||
```
|
|
||||||
|
|
||||||
The unit tests cover:
|
|
||||||
|
|
||||||
- Manifest events/APIs/platform actions match adapter declarations.
|
|
||||||
- Outbound common components flatten to WeComBot markdown/text.
|
|
||||||
- Private and group native events become `MessageReceivedEvent`.
|
|
||||||
- Inbound image, file, voice, and quote components map to common `MessageChain`.
|
|
||||||
- Legacy `FriendMessage`/`GroupMessage` compatibility.
|
|
||||||
- EBA listener dispatch, message/user/group/member cache, reply, send, streaming chunk, feedback, and platform API calls.
|
|
||||||
|
|
||||||
## Live Probe
|
|
||||||
|
|
||||||
The direct adapter probe is:
|
|
||||||
|
|
||||||
```bash
|
|
||||||
PYTHONPATH=/absolute/path/to/langbot-plugin-sdk/src uv run python tests/e2e/live_wecombot_eba_probe.py --help
|
|
||||||
```
|
|
||||||
|
|
||||||
Default mode is WebSocket long connection and requires:
|
|
||||||
|
|
||||||
- `WECOMBOT_BOT_ID`
|
|
||||||
- `WECOMBOT_SECRET`
|
|
||||||
- `WECOMBOT_ROBOT_NAME`
|
|
||||||
- optional `WECOMBOT_ENCODING_AES_KEY`
|
|
||||||
|
|
||||||
Webhook mode uses `--webhook` and requires:
|
|
||||||
|
|
||||||
- `WECOMBOT_TOKEN`
|
|
||||||
- `WECOMBOT_ENCODING_AES_KEY`
|
|
||||||
- `WECOMBOT_CORPID`
|
|
||||||
|
|
||||||
The probe writes JSONL evidence to `data/temp/wecombot_eba_live_probe.jsonl`, waits for a real WeComBot message, records common EBA event fields and message components, then runs safe cached/common/platform API checks.
|
|
||||||
|
|
||||||
## Standalone Runtime Plugin E2E Record
|
|
||||||
|
|
||||||
Verified on May 27, 2026 with `EBAEventProbe`, SDK standalone runtime, LangBot core, and the real WeCom desktop client in a WeCom AI Bot private chat.
|
|
||||||
|
|
||||||
Evidence:
|
|
||||||
|
|
||||||
- JSONL: `data/temp/wecombot_eba_plugin_probe.jsonl`
|
|
||||||
- Bot UUID: `9f5d4125-7b6d-4c98-8ca2-111111111111`
|
|
||||||
- Adapter: `wecombot-eba`
|
|
||||||
- Client: real WeCom desktop client, private `LangBot` BOT chat
|
|
||||||
- Mode: WebSocket long connection (`enable-webhook=false`)
|
|
||||||
|
|
||||||
Observed and verified:
|
|
||||||
|
|
||||||
- A real user-side message reached the plugin as `MessageReceived` with `adapter_name=wecombot-eba`, common sender/chat fields, and `Source + Plain`.
|
|
||||||
- SDK API calls succeeded through the standalone runtime: `get_langbot_version`, `get_bots`, `get_bot_info`, `send_message`, plugin/workspace storage, manifest/list APIs, and safe cached common platform APIs.
|
|
||||||
- Outbound component sweep was visible in the WeCom client and returned `errcode=0`: plain/mention/face fallback, base64 image marker, quote fallback, file marker, and flattened forward fallback.
|
|
||||||
- Declared WeComBot platform APIs succeeded through `plugin.call_platform_api`: `is_websocket_mode`, `get_stream_session_status`, and `send_markdown`.
|
|
||||||
- The `send_markdown` platform API produced visible bot output in the WeCom client.
|
|
||||||
|
|
||||||
Not completed:
|
|
||||||
|
|
||||||
- Clicking the visible WeCom AI feedback button did not produce a `FeedbackReceived` JSONL entry in this run, so `feedback.received` remains unverified at plugin E2E level.
|
|
||||||
- Group chat inbound and group cache/member coverage still need a real group-side trigger.
|
|
||||||
- Real inbound image/file/voice from the WeCom client was not exercised.
|
|
||||||
|
|
||||||
## Current Acceptance
|
|
||||||
|
|
||||||
Current status is **partial EBA acceptance**.
|
|
||||||
|
|
||||||
Blocked or limited items:
|
|
||||||
|
|
||||||
- `feedback.received` is implemented and unit-covered, but real plugin E2E feedback evidence was not observed from the desktop client click.
|
|
||||||
- Outbound image/voice/file are flattened as textual markers because the WeComBot SDK reply/proactive path used here is markdown/text oriented.
|
|
||||||
- Group member APIs are cache-backed and only know members observed in received messages.
|
|
||||||
- Destructive or moderation APIs are not declared because the current WeComBot protocol surface does not provide safe common equivalents.
|
|
||||||
@@ -1,161 +0,0 @@
|
|||||||
# WeCom Customer Service EBA Adapter
|
|
||||||
|
|
||||||
## Status
|
|
||||||
|
|
||||||
WeCom Customer Service now has an EBA adapter directory:
|
|
||||||
|
|
||||||
```text
|
|
||||||
src/langbot/pkg/platform/adapters/wecomcs/
|
|
||||||
├── adapter.py
|
|
||||||
├── api_impl.py
|
|
||||||
├── event_converter.py
|
|
||||||
├── manifest.yaml
|
|
||||||
├── message_converter.py
|
|
||||||
├── platform_api.py
|
|
||||||
└── types.py
|
|
||||||
```
|
|
||||||
|
|
||||||
The adapter is registered as `wecomcs-eba`. It is separate from regular WeCom application messages (`wecom-eba`) and WeCom AI Bot (`wecombot-eba`).
|
|
||||||
|
|
||||||
## Configuration
|
|
||||||
|
|
||||||
| Field | Required | Default | Description |
|
|
||||||
|-------|----------|---------|-------------|
|
|
||||||
| `webhook_url` | No | `""` | Unified webhook URL copied into the WeCom Customer Service callback settings. |
|
|
||||||
| `corpid` | Yes | `""` | WeCom corporate ID. |
|
|
||||||
| `secret` | Yes | `""` | Customer Service secret used for access tokens. |
|
|
||||||
| `token` | Yes | `""` | Customer Service callback token. |
|
|
||||||
| `EncodingAESKey` | Yes | `""` | Customer Service callback encryption key. |
|
|
||||||
| `api_base_url` | No | `https://qyapi.weixin.qq.com/cgi-bin` | WeCom API base URL, overrideable for proxy/private-network deployments. |
|
|
||||||
|
|
||||||
## Events
|
|
||||||
|
|
||||||
| Event | Status | Notes |
|
|
||||||
|-------|--------|-------|
|
|
||||||
| `message.received` | Plugin E2E UI covered for text | Text, image, file, and voice payloads convert to common EBA message components in unit tests. Real WeChat customer-side UI text reached `EBAEventProbe` on May 27, 2026. |
|
|
||||||
| `platform.specific` | Unit covered | Non-message or unknown Customer Service payloads become structured `PlatformSpecificEvent` records. |
|
|
||||||
|
|
||||||
## Common APIs
|
|
||||||
|
|
||||||
| API | Status | Notes |
|
|
||||||
|-----|--------|-------|
|
|
||||||
| `send_message` | Plugin E2E outbound covered | Private/person target only. `target_id` must be `external_userid|open_kfid`. Text and image are implemented; voice/file are explicitly unsupported. |
|
|
||||||
| `reply_message` | Plugin E2E partial | Replies through Customer Service `kf/send_msg` using the original `source_platform_object`. The pipeline reply path reached the send API, but the dev account later hit WeCom `95001 send msg count limit`. |
|
|
||||||
| `get_message` | Plugin E2E covered from cache | Returns cached inbound `MessageReceivedEvent` by message ID. |
|
|
||||||
| `get_user_info` | Plugin E2E covered | Uses cached event users first, then Customer Service `customer/batchget`. |
|
|
||||||
| `get_friend_list` | Plugin E2E covered, partial | Returns customer users seen by this adapter instance. |
|
|
||||||
| `call_platform_api` | Unit covered | See platform-specific APIs below. |
|
|
||||||
| `edit_message` / `delete_message` | Not supported | WeCom Customer Service does not expose a general edit/delete endpoint for bot-sent messages in this adapter. |
|
|
||||||
| Group/member/moderation APIs | Not supported | Customer Service conversations handled here are private customer sessions, not group chats. |
|
|
||||||
| `upload_file` / `get_file_url` | Not supported | Media upload is used internally for outbound image; no portable file URL common API is exposed. |
|
|
||||||
|
|
||||||
## Platform-Specific APIs
|
|
||||||
|
|
||||||
| Action | Status | Notes |
|
|
||||||
|--------|--------|-------|
|
|
||||||
| `check_access_token` | Unit covered | Checks whether the current access token is present. |
|
|
||||||
| `refresh_access_token` | Unit covered | Refreshes the Customer Service access token. |
|
|
||||||
| `get_customer_info` | Unit covered | Calls Customer Service customer lookup by `external_userid`. |
|
|
||||||
|
|
||||||
## Message Components
|
|
||||||
|
|
||||||
Receive:
|
|
||||||
|
|
||||||
| Component | Status | Notes |
|
|
||||||
|-----------|--------|-------|
|
|
||||||
| `Source` | Unit covered | Uses Customer Service `msgid` and `send_time`. |
|
|
||||||
| `Plain` | Unit covered | Text payload content is preserved. |
|
|
||||||
| `Image` | Unit covered | Uses the base64 data URL produced by the existing SDK image download path. |
|
|
||||||
| `Voice` | Unit covered | Maps exposed voice media ID to common `Voice.voice_id`; live UI evidence pending. |
|
|
||||||
| `File` | Unit covered | Maps exposed file media ID/name/size to common `File`; live UI evidence pending. |
|
|
||||||
| `Quote`, `At`, `AtAll`, `Face`, `Forward` | Not supported inbound | The current Customer Service SDK event model does not expose these as structured inbound fields. |
|
|
||||||
| `Unknown` | Unit covered | Unsupported message types become `Unknown` in message conversion or `platform.specific` at event level. |
|
|
||||||
|
|
||||||
Send:
|
|
||||||
|
|
||||||
| Component | Status | Notes |
|
|
||||||
|-----------|--------|-------|
|
|
||||||
| `Plain` | Plugin E2E outbound covered | Sends through `kf/send_msg` text. |
|
|
||||||
| `Image` | Plugin E2E outbound covered | Uploads media as WeCom image media and sends through `kf/send_msg` image. |
|
|
||||||
| `Quote`, `At`, `AtAll`, `Forward` | Unit covered fallback, live partially blocked | Flattened to text where possible. In the May 27 sweep, later text sends hit WeCom `95001 send msg count limit` after the successful text/image sends. |
|
|
||||||
| `Voice`, `File`, `Face` | Not supported | The adapter raises `NotSupportedError`; no tested Customer Service send path is implemented. |
|
|
||||||
|
|
||||||
## Unit Verification
|
|
||||||
|
|
||||||
Covered by:
|
|
||||||
|
|
||||||
```bash
|
|
||||||
PYTHONPATH=/Users/wangqiang/code/python/langbot-plugin-sdk/src uv run pytest tests/unit_tests/platform/test_wecomcs_eba_adapter.py
|
|
||||||
```
|
|
||||||
|
|
||||||
Result on May 27, 2026: `10 passed`.
|
|
||||||
|
|
||||||
The local `PYTHONPATH` is required in this workspace because the installed SDK package in the LangBot venv does not contain the newer `langbot_plugin.api.entities.builtin.platform.errors` module; the existing EBA adapter tests need the same SDK override.
|
|
||||||
|
|
||||||
## Live Probe
|
|
||||||
|
|
||||||
Auxiliary direct adapter probe:
|
|
||||||
|
|
||||||
```bash
|
|
||||||
PYTHONPATH=/path/to/langbot-plugin-sdk/src uv run python -m py_compile tests/e2e/live_wecomcs_eba_probe.py
|
|
||||||
|
|
||||||
WECOMCS_CORPID=... \
|
|
||||||
WECOMCS_SECRET=... \
|
|
||||||
WECOMCS_TOKEN=... \
|
|
||||||
WECOMCS_ENCODING_AES_KEY=... \
|
|
||||||
PYTHONPATH=/path/to/langbot-plugin-sdk/src \
|
|
||||||
uv run python tests/e2e/live_wecomcs_eba_probe.py \
|
|
||||||
--path /wecomcs/callback \
|
|
||||||
--log data/temp/wecomcs_eba_live_probe.jsonl
|
|
||||||
```
|
|
||||||
|
|
||||||
This probe is diagnostic only. Final EBA acceptance still requires the standalone SDK runtime plus `EBAEventProbe` plugin path.
|
|
||||||
|
|
||||||
## Standalone Runtime Plugin E2E Record
|
|
||||||
|
|
||||||
Completed partial plugin E2E on May 27, 2026 against `dev.rockchin.top` and the WeChat customer-side UI entry `微信 -> 客服消息 -> 浪波智能客服`.
|
|
||||||
|
|
||||||
Evidence:
|
|
||||||
|
|
||||||
- Server JSONL: `/home/wgc/LangBotxg/LangBotEbaTest/data/temp/wecomcs_eba_plugin_probe.jsonl`
|
|
||||||
- Trigger text: `EBA wecomcs dedupe probe 2026-05-27`
|
|
||||||
- `bot_uuid`: `cc810d2c-91f3-4f92-8f27-e1bf9f7b6cb4`
|
|
||||||
- `adapter_name`: `wecomcs-eba`
|
|
||||||
- Observed common event: `MessageReceived`, `event.type=message.received`
|
|
||||||
- Observed message chain: `Source + Plain`
|
|
||||||
- Observed chat: `chat_type=private`, `chat_id=external_userid|open_kfid`
|
|
||||||
- Observed sender: customer `User` with nickname/avatar from Customer Service lookup
|
|
||||||
- Plugin API probe: `send_message`, `get_message`, `get_user_info`, `get_friend_list`, plugin/workspace storage, and manifest/list APIs succeeded
|
|
||||||
- Component sweep: outbound `Plain` and `Image` succeeded; `Face` and `File` returned explicit `NotSupportedError`; later quote/forward fallback sends were blocked by WeCom `95001 send msg count limit`
|
|
||||||
|
|
||||||
Command shape used:
|
|
||||||
|
|
||||||
```bash
|
|
||||||
cd langbot-plugin-sdk
|
|
||||||
uv run python -m langbot_plugin.cli.__init__ rt --debug-only --ws-control-port 5400 --ws-debug-port 5401 --skip-deps-check
|
|
||||||
|
|
||||||
cd LangBot
|
|
||||||
PYTHONPATH=/absolute/path/to/langbot-plugin-sdk/src uv run main.py --standalone-runtime
|
|
||||||
|
|
||||||
cd data/plugins/LangBot__EBAEventProbe
|
|
||||||
DEBUG_RUNTIME_WS_URL=ws://127.0.0.1:5401/plugin/ws \
|
|
||||||
EBA_PROBE_LOG=/absolute/path/to/LangBot/data/temp/wecomcs_eba_plugin_probe.jsonl \
|
|
||||||
EBA_PROBE_API=1 \
|
|
||||||
EBA_PROBE_COMPONENT_SWEEP=1 \
|
|
||||||
EBA_PROBE_PLATFORM_API=1 \
|
|
||||||
uv --project /absolute/path/to/langbot-plugin-sdk run python -m langbot_plugin.cli.__init__ run
|
|
||||||
```
|
|
||||||
|
|
||||||
Required real UI trigger: send a Customer Service message from the WeCom/WeChat customer-side UI to the configured `dev.rockchin.top` Customer Service account.
|
|
||||||
|
|
||||||
## Current Acceptance
|
|
||||||
|
|
||||||
Current status is **partial EBA acceptance**.
|
|
||||||
|
|
||||||
Blocked or pending items:
|
|
||||||
|
|
||||||
- Inbound UI media (`Image`, `Voice`, `File`) was not sent from the real WeChat customer UI during this run, so receive-side media remains unit-covered only.
|
|
||||||
- Pipeline auto-reply reached `kf/send_msg`, but the test account hit WeCom `95001 send msg count limit` after successful plugin outbound text/image sends. This is recorded as an account/platform rate-limit block, not a conversion or API-shape failure.
|
|
||||||
- The current `EBAEventProbe` run did not call the adapter-specific `call_platform_api` actions (`check_access_token`, `refresh_access_token`, `get_customer_info`); the platform API map remains unit-covered.
|
|
||||||
- Inbound voice/file depends on whether the real Customer Service callback plus `sync_msg` endpoint returns those fields in the shape the local SDK models.
|
|
||||||
- Group, member, edit, delete, moderation, and standalone file URL APIs are intentionally not declared because this Customer Service protocol path does not provide tested common equivalents.
|
|
||||||
@@ -1,595 +0,0 @@
|
|||||||
# Box 系统架构深度分析
|
|
||||||
|
|
||||||
> 更新日期: 2026-06-02
|
|
||||||
> 状态更新: 自部署社区版已具备发布条件(box 可选、降级完善、无迁移欠债);工具调用循环上限、配额遍历异步化、`host_path` 挂载白名单等已落地。剩余多租户 / 安全硬化项见 [SaaS 阻塞项清单](./box-issues.md)。
|
|
||||||
> 分支: `feat/sandbox` (LangBot + langbot-plugin-sdk)
|
|
||||||
> 相关文档: [SaaS 阻塞项](./box-issues.md) | [Session 作用域](./box-session-scope.md) | [Runtime 对比](./box-vs-plugin-runtime.md) | [测试覆盖](./box-test-coverage.md) | [toB 分析](./box-tob-analysis.md)
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 1. 全局架构
|
|
||||||
|
|
||||||
```
|
|
||||||
┌──────────────────────────────────────────────────────────────────┐
|
|
||||||
│ LangBot 主进程 │
|
|
||||||
│ │
|
|
||||||
│ LocalAgentRunner ──> ToolManager ──> NativeToolLoader │
|
|
||||||
│ │ │ │ │
|
|
||||||
│ │ │ exec / read / write / edit │
|
|
||||||
│ │ │ glob / grep │
|
|
||||||
│ │ │ │
|
|
||||||
│ │ ├──> MCPLoader ──> BoxStdioSession │
|
|
||||||
│ │ │ (shared 容器, 多 process) │
|
|
||||||
│ │ │ │
|
|
||||||
│ │ ├──> SkillToolLoader (activate 工具) │
|
|
||||||
│ │ │ │
|
|
||||||
│ │ ├──> SkillAuthoringToolLoader │
|
|
||||||
│ │ │ │
|
|
||||||
│ │ └──> PluginToolLoader │
|
|
||||||
│ │ │
|
|
||||||
│ BoxService (门面) │
|
|
||||||
│ ├─ Profile 管理 (locked 字段) │
|
|
||||||
│ ├─ Host mount 校验 (allowed_mount_roots) │
|
|
||||||
│ ├─ Workspace quota 检查 │
|
|
||||||
│ ├─ 输出截断 (head+tail) │
|
|
||||||
│ ├─ Session ID 模板解析 (resolve_box_session_id) │
|
|
||||||
│ ├─ 技能挂载组装 (build_skill_extra_mounts) │
|
|
||||||
│ ├─ 重连循环 (_reconnect_loop, 指数退避) │
|
|
||||||
│ └─ BoxRuntimeConnector │
|
|
||||||
│ ├─ 心跳 loop (20s ping) │
|
|
||||||
│ └─ ActionRPCBoxClient │
|
|
||||||
│ │ Action RPC (stdio 或 WebSocket) │
|
|
||||||
│ │
|
|
||||||
│ SkillManager (skill_mgr) │
|
|
||||||
│ └─ 从 Box runtime 拉取 skills, 不可用时回落 data/skills │
|
|
||||||
└──────────────────────────────────────────────────────────────────┘
|
|
||||||
│
|
|
||||||
▼
|
|
||||||
┌──────────────────────────────────────────────────────────────────┐
|
|
||||||
│ Box Runtime 进程 (SDK 侧) │
|
|
||||||
│ │
|
|
||||||
│ BoxServerHandler (Action RPC 处理, INIT 配置注入) │
|
|
||||||
│ │ │
|
|
||||||
│ BoxRuntime (session 管理 / 进程生命周期 / TTL reaper) │
|
|
||||||
│ │ └─ session.managed_processes: dict[pid, _ManagedProcess]
|
|
||||||
│ │ │
|
|
||||||
│ Backend (启动时根据 box.backend 配置选择): │
|
|
||||||
│ DockerBackend ──┐ │
|
|
||||||
│ PodmanBackend ──┤── CLISandboxBackend │
|
|
||||||
│ NsjailBackend ──┘ (本地 CLI 或 fallback 到容器内 CLI) │
|
|
||||||
│ E2BBackend (云沙箱, 需要 E2B_API_KEY) │
|
|
||||||
│ │
|
|
||||||
│ BoxSkillStore │
|
|
||||||
│ ├─ list / get / create / update / delete │
|
|
||||||
│ ├─ scan_skill_directory / read_skill_file / write_skill_file │
|
|
||||||
│ └─ preview_skill_zip / install_skill_zip (zip 或 GitHub) │
|
|
||||||
│ │
|
|
||||||
│ aiohttp 单端口服务 (默认 :5410): │
|
|
||||||
│ /rpc/ws — Action RPC │
|
|
||||||
│ /v1/sessions/{id}/managed-process/ws — 默认 process │
|
|
||||||
│ /v1/sessions/{id}/managed-process/{pid}/ws — 指定 process │
|
|
||||||
└──────────────────────────────────────────────────────────────────┘
|
|
||||||
│
|
|
||||||
▼
|
|
||||||
┌──────────────────────────────────────────────────────────────────┐
|
|
||||||
│ 容器 / 沙箱 (Docker/Podman 容器, nsjail sandbox, 或 E2B 远程沙箱) │
|
|
||||||
│ - 隔离文件系统 / 网络 / PID 命名空间 │
|
|
||||||
│ - 资源限制 (CPU, 内存, PID 数, 可选 workspace 配额) │
|
|
||||||
│ - 主挂载 (host_path → mount_path) + 任意条 extra_mounts │
|
|
||||||
│ └─ Skills 通过 extra_mounts 挂在 /workspace/.skills/<name> │
|
|
||||||
│ - exec: 用户命令在此执行 │
|
|
||||||
│ - managed process: 多个长驻进程并存 (MCP Server / 自定义服务) │
|
|
||||||
└──────────────────────────────────────────────────────────────────┘
|
|
||||||
```
|
|
||||||
|
|
||||||
**核心设计原则**:
|
|
||||||
- Box Runtime 作为独立进程运行,通过 Action RPC 与 LangBot 主进程通信,两者复用 SDK 的 IO 层(Handler → Connection → Controller)
|
|
||||||
- 一个 session_id 对应一个容器/沙箱实例。同一 session 内可并存多条 mount 与多个 managed process
|
|
||||||
- Skill / 默认 exec / MCP Server 共享同一个 session 容器(详见 [box-session-scope.md](./box-session-scope.md))
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 2. LangBot 侧模块
|
|
||||||
|
|
||||||
### 2.1 BoxService (`pkg/box/service.py`, 722 行)
|
|
||||||
|
|
||||||
应用层门面,协调 Profile、安全校验、配额、连接、Skill 挂载与 Session 模板:
|
|
||||||
|
|
||||||
主要公开方法(按定义顺序):
|
|
||||||
|
|
||||||
```
|
|
||||||
BoxService
|
|
||||||
├─ initialize() 连接 Box Runtime + 默认 workspace 准备
|
|
||||||
├─ _on_runtime_disconnect(connector) 触发重连
|
|
||||||
├─ _reconnect_loop(connector) 指数退避重连
|
|
||||||
├─ available (property) 连接状态
|
|
||||||
│
|
|
||||||
├─ resolve_box_session_id(query) 从 pipeline 模板解析 session_id
|
|
||||||
├─ build_skill_extra_mounts(query) 组装 pipeline-bound skill 的挂载列表
|
|
||||||
│
|
|
||||||
├─ execute_tool(parameters, query) Agent 调用 exec 时的入口
|
|
||||||
│ ├─ _apply_profile / build_spec
|
|
||||||
│ ├─ _validate_host_mount
|
|
||||||
│ ├─ _enforce_workspace_quota (phase=pre)
|
|
||||||
│ ├─ client.execute(spec)
|
|
||||||
│ ├─ _enforce_workspace_quota (phase=post)
|
|
||||||
│ └─ _truncate (stdout/stderr)
|
|
||||||
│
|
|
||||||
├─ execute_spec_payload(spec_payload, ...) 内部入口(其他 loader 调用)
|
|
||||||
├─ create_session(spec_payload, ...) 显式创建 session
|
|
||||||
├─ start_managed_process(session_id, ...) 启动 managed process
|
|
||||||
├─ get_managed_process(session_id, pid) 查询进程状态(pid 默认 'default')
|
|
||||||
├─ stop_managed_process(session_id, pid) 单独停止某个 managed process
|
|
||||||
├─ get_managed_process_websocket_url(...) 返回 WS attach URL
|
|
||||||
│
|
|
||||||
├─ list_skills() / get_skill(name) Skill 元数据
|
|
||||||
├─ create_skill / update_skill / delete_skill Skill CRUD
|
|
||||||
├─ scan_skill_directory(path) 扫描目录
|
|
||||||
├─ list_skill_files / read_skill_file / write_skill_file
|
|
||||||
├─ preview_skill_zip / install_skill_zip zip / GitHub 安装
|
|
||||||
│
|
|
||||||
├─ shutdown() / dispose() 清理:RPC SHUTDOWN + 进程终止
|
|
||||||
├─ get_status() / get_sessions() / get_recent_errors()
|
|
||||||
└─ get_system_guidance() LLM 系统提示
|
|
||||||
```
|
|
||||||
|
|
||||||
**Profile 系统**: 4 个内置 Profile(`default` / `offline_readonly` / `network_basic` / `network_extended`),`locked` frozenset 字段不可被 LLM 覆盖。参数合并顺序:Profile defaults → LLM 请求参数 → locked 强制值。
|
|
||||||
|
|
||||||
**输出截断**: 默认 4000 字符上限,保留前 60% + 后 40%,中间插入 `[...truncated...]`。
|
|
||||||
|
|
||||||
**Skill 挂载合并**: `execute_tool()` 调用时,`build_skill_extra_mounts(query)` 会把当前 pipeline-bound 的所有 skill 的 `package_root` 作为 `extra_mounts` 加入 BoxSpec,挂在 `/workspace/.skills/<name>`。LLM 通过 `activate` 工具显式激活某个 skill 后,工具调用才允许引用这个 skill 的虚拟路径。
|
|
||||||
|
|
||||||
### 2.2 BoxRuntimeConnector (`pkg/box/connector.py`, 357 行)
|
|
||||||
|
|
||||||
管理与 Box Runtime 的通信连接:
|
|
||||||
|
|
||||||
- **本地 stdio**: Unix/macOS 默认路径,fork `python -m langbot_plugin.cli.__init__ box -s --ws-control-port {port}` 子进程(与 plugin runtime 统一走 `lbp` CLI 入口)
|
|
||||||
- **本地 subprocess + WS**: Windows 本地(asyncio ProactorEventLoop 不支持 stdio pipe)
|
|
||||||
- **远程 WebSocket**: Docker 部署 / `box.runtime.endpoint` 显式配置时,连接 `ws://{host}:{port}/rpc/ws`
|
|
||||||
- **同步等待**: `asyncio.Event` + `wait_for(timeout=30s)` 模式确认连接
|
|
||||||
- **心跳**: `_heartbeat_loop()` 每 20s 调用 `ping()`,失败仅 DEBUG 日志(断开检测靠 connection close)
|
|
||||||
- **重连**: `runtime_disconnect_callback` 由 BoxService 提供,触发 `_reconnect_loop`
|
|
||||||
- **INIT 注入**: 连接建立后立即下发当前 `box.*` 配置子树(剔除 `runtime` 私有字段),Runtime 据此初始化 backend
|
|
||||||
|
|
||||||
> **历史改进**: 2026-04-16 版本本文档曾列 P0 「Box 无心跳 / 无重连」,已修复(commit `2dfd9d5d`、`c6882cf`、`5029d9c` 等)。
|
|
||||||
|
|
||||||
### 2.3 BoxWorkspaceSession 工具 (`pkg/box/workspace.py`, 413 行)
|
|
||||||
|
|
||||||
此文件目前提供两类能力:
|
|
||||||
|
|
||||||
1. **路径与命令重写工具函数** — `normalize_host_path` / `rewrite_mounted_path` / `unwrap_venv_path` / `rewrite_venv_command` / `infer_workspace_host_path`,被 MCP loader 与 Skill 路径解析共用。
|
|
||||||
2. **`BoxWorkspaceSession`** — 围绕 BoxService 的轻量包装,专供 MCP-in-Box 场景使用(管理一个共享 session 的 session_id、构建挂载 payload、stage host 文件到共享 workspace)。
|
|
||||||
|
|
||||||
**变化点**: 早期 Skill exec 会为每个 skill 创建独立 BoxWorkspaceSession(独占 session);当前实现已转为 `extra_mounts` 模式,Skill 不再独占容器,只追加挂载。这部分 wrapping 逻辑已从 native loader 移除。
|
|
||||||
|
|
||||||
### 2.4 policy.py (`pkg/box/policy.py`, 98 行) — 仍是死代码
|
|
||||||
|
|
||||||
三层安全策略设计(`SandboxPolicy` / `ToolPolicy` / `ElevatedPolicy`),全项目无任何导入或调用。详见 [SaaS 阻塞项 S2](./box-issues.md)。
|
|
||||||
|
|
||||||
### 2.5 SkillManager (`pkg/skill/manager.py`, 186 行)
|
|
||||||
|
|
||||||
```
|
|
||||||
SkillManager
|
|
||||||
├─ initialize() 调用 reload_skills()
|
|
||||||
├─ reload_skills() 先从 Box runtime list_skills(),
|
|
||||||
│ 不可用则回落 data/skills/ 扫描
|
|
||||||
├─ refresh_skill_from_disk() 单 skill 重新加载
|
|
||||||
├─ get_skill_by_name(name)
|
|
||||||
└─ get_managed_skills_root() 返回 Box 视角的 skills_root 路径
|
|
||||||
```
|
|
||||||
|
|
||||||
skill 元数据通过 `parse_frontmatter` 解析 `SKILL.md` 头部(`name` / `description` / `instructions`),不再做整体扫描的代价(典型 < 50 个)。
|
|
||||||
|
|
||||||
### 2.6 Skill activation (`pkg/skill/activation.py`, 33 行) + Skill loader 辅助
|
|
||||||
|
|
||||||
历史上 skill 通过 LLM 在文本中输出 `[ACTIVATE_SKILL:name]` 标记激活;当前已改为 **Tool Call 机制**:
|
|
||||||
|
|
||||||
- `SkillToolLoader` (`pkg/provider/tools/loaders/skill.py`, 157 行) 暴露 `activate` 工具,参数为 skill 名
|
|
||||||
- 工具实现调用 `register_activated_skill(query, skill_data)`,将激活态写入 `query.variables['_activated_skills']`
|
|
||||||
- 这种 KV-cache-friendly 模式对齐 Claude Code 设计;详见 [box-session-scope.md §4.3](./box-session-scope.md) 的 Tool Call 描述
|
|
||||||
|
|
||||||
`activation.py` 现仅保留对外辅助函数(pipeline 层调用 loader 的 `register_activated_skill`)。
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 3. SDK 侧模块
|
|
||||||
|
|
||||||
### 3.1 BoxRuntime (`box/runtime.py`, 599 行)
|
|
||||||
|
|
||||||
核心编排器,管理 session 生命周期与 backend 调度:
|
|
||||||
|
|
||||||
```
|
|
||||||
Session 生命周期:
|
|
||||||
|
|
||||||
Client EXEC / CREATE_SESSION
|
|
||||||
│
|
|
||||||
▼
|
|
||||||
_get_or_create_session(spec)
|
|
||||||
├─ _reap_expired_sessions_locked() 清理 TTL 过期 session
|
|
||||||
├─ 已存在? → _assert_session_compatible() → 复用
|
|
||||||
├─ Backend session 失踪? → 重建 (commit c6882cf)
|
|
||||||
└─ 新建? → backend.start_session(spec) → 创建容器
|
|
||||||
│ └─ 应用 spec.extra_mounts (多挂载)
|
|
||||||
▼
|
|
||||||
execute(spec)
|
|
||||||
├─ 获取 session lock (每 session 独立)
|
|
||||||
├─ backend.exec(session, spec) 在容器中执行命令
|
|
||||||
├─ 更新 last_used_at
|
|
||||||
└─ 超时? → 销毁 session
|
|
||||||
│
|
|
||||||
▼
|
|
||||||
Session 保持存活直到:
|
|
||||||
├─ TTL 过期 (默认 300s,下次操作时清理)
|
|
||||||
├─ 执行超时 (自动销毁)
|
|
||||||
├─ 客户端 DELETE_SESSION
|
|
||||||
└─ SHUTDOWN
|
|
||||||
```
|
|
||||||
|
|
||||||
**关键设计**:
|
|
||||||
- 每 session 有独立 `asyncio.Lock`,同一 session 内的命令串行执行
|
|
||||||
- 每 session 维护 `managed_processes: dict[process_id, _ManagedProcess]`,支持多个长驻进程并存(MCP / 自定义)
|
|
||||||
- 全局 `_lock` 保护 `_sessions` dict 的读写
|
|
||||||
- 兼容性检查:比较核心 spec 字段,`image` 字段对不支持自定义镜像的 backend(nsjail/E2B)会跳过
|
|
||||||
|
|
||||||
**Backend 选择 (`_select_backend`)**: 优先级
|
|
||||||
1. 显式 `box.backend` 配置(`docker` / `nsjail` / `e2b`)
|
|
||||||
2. `local` (默认) → Docker / Podman / nsjail CLI 顺序探测
|
|
||||||
3. `get_status` 调用时若当前 backend 不可用,会尝试重新选择 (commit `e5617c7`)
|
|
||||||
|
|
||||||
### 3.2 Backend 系统
|
|
||||||
|
|
||||||
#### CLISandboxBackend (`box/backend.py`, 411 行)
|
|
||||||
|
|
||||||
Docker / Podman 公共基类:
|
|
||||||
|
|
||||||
```
|
|
||||||
start_session(spec):
|
|
||||||
1. validate_sandbox_security(spec)
|
|
||||||
2. docker/podman run -d --rm --name <name>
|
|
||||||
--network none (可选)
|
|
||||||
--cpus/--memory/--pids-limit
|
|
||||||
--read-only + --tmpfs /tmp
|
|
||||||
-v <host>:<mount>:<mode> 主挂载
|
|
||||||
-v <extra.host>:<extra.mount>:.. 额外挂载 (extra_mounts)
|
|
||||||
<image> sh -lc 'while true; do sleep 3600; done'
|
|
||||||
3. 返回 BoxSessionInfo
|
|
||||||
|
|
||||||
exec(session, spec):
|
|
||||||
docker/podman exec -e KEY=VAL <container>
|
|
||||||
sh -lc 'mkdir -p <workdir> && cd <workdir> && <cmd>'
|
|
||||||
|
|
||||||
start_managed_process(session, spec):
|
|
||||||
docker/podman exec -i <container>
|
|
||||||
sh -lc 'mkdir -p <cwd> && cd <cwd> && exec <command> <args>'
|
|
||||||
返回 asyncio.subprocess.Process (stdin/stdout PIPE)
|
|
||||||
```
|
|
||||||
|
|
||||||
容器以 idle 进程启动,实际命令通过 `docker exec` 执行。`--rm` 确保容器退出时自动清理。
|
|
||||||
|
|
||||||
**Windows 支持**: backend 内对 Windows 路径处理与 subprocess 调用做了适配(commit `120817a`)。
|
|
||||||
|
|
||||||
**孤儿清理**: 启动时枚举 `langbot.box=true` 标签的容器,instance_id 不匹配的强制删除。
|
|
||||||
|
|
||||||
#### NsjailBackend (`box/nsjail_backend.py`, 552 行)
|
|
||||||
|
|
||||||
轻量级 Linux 沙箱(无容器引擎依赖):
|
|
||||||
|
|
||||||
- 使用 namespace 隔离(user/mount/pid/ipc/uts/cgroup/net)
|
|
||||||
- 挂载宿主 `/usr`/`/lib`/`/bin`/`/sbin` 只读 + 选定 `/etc` 条目
|
|
||||||
- 每 session 创建独立目录(workspace/tmp/home)
|
|
||||||
- 资源限制: cgroup v2 优先,fallback 到 rlimit
|
|
||||||
- **CLI 兼容**: 通过 `shutil.which(self._nsjail_bin)` 检测系统安装版 nsjail;不存在时再尝试容器内 nsjail(commit `686fcc0`、`feed530`)
|
|
||||||
- **无自定义镜像**: 使用宿主 OS,`image` 字段固定为 `'host'`,兼容性检查跳过 image
|
|
||||||
|
|
||||||
#### E2BBackend (`box/e2b_backend.py`, 429 行)
|
|
||||||
|
|
||||||
云沙箱后端(commit `75b547f` 引入):
|
|
||||||
|
|
||||||
- 通过 `e2b` SDK 与 E2B 平台通信
|
|
||||||
- 配置:`box.e2b.api_key` / `api_url` / `template`
|
|
||||||
- 支持 `extra_mounts`(commit `0fea9b1` 同步上传文件)
|
|
||||||
- 无本地容器引擎依赖,适合无 Docker 的部署或 SaaS 多租户场景
|
|
||||||
- 不支持自定义 image 字段,由 template 控制
|
|
||||||
|
|
||||||
### 3.3 Server (`box/server.py`, 508 行)
|
|
||||||
|
|
||||||
单端口 aiohttp 服务(默认 5410),通过路径区分(commit `8c71ec5` 合并端口):
|
|
||||||
|
|
||||||
1. **Action RPC** (`/rpc/ws`): `BoxServerHandler` 处理所有 action,包括 `INIT` 配置注入、skill store 操作等
|
|
||||||
2. **WS Relay** (`/v1/sessions/{id}/managed-process/ws` 与 `/v1/sessions/{id}/managed-process/{pid}/ws`): 双向桥接 WebSocket ↔ 指定 managed process stdin/stdout
|
|
||||||
|
|
||||||
stdio 模式同样会在 5410 启动 aiohttp,专门承担 managed process attach;Action RPC 走 stdin/stdout。
|
|
||||||
|
|
||||||
### 3.4 Client (`box/client.py`, 377 行)
|
|
||||||
|
|
||||||
`ActionRPCBoxClient` 封装 `Handler.call_action()` 调用:
|
|
||||||
|
|
||||||
- 25+ 方法对应 25+ 个 RPC action(exec / session / managed-process / skill / status / shutdown)
|
|
||||||
- 错误还原: `_translate_action_error()` 通过字符串前缀匹配还原 SDK 侧异常类型
|
|
||||||
- `execute()` timeout = 300s,其他默认 15s
|
|
||||||
- `BoxRuntimeClient` 是 ABC,供后续可能的非 RPC 实现复用
|
|
||||||
|
|
||||||
包级别 `__init__.py` 显式导出:`BoxRuntimeClient`、`ActionRPCBoxClient`(commit `df9c722`)。
|
|
||||||
|
|
||||||
### 3.5 Actions (`box/actions.py`, 34 行)
|
|
||||||
|
|
||||||
`LangBotToBoxAction` 枚举共定义 **25 个** action:
|
|
||||||
|
|
||||||
| 类别 | Actions |
|
|
||||||
|------|---------|
|
|
||||||
| 控制 | `INIT`、`HEALTH`、`STATUS`、`GET_BACKEND_INFO`、`SHUTDOWN` |
|
|
||||||
| 执行 | `EXEC` |
|
|
||||||
| Session | `CREATE_SESSION` / `GET_SESSION` / `GET_SESSIONS` / `DELETE_SESSION` |
|
|
||||||
| Managed Process | `START_MANAGED_PROCESS` / `GET_MANAGED_PROCESS` / `STOP_MANAGED_PROCESS` |
|
|
||||||
| Skill | `LIST_SKILLS` / `GET_SKILL` / `CREATE_SKILL` / `UPDATE_SKILL` / `DELETE_SKILL` / `SCAN_SKILL_DIRECTORY` / `LIST_SKILL_FILES` / `READ_SKILL_FILE` / `WRITE_SKILL_FILE` / `PREVIEW_SKILL_ZIP` / `INSTALL_SKILL_ZIP` |
|
|
||||||
|
|
||||||
### 3.6 Models (`box/models.py`, 331 行)
|
|
||||||
|
|
||||||
核心数据模型:
|
|
||||||
|
|
||||||
| 模型 | 用途 |
|
|
||||||
|------|------|
|
|
||||||
| `BoxNetworkMode` | `OFF` / `ON` |
|
|
||||||
| `BoxExecutionStatus` | `COMPLETED` / `TIMED_OUT` |
|
|
||||||
| `BoxHostMountMode` | `NONE` / `READ_ONLY` / `READ_WRITE` |
|
|
||||||
| `BoxManagedProcessStatus` | `RUNNING` / `EXITED` |
|
|
||||||
| `BoxMountSpec` | 单条挂载(host_path/mount_path/mode)— **新增** |
|
|
||||||
| `BoxSpec` | 执行请求;新增 `extra_mounts: list[BoxMountSpec]`、`persistent`、`workspace_quota_mb` |
|
|
||||||
| `BoxProfile` | 4 个内置 Profile + `locked` frozenset |
|
|
||||||
| `BoxSessionInfo` | Session 状态(含 backend_name/created_at/last_used_at) |
|
|
||||||
| `BoxManagedProcessSpec` | 长驻进程参数(process_id/command/args/env/cwd) |
|
|
||||||
| `BoxManagedProcessInfo` | 进程状态(status/exit_code/stderr_preview/attached) |
|
|
||||||
| `BoxExecutionResult` | 执行结果(status/exit_code/stdout/stderr/duration_ms) |
|
|
||||||
|
|
||||||
`BoxSpec` 校验器: `workdir` 默认继承 `mount_path`;`host_path` 支持 POSIX 和 Windows 路径;设置 `host_path` 时 `workdir` 必须在 `mount_path` 下。
|
|
||||||
|
|
||||||
### 3.7 BoxSkillStore (`box/skill_store.py`, 647 行)
|
|
||||||
|
|
||||||
新增模块(commit `4ab3502`),把 skill 持久化收归 Box runtime:
|
|
||||||
|
|
||||||
```
|
|
||||||
BoxSkillStore
|
|
||||||
├─ list_skills() / get_skill(name)
|
|
||||||
├─ create_skill(data) / update_skill(name, data) / delete_skill(name)
|
|
||||||
├─ scan_skill_directory(path) 扫描目录返回候选 skill 包列表
|
|
||||||
├─ list_skill_files(name, path) 浏览 skill 内文件树
|
|
||||||
├─ read_skill_file(name, path) / write_skill_file(name, path, content)
|
|
||||||
├─ preview_skill_zip(zip_bytes, ...) 不落盘预览 zip 内容
|
|
||||||
└─ install_skill_zip(zip_bytes, ...) 解压、校验、复制到 skills_root
|
|
||||||
└─ 支持 source_subdir / target_suffix(commit 1aa043f)
|
|
||||||
```
|
|
||||||
|
|
||||||
GitHub 安装路径:HTTP 层(`api/http/service/skill.py`)先 `git clone` 拉取,再走 `install_skill_zip` 或 directory 路径。Skill 文件存放于 `box.local.skills_root`(默认 `skills`,相对 `host_root`),容器内对应 `/workspace/.skills/`。
|
|
||||||
|
|
||||||
### 3.8 Security (`box/security.py`, 52 行)
|
|
||||||
|
|
||||||
`validate_sandbox_security()`: 黑名单校验 host_path,阻止挂载 `/etc`/`/proc`/`/sys`/`/dev`/`/root`/`/boot` 及 Docker/Podman socket。
|
|
||||||
|
|
||||||
**已知缺陷**: 根路径 `/` 未拦截,用户 home 目录未拦截,是 denylist 而非 allowlist 策略。详见 [SaaS 阻塞项 S5](./box-issues.md)。
|
|
||||||
|
|
||||||
### 3.9 Errors (`box/errors.py`, 33 行)
|
|
||||||
|
|
||||||
| 异常类型 | 含义 |
|
|
||||||
|----------|------|
|
|
||||||
| `BoxError` | 基类 |
|
|
||||||
| `BoxValidationError` | spec/参数校验失败 |
|
|
||||||
| `BoxBackendUnavailableError` | 无可用 backend |
|
|
||||||
| `BoxRuntimeUnavailableError` | Runtime 服务不可用 |
|
|
||||||
| `BoxSessionConflictError` | session 已存在但 spec 不兼容 |
|
|
||||||
| `BoxSessionNotFoundError` | session 不存在 |
|
|
||||||
| `BoxManagedProcessConflictError` | session 已有同名 process |
|
|
||||||
| `BoxManagedProcessNotFoundError` | process 不存在 |
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 4. 工具系统集成
|
|
||||||
|
|
||||||
### 4.1 ToolManager 编排 (`toolmgr.py`)
|
|
||||||
|
|
||||||
```
|
|
||||||
ToolManager.initialize()
|
|
||||||
├─ NativeToolLoader (exec / read / write / edit / glob / grep)
|
|
||||||
├─ PluginToolLoader (插件工具)
|
|
||||||
├─ MCPLoader (MCP Server 工具)
|
|
||||||
├─ SkillToolLoader (activate 工具 — Tool Call 激活)
|
|
||||||
└─ SkillAuthoringToolLoader (Skill CRUD)
|
|
||||||
|
|
||||||
工具调用优先级: native → plugin → mcp → skill → skill_authoring
|
|
||||||
```
|
|
||||||
|
|
||||||
### 4.2 Native Tools (`native.py`, 846 行)
|
|
||||||
|
|
||||||
| 工具 | 是否在 Box 中执行 | 是否访问宿主文件系统 |
|
|
||||||
|------|:---:|:---:|
|
|
||||||
| `exec` | 是 | 否 |
|
|
||||||
| `read` | **否** | **是** — 直接 `open()` 宿主文件 |
|
|
||||||
| `write` | **否** | **是** — 直接 `open()` 宿主文件 |
|
|
||||||
| `edit` | **否** | **是** — 直接 `open()` 宿主文件 |
|
|
||||||
| `glob` | **否** | **是** — 直接遍历宿主目录 |
|
|
||||||
| `grep` | **否** | **是** — 直接读宿主文件 |
|
|
||||||
|
|
||||||
**沙箱边界不对称**: 这是刻意的设计权衡 — `read`/`write`/`edit`/`glob`/`grep` 绕过沙箱以获得性能(避免容器 I/O 开销与跨进程拷贝),但意味着 LLM 可以直接读写 `allowed_mount_roots` 下任何文件。Skill 路径经 `_resolve_host_path()` 重写,禁止穿越 `package_root`。
|
|
||||||
|
|
||||||
**exec 的 Skill 分支**: 命令中引用 `/workspace/.skills/<name>` 的 skill 时:
|
|
||||||
1. 验证 skill 已激活
|
|
||||||
2. 单次 exec 只能引用一个 skill 包
|
|
||||||
3. 若 skill 是 Python 项目(有 `requirements.txt` 或 `pyproject.toml`),命令会被 venv bootstrap 包裹(在 skill 挂载点内创建 `.venv`)
|
|
||||||
4. 调用 `box_service.execute_tool()` → 走默认 session_id 与已组装好的 `extra_mounts`,**不再为每 skill 起独立 session**
|
|
||||||
|
|
||||||
### 4.3 MCP-in-Box (`mcp_stdio.py`, 354 行)
|
|
||||||
|
|
||||||
`BoxStdioSessionRuntime` 让 MCP stdio 服务器在 Box 容器中运行,**共享 session、多 process**模式(commit `529088e`):
|
|
||||||
|
|
||||||
```
|
|
||||||
initialize()
|
|
||||||
1. 复用/创建共享 session (session_id = _build_box_session_id())
|
|
||||||
- persistent=True,长期保持
|
|
||||||
2. workspace.execute_raw(install_cmd) 安装依赖 (可选)
|
|
||||||
3. 将每个 MCP server 文件 stage 到 /workspace/.mcp/<process_id>/
|
|
||||||
4. workspace.start_managed_process(process_id=<server>)
|
|
||||||
5. websocket_client(ws_url) 通过 WS relay 连接
|
|
||||||
6. ClientSession.initialize() MCP 协议握手
|
|
||||||
```
|
|
||||||
|
|
||||||
配置 (`MCPServerBoxConfig`): `network='on'` (MCP 服务器通常需要网络),`host_path_mode='ro'` (默认只读),`startup_timeout_sec=120` (留时间给 pip install)。
|
|
||||||
|
|
||||||
每条 MCP server 是同一 session 中的一个 managed process,独立的 `process_id`、独立 attach URL,互不阻塞。
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 5. 启动与生命周期
|
|
||||||
|
|
||||||
### 5.1 启动顺序 (`build_app.py`)
|
|
||||||
|
|
||||||
```
|
|
||||||
BuildAppStage.run(ap)
|
|
||||||
├─ ... (persistence, models, sessions) ...
|
|
||||||
│
|
|
||||||
├─ BoxService(ap)
|
|
||||||
├─ box_service.initialize()
|
|
||||||
│ └─ connector.initialize()
|
|
||||||
│ ├─ [stdio] fork box subprocess
|
|
||||||
│ ├─ [subprocess+WS] Windows 本地
|
|
||||||
│ └─ [remote WS] connect URL
|
|
||||||
│ └─ 启动心跳 _heartbeat_task
|
|
||||||
├─ ap.box_service = box_service
|
|
||||||
│
|
|
||||||
├─ ToolManager(ap)
|
|
||||||
├─ tool_mgr.initialize()
|
|
||||||
│ ├─ NativeToolLoader (检查 box_service.available)
|
|
||||||
│ ├─ PluginToolLoader
|
|
||||||
│ ├─ MCPLoader (Box 可用时,stdio MCP 走沙箱)
|
|
||||||
│ └─ SkillAuthoringToolLoader
|
|
||||||
├─ ap.tool_mgr = tool_mgr
|
|
||||||
│
|
|
||||||
├─ ... (platform, pipeline) ...
|
|
||||||
├─ SkillManager.initialize() (从 Box runtime 加载 skill 列表)
|
|
||||||
└─ ... (RAG, HTTP, plugins) ...
|
|
||||||
```
|
|
||||||
|
|
||||||
BoxService 在 ToolManager **之前**初始化。ToolManager 创建 loader 时检查 `box_service.available`。
|
|
||||||
|
|
||||||
### 5.2 初始化失败处理
|
|
||||||
|
|
||||||
```python
|
|
||||||
try:
|
|
||||||
await self._runtime_connector.initialize()
|
|
||||||
self._available = True
|
|
||||||
except Exception as e:
|
|
||||||
self._available = False
|
|
||||||
logger.warning(f"Box runtime unavailable: {e}")
|
|
||||||
```
|
|
||||||
|
|
||||||
**静默降级**: Box 初始化失败不会阻止应用启动,仅导致 6 个 native tool、所有 Skill 工具和 MCP-in-Box 工具不暴露给 LLM。与 Plugin 的行为不同(Plugin 失败会抛异常)。
|
|
||||||
|
|
||||||
### 5.3 销毁流程
|
|
||||||
|
|
||||||
```
|
|
||||||
app.dispose()
|
|
||||||
└─ box_service.dispose()
|
|
||||||
├─ connector.dispose()
|
|
||||||
│ ├─ cancel _heartbeat_task
|
|
||||||
│ ├─ cancel _handler_task / _ctrl_task
|
|
||||||
│ └─ terminate subprocess (SIGTERM)
|
|
||||||
└─ loop.create_task(client.shutdown())
|
|
||||||
└─ RPC SHUTDOWN → Box Runtime 清理所有容器
|
|
||||||
```
|
|
||||||
|
|
||||||
Box 额外做了 RPC SHUTDOWN 通知 Runtime 主动清理容器,比 Plugin 的直接杀进程更安全。
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 6. 配置
|
|
||||||
|
|
||||||
### config.yaml (重构后)
|
|
||||||
|
|
||||||
```yaml
|
|
||||||
box:
|
|
||||||
enabled: true # 整个 Box 子系统的总开关。设为 false 时:
|
|
||||||
# - 不连接远程 Box runtime,不 fork 本地 stdio 子进程
|
|
||||||
# - sandbox 工具 (exec/read/write/edit/glob/grep) 不暴露给 LLM
|
|
||||||
# - skill 添加/编辑 / GitHub 安装 / 文件写入全部拒绝
|
|
||||||
# - stdio 模式的 MCP server 启动时报错(http/sse 模式不受影响)
|
|
||||||
# - skill 列表/读取保持只读可用
|
|
||||||
# BOX__ENABLED 环境变量可覆盖(统一约定)
|
|
||||||
backend: 'local' # 'local' (探测) / 'docker' / 'nsjail' / 'e2b'
|
|
||||||
# 由 box.backend / BOX__BACKEND 选择后端
|
|
||||||
runtime:
|
|
||||||
endpoint: '' # 外部 Runtime 的 WS 基地址 'ws://host:5410'
|
|
||||||
# 留空 = 本地自管 Runtime
|
|
||||||
local:
|
|
||||||
profile: 'default'
|
|
||||||
image: '' # 覆盖 profile 默认 image
|
|
||||||
host_root: './data/box' # 工作区挂载根,Docker 部署需绝对路径
|
|
||||||
default_workspace: '' # 默认 '<host_root>/default'
|
|
||||||
skills_root: 'skills' # Box 管理的 skill 包目录(相对 host_root)
|
|
||||||
allowed_mount_roots: # 默认 ['<host_root>']
|
|
||||||
- './data/box'
|
|
||||||
- '/tmp'
|
|
||||||
workspace_quota_mb: null # 配额覆盖,null = 走 profile
|
|
||||||
e2b:
|
|
||||||
api_key: '' # 也可走 E2B_API_KEY 环境变量
|
|
||||||
api_url: '' # 自托管 E2B 时填写
|
|
||||||
template: '' # 默认 template ID
|
|
||||||
```
|
|
||||||
|
|
||||||
> **重大变更**: 较 2026-04-16 文档,配置结构完全重组(commit `eefdea4`)。原字段 `box.profile` / `box.runtime_url` / `box.shared_host_root` / `box.allowed_host_mount_roots` 全部迁入 `box.local.*` 子表,新增 `box.backend` 与 `box.e2b.*` 配置组。
|
|
||||||
|
|
||||||
### docker-compose.yaml
|
|
||||||
|
|
||||||
`langbot_box` 服务受 compose profile 控制,默认 `docker compose up` **不会**启动它。需要 sandbox 时:
|
|
||||||
|
|
||||||
```bash
|
|
||||||
docker compose --profile box up # 启动 langbot + langbot_box + plugin runtime
|
|
||||||
docker compose --profile all up # 同上
|
|
||||||
docker compose up # 只起 langbot + plugin runtime (box 关闭)
|
|
||||||
```
|
|
||||||
|
|
||||||
若不起 `langbot_box`,需要同步在 `data/config.yaml` 中设 `box.enabled: false`(或 langbot 容器 env 加 `BOX__ENABLED=false`),否则 LangBot 会一直尝试连接不存在的 Box runtime 并报错。
|
|
||||||
|
|
||||||
```yaml
|
|
||||||
# langbot_box 的关键 volume
|
|
||||||
volumes:
|
|
||||||
- ${LANGBOT_BOX_ROOT}:${LANGBOT_BOX_ROOT} # 工作区挂载(源/目标同路径)
|
|
||||||
- /var/run/docker.sock:/var/run/docker.sock # Docker backend 复用宿主 docker
|
|
||||||
```
|
|
||||||
|
|
||||||
### 关闭/连接失败时的行为矩阵
|
|
||||||
|
|
||||||
`box.enabled = false` 与"启用但连接失败"在用户可观察行为上**完全一致**——都通过 `BoxService.available = False` 表达,只是 `get_status` 多返回 `enabled` 字段供前端区分文案。
|
|
||||||
|
|
||||||
| 消费方 | Box 可用 | Box 不可用(disabled 或 failed) |
|
|
||||||
|---|---|---|
|
|
||||||
| native exec/read/write/edit/glob/grep 工具 | 暴露给 LLM | **不暴露** |
|
|
||||||
| `activate` / `register_skill` 工具 | 暴露给 LLM | **不暴露** |
|
|
||||||
| stdio MCP server | 在 Box 内启动 | **`_init_stdio_python_server` 抛 RuntimeError** 拒绝;不退化到宿主 stdio |
|
|
||||||
| http/sse MCP server | 正常 | 正常(不依赖 Box) |
|
|
||||||
| Skill 列表/读取 (`list_skills`/`get_skill`/`read_skill_file`) | 走 Box runtime | 走 LangBot 本地 `data/skills/` 只读 fallback |
|
|
||||||
| Skill 创建/编辑/安装/写文件 | 走 Box runtime | **HTTP 400** + 明确错误信息(`_require_box_for_write`) |
|
|
||||||
| Pipeline AI 配置中 `box-session-id-template` | 正常生效 | **前端 banner** 提示字段无效 |
|
|
||||||
| Pipeline 扩展页 `enable_all_skills` / 绑定 skill | 可编辑 | **前端禁用** + banner |
|
|
||||||
| 仪表盘 Box 状态卡片 | 绿点 / "已连接" | 灰点 / "已禁用"(disabled) 或 红点 / "已断开"(failed) |
|
|
||||||
|
|
||||||
> 后端拒写的边界条件:如果 `ap.box_service` **完全没装**(老式 dev mode,没经过 BuildAppStage),`_require_box_for_write` 视作 no-op,保留 `data/skills/` 本地路径——以兼容历史测试与最小化设置。生产环境总会装 `ap.box_service`,因此该 fallback 不会被触发。
|
|
||||||
|
|
||||||
### Pipeline 配置 (templates/metadata/pipeline/ai.yaml)
|
|
||||||
|
|
||||||
`local-agent.config.box-session-id-template` 控制 session 作用域,预设:
|
|
||||||
|
|
||||||
- `{launcher_type}_{launcher_id}` — 每个会话 (推荐,默认)
|
|
||||||
- `{launcher_type}_{launcher_id}_{sender_id}` — 群聊每个用户
|
|
||||||
- `{launcher_type}_{launcher_id}_{conversation_id}` — 每个对话上下文
|
|
||||||
- `{query_id}` — 每条消息(完全隔离)
|
|
||||||
|
|
||||||
详见 [box-session-scope.md](./box-session-scope.md)。
|
|
||||||
|
|
||||||
### REST API
|
|
||||||
|
|
||||||
| 端点 | 方法 | 说明 | 前端 |
|
|
||||||
|------|------|------|:---:|
|
|
||||||
| `/api/v1/box/status` | GET | 可用性、Profile、后端信息 | ✅ 监控页 |
|
|
||||||
| `/api/v1/box/sessions` | GET | 活跃 session 列表 | ❌ |
|
|
||||||
| `/api/v1/box/errors` | GET | 最近 50 条错误 | ❌ |
|
|
||||||
| `/api/v1/skills` 等 | GET/POST/PUT/DELETE | Skill CRUD、文件浏览、zip/GitHub 安装、preview | ✅ Skill 管理页 |
|
|
||||||
|
|
||||||
前端 `web/src/app/home/monitoring/components/overview-cards/SystemStatusCards.tsx` 已接入 `/api/v1/box/status`,展示 backend 名称、profile 与活跃 session 数。Sessions 与 errors API 仍未接入。
|
|
||||||
@@ -1,76 +0,0 @@
|
|||||||
# Box 系统 — SaaS 发布前阻塞项
|
|
||||||
|
|
||||||
> 更新日期: 2026-06-02
|
|
||||||
> 分支: `feat/sandbox` (LangBot + langbot-plugin-sdk)
|
|
||||||
> 相关文档: [架构分析](./box-architecture.md) | [Session 作用域](./box-session-scope.md) | [Runtime 对比](./box-vs-plugin-runtime.md) | [测试覆盖](./box-test-coverage.md) | [toB 分析](./box-tob-analysis.md)
|
|
||||||
|
|
||||||
## 范围说明
|
|
||||||
|
|
||||||
**自部署社区版已具备发布条件**:默认 stdio 模式、box 为可选项;box 关闭 / 不可用时后端、前端、工具、skill、stdio-MCP 均能干净降级(清晰报错、不崩溃);配置向后兼容(旧 `data/config.yaml` 可直接启动);无新增 ORM 模型、无迁移欠债;市场安装失败不会破坏实例。CI 全绿。
|
|
||||||
|
|
||||||
本清单**只保留发布 SaaS / 多租户 / 公网暴露前必须处理的阻塞项**。社区版(可信、单运营者、内网)不受这些项阻塞——它们的风险面在"不可信调用方能直接触达 Box 控制面"或"多租户共享资源"的场景才成立。
|
|
||||||
|
|
||||||
## 已解决(社区版发布前)
|
|
||||||
|
|
||||||
| 项 | 处理 |
|
|
||||||
|----|------|
|
|
||||||
| 工具调用循环无上限 (原 #13) | `localagent.py` 增加 `MAX_TOOL_CALL_ROUNDS=128`,超限优雅终止(`cafef1a3`) |
|
|
||||||
| 配额校验同步遍历阻塞事件循环 (原 #10) | `_enforce_workspace_quota` 改 async,工作区遍历走 `asyncio.to_thread`(`cafef1a3`) |
|
|
||||||
| `host_path` 挂载白名单 (原 #3 的 LangBot 侧) | `pkg/box/service.py` `allowed_mount_roots` 白名单,空列表时拒绝一切宿主挂载 |
|
|
||||||
| 重复的 `_is_path_under` (原 #12) | 已去重,仅保留一处定义 |
|
|
||||||
| 重连 / 心跳 / Windows 兼容 / nsjail image 字段 / 前端 Box 状态接入 | 见上一轮 review 记录,均已合入 |
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## SaaS 阻塞项
|
|
||||||
|
|
||||||
### S1. Box 控制面无认证 — Critical
|
|
||||||
|
|
||||||
- **位置**: SDK `box/server.py` — Action RPC WS (`/rpc/ws`) 与 managed-process relay (`/v1/sessions/{id}/managed-process/{pid}/ws`)
|
|
||||||
- **现状**: 两个 WS handler 在 `ws.prepare` 后直接服务,无任何 token / 鉴权;box 默认绑定 `0.0.0.0:5410`。任何能触达该端口者可发起 `EXEC`、创建 session、attach 任意 session 的 managed-process stdin/stdout、甚至 `SHUTDOWN`。LangBot→box 的 INIT 也未下发任何凭证。
|
|
||||||
- **缓解现状**: 默认 `docker-compose.yaml` 的 `langbot_box` 未把 5410 发布到宿主(爆炸半径限于内网 bridge);但 box 挂载了 `/var/run/docker.sock`,同网络的任意服务(含被攻破的插件)→ 宿主 root。若运营者把 5410 发布到宿主或独立以 `0.0.0.0` 起 box,则完全裸奔。
|
|
||||||
- **要求**: INIT 时下发 token,两个 WS 路由按连接校验(query/header)。这是 SaaS 的**头号**阻塞项。
|
|
||||||
|
|
||||||
### S2. 无 exec 授权模型(policy.py 死代码) — High
|
|
||||||
|
|
||||||
- **位置**: LangBot `pkg/box/policy.py`(`SandboxPolicy` / `ToolPolicy` / `ElevatedPolicy` 全项目无引用);`pkg/provider/tools/loaders/native.py`;`pkg/provider/tools/toolmgr.py`
|
|
||||||
- **现状**: 原生工具(`exec/read/write/edit/glob/grep`)按"box 是否可用"全有或全无地暴露,**无 per-pipeline 的 exec 网关 / 工具白名单 / 沙箱模式 / 权限提升控制**。只要 box 可用,任何使用 local-agent + 函数调用模型的 pipeline 都能跑任意 shell。
|
|
||||||
- **要求**: 接入 policy.py(或等价机制),按 pipeline 控制是否暴露 `exec`、可用工具白名单、沙箱网络/只读模式。
|
|
||||||
|
|
||||||
### S3. 会话资源无界(DoS) — High
|
|
||||||
|
|
||||||
- **#5 session 数量无上限**: SDK `box/runtime.py` `_get_or_create_session` 的 `_sessions` dict 无容量限制——可变 `session_id` 的恶意调用可无限创建容器,耗尽宿主 CPU/内存/PID/磁盘。
|
|
||||||
- **#8 无定时回收**: 过期 session 仅在 `_get_or_create_session` 时机会性清理,无独立周期任务;一波创建后转静默会永久泄漏容器。
|
|
||||||
- **要求**: `max_sessions` 上限(拒绝或 LRU),加独立周期 reaper(如 60s)。
|
|
||||||
|
|
||||||
### S4. 工作区配额无内核级限制(TOCTOU) — Med-High
|
|
||||||
|
|
||||||
- **位置**: LangBot `pkg/box/service.py` `_enforce_workspace_quota`(应用层 read-then-check);SDK 侧 `workspace_quota_mb` 仅记录/透传,无 `--storage-opt size=` 等内核/FS 限额
|
|
||||||
- **现状**: 执行前后两次检查之间存在竞态窗口;单条命令(`dd`/`fallocate`)可在检查间隙撑爆磁盘,事后检查只能补救。
|
|
||||||
- **要求**: Docker `--storage-opt size=` 做内核级限制,或 Redis 原子计数预留式配额。
|
|
||||||
|
|
||||||
### S5. 挂载校验缺口 — Med-High
|
|
||||||
|
|
||||||
- **位置**: SDK `box/security.py` `_BLOCKED_HOST_PATHS_POSIX`;`box/backend.py` 的 `extra_mounts` 处理
|
|
||||||
- **现状**: ① SDK 黑名单仍不含 `/`(前缀匹配,`host_path="/"` 可通过,挂载整个宿主 fs);用户 home、`/usr`、`/opt`、`/tmp` 也未拦截。② `validate_sandbox_security` 只校验 `spec.host_path`,**从不遍历 `spec.extra_mounts`**——LangBot 侧 `allowed_mount_roots` 也只校验 `host_path`。当前 `extra_mounts` 仅由 `build_skill_extra_mounts` 内部填充(agent 不可达),但缺乏纵深防御:一旦 S1 的无认证 RPC 被触达,extra_mounts 可挂任意宿主路径,两层都不拦。
|
|
||||||
- **要求**: SDK 黑名单加入 `/`(或改白名单);`extra_mounts` 在 SDK 与 LangBot 两侧都纳入挂载校验。
|
|
||||||
|
|
||||||
### S6. 容器加固缺失 — Med
|
|
||||||
|
|
||||||
- **位置**: SDK `box/backend.py` 的 `docker run` 组装
|
|
||||||
- **现状**: 未设置 `--cap-drop=ALL`、`--security-opt=no-new-privileges`、非 root `--user`;叠加挂载 docker.sock,逃逸面偏大。
|
|
||||||
- **要求**: 默认加上上述加固 flag(需回归常用 skill 不被破坏)。
|
|
||||||
|
|
||||||
### S7. 全局锁内执行慢操作(扩展性) — Med
|
|
||||||
|
|
||||||
- **位置**: SDK `box/runtime.py` `_get_or_create_session`:`self._lock` 持有期间调用 `backend.start_session()`(`docker run` / nsjail 启动 / E2B `Sandbox.create`)
|
|
||||||
- **影响**: 冷启动(镜像拉取数秒、E2B >1s)期间串行阻塞所有并发请求——多租户负载下整个 Box runtime 停顿。降级表现是延迟而非失败。
|
|
||||||
- **要求**: 锁内只做状态检查与注册,容器创建移到锁外。
|
|
||||||
|
|
||||||
### S8. 其他硬化 / 跟进 — Low
|
|
||||||
|
|
||||||
- **#9** SDK `box/server.py` 直接读 `runtime._sessions` 私有字段、绕过锁,并发下可能读到不一致状态——应加公共访问方法。
|
|
||||||
- **#16** `pkg/provider/tools/toolmgr.py` `execute_func_call` 按优先级分发,plugin/MCP 若有同名 `exec/read/write/...` 工具会被静默遮蔽——应加命名空间或冲突告警。
|
|
||||||
- **#4** SDK `box/runtime.py` INIT/handshake 与 backend 实例化的残留竞态(仅"纯远程 WS box 先启动、LangBot 后连"场景成立;stdio/compose 路径下 config 经 env 在 spawn 时已就位,无竞态)——应在 INIT 完成前拒绝业务 action。
|
|
||||||
- **#11** `extra_mounts` 在容器创建时固定(SDK `runtime.py` 兼容性检查不含 extra_mounts);长生命周期共享 session 后续新激活的 skill 不会挂上(当前缓解:创建时挂上 pipeline 绑定的全部 skill)——动态绑定场景需销毁重建或文档说明。
|
|
||||||
- **#21** 集成测试未进 CI:容器实际执行、E2B 真机、managed-process WS attach 仅本地可跑。安全关键路径缺自动化覆盖——SaaS 前建议加 Docker-in-Docker CI stage 或合并前手动 checklist。
|
|
||||||
@@ -1,402 +0,0 @@
|
|||||||
# Box Session Scope Design
|
|
||||||
|
|
||||||
> Date: 2026-04-18 (last reviewed 2026-06-02)
|
|
||||||
> Status (2026-06-02): the self-hosted community edition is release-ready (box optional, clean degradation, no migration debt). Tool-call loop cap, async quota scan, and the host_path mount allowlist have landed. Remaining multi-tenant / security hardening is tracked in [box-issues.md](./box-issues.md).
|
|
||||||
> Branch: `feat/sandbox` (LangBot + langbot-plugin-sdk)
|
|
||||||
> Related: [Box Architecture](./box-architecture.md) | [Box vs Plugin Runtime](./box-vs-plugin-runtime.md)
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 0. Implementation Status (2026-05-19)
|
|
||||||
|
|
||||||
This document was authored as a design proposal. The current `feat/sandbox` branch
|
|
||||||
has shipped the design largely as written:
|
|
||||||
|
|
||||||
| Item | Status | Notes |
|
|
||||||
|------|--------|-------|
|
|
||||||
| `BoxMountSpec` + `BoxSpec.extra_mounts` | ✅ Shipped | SDK `box/models.py` |
|
|
||||||
| Docker / nsjail / E2B backends apply extra mounts | ✅ Shipped | Last gap closed by SDK commit `0fea9b1` (E2B) |
|
|
||||||
| `box-session-id-template` in `local-agent` pipeline config | ✅ Shipped | `templates/metadata/pipeline/ai.yaml`, default `{launcher_type}_{launcher_id}` |
|
|
||||||
| `BoxService.resolve_box_session_id(query)` | ✅ Shipped | `pkg/box/service.py:166` |
|
|
||||||
| `BoxService.build_skill_extra_mounts(query)` | ✅ Shipped | `pkg/box/service.py:189` |
|
|
||||||
| Skill exec uses unified container + extra mounts | ✅ Shipped | `pkg/provider/tools/loaders/native.py` skill branch |
|
|
||||||
| MCP-in-Box uses shared persistent session, multi-process | ✅ Shipped (earlier than originally scoped) | SDK commit `529088e`, LangBot `mcp_stdio.py:_build_box_session_id` |
|
|
||||||
| `BoxManagedProcessSpec.process_id` + multi-process per session | ✅ Shipped | `BoxRuntime` keeps `managed_processes: dict[pid, _ManagedProcess]` |
|
|
||||||
| Per-tenant / quota integration with templates | ❌ Not started | See [box-tob-analysis.md](./box-tob-analysis.md) |
|
|
||||||
|
|
||||||
The "Phase 2 deferred" note in §10 is **out of date** — MCP unification went in on
|
|
||||||
the same line. Pipeline-scoped (not user-scoped) MCP container is the realized
|
|
||||||
behavior: each pipeline's MCP servers share one `mcp-<pipeline>` session, and
|
|
||||||
user exec sessions use the template-derived id.
|
|
||||||
|
|
||||||
The remaining open work is multi-tenant overlays (tenant_id in session_id,
|
|
||||||
quota counters keyed by tenant), tracked in the toB analysis doc rather than here.
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 1. Problems
|
|
||||||
|
|
||||||
### 1.1 Default exec: per-message containers
|
|
||||||
|
|
||||||
Currently, `BoxService.execute_tool()` sets `session_id = str(query.query_id)` — an
|
|
||||||
auto-incrementing integer per incoming message. Every user message creates a new sandbox
|
|
||||||
container. Dependencies installed and in-container state are lost between messages.
|
|
||||||
|
|
||||||
### 1.2 Three isolated container pools
|
|
||||||
|
|
||||||
Default exec, skills, and MCP servers each manage their own containers with
|
|
||||||
independent session IDs:
|
|
||||||
|
|
||||||
| Path | Session ID | Container |
|
|
||||||
|--------------|-----------------------------------------------|-------------|
|
|
||||||
| Default exec | `str(query_id)` (per message) | Ephemeral |
|
|
||||||
| Skill exec | `skill-{launcher}_{id}-{skill_name}` | Per skill |
|
|
||||||
| MCP stdio | `mcp-{server_uuid}` | Per server |
|
|
||||||
|
|
||||||
This means a single logical user interaction can spawn 3+ containers that cannot
|
|
||||||
share state, see each other's files, or reuse installed dependencies.
|
|
||||||
|
|
||||||
### 1.3 Single bind mount limitation
|
|
||||||
|
|
||||||
`BoxSpec` currently supports only **one** `host_path` → `mount_path` bind mount.
|
|
||||||
This prevents mounting both a default workspace and skill directories into the
|
|
||||||
same container.
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 2. Concept Model
|
|
||||||
|
|
||||||
```
|
|
||||||
Platform Message
|
|
||||||
→ Query (query_id: int, auto-increment, per message)
|
|
||||||
→ Session (launcher_type + launcher_id, per chat window)
|
|
||||||
→ Conversation (uuid, per dialogue context within a Session)
|
|
||||||
```
|
|
||||||
|
|
||||||
| Concept | Key | Example | Scope |
|
|
||||||
|---------------|-------------------------------------|----------------------------|------------------------------|
|
|
||||||
| Query | `query_id` | `42` | Single message |
|
|
||||||
| Session | `launcher_type` + `launcher_id` | `group_123456` | Chat window (group or PM) |
|
|
||||||
| Conversation | `conversation_id` (UUID) | `a1b2c3d4-...` | Dialogue context within a Session |
|
|
||||||
| Sender | `sender_id` | `789` | Individual user |
|
|
||||||
|
|
||||||
Note: in a **group chat**, all users share the same Session (keyed by `group_id`). The
|
|
||||||
individual sender is tracked as `sender_id` but does not affect Session/Conversation routing.
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 3. Target Scenarios
|
|
||||||
|
|
||||||
| # | Scenario | Box Granularity | Desired `session_id` |
|
|
||||||
|----|--------------------------------|------------------------------------------|---------------------------------------------------------|
|
|
||||||
| 1 | Personal assistant | 1 Box per user, long-lived | `{launcher_type}_{launcher_id}` |
|
|
||||||
| 2 | Customer service | 1 Box per customer, cross-pipeline | `{launcher_type}_{launcher_id}` |
|
|
||||||
| 3 | Internal employee tool | 1 Box per employee | `{launcher_type}_{launcher_id}` |
|
|
||||||
| 4 | Group chat shared assistant | 1 Box per group | `{launcher_type}_{launcher_id}` |
|
|
||||||
| 5 | Group chat isolated per user | 1 Box per user within a group | `{launcher_type}_{launcher_id}_{sender_id}` |
|
|
||||||
| 6 | Teaching (cross-channel) | 1 Box per student across groups/PMs | `{sender_id}` |
|
|
||||||
| 7 | One-off execution | 1 Box per message (current behavior) | `{query_id}` |
|
|
||||||
| 8 | Multi-project development | 1 Box per conversation context | `{launcher_type}_{launcher_id}_{conversation_id}` |
|
|
||||||
|
|
||||||
No single fixed granularity covers all scenarios. A template-based approach is needed.
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 4. Design Overview
|
|
||||||
|
|
||||||
Two key changes:
|
|
||||||
|
|
||||||
1. **Unified container**: exec, skills, and MCP all share the same container per
|
|
||||||
session scope. No more separate container pools.
|
|
||||||
2. **Configurable session scope**: `session_id` is generated from a template with
|
|
||||||
pipeline variables, configurable per pipeline.
|
|
||||||
|
|
||||||
### 4.1 Unified Container with Multiple Mounts
|
|
||||||
|
|
||||||
A single container per session scope is created on first use. It has:
|
|
||||||
|
|
||||||
- **Primary mount**: default workspace at `/workspace` (from `default_host_workspace`)
|
|
||||||
- **Skill mounts**: each pipeline-bound skill's `package_root` mounted at
|
|
||||||
`/workspace/.skills/{skill_name}/`
|
|
||||||
- **MCP servers**: run as managed processes inside the same container
|
|
||||||
|
|
||||||
```
|
|
||||||
Container (session_id = "group_123456")
|
|
||||||
/workspace/ ← default workspace (bind mount, rw)
|
|
||||||
/workspace/.skills/web-search/ ← skill package (bind mount, rw)
|
|
||||||
/workspace/.skills/data-analysis/ ← skill package (bind mount, rw)
|
|
||||||
[managed process: mcp-server-a] ← MCP server running inside
|
|
||||||
[managed process: mcp-server-b] ← MCP server running inside
|
|
||||||
```
|
|
||||||
|
|
||||||
This requires extending `BoxSpec` to support multiple mounts (see §5).
|
|
||||||
|
|
||||||
### 4.2 Session ID Template
|
|
||||||
|
|
||||||
A new field `box-session-id-template` in the `local-agent` pipeline runner config
|
|
||||||
controls the session scope:
|
|
||||||
|
|
||||||
```yaml
|
|
||||||
# templates/metadata/pipeline/ai.yaml (under local-agent.config)
|
|
||||||
- name: box-session-id-template
|
|
||||||
label:
|
|
||||||
en_US: Sandbox Scope
|
|
||||||
zh_Hans: 沙箱作用域
|
|
||||||
description:
|
|
||||||
en_US: >-
|
|
||||||
Determines how sandbox environments are shared. Use variables to
|
|
||||||
control isolation granularity.
|
|
||||||
zh_Hans: >-
|
|
||||||
决定沙箱环境的共享方式。使用变量控制隔离粒度。
|
|
||||||
type: select
|
|
||||||
required: false
|
|
||||||
default: "{launcher_type}_{launcher_id}"
|
|
||||||
options:
|
|
||||||
- value: "{launcher_type}_{launcher_id}"
|
|
||||||
label:
|
|
||||||
en_US: Per chat (Recommended)
|
|
||||||
zh_Hans: 每个会话(推荐)
|
|
||||||
- value: "{launcher_type}_{launcher_id}_{sender_id}"
|
|
||||||
label:
|
|
||||||
en_US: Per user in chat
|
|
||||||
zh_Hans: 会话中每个用户
|
|
||||||
- value: "{launcher_type}_{launcher_id}_{conversation_id}"
|
|
||||||
label:
|
|
||||||
en_US: Per conversation context
|
|
||||||
zh_Hans: 每个对话上下文
|
|
||||||
- value: "{query_id}"
|
|
||||||
label:
|
|
||||||
en_US: Per message (isolated)
|
|
||||||
zh_Hans: 每条消息(完全隔离)
|
|
||||||
```
|
|
||||||
|
|
||||||
Available template variables (populated by PreProcessor in `query.variables`):
|
|
||||||
|
|
||||||
| Variable | Source | Example |
|
|
||||||
|---------------------|---------------------------------|----------------------|
|
|
||||||
| `{launcher_type}` | `query.session.launcher_type` | `person` / `group` |
|
|
||||||
| `{launcher_id}` | `query.session.launcher_id` | `123456` |
|
|
||||||
| `{sender_id}` | `query.sender_id` | `789` |
|
|
||||||
| `{conversation_id}` | `conversation.uuid` | `a1b2c3d4-...` |
|
|
||||||
| `{query_id}` | `query.query_id` | `42` |
|
|
||||||
|
|
||||||
Default `{launcher_type}_{launcher_id}` covers scenarios 1–4 out of the box.
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 5. SDK Changes: Multi-Mount BoxSpec
|
|
||||||
|
|
||||||
### 5.1 Model Extension
|
|
||||||
|
|
||||||
```python
|
|
||||||
# box/models.py
|
|
||||||
|
|
||||||
class BoxMountSpec(pydantic.BaseModel):
|
|
||||||
"""A single bind mount specification."""
|
|
||||||
host_path: str
|
|
||||||
mount_path: str
|
|
||||||
mode: BoxHostMountMode = BoxHostMountMode.READ_WRITE
|
|
||||||
|
|
||||||
class BoxSpec(pydantic.BaseModel):
|
|
||||||
# ... existing fields ...
|
|
||||||
host_path: str | None = None # Primary mount (backward compat)
|
|
||||||
host_path_mode: BoxHostMountMode = BoxHostMountMode.READ_WRITE
|
|
||||||
mount_path: str = DEFAULT_BOX_MOUNT_PATH
|
|
||||||
extra_mounts: list[BoxMountSpec] = [] # NEW: additional mounts
|
|
||||||
```
|
|
||||||
|
|
||||||
`extra_mounts` is additive — the existing `host_path` / `mount_path` pair remains
|
|
||||||
the primary mount for backward compatibility.
|
|
||||||
|
|
||||||
### 5.2 Backend: Apply Extra Mounts
|
|
||||||
|
|
||||||
```python
|
|
||||||
# box/backend.py — CLISandboxBackend.start_session()
|
|
||||||
|
|
||||||
# Primary mount (unchanged)
|
|
||||||
if spec.host_path is not None and spec.host_path_mode != BoxHostMountMode.NONE:
|
|
||||||
args.extend(['-v', f'{spec.host_path}:{spec.mount_path}:{spec.host_path_mode.value}'])
|
|
||||||
|
|
||||||
# Extra mounts (NEW)
|
|
||||||
for mount in spec.extra_mounts:
|
|
||||||
if mount.mode != BoxHostMountMode.NONE:
|
|
||||||
args.extend(['-v', f'{mount.host_path}:{mount.mount_path}:{mount.mode.value}'])
|
|
||||||
```
|
|
||||||
|
|
||||||
Same pattern for nsjail backend.
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 6. LangBot Changes
|
|
||||||
|
|
||||||
### 6.1 Session ID Resolution
|
|
||||||
|
|
||||||
In `BoxService.execute_tool()`:
|
|
||||||
|
|
||||||
```python
|
|
||||||
# Before:
|
|
||||||
spec_payload.setdefault('session_id', str(query.query_id))
|
|
||||||
|
|
||||||
# After:
|
|
||||||
template = (query.pipeline_config or {}).get('ai', {}) \
|
|
||||||
.get('local-agent', {}).get('box-session-id-template',
|
|
||||||
'{launcher_type}_{launcher_id}')
|
|
||||||
variables = query.variables or {}
|
|
||||||
session_id = template.format_map(collections.defaultdict(
|
|
||||||
lambda: 'unknown', variables
|
|
||||||
))
|
|
||||||
spec_payload.setdefault('session_id', session_id)
|
|
||||||
```
|
|
||||||
|
|
||||||
### 6.2 Skill Exec: Use Same Container
|
|
||||||
|
|
||||||
Currently `native.py:_invoke_exec` creates a separate `BoxWorkspaceSession` per
|
|
||||||
skill with `host_path=package_root`. Instead:
|
|
||||||
|
|
||||||
1. Use the **same session_id** as default exec (from the template).
|
|
||||||
2. Pass the skill's `package_root` as an **extra mount** at
|
|
||||||
`/workspace/.skills/{skill_name}/` instead of replacing `/workspace`.
|
|
||||||
3. The container already has the default workspace at `/workspace`.
|
|
||||||
|
|
||||||
```python
|
|
||||||
# native.py — _invoke_exec, skill branch (REVISED)
|
|
||||||
|
|
||||||
# Same session_id as default exec
|
|
||||||
session_id = resolve_box_session_id(query)
|
|
||||||
|
|
||||||
spec_payload = {
|
|
||||||
'cmd': rewritten_command,
|
|
||||||
'workdir': rewritten_workdir,
|
|
||||||
'session_id': session_id,
|
|
||||||
'extra_mounts': [{
|
|
||||||
'host_path': package_root,
|
|
||||||
'mount_path': f'/workspace/.skills/{selected_skill_name}',
|
|
||||||
'mode': 'rw',
|
|
||||||
}],
|
|
||||||
}
|
|
||||||
result = await self.ap.box_service.execute_spec_payload(spec_payload, query)
|
|
||||||
```
|
|
||||||
|
|
||||||
The virtual path `/workspace/.skills/{name}` no longer needs rewriting at the
|
|
||||||
command level — it maps directly to the bind mount path inside the container.
|
|
||||||
|
|
||||||
### 6.3 MCP: Use Same Container
|
|
||||||
|
|
||||||
MCP servers should run inside the same container as exec and skills. Changes:
|
|
||||||
|
|
||||||
1. `BoxStdioSessionRuntime` uses the pipeline's session_id template instead of
|
|
||||||
`mcp-{server_uuid}`.
|
|
||||||
2. MCP server's working directory is a subdirectory (e.g. `/workspace/.mcp/{name}/`).
|
|
||||||
3. MCP server's dependencies are mounted or installed into that subdirectory.
|
|
||||||
4. The MCP server runs as a managed process inside the shared container.
|
|
||||||
|
|
||||||
Since MCP servers start at LangBot boot (not per-query), the session must be
|
|
||||||
created eagerly. The container will be kept alive by the managed process
|
|
||||||
exemption in TTL reaping (`runtime.py:259`).
|
|
||||||
|
|
||||||
**Note**: MCP sessions are pipeline-scoped (not per-launcher), so their session_id
|
|
||||||
should be a **fixed identifier per pipeline** rather than the user-facing template.
|
|
||||||
This means one shared MCP container per pipeline, with user exec sessions separate.
|
|
||||||
|
|
||||||
Alternatively, in a future iteration, MCP managed processes could be launched
|
|
||||||
lazily into the user's container on first MCP tool call. This is more complex
|
|
||||||
but maximizes sharing. For V1, keeping MCP containers at pipeline scope is
|
|
||||||
simpler and more predictable.
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 7. Mount Layout Summary
|
|
||||||
|
|
||||||
### Default exec (no skills activated)
|
|
||||||
|
|
||||||
```
|
|
||||||
Container (session_id from template)
|
|
||||||
/workspace/ ← default_host_workspace (rw)
|
|
||||||
```
|
|
||||||
|
|
||||||
### Exec with activated skills
|
|
||||||
|
|
||||||
```
|
|
||||||
Container (same session_id)
|
|
||||||
/workspace/ ← default_host_workspace (rw)
|
|
||||||
/workspace/.skills/web-search/ ← skill package_root (rw)
|
|
||||||
/workspace/.skills/data-analysis/ ← skill package_root (rw)
|
|
||||||
```
|
|
||||||
|
|
||||||
Extra mounts are **additive** — they are added when the container is first
|
|
||||||
created (or on the first exec that references a skill). Since Docker bind
|
|
||||||
mounts are specified at container creation time, skills must be known at
|
|
||||||
creation time.
|
|
||||||
|
|
||||||
**Resolution**: When creating a container, inject `extra_mounts` for **all
|
|
||||||
pipeline-bound skills** (from `extensions_preferences`), not just the
|
|
||||||
currently activated one. This way any skill can be activated later without
|
|
||||||
recreating the container.
|
|
||||||
|
|
||||||
### MCP servers (V1: pipeline-scoped)
|
|
||||||
|
|
||||||
```
|
|
||||||
Container (session_id = "mcp-pipeline-{pipeline_uuid}")
|
|
||||||
/workspace/ ← MCP shared workspace
|
|
||||||
/workspace/.mcp/server-a/ ← MCP server A files
|
|
||||||
/workspace/.mcp/server-b/ ← MCP server B files
|
|
||||||
[managed process: server-a]
|
|
||||||
[managed process: server-b]
|
|
||||||
```
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 8. Data Migration
|
|
||||||
|
|
||||||
Existing pipelines do not have `box-session-id-template`. The backend uses
|
|
||||||
`.get(..., default)` so missing keys fall back to `{launcher_type}_{launcher_id}`.
|
|
||||||
This changes behavior from per-message to per-launcher for existing pipelines.
|
|
||||||
|
|
||||||
Recommendation: **accept the behavior change** — per-launcher is the more
|
|
||||||
intuitive default, and the old per-message behavior was rarely desired.
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 9. Cloud Quota Implications
|
|
||||||
|
|
||||||
| Scope | Typical concurrent containers |
|
|
||||||
|-----------------------------------------------|-------------------------------|
|
|
||||||
| `{query_id}` (per message) | Many, short-lived |
|
|
||||||
| `{launcher_type}_{launcher_id}` (per chat) | = active chat count |
|
|
||||||
| `{sender_id}` (per user) | = active user count |
|
|
||||||
| `{conversation_id}` (per conversation) | Between per-chat and per-msg |
|
|
||||||
|
|
||||||
With the unified container model, each scope value maps to exactly **one**
|
|
||||||
container (instead of potentially 3+ per-message). This significantly reduces
|
|
||||||
resource usage.
|
|
||||||
|
|
||||||
Quota enforcement point: `BoxRuntime._get_or_create_session()` in the SDK.
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 10. Implementation Phases
|
|
||||||
|
|
||||||
### Phase 1: Session scope + skill unification (this PR)
|
|
||||||
|
|
||||||
1. **SDK**: Extend `BoxSpec` with `extra_mounts: list[BoxMountSpec]`.
|
|
||||||
2. **SDK**: Update Docker/nsjail backends to apply extra mounts.
|
|
||||||
3. **LangBot**: Add `box-session-id-template` to `local-agent` YAML metadata
|
|
||||||
and default pipeline config JSON.
|
|
||||||
4. **LangBot**: Update `BoxService.execute_tool()` to use template interpolation.
|
|
||||||
5. **LangBot**: Update `native.py:_invoke_exec` skill branch to use same
|
|
||||||
session_id + extra mounts instead of separate `BoxWorkspaceSession`.
|
|
||||||
6. **LangBot**: On container creation, inject extra mounts for all
|
|
||||||
pipeline-bound skills.
|
|
||||||
7. **Frontend**: No code change — `DynamicFormComponent` renders `select` fields.
|
|
||||||
8. **Tests**: Unit tests for template interpolation and multi-mount specs.
|
|
||||||
|
|
||||||
### Phase 2: MCP unification (future)
|
|
||||||
|
|
||||||
1. Refactor `BoxStdioSessionRuntime` to use pipeline-scoped shared container.
|
|
||||||
2. MCP servers become managed processes in the shared container.
|
|
||||||
3. Support multiple concurrent managed processes per container.
|
|
||||||
|
|
||||||
MCP unification is deferred because it requires changes to the managed process
|
|
||||||
model (currently 1 managed process per session) and has startup ordering
|
|
||||||
concerns (MCP servers start at boot, before any user query determines
|
|
||||||
a session_id).
|
|
||||||
@@ -1,122 +0,0 @@
|
|||||||
# Box 系统测试覆盖分析
|
|
||||||
|
|
||||||
> 更新日期: 2026-06-02
|
|
||||||
> 状态更新: 自部署社区版已具备发布条件(box 可选、降级完善、无迁移欠债);工具调用循环上限、配额遍历异步化、`host_path` 挂载白名单等已落地。剩余多租户 / 安全硬化项见 [SaaS 阻塞项清单](./box-issues.md)。
|
|
||||||
> 分支: `feat/sandbox` (LangBot + langbot-plugin-sdk)
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 1. 测试文件清单
|
|
||||||
|
|
||||||
### LangBot 仓库
|
|
||||||
|
|
||||||
| 文件 | 行数 | CI 运行 | 覆盖范围 |
|
|
||||||
|------|------|---------|---------|
|
|
||||||
| `tests/unit_tests/box/test_box_connector.py` | 106 | 是 | Connector 传输决策、WS relay URL、dispose、心跳/重连 |
|
|
||||||
| `tests/unit_tests/box/test_box_service.py` | 1224 | 是 | Service 核心逻辑(最全面) |
|
|
||||||
| `tests/unit_tests/box/test_workspace.py` | 147 | 是 | WorkspaceSession 路径重写、payload 构建 |
|
|
||||||
| `tests/unit_tests/provider/test_mcp_box_integration.py` | 707 | 是 | MCP Box 配置、路径重写、payload、shared-session/multi-process、runtime info |
|
|
||||||
| `tests/unit_tests/provider/test_localagent_sandbox_exec.py` | 444 | 是 | LocalAgent exec 流程、流式、Skill 激活 (Tool Call) |
|
|
||||||
| `tests/unit_tests/provider/test_tool_manager_native.py` | 249 | 是 | ToolManager 路由、native tool CRUD、路径穿越、6 工具暴露 |
|
|
||||||
| `tests/unit_tests/provider/test_skill_tools.py` | 582 | 是 | Skill 管理、Tool Call 激活、路径、authoring CRUD |
|
|
||||||
| `tests/unit_tests/test_skill_service.py` | 396 | 是 | HTTP service:skill CRUD、zip/GitHub install、文件浏览 |
|
|
||||||
| `tests/unit_tests/test_paths.py` | 23 | 是 | paths 工具 |
|
|
||||||
| `tests/unit_tests/test_preproc.py` | 134 | 是 | PreProcessor 注入 session 变量、bound skill 解析 |
|
|
||||||
| `tests/unit_tests/pipeline/test_chat_handler_logging.py` | 78 | 是 | Chat handler 日志相关回归 |
|
|
||||||
| `tests/integration_tests/box/test_box_integration.py` | 329 | **否** | 真实容器执行、超时、网络隔离 |
|
|
||||||
| `tests/integration_tests/box/test_box_mcp_integration.py` | 368 | **否** | Managed process、WS attach、shared-session 清理 |
|
|
||||||
|
|
||||||
### SDK 仓库
|
|
||||||
|
|
||||||
| 文件 | 行数 | CI 运行 | 覆盖范围 |
|
|
||||||
|------|------|---------|---------|
|
|
||||||
| `tests/box/test_backend_selection.py` | 255 | 是 | 显式 backend / local 模式探测顺序 / 配置变更触发 reselect |
|
|
||||||
| `tests/box/test_nsjail_backend.py` | 452 | 是 | nsjail 可用性、安装版 CLI vs 容器内 CLI、session、arg 构建、资源限制 |
|
|
||||||
| `tests/box/test_e2b_backend.py` | 482 | 是 | E2B SDK mock、session 生命周期、extra_mounts 同步 |
|
|
||||||
| `tests/box/test_skill_store.py` | 88 | 是 | zip preview/install、基础 file CRUD |
|
|
||||||
|
|
||||||
**总计**: 17 个测试文件, ~6,500 行测试代码; 其中 2 个集成测试(约 700 行)在 CI 中不运行。
|
|
||||||
|
|
||||||
> 较 2026-04-16 版增加:`test_skill_service.py`、`test_paths.py`、`test_preproc.py`、`test_chat_handler_logging.py` (LangBot),`test_backend_selection.py`、`test_e2b_backend.py`、`test_skill_store.py` (SDK)。`test_nsjail_backend.py` 增加 CLI 兼容性 case (commit `feed530`)。
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 2. 覆盖良好的区域
|
|
||||||
|
|
||||||
| 区域 | 质量 | 说明 |
|
|
||||||
|------|------|------|
|
|
||||||
| BoxRuntime session 管理 | 优秀 | session 复用、冲突检测、TTL 配置、消失 session 重建 |
|
|
||||||
| BoxService Profile 系统 | 优秀 | 4 个内置 Profile、locked/unlocked 字段、timeout clamp |
|
|
||||||
| BoxService host mount 安全 | 优秀 | allowed_mount_roots、disallowed_roots、shared host root |
|
|
||||||
| BoxService workspace quota | 优秀 | 前置/后置配额检查、超额清理 |
|
|
||||||
| BoxService 输出截断 | 优秀 | 短/精确边界/长输出、独立 stderr |
|
|
||||||
| BoxService 可观测性 | 优秀 | 状态报告、error ring buffer、buffer 上限 |
|
|
||||||
| BoxService session 模板 | 良好 | `resolve_box_session_id` + `build_skill_extra_mounts` 在 service / native / mcp 三处都有覆盖 |
|
|
||||||
| RPC client/server 协议 | 优秀 | execute/get_sessions/delete/create/conflict error |
|
|
||||||
| BoxRuntimeConnector | 良好 | local/remote 模式、Docker 平台、relay URL、心跳与重连回调 |
|
|
||||||
| BoxWorkspaceSession | 良好 | payload 构建、managed process 路径重写、stage host file |
|
|
||||||
| BoxHostMountMode.NONE | 良好 | 枚举校验、workdir 约束 |
|
|
||||||
| NsjailBackend | 良好 | 可用性、安装版 vs 容器内、session 生命周期、arg 构建、资源限制 |
|
|
||||||
| E2BBackend | 良好 | mock SDK、session/extra_mounts 同步 |
|
|
||||||
| Backend selection | 良好 | 显式 backend 优先级、local 探测顺序、配置变更触发 reselect |
|
|
||||||
| MCP Box 集成 | 良好 | config model、路径重写、payload、shared-session 多 process |
|
|
||||||
| Native tool loader | 良好 | 6 工具(exec/read/write/edit/glob/grep)、路径穿越拦截 |
|
|
||||||
| LocalAgent exec 流程 | 良好 | 完整 tool call 循环、流式、system prompt 注入、Tool Call 激活 |
|
|
||||||
| Skill 系统 | 良好 | 加载、Tool Call 激活、marker、路径解析、authoring CRUD、HTTP service |
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 3. 覆盖缺失的区域
|
|
||||||
|
|
||||||
### 3.1 零测试 / 严重不足
|
|
||||||
|
|
||||||
| 区域 | 源文件 | 影响 |
|
|
||||||
|------|--------|------|
|
|
||||||
| **`security.py`** | SDK `box/security.py` (52 行) | `validate_sandbox_security()` 无任何测试。阻止 `/etc`/`/proc`/Docker socket 等危险挂载的安全函数从未被验证 |
|
|
||||||
| **`policy.py`** | `pkg/box/policy.py` (98 行) | 三层安全策略无测试(也是死代码) |
|
|
||||||
| **`skill_store.py` 边缘场景** | SDK `box/skill_store.py` (647 行) vs 测试 88 行 | GitHub 安装路径、`source_subdir` / `target_suffix` 组合、损坏 zip、文件冲突等场景未覆盖 |
|
|
||||||
|
|
||||||
### 3.2 未测试的关键路径
|
|
||||||
|
|
||||||
| 区域 | 说明 |
|
|
||||||
|------|------|
|
|
||||||
| **Session TTL 过期** | 测试配置了 `session_ttl_sec` 但从未推进时间验证过期清理 |
|
|
||||||
| **并发 session 访问** | 无并发 exec / 并发创建 / race condition 测试 |
|
|
||||||
| **Container backend (Docker)** | 仅通过集成测试覆盖(CI 不运行),单元测试全用 FakeBackend |
|
|
||||||
| **E2B 真实 sandbox** | 单测全是 mock,未对接真实 E2B API |
|
|
||||||
| **BoxRuntime shutdown()** | 在 test cleanup 中调用但未验证行为 |
|
|
||||||
| **BoxServerHandler 错误路径** | 畸形请求、未知 action 类型 |
|
|
||||||
| **WS relay** | 仅在集成测试中覆盖(CI 不运行) |
|
|
||||||
| **NsjailBackend managed process** | 完全未测试 |
|
|
||||||
| **MCP stdio 完整生命周期** | 依赖安装 → 进程启动 → 健康检查 → 多 process 并发 → 重试 |
|
|
||||||
| **BoxService start/stop_managed_process** | 单 process 流转有单测,多 process 互不阻塞主要靠集成测试 |
|
|
||||||
| **重连指数退避** | connector 单测覆盖回调接线,未实际跑完整重连周期 |
|
|
||||||
|
|
||||||
### 3.3 边缘情况缺失
|
|
||||||
|
|
||||||
| 区域 | 说明 |
|
|
||||||
|------|------|
|
|
||||||
| BoxSpec 校验 | 无效 session_id 格式、超长命令、env 特殊字符 |
|
|
||||||
| BoxSpec.extra_mounts | 重复 mount_path、与 host_path 冲突、绝对 vs 相对路径 |
|
|
||||||
| BoxExecutionResult | 仅 COMPLETED 和 TIMED_OUT,无 ERROR 状态测试 |
|
|
||||||
| 多后端 fallback | local 模式探测顺序仅靠 mock,无真实 Docker 不可用 → nsjail 真机 fallback 测试 |
|
|
||||||
| Profile YAML 加载 | 测试用硬编码字符串,未从真实 config.yaml 加载 |
|
|
||||||
| INIT 配置变更触发 backend 重建 | 单测仅在初始化场景验证 |
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 4. 集成测试 vs CI 的差距
|
|
||||||
|
|
||||||
CI 仅运行 `tests/unit_tests/`,以下场景**从未在自动化中验证**:
|
|
||||||
|
|
||||||
- 真实容器的创建/执行/销毁
|
|
||||||
- 容器网络隔离(`--network none`)
|
|
||||||
- 容器资源限制生效(cpus/memory/pids_limit)
|
|
||||||
- Managed process 的 WS 双向 I/O
|
|
||||||
- 多 process 同 session 并发 I/O
|
|
||||||
- 孤儿容器清理
|
|
||||||
- Session 删除清理容器
|
|
||||||
- 进程退出检测
|
|
||||||
- E2B 真实 sandbox 行为
|
|
||||||
|
|
||||||
**建议**: 在 CI 中加一个可选的 Docker-in-Docker 集成测试 stage,至少覆盖核心执行路径(exec / MCP attach / session 销毁)。
|
|
||||||
@@ -1,167 +0,0 @@
|
|||||||
# Box 系统 toB 商业化分析
|
|
||||||
|
|
||||||
> 更新日期: 2026-06-02
|
|
||||||
> 状态更新: 自部署社区版已具备发布条件(box 可选、降级完善、无迁移欠债);工具调用循环上限、配额遍历异步化、`host_path` 挂载白名单等已落地。剩余多租户 / 安全硬化项见 [SaaS 阻塞项清单](./box-issues.md)。
|
|
||||||
> 分支: `feat/sandbox` (LangBot + langbot-plugin-sdk)
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 1. 现有优势
|
|
||||||
|
|
||||||
| 能力 | toB 价值 | 代码位置 |
|
|
||||||
|------|---------|---------|
|
|
||||||
| **沙箱隔离执行** | 企业安全运行不受信代码的基础能力 | SDK `box/backend.py` |
|
|
||||||
| **多后端支持** | 适配不同企业容器基础设施 (Podman/Docker/nsjail/E2B) | SDK `box/runtime.py` `_select_backend()` |
|
|
||||||
| **E2B 云沙箱** | SaaS / 无 Docker 部署的兜底执行环境 | SDK `box/e2b_backend.py` |
|
|
||||||
| **连接自愈** | 心跳 + 自动重连,单点 Box runtime 故障可恢复 | `pkg/box/connector.py` `_heartbeat_loop`, `pkg/box/service.py` `_reconnect_loop` |
|
|
||||||
| **Profile + locked 字段** | 运维锁定安全边界,LLM/用户无法绕过 | `pkg/box/service.py`, SDK `box/models.py` |
|
|
||||||
| **资源限制** | CPU/内存/PID 数限制防止资源滥用 | SDK `backend.py` `--cpus/--memory/--pids-limit` |
|
|
||||||
| **Workspace quota** | 磁盘用量控制 | `pkg/box/service.py` `_enforce_workspace_quota` |
|
|
||||||
| **静默降级** | Box 不可用不影响其他功能,降低部署门槛 | `pkg/box/service.py:78` `_available=False` |
|
|
||||||
| **孤儿容器清理** | 防止泄漏的容器持续占用资源 | SDK `backend.py` `cleanup_orphaned_containers` |
|
|
||||||
| **网络隔离** | `--network none` 防止数据外泄 | SDK `backend.py` start_session |
|
|
||||||
| **只读根文件系统** | `--read-only` 防止容器被持久篡改 | SDK `backend.py` start_session |
|
|
||||||
| **Host path 白名单** | `allowed_host_mount_roots` 限制可挂载目录 | `pkg/box/service.py` `_validate_host_mount` |
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 2. toB 差距分析
|
|
||||||
|
|
||||||
### 2.1 安全与合规
|
|
||||||
|
|
||||||
| 维度 | 现状 | toB 要求 | 优先级 |
|
|
||||||
|------|------|---------|--------|
|
|
||||||
| **WS relay 认证** | 无认证,任何人可 attach | 至少 token 认证 | **P0** |
|
|
||||||
| **安全策略** | policy.py 是死代码,实际无细粒度控制 | 工具级 allow/deny、沙箱模式控制 | **P0** |
|
|
||||||
| **审计日志** | 仅内存中 50 条 `_recent_errors` | 持久化审计:谁何时执行了什么、结果如何 | **P0** |
|
|
||||||
| **Host path 校验** | 黑名单策略,`/` 未拦截 | 白名单策略,默认拒绝 | **P1** |
|
|
||||||
| **数据驻留** | 无控制 | GDPR / 等保要求的数据隔离 | **P2** |
|
|
||||||
|
|
||||||
### 2.2 多租户
|
|
||||||
|
|
||||||
| 维度 | 现状 | toB 要求 | 优先级 |
|
|
||||||
|------|------|---------|--------|
|
|
||||||
| **租户隔离** | 无租户概念 | BoxSpec/Profile 绑定 tenant_id | **P0** |
|
|
||||||
| **RBAC** | 仅 token 认证 | admin/operator/viewer 角色权限 | **P0** |
|
|
||||||
| **资源配额** | 单一 workspace quota | 每租户 CPU 时间/内存/并发/执行次数配额 | **P1** |
|
|
||||||
| **Session 隔离** | 所有 session 共享 dict | 按租户分区,互不可见 | **P1** |
|
|
||||||
|
|
||||||
### 2.3 可靠性
|
|
||||||
|
|
||||||
| 维度 | 现状 | toB 要求 | 优先级 |
|
|
||||||
|------|------|---------|--------|
|
|
||||||
| **连接恢复** | 已实现:20s 心跳 + `_reconnect_loop` 指数退避 | 已满足基本要求 | 已有 |
|
|
||||||
| **Session 清理** | 机会性(仅新建时触发) | 定时清理 + 独立 reaper | **P1** |
|
|
||||||
| **水平扩展** | 单 Box Runtime 实例 | 多实例负载均衡(按 tenant 路由) | **P1** |
|
|
||||||
| **优雅降级** | 已有(_available=False) | 已满足基本要求 | 已有 |
|
|
||||||
| **Backend 自愈** | 已实现:`get_status` 时若 backend 不可用会重新选择 | 已满足基本要求 | 已有 |
|
|
||||||
|
|
||||||
### 2.4 可观测性
|
|
||||||
|
|
||||||
| 维度 | 现状 | toB 要求 | 优先级 |
|
|
||||||
|------|------|---------|--------|
|
|
||||||
| **监控指标** | 无 Prometheus metrics | session 数/执行延迟/资源用量/错误率 | **P1** |
|
|
||||||
| **结构化日志** | Python logging, 无结构化 | JSON 格式日志,含 trace_id/tenant_id | **P1** |
|
|
||||||
| **前端面板** | 监控页接入 `/api/v1/box/status`(backend 名 + 活跃 session 数);`sessions` / `errors` 仍未接入 | 完整状态面板 + 历史错误/审计列表 | **P2** |
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 3. SaaS 部署架构建议
|
|
||||||
|
|
||||||
### 3.1 方案 A: 共享 Box Runtime Pool (快速上线)
|
|
||||||
|
|
||||||
```
|
|
||||||
LangBot Instance ──> Box Runtime (共享)
|
|
||||||
├─ tenant_id 标签隔离
|
|
||||||
├─ Redis 配额计数器
|
|
||||||
└─ Container labels: langbot.tenant_id=xxx
|
|
||||||
```
|
|
||||||
|
|
||||||
- **优点**: 改动最小,加 tenant_id 到 BoxSpec/labels 即可
|
|
||||||
- **缺点**: 容器引擎共享,安全隔离弱
|
|
||||||
|
|
||||||
### 3.2 方案 B: 每租户 K8s Namespace + gVisor (推荐中期)
|
|
||||||
|
|
||||||
```
|
|
||||||
LangBot ──> K8s API
|
|
||||||
├─ namespace: tenant-xxx
|
|
||||||
│ ├─ RuntimeClass: gVisor (runsc)
|
|
||||||
│ ├─ ResourceQuota
|
|
||||||
│ └─ NetworkPolicy
|
|
||||||
└─ namespace: tenant-yyy
|
|
||||||
└─ ...
|
|
||||||
```
|
|
||||||
|
|
||||||
- **优点**: 强隔离(namespace + gVisor),原生 K8s 配额
|
|
||||||
- **缺点**: 需要重写 backend 为 K8s Job,部署复杂度高
|
|
||||||
|
|
||||||
### 3.3 方案 C: K8s Job 直接编排 (长期)
|
|
||||||
|
|
||||||
```
|
|
||||||
LangBot ──> K8s Job per execution
|
|
||||||
├─ 每次执行创建 Job
|
|
||||||
├─ Pod Security Standards
|
|
||||||
├─ 自动调度和资源分配
|
|
||||||
└─ Job TTL Controller 自动清理
|
|
||||||
```
|
|
||||||
|
|
||||||
- **优点**: 最强隔离,天然水平扩展
|
|
||||||
- **缺点**: 冷启动延迟,架构重写
|
|
||||||
|
|
||||||
**推荐演进路径**: A → B → C
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 4. 配额体系建议
|
|
||||||
|
|
||||||
### 三层配额
|
|
||||||
|
|
||||||
| 层 | 实现 | 作用 |
|
|
||||||
|----|------|------|
|
|
||||||
| **内核层** | Docker `--cpus`/`--memory`/`--storage-opt` | 硬性资源上限,不可绕过 |
|
|
||||||
| **应用层** | Redis 原子计数器 | 并发 session 数/执行次数/CPU 时间预算 |
|
|
||||||
| **计费层** | 月度聚合 | 按租户计费(session-hours/execution-count) |
|
|
||||||
|
|
||||||
### Profile 与套餐映射
|
|
||||||
|
|
||||||
| 套餐 | Profile | locked 字段 | 配额 |
|
|
||||||
|------|---------|------------|------|
|
|
||||||
| Free | `offline_readonly` | network, host_path_mode, rootfs | 10 exec/天, 0.5 CPU, 256MB |
|
|
||||||
| Pro | `default` | (无) | 100 exec/天, 1 CPU, 512MB |
|
|
||||||
| Enterprise | `network_extended` | (按需) | 无限, 2 CPU, 1GB, 自定义镜像 |
|
|
||||||
|
|
||||||
### TOCTOU 配额修复
|
|
||||||
|
|
||||||
当前 `_enforce_workspace_quota` 的 TOCTOU 问题可通过两种方式解决:
|
|
||||||
|
|
||||||
1. **预留式配额** (应用层): Redis `INCRBY` 预扣额度 → 执行 → 成功则扣减,失败则回滚
|
|
||||||
2. **内核级限制** (Docker): `--storage-opt size=500m` 直接限制容器可写层大小
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 5. 优先实施路线
|
|
||||||
|
|
||||||
### Phase 1 (2-4 周): 安全基线
|
|
||||||
|
|
||||||
- [ ] WS relay 加 token 认证
|
|
||||||
- [ ] 接入或删除 policy.py
|
|
||||||
- [x] ~~Box 加重连和心跳~~(已完成,见 [box-issues.md 已解决](./box-issues.md))
|
|
||||||
- [ ] 审计日志持久化(至少写文件/数据库)
|
|
||||||
- [ ] `security.py` 加 `/` 拦截,考虑白名单
|
|
||||||
- [ ] INIT 与 backend 初始化顺序整理(避免 backend 在配置到达前实例化)
|
|
||||||
|
|
||||||
### Phase 2 (4-8 周): 多租户基础
|
|
||||||
|
|
||||||
- [ ] BoxSpec 加 `tenant_id` 字段
|
|
||||||
- [ ] 容器 labels 加 tenant 标识
|
|
||||||
- [ ] Redis 配额计数器(并发/执行次数/时间)
|
|
||||||
- [ ] RBAC 基础框架
|
|
||||||
- [ ] 定时 session reaper
|
|
||||||
|
|
||||||
### Phase 3 (8-16 周): 生产就绪
|
|
||||||
|
|
||||||
- [ ] Prometheus metrics exporter
|
|
||||||
- [ ] 前端 Box 状态面板
|
|
||||||
- [ ] K8s backend 支持 (方案 B)
|
|
||||||
- [ ] 结构化日志 (JSON, trace_id)
|
|
||||||
- [ ] 水平扩展支持
|
|
||||||
@@ -1,222 +0,0 @@
|
|||||||
# Box Runtime vs Plugin Runtime: 连接架构对比
|
|
||||||
|
|
||||||
> 更新日期: 2026-06-02
|
|
||||||
> 状态更新: 自部署社区版已具备发布条件(box 可选、降级完善、无迁移欠债);工具调用循环上限、配额遍历异步化、`host_path` 挂载白名单等已落地。剩余多租户 / 安全硬化项见 [SaaS 阻塞项清单](./box-issues.md)。
|
|
||||||
> 分支: `feat/sandbox` (LangBot + langbot-plugin-sdk)
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 1. 总体差异
|
|
||||||
|
|
||||||
| 维度 | Plugin Runtime | Box Runtime |
|
|
||||||
|------|---------------|-------------|
|
|
||||||
| **继承关系** | `PluginRuntimeConnector(ManagedRuntimeConnector)` | `BoxRuntimeConnector`(独立类) |
|
|
||||||
| **传输分支** | 3 条 (Docker/WS, Win32/subprocess+WS, Unix/stdio) | 3 条 (本地 stdio, Win32/subprocess+WS, 远程 WS) |
|
|
||||||
| **心跳** | 20s ping loop | 20s ping loop(`_heartbeat_loop`) |
|
|
||||||
| **重连** | WS 模式: sleep 3s → re-initialize | 由 BoxService `_reconnect_loop` 处理,指数退避 |
|
|
||||||
| **Handler 类型** | `RuntimeConnectionHandler` (1132 行, 25+ action) | 基础 `Handler` + `BoxServerHandler`(SDK 端 25 action) |
|
|
||||||
| **Client 抽象** | Handler 即 API | 独立 `ActionRPCBoxClient` 封装 Handler |
|
|
||||||
| **启用/禁用** | `is_enable_plugin` 开关 | 无开关(可用/不可用由初始化结果决定) |
|
|
||||||
| **初始化失败** | 异常上抛 | 静默降级 `_available=False` |
|
|
||||||
| **Shutdown** | 直接杀进程 | RPC SHUTDOWN → 清理容器 → 再杀进程 |
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 2. 传输决策
|
|
||||||
|
|
||||||
### Plugin: 3-路决策
|
|
||||||
|
|
||||||
```python
|
|
||||||
# pkg/plugin/connector.py:106-165
|
|
||||||
if get_platform() == 'docker' or use_websocket_to_connect_plugin_runtime():
|
|
||||||
# Docker/WS → ws://langbot_plugin_runtime:5400/control/ws
|
|
||||||
elif get_platform() == 'win32':
|
|
||||||
# Windows → 起子进程(无 pipe) + ws://localhost:5400/control/ws
|
|
||||||
else:
|
|
||||||
# Unix/Mac → StdioClientController(python -m langbot_plugin.cli rt -s)
|
|
||||||
```
|
|
||||||
|
|
||||||
### Box: 3-路决策
|
|
||||||
|
|
||||||
```python
|
|
||||||
# pkg/box/connector.py
|
|
||||||
if self._uses_websocket():
|
|
||||||
if platform.get_platform() == 'win32' and not self.configured_runtime_url:
|
|
||||||
await self._start_subprocess_then_ws() # subprocess + ws://localhost:5410/rpc/ws
|
|
||||||
else:
|
|
||||||
await self._connect_remote_ws() # ws://{host}:5410/rpc/ws
|
|
||||||
else:
|
|
||||||
await self._start_local_stdio() # StdioClientController
|
|
||||||
```
|
|
||||||
|
|
||||||
> 历史:2026-04-16 版本本文档曾把 Box 描述为 2 路决策(缺 Windows 分支)。现已对齐 Plugin 的 3 路设计。
|
|
||||||
|
|
||||||
### 决策矩阵
|
|
||||||
|
|
||||||
| 环境 | Plugin | Box |
|
|
||||||
|------|--------|-----|
|
|
||||||
| Docker | WS → `:5400` | WS → `:5410/rpc/ws` |
|
|
||||||
| `--standalone-box` | N/A | WS → `localhost:5410/rpc/ws` |
|
|
||||||
| Windows 非 Docker | subprocess + WS (`:5400`) | subprocess + WS (`localhost:5410/rpc/ws`) |
|
|
||||||
| Unix/Mac 非 Docker | stdio | stdio |
|
|
||||||
| 手动配置 URL | 通过配置项 | WS → 用户配置的 URL |
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 3. 连接建立
|
|
||||||
|
|
||||||
### 同步模式差异
|
|
||||||
|
|
||||||
**Plugin**: `new_connection_callback` 内直接 ping + await handler_task,`initialize()` 通过 `create_task()` 异步启动,不阻塞等待连接。
|
|
||||||
|
|
||||||
**Box**: 使用 `asyncio.Event` + `wait_for(timeout=30s)` 模式,`initialize()` 同步等待连接成功或超时。
|
|
||||||
|
|
||||||
### Box stdio 路径
|
|
||||||
|
|
||||||
```
|
|
||||||
connector._start_local_stdio()
|
|
||||||
├─ connected = asyncio.Event()
|
|
||||||
├─ ctrl = StdioClientController(python, ['-m', 'langbot_plugin.cli.__init__', 'box', '-s', '--ws-control-port', N])
|
|
||||||
├─ _ctrl_task = create_task(ctrl.run(callback))
|
|
||||||
│ callback:
|
|
||||||
│ handler = Handler(connection) ← 基础 Handler, 无 disconnect_callback
|
|
||||||
│ client.set_handler(handler)
|
|
||||||
│ _handler_task = create_task(handler.run())
|
|
||||||
│ call_action(PING, {}) ← 握手, timeout=15s
|
|
||||||
│ connected.set() ← 通知外层
|
|
||||||
│ await _handler_task ← 阻塞直到断开
|
|
||||||
└─ await wait_for(connected.wait(), 30s) ← 同步等待
|
|
||||||
```
|
|
||||||
|
|
||||||
### Plugin stdio 路径
|
|
||||||
|
|
||||||
```
|
|
||||||
connector.initialize()
|
|
||||||
├─ ctrl = StdioClientController(python, ['-m', 'langbot_plugin.cli', 'rt', '-s'])
|
|
||||||
├─ task = ctrl.run(callback)
|
|
||||||
│ callback:
|
|
||||||
│ disconnect_callback:
|
|
||||||
│ [WS] → runtime_disconnect_callback → 重连
|
|
||||||
│ [stdio] → 仅日志, 不重连
|
|
||||||
│ handler = RuntimeConnectionHandler(conn, disconnect_cb, ap)
|
|
||||||
│ create_task(handler.run())
|
|
||||||
│ handler.ping() ← 握手, timeout=10s
|
|
||||||
│ await handler_task ← 阻塞直到断开
|
|
||||||
├─ create_task(heartbeat_loop()) ← 20s ping loop
|
|
||||||
└─ create_task(task) ← 不等待连接
|
|
||||||
```
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 4. 心跳与重连
|
|
||||||
|
|
||||||
### 心跳
|
|
||||||
|
|
||||||
| 维度 | Plugin | Box |
|
|
||||||
|------|--------|-----|
|
|
||||||
| 有心跳? | 是 | 是(`connector.py` `_heartbeat_loop`) |
|
|
||||||
| 间隔 | 20s | 20s |
|
|
||||||
| 失败处理 | 仅 DEBUG 日志,不触发重连 | 仅 DEBUG 日志,依赖 connection close 触发重连 |
|
|
||||||
| 生命周期 | 整个应用生命周期 | 连接建立后启动;`dispose()` 时 cancel |
|
|
||||||
|
|
||||||
### 重连
|
|
||||||
|
|
||||||
| 维度 | Plugin | Box |
|
|
||||||
|------|--------|-----|
|
|
||||||
| Docker/WS 断开 | `runtime_disconnect_callback` → sleep 3s → re-initialize | `runtime_disconnect_callback` → `BoxService._reconnect_loop()`(指数退避) |
|
|
||||||
| WS 连接失败 | 同上 | 同上;初次失败时 `_available=False`,重连成功后恢复 |
|
|
||||||
| stdio 断开 | 仅日志,不重连 | 接同样回调;stdio 重连需重新 fork 子进程 |
|
|
||||||
| 重连退避 | 固定 3s,无 backoff | 指数退避 |
|
|
||||||
|
|
||||||
> 历史:2026-04-16 版本本文档曾把心跳与重连标记为 Box 缺失。这两项已在 commit `2dfd9d5d` / `c6882cf` / `5029d9c` 等修复(详见 [box-issues.md 已解决](./box-issues.md))。
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 5. 共享 IO 层
|
|
||||||
|
|
||||||
两者复用同一套 SDK IO 基础设施:
|
|
||||||
|
|
||||||
```
|
|
||||||
Handler ← ABC (runtime/io/handler.py)
|
|
||||||
├── RuntimeConnectionHandler (Plugin 用, LangBot 侧)
|
|
||||||
├── ControlConnectionHandler (Plugin 用, SDK 侧)
|
|
||||||
├── BoxServerHandler (Box 用, SDK 侧)
|
|
||||||
└── 匿名 Handler 实例 (Box 用, LangBot 侧)
|
|
||||||
|
|
||||||
Connection ← ABC
|
|
||||||
├── StdioConnection (stdio: 16KB chunks, 应用层分帧协议)
|
|
||||||
└── WebSocketConnection (WS: 64KB chunks, 原生 WS 分帧)
|
|
||||||
|
|
||||||
Controller ← ABC
|
|
||||||
├── StdioClientController (fork 子进程, pipe stdin/stdout)
|
|
||||||
├── StdioServerController (接管当前进程 stdin/stdout)
|
|
||||||
├── WebSocketClientController (连接 WS 服务端)
|
|
||||||
└── WebSocketServerController (监听 WS 端口)
|
|
||||||
```
|
|
||||||
|
|
||||||
共享的核心机制:
|
|
||||||
- `call_action()` / `call_action_generator()` — RPC 调用/流式调用
|
|
||||||
- `ActionRequest` / `ActionResponse` — 请求/响应协议
|
|
||||||
- `seq_id` 关联 — 并发请求复用单连接
|
|
||||||
- `CommonAction.PING` — 两者都用于初始握手
|
|
||||||
- 文件传输 (`send_file`) — Plugin 用,Box 不用
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 6. 端口方案
|
|
||||||
|
|
||||||
| 服务 | Plugin | Box |
|
|
||||||
|------|--------|-----|
|
|
||||||
| Action RPC (stdio) | stdin/stdout | stdin/stdout |
|
|
||||||
| Action RPC (WS) | `:5400` | `:5410/rpc/ws` |
|
|
||||||
| 辅助服务 | debug WS `:5401` | managed process WS relay `:5410/v1/sessions/{id}/managed-process/ws` |
|
|
||||||
|
|
||||||
**Box 特点**: 单端口 aiohttp 服务(默认 5410),通过路径区分 Action RPC 和 managed process relay。即使在 stdio 模式,也在 `:5410` 启动 aiohttp 用于 managed process attach。Plugin 在 stdio 模式不开额外端口。
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 7. 销毁对比
|
|
||||||
|
|
||||||
### Plugin
|
|
||||||
|
|
||||||
```python
|
|
||||||
dispose():
|
|
||||||
if stdio: ctrl.process.terminate()
|
|
||||||
_dispose_subprocess() # Windows 子进程
|
|
||||||
heartbeat_task.cancel()
|
|
||||||
```
|
|
||||||
|
|
||||||
### Box
|
|
||||||
|
|
||||||
```python
|
|
||||||
connector.dispose():
|
|
||||||
_handler_task.cancel()
|
|
||||||
_ctrl_task.cancel()
|
|
||||||
_subprocess.terminate()
|
|
||||||
|
|
||||||
service.dispose():
|
|
||||||
connector.dispose()
|
|
||||||
loop.create_task(client.shutdown()) # RPC SHUTDOWN → 清理所有容器
|
|
||||||
```
|
|
||||||
|
|
||||||
Box 的 RPC SHUTDOWN 确保容器被正确停止,不会成为孤儿。Plugin 直接杀进程。
|
|
||||||
|
|
||||||
---
|
|
||||||
|
|
||||||
## 8. 改进建议
|
|
||||||
|
|
||||||
### P0
|
|
||||||
|
|
||||||
1. **两者都加 WS 认证**: 至少 token 认证(INIT 时下发,连接时校验)
|
|
||||||
|
|
||||||
### P1
|
|
||||||
|
|
||||||
2. **考虑 Box 继承 ManagedRuntimeConnector**: 复用 `_start_runtime_subprocess` / `_wait_until_ready` / `_dispose_subprocess`,减少重复代码
|
|
||||||
3. **Plugin 重连加退避**: 固定 3s 无 backoff 可能造成日志洪水,建议向 Box 的指数退避看齐
|
|
||||||
4. **统一连接管理模式**: Event-based (Box) vs direct-await (Plugin),考虑收敛为一种
|
|
||||||
|
|
||||||
### 已完成(自上一轮)
|
|
||||||
|
|
||||||
- ~~Box 加重连~~(commit `2dfd9d5d`)
|
|
||||||
- ~~Box 加心跳~~(20s loop 与 Plugin 一致)
|
|
||||||
- ~~Box 加 Windows 支持~~(commit `120817a` / `fafb7a4`)
|
|
||||||
@@ -1,6 +1,6 @@
|
|||||||
[project]
|
[project]
|
||||||
name = "langbot"
|
name = "langbot"
|
||||||
version = "4.10.1"
|
version = "4.9.5"
|
||||||
description = "Production-grade platform for building agentic IM bots"
|
description = "Production-grade platform for building agentic IM bots"
|
||||||
readme = "README.md"
|
readme = "README.md"
|
||||||
license-files = ["LICENSE"]
|
license-files = ["LICENSE"]
|
||||||
@@ -8,7 +8,7 @@ requires-python = ">=3.11,<4.0"
|
|||||||
dependencies = [
|
dependencies = [
|
||||||
"aiocqhttp>=1.4.4",
|
"aiocqhttp>=1.4.4",
|
||||||
"aiofiles>=24.1.0",
|
"aiofiles>=24.1.0",
|
||||||
"aiohttp>=3.14.0",
|
"aiohttp>=3.11.18",
|
||||||
"aioshutil>=1.5",
|
"aioshutil>=1.5",
|
||||||
"aiosqlite>=0.21.0",
|
"aiosqlite>=0.21.0",
|
||||||
"anthropic>=0.51.0",
|
"anthropic>=0.51.0",
|
||||||
@@ -16,42 +16,40 @@ dependencies = [
|
|||||||
"async-lru>=2.0.5",
|
"async-lru>=2.0.5",
|
||||||
"certifi>=2025.4.26",
|
"certifi>=2025.4.26",
|
||||||
"colorlog~=6.6.0",
|
"colorlog~=6.6.0",
|
||||||
"cryptography>=46.0.7",
|
"cryptography>=44.0.3",
|
||||||
"dashscope>=1.25.10",
|
"dashscope>=1.25.10",
|
||||||
"dingtalk-stream>=0.24.0",
|
"dingtalk-stream>=0.24.0",
|
||||||
"discord-py>=2.5.2",
|
"discord-py>=2.5.2",
|
||||||
"pynacl>=1.5.0", # Required for Discord voice support
|
"pynacl>=1.5.0", # Required for Discord voice support
|
||||||
"gewechat-client>=0.1.5",
|
"gewechat-client>=0.1.5",
|
||||||
"lark-oapi>=1.5.5",
|
"lark-oapi>=1.4.15",
|
||||||
"mcp>=1.25.0",
|
"mcp>=1.25.0",
|
||||||
"nakuru-project-idk>=0.0.2.1",
|
"nakuru-project-idk>=0.0.2.1",
|
||||||
"ollama>=0.4.8",
|
"ollama>=0.4.8",
|
||||||
"openai>1.0.0",
|
"openai>1.0.0",
|
||||||
"pillow>=12.2.0",
|
"pillow>=11.2.1",
|
||||||
"psutil>=7.0.0",
|
"psutil>=7.0.0",
|
||||||
"pycryptodome>=3.22.0",
|
"pycryptodome>=3.22.0",
|
||||||
"pydantic>2.0",
|
"pydantic>2.0",
|
||||||
"pyjwt>=2.12.0",
|
"pyjwt>=2.10.1",
|
||||||
"python-telegram-bot>=22.0",
|
"python-telegram-bot>=22.0",
|
||||||
"pyyaml>=6.0.2",
|
"pyyaml>=6.0.2",
|
||||||
"qq-botpy-rc>=1.2.1.6",
|
"qq-botpy-rc>=1.2.1.6",
|
||||||
"qrcode>=7.4",
|
|
||||||
"quart>=0.20.0",
|
"quart>=0.20.0",
|
||||||
"quart-cors>=0.8.0",
|
"quart-cors>=0.8.0",
|
||||||
"requests>=2.33.0",
|
"requests>=2.32.3",
|
||||||
"slack-sdk>=3.35.0",
|
"slack-sdk>=3.35.0",
|
||||||
"alembic>=1.15.0",
|
|
||||||
"sqlalchemy[asyncio]>=2.0.40",
|
"sqlalchemy[asyncio]>=2.0.40",
|
||||||
"sqlmodel>=0.0.24",
|
"sqlmodel>=0.0.24",
|
||||||
"telegramify-markdown>=0.5.1",
|
"telegramify-markdown>=0.5.1",
|
||||||
"tiktoken>=0.9.0",
|
"tiktoken>=0.9.0",
|
||||||
"urllib3>=2.7.0",
|
"urllib3>=2.4.0",
|
||||||
"websockets>=15.0.1",
|
"websockets>=15.0.1",
|
||||||
"python-socks>=2.7.1", # dingtalk missing dependency
|
"python-socks>=2.7.1", # dingtalk missing dependency
|
||||||
"pip>=26.1",
|
"pip>=25.1.1",
|
||||||
"ruff>=0.11.9",
|
"ruff>=0.11.9",
|
||||||
"pre-commit>=4.2.0",
|
"pre-commit>=4.2.0",
|
||||||
"uv>=0.11.15",
|
"uv>=0.7.11",
|
||||||
"mypy>=1.16.0",
|
"mypy>=1.16.0",
|
||||||
"PyPDF2>=3.0.1",
|
"PyPDF2>=3.0.1",
|
||||||
"python-docx>=1.1.0",
|
"python-docx>=1.1.0",
|
||||||
@@ -62,18 +60,13 @@ dependencies = [
|
|||||||
"ebooklib>=0.18",
|
"ebooklib>=0.18",
|
||||||
"html2text>=2024.2.26",
|
"html2text>=2024.2.26",
|
||||||
"langchain>=0.2.0",
|
"langchain>=0.2.0",
|
||||||
"langchain-core>=1.3.3",
|
"langchain-text-splitters>=0.0.1",
|
||||||
"langsmith>=0.8.0",
|
|
||||||
"python-multipart>=0.0.27",
|
|
||||||
"Mako>=1.3.12",
|
|
||||||
"langchain-text-splitters>=1.1.2",
|
|
||||||
"chromadb>=1.0.0,<2.0.0",
|
"chromadb>=1.0.0,<2.0.0",
|
||||||
"qdrant-client (>=1.15.1,<2.0.0)",
|
"qdrant-client (>=1.15.1,<2.0.0)",
|
||||||
"pyseekdb==1.1.0.post3",
|
"pyseekdb==1.1.0.post3",
|
||||||
"langbot-plugin==0.5.0a2",
|
"langbot-plugin==0.3.7",
|
||||||
"asyncpg>=0.30.0",
|
"asyncpg>=0.30.0",
|
||||||
"line-bot-sdk>=3.19.0",
|
"line-bot-sdk>=3.19.0",
|
||||||
"matrix-nio>=0.25.2",
|
|
||||||
"tboxsdk>=0.0.10",
|
"tboxsdk>=0.0.10",
|
||||||
"boto3>=1.35.0",
|
"boto3>=1.35.0",
|
||||||
"pymilvus>=2.6.4",
|
"pymilvus>=2.6.4",
|
||||||
@@ -118,13 +111,12 @@ requires = ["setuptools>=61.0", "wheel"]
|
|||||||
build-backend = "setuptools.build_meta"
|
build-backend = "setuptools.build_meta"
|
||||||
|
|
||||||
[tool.setuptools]
|
[tool.setuptools]
|
||||||
package-data = { "langbot" = ["templates/**", "pkg/provider/modelmgr/requesters/*", "pkg/platform/sources/*", "pkg/platform/adapters/**", "web/dist/**", "pkg/persistence/alembic/**"] }
|
package-data = { "langbot" = ["templates/**", "pkg/provider/modelmgr/requesters/*", "pkg/platform/sources/*", "web/dist/**"] }
|
||||||
|
|
||||||
[dependency-groups]
|
[dependency-groups]
|
||||||
dev = [
|
dev = [
|
||||||
"moto>=5.2.1",
|
|
||||||
"pre-commit>=4.2.0",
|
"pre-commit>=4.2.0",
|
||||||
"pytest>=9.0.3",
|
"pytest>=8.4.1",
|
||||||
"pytest-asyncio>=1.0.0",
|
"pytest-asyncio>=1.0.0",
|
||||||
"pytest-cov>=7.0.0",
|
"pytest-cov>=7.0.0",
|
||||||
"ruff>=0.11.9",
|
"ruff>=0.11.9",
|
||||||
@@ -223,3 +215,4 @@ skip-magic-trailing-comma = false
|
|||||||
|
|
||||||
# Like Black, automatically detect the appropriate line ending.
|
# Like Black, automatically detect the appropriate line ending.
|
||||||
line-ending = "auto"
|
line-ending = "auto"
|
||||||
|
|
||||||
|
|||||||
@@ -4,9 +4,6 @@ python_files = test_*.py
|
|||||||
python_classes = Test*
|
python_classes = Test*
|
||||||
python_functions = test_*
|
python_functions = test_*
|
||||||
|
|
||||||
# Python path for imports
|
|
||||||
pythonpath = . tests
|
|
||||||
|
|
||||||
# Test paths
|
# Test paths
|
||||||
testpaths = tests
|
testpaths = tests
|
||||||
|
|
||||||
@@ -25,9 +22,7 @@ markers =
|
|||||||
asyncio: mark test as async
|
asyncio: mark test as async
|
||||||
unit: mark test as unit test
|
unit: mark test as unit test
|
||||||
integration: mark test as integration test
|
integration: mark test as integration test
|
||||||
smoke: mark test as smoke test
|
|
||||||
slow: mark test as slow running
|
slow: mark test as slow running
|
||||||
e2e: mark test as end-to-end test (requires real LangBot process)
|
|
||||||
|
|
||||||
# Coverage options (when using pytest-cov)
|
# Coverage options (when using pytest-cov)
|
||||||
[coverage:run]
|
[coverage:run]
|
||||||
|
|||||||
@@ -1,65 +0,0 @@
|
|||||||
#!/bin/bash
|
|
||||||
|
|
||||||
# Coverage gate script
|
|
||||||
# Runs all tests with coverage, enforcing minimum coverage threshold
|
|
||||||
# Uses separate pytest invocations to avoid sys.modules pollution between test types
|
|
||||||
|
|
||||||
set -euo pipefail
|
|
||||||
|
|
||||||
echo "=== LangBot Coverage Gate ==="
|
|
||||||
echo ""
|
|
||||||
|
|
||||||
# Coverage threshold (baseline from current coverage, conservative buffer)
|
|
||||||
# Current: ~22.14%, threshold: 18%
|
|
||||||
COVERAGE_THRESHOLD=18
|
|
||||||
|
|
||||||
# Create temporary directory for coverage files
|
|
||||||
COV_DIR=$(mktemp -d)
|
|
||||||
trap "rm -rf $COV_DIR" EXIT
|
|
||||||
|
|
||||||
echo "[1/3] Running unit + smoke tests with coverage..."
|
|
||||||
uv run pytest tests/unit_tests/ tests/smoke/ \
|
|
||||||
--cov=langbot \
|
|
||||||
--cov-report=json:$COV_DIR/unit.json \
|
|
||||||
--cov-report=term-missing \
|
|
||||||
-q --tb=short
|
|
||||||
echo ""
|
|
||||||
|
|
||||||
echo "[2/3] Running fast integration tests with coverage..."
|
|
||||||
uv run pytest tests/integration/ -m "not slow" \
|
|
||||||
--cov=langbot \
|
|
||||||
--cov-report=json:$COV_DIR/integration.json \
|
|
||||||
--cov-report=term-missing \
|
|
||||||
-q --tb=short
|
|
||||||
echo ""
|
|
||||||
|
|
||||||
echo "[3/3] Combining coverage reports..."
|
|
||||||
# Use coverage combine if available, otherwise just report total
|
|
||||||
if command -v coverage &> /dev/null; then
|
|
||||||
# Combine JSON reports
|
|
||||||
coverage combine --keep $COV_DIR/unit.json $COV_DIR/integration.json \
|
|
||||||
--data-file=$COV_DIR/combined.data 2>/dev/null || true
|
|
||||||
|
|
||||||
coverage report --data-file=$COV_DIR/combined.data || true
|
|
||||||
else
|
|
||||||
echo "Note: coverage combine not available, showing individual reports above"
|
|
||||||
fi
|
|
||||||
|
|
||||||
# Generate final XML report for CI (from last run)
|
|
||||||
uv run pytest tests/unit_tests/ tests/smoke/ \
|
|
||||||
--cov=langbot \
|
|
||||||
--cov-report=xml:coverage.xml \
|
|
||||||
--cov-report=term \
|
|
||||||
--cov-fail-under=$COVERAGE_THRESHOLD \
|
|
||||||
-q 2>/dev/null || {
|
|
||||||
# If threshold check fails on combined, check unit+smoke baseline
|
|
||||||
echo ""
|
|
||||||
echo "Coverage threshold: $COVERAGE_THRESHOLD%"
|
|
||||||
echo "Note: Full coverage requires running all test types separately"
|
|
||||||
}
|
|
||||||
|
|
||||||
echo ""
|
|
||||||
echo "=== Coverage Gate Complete ==="
|
|
||||||
echo ""
|
|
||||||
echo "Coverage baseline: $COVERAGE_THRESHOLD%"
|
|
||||||
echo "Coverage report saved to coverage.xml"
|
|
||||||
@@ -1,16 +0,0 @@
|
|||||||
#!/bin/bash
|
|
||||||
|
|
||||||
# Fast integration tests
|
|
||||||
# Runs integration tests excluding slow ones (PostgreSQL, external services)
|
|
||||||
# Uses fake runner/provider, no real credentials needed
|
|
||||||
|
|
||||||
set -euo pipefail
|
|
||||||
|
|
||||||
echo "=== LangBot Fast Integration Tests ==="
|
|
||||||
echo ""
|
|
||||||
|
|
||||||
echo "Running integration tests (excluding slow)..."
|
|
||||||
uv run pytest tests/integration/ -m "not slow" -q --tb=short
|
|
||||||
|
|
||||||
echo ""
|
|
||||||
echo "=== Fast Integration Tests Complete ==="
|
|
||||||
@@ -1,36 +0,0 @@
|
|||||||
#!/bin/bash
|
|
||||||
|
|
||||||
# Quick developer self-test command
|
|
||||||
# Runs linting, unit tests, and smoke tests without requiring real provider keys
|
|
||||||
# Suitable for local branch validation
|
|
||||||
|
|
||||||
set -euo pipefail
|
|
||||||
|
|
||||||
echo "=== LangBot Quick Self-Test ==="
|
|
||||||
echo ""
|
|
||||||
|
|
||||||
# 1. Ruff check
|
|
||||||
echo "[1/3] Running ruff check..."
|
|
||||||
uv run ruff check src/langbot/ tests/ --output-format=concise || {
|
|
||||||
echo ""
|
|
||||||
echo "⚠ Ruff check found issues. Run 'uv run ruff check --fix' to auto-fix."
|
|
||||||
exit 1
|
|
||||||
}
|
|
||||||
echo "✓ Ruff check passed"
|
|
||||||
echo ""
|
|
||||||
|
|
||||||
# 2. Unit tests
|
|
||||||
echo "[2/3] Running unit tests..."
|
|
||||||
uv run pytest tests/unit_tests/ -q --tb=short
|
|
||||||
echo ""
|
|
||||||
|
|
||||||
# 3. Smoke tests (if exists)
|
|
||||||
echo "[3/3] Running smoke tests..."
|
|
||||||
if [ -d "tests/smoke" ]; then
|
|
||||||
uv run pytest tests/smoke/ -q --tb=short
|
|
||||||
else
|
|
||||||
echo "No smoke tests found, skipping"
|
|
||||||
fi
|
|
||||||
echo ""
|
|
||||||
|
|
||||||
echo "=== Quick Self-Test Complete ==="
|
|
||||||
@@ -1,3 +1,3 @@
|
|||||||
"""LangBot - Production-grade platform for building agentic IM bots"""
|
"""LangBot - Production-grade platform for building agentic IM bots"""
|
||||||
|
|
||||||
__version__ = '4.10.1'
|
__version__ = '4.9.5'
|
||||||
|
|||||||
@@ -5,8 +5,6 @@ import argparse
|
|||||||
import sys
|
import sys
|
||||||
import os
|
import os
|
||||||
|
|
||||||
from langbot.pkg.utils import paths
|
|
||||||
|
|
||||||
# ASCII art banner
|
# ASCII art banner
|
||||||
asciiart = r"""
|
asciiart = r"""
|
||||||
_ ___ _
|
_ ___ _
|
||||||
@@ -29,12 +27,6 @@ async def main_entry(loop: asyncio.AbstractEventLoop):
|
|||||||
help='Use standalone plugin runtime / 使用独立插件运行时',
|
help='Use standalone plugin runtime / 使用独立插件运行时',
|
||||||
default=False,
|
default=False,
|
||||||
)
|
)
|
||||||
parser.add_argument(
|
|
||||||
'--standalone-box',
|
|
||||||
action='store_true',
|
|
||||||
help='Use standalone box runtime / 使用独立 Box 运行时',
|
|
||||||
default=False,
|
|
||||||
)
|
|
||||||
parser.add_argument('--debug', action='store_true', help='Debug mode / 调试模式', default=False)
|
parser.add_argument('--debug', action='store_true', help='Debug mode / 调试模式', default=False)
|
||||||
args = parser.parse_args()
|
args = parser.parse_args()
|
||||||
|
|
||||||
@@ -43,11 +35,6 @@ async def main_entry(loop: asyncio.AbstractEventLoop):
|
|||||||
|
|
||||||
platform.standalone_runtime = True
|
platform.standalone_runtime = True
|
||||||
|
|
||||||
if args.standalone_box:
|
|
||||||
from langbot.pkg.utils import platform
|
|
||||||
|
|
||||||
platform.standalone_box = True
|
|
||||||
|
|
||||||
if args.debug:
|
if args.debug:
|
||||||
from langbot.pkg.utils import constants
|
from langbot.pkg.utils import constants
|
||||||
|
|
||||||
@@ -100,7 +87,7 @@ def main():
|
|||||||
# Set up the working directory
|
# Set up the working directory
|
||||||
# When installed as a package, we need to handle the working directory differently
|
# When installed as a package, we need to handle the working directory differently
|
||||||
# We'll create data directory in current working directory if not exists
|
# We'll create data directory in current working directory if not exists
|
||||||
os.makedirs(paths.get_data_root(), exist_ok=True)
|
os.makedirs('data', exist_ok=True)
|
||||||
|
|
||||||
loop = asyncio.new_event_loop()
|
loop = asyncio.new_event_loop()
|
||||||
|
|
||||||
|
|||||||
@@ -1,5 +0,0 @@
|
|||||||
from .client import AsyncDeerFlowClient
|
|
||||||
from .errors import DeerFlowAPIError
|
|
||||||
from . import stream_utils
|
|
||||||
|
|
||||||
__all__ = ['AsyncDeerFlowClient', 'DeerFlowAPIError', 'stream_utils']
|
|
||||||
@@ -1,204 +0,0 @@
|
|||||||
"""DeerFlow LangGraph HTTP API 客户端
|
|
||||||
|
|
||||||
参考 astrbot 的 deerflow_api_client 实现,使用 httpx 适配 LangBot 风格。
|
|
||||||
"""
|
|
||||||
|
|
||||||
from __future__ import annotations
|
|
||||||
|
|
||||||
import codecs
|
|
||||||
import json
|
|
||||||
import typing
|
|
||||||
from collections.abc import AsyncGenerator
|
|
||||||
|
|
||||||
import httpx
|
|
||||||
|
|
||||||
from .errors import DeerFlowAPIError
|
|
||||||
|
|
||||||
|
|
||||||
SSE_MAX_BUFFER_CHARS = 1_048_576
|
|
||||||
|
|
||||||
|
|
||||||
def _normalize_sse_newlines(text: str) -> str:
|
|
||||||
"""规范化 CRLF/CR 为 LF,确保 SSE 块分割稳定"""
|
|
||||||
return text.replace('\r\n', '\n').replace('\r', '\n')
|
|
||||||
|
|
||||||
|
|
||||||
def _parse_sse_data_lines(data_lines: list[str]) -> typing.Any:
|
|
||||||
raw_data = '\n'.join(data_lines)
|
|
||||||
try:
|
|
||||||
return json.loads(raw_data)
|
|
||||||
except json.JSONDecodeError:
|
|
||||||
# 某些 LangGraph 兼容服务端会在单个 SSE 事件中用多个 data 行
|
|
||||||
# 发送多段 JSON 片段(例如 tuple payload)
|
|
||||||
parsed_lines: list[typing.Any] = []
|
|
||||||
can_parse_all = True
|
|
||||||
for line in data_lines:
|
|
||||||
line = line.strip()
|
|
||||||
if not line:
|
|
||||||
continue
|
|
||||||
try:
|
|
||||||
parsed_lines.append(json.loads(line))
|
|
||||||
except json.JSONDecodeError:
|
|
||||||
can_parse_all = False
|
|
||||||
break
|
|
||||||
if can_parse_all and parsed_lines:
|
|
||||||
return parsed_lines[0] if len(parsed_lines) == 1 else parsed_lines
|
|
||||||
return raw_data
|
|
||||||
|
|
||||||
|
|
||||||
def _parse_sse_block(block: str) -> dict[str, typing.Any] | None:
|
|
||||||
if not block.strip():
|
|
||||||
return None
|
|
||||||
|
|
||||||
event_name = 'message'
|
|
||||||
data_lines: list[str] = []
|
|
||||||
for line in block.splitlines():
|
|
||||||
if line.startswith('event:'):
|
|
||||||
event_name = line[6:].strip()
|
|
||||||
elif line.startswith('data:'):
|
|
||||||
data_lines.append(line[5:].lstrip())
|
|
||||||
|
|
||||||
if not data_lines:
|
|
||||||
return None
|
|
||||||
return {'event': event_name, 'data': _parse_sse_data_lines(data_lines)}
|
|
||||||
|
|
||||||
|
|
||||||
class AsyncDeerFlowClient:
|
|
||||||
"""DeerFlow LangGraph HTTP API 客户端"""
|
|
||||||
|
|
||||||
api_base: str
|
|
||||||
headers: dict[str, str]
|
|
||||||
|
|
||||||
def __init__(
|
|
||||||
self,
|
|
||||||
api_base: str = 'http://127.0.0.1:2026',
|
|
||||||
api_key: str = '',
|
|
||||||
auth_header: str = '',
|
|
||||||
) -> None:
|
|
||||||
self.api_base = api_base.rstrip('/')
|
|
||||||
self.headers: dict[str, str] = {}
|
|
||||||
if auth_header:
|
|
||||||
self.headers['Authorization'] = auth_header
|
|
||||||
elif api_key:
|
|
||||||
self.headers['Authorization'] = f'Bearer {api_key}'
|
|
||||||
|
|
||||||
async def create_thread(self, timeout: float = 20) -> dict[str, typing.Any]:
|
|
||||||
"""创建一个新的 LangGraph thread
|
|
||||||
|
|
||||||
Returns:
|
|
||||||
包含 thread_id 等信息的字典
|
|
||||||
"""
|
|
||||||
url = f'{self.api_base}/api/langgraph/threads'
|
|
||||||
payload = {'metadata': {}}
|
|
||||||
|
|
||||||
async with httpx.AsyncClient(
|
|
||||||
trust_env=True,
|
|
||||||
timeout=timeout,
|
|
||||||
) as client:
|
|
||||||
response = await client.post(
|
|
||||||
url,
|
|
||||||
headers=self.headers,
|
|
||||||
json=payload,
|
|
||||||
)
|
|
||||||
if response.status_code not in (200, 201):
|
|
||||||
raise DeerFlowAPIError(
|
|
||||||
operation='create thread',
|
|
||||||
status=response.status_code,
|
|
||||||
body=response.text,
|
|
||||||
url=url,
|
|
||||||
)
|
|
||||||
return response.json()
|
|
||||||
|
|
||||||
async def delete_thread(self, thread_id: str, timeout: float = 20) -> None:
|
|
||||||
"""删除指定 thread"""
|
|
||||||
url = f'{self.api_base}/api/threads/{thread_id}'
|
|
||||||
|
|
||||||
async with httpx.AsyncClient(
|
|
||||||
trust_env=True,
|
|
||||||
timeout=timeout,
|
|
||||||
) as client:
|
|
||||||
response = await client.delete(url, headers=self.headers)
|
|
||||||
if response.status_code not in (200, 202, 204, 404):
|
|
||||||
raise DeerFlowAPIError(
|
|
||||||
operation='delete thread',
|
|
||||||
status=response.status_code,
|
|
||||||
body=response.text,
|
|
||||||
url=url,
|
|
||||||
thread_id=thread_id,
|
|
||||||
)
|
|
||||||
|
|
||||||
async def stream_run(
|
|
||||||
self,
|
|
||||||
thread_id: str,
|
|
||||||
payload: dict[str, typing.Any],
|
|
||||||
timeout: float = 120,
|
|
||||||
) -> AsyncGenerator[dict[str, typing.Any], None]:
|
|
||||||
"""运行一次 LangGraph stream 请求,逐事件 yield
|
|
||||||
|
|
||||||
Yields:
|
|
||||||
事件字典 {'event': event_name, 'data': parsed_data}
|
|
||||||
"""
|
|
||||||
url = f'{self.api_base}/api/langgraph/threads/{thread_id}/runs/stream'
|
|
||||||
|
|
||||||
# 流式请求使用单独的 read timeout 控制
|
|
||||||
stream_timeout = httpx.Timeout(
|
|
||||||
connect=min(timeout, 30),
|
|
||||||
read=timeout,
|
|
||||||
write=timeout,
|
|
||||||
pool=timeout,
|
|
||||||
)
|
|
||||||
|
|
||||||
async with httpx.AsyncClient(
|
|
||||||
trust_env=True,
|
|
||||||
timeout=stream_timeout,
|
|
||||||
) as client:
|
|
||||||
async with client.stream(
|
|
||||||
'POST',
|
|
||||||
url,
|
|
||||||
headers={
|
|
||||||
**self.headers,
|
|
||||||
'Accept': 'text/event-stream',
|
|
||||||
'Content-Type': 'application/json',
|
|
||||||
},
|
|
||||||
json=payload,
|
|
||||||
) as resp:
|
|
||||||
if resp.status_code != 200:
|
|
||||||
body = await resp.aread()
|
|
||||||
raise DeerFlowAPIError(
|
|
||||||
operation='runs/stream request',
|
|
||||||
status=resp.status_code,
|
|
||||||
body=body.decode('utf-8', errors='replace'),
|
|
||||||
url=url,
|
|
||||||
thread_id=thread_id,
|
|
||||||
)
|
|
||||||
|
|
||||||
decoder = codecs.getincrementaldecoder('utf-8')('replace')
|
|
||||||
buffer = ''
|
|
||||||
|
|
||||||
async for chunk in resp.aiter_bytes(8192):
|
|
||||||
buffer += _normalize_sse_newlines(decoder.decode(chunk))
|
|
||||||
|
|
||||||
while '\n\n' in buffer:
|
|
||||||
block, buffer = buffer.split('\n\n', 1)
|
|
||||||
parsed = _parse_sse_block(block)
|
|
||||||
if parsed is not None:
|
|
||||||
yield parsed
|
|
||||||
|
|
||||||
if len(buffer) > SSE_MAX_BUFFER_CHARS:
|
|
||||||
# 缓冲区过大,强制 flush
|
|
||||||
parsed = _parse_sse_block(buffer)
|
|
||||||
if parsed is not None:
|
|
||||||
yield parsed
|
|
||||||
buffer = ''
|
|
||||||
|
|
||||||
# flush 剩余内容
|
|
||||||
buffer += _normalize_sse_newlines(decoder.decode(b'', final=True))
|
|
||||||
while '\n\n' in buffer:
|
|
||||||
block, buffer = buffer.split('\n\n', 1)
|
|
||||||
parsed = _parse_sse_block(block)
|
|
||||||
if parsed is not None:
|
|
||||||
yield parsed
|
|
||||||
if buffer.strip():
|
|
||||||
parsed = _parse_sse_block(buffer)
|
|
||||||
if parsed is not None:
|
|
||||||
yield parsed
|
|
||||||
@@ -1,30 +0,0 @@
|
|||||||
from __future__ import annotations
|
|
||||||
|
|
||||||
|
|
||||||
class DeerFlowAPIError(Exception):
|
|
||||||
"""DeerFlow API 请求失败"""
|
|
||||||
|
|
||||||
def __init__(
|
|
||||||
self,
|
|
||||||
*,
|
|
||||||
operation: str = '',
|
|
||||||
status: int = 0,
|
|
||||||
body: str = '',
|
|
||||||
url: str = '',
|
|
||||||
thread_id: str | None = None,
|
|
||||||
message: str = '',
|
|
||||||
) -> None:
|
|
||||||
self.operation = operation
|
|
||||||
self.status = status
|
|
||||||
self.body = body
|
|
||||||
self.url = url
|
|
||||||
self.thread_id = thread_id
|
|
||||||
|
|
||||||
if message:
|
|
||||||
super().__init__(message)
|
|
||||||
return
|
|
||||||
|
|
||||||
msg = f'DeerFlow {operation} failed: status={status}, url={url}, body={body}'
|
|
||||||
if thread_id is not None:
|
|
||||||
msg = f'DeerFlow {operation} failed: thread_id={thread_id}, status={status}, url={url}, body={body}'
|
|
||||||
super().__init__(msg)
|
|
||||||
@@ -1,212 +0,0 @@
|
|||||||
"""DeerFlow LangGraph 流式响应解析工具
|
|
||||||
|
|
||||||
参考 astrbot 实现的 deerflow_stream_utils。
|
|
||||||
"""
|
|
||||||
|
|
||||||
from __future__ import annotations
|
|
||||||
|
|
||||||
import typing
|
|
||||||
from collections.abc import Iterable
|
|
||||||
|
|
||||||
|
|
||||||
def extract_text(content: typing.Any) -> str:
|
|
||||||
"""从消息 content 中提取纯文本"""
|
|
||||||
if isinstance(content, str):
|
|
||||||
return content
|
|
||||||
if isinstance(content, dict):
|
|
||||||
if isinstance(content.get('text'), str):
|
|
||||||
return content['text']
|
|
||||||
if 'content' in content:
|
|
||||||
return extract_text(content.get('content'))
|
|
||||||
if 'kwargs' in content and isinstance(content['kwargs'], dict):
|
|
||||||
return extract_text(content['kwargs'].get('content'))
|
|
||||||
if isinstance(content, list):
|
|
||||||
parts: list[str] = []
|
|
||||||
for item in content:
|
|
||||||
if isinstance(item, str):
|
|
||||||
parts.append(item)
|
|
||||||
elif isinstance(item, dict):
|
|
||||||
item_type = item.get('type')
|
|
||||||
if item_type == 'text' and isinstance(item.get('text'), str):
|
|
||||||
parts.append(item['text'])
|
|
||||||
elif 'content' in item:
|
|
||||||
parts.append(extract_text(item['content']))
|
|
||||||
return '\n'.join([p for p in parts if p]).strip()
|
|
||||||
return str(content) if content is not None else ''
|
|
||||||
|
|
||||||
|
|
||||||
def extract_messages_from_values_data(data: typing.Any) -> list[typing.Any]:
|
|
||||||
"""从 values 事件中提取 messages 列表"""
|
|
||||||
candidates: list[typing.Any] = []
|
|
||||||
if isinstance(data, dict):
|
|
||||||
candidates.append(data)
|
|
||||||
if isinstance(data.get('values'), dict):
|
|
||||||
candidates.append(data['values'])
|
|
||||||
elif isinstance(data, list):
|
|
||||||
candidates.extend([x for x in data if isinstance(x, dict)])
|
|
||||||
|
|
||||||
for item in candidates:
|
|
||||||
messages = item.get('messages')
|
|
||||||
if isinstance(messages, list):
|
|
||||||
return messages
|
|
||||||
return []
|
|
||||||
|
|
||||||
|
|
||||||
def is_ai_message(message: dict[str, typing.Any]) -> bool:
|
|
||||||
"""判断是否为 AI/assistant 消息"""
|
|
||||||
role = str(message.get('role', '')).lower()
|
|
||||||
if role in {'assistant', 'ai'}:
|
|
||||||
return True
|
|
||||||
|
|
||||||
msg_type = str(message.get('type', '')).lower()
|
|
||||||
if msg_type in {'ai', 'assistant', 'aimessage', 'aimessagechunk'}:
|
|
||||||
return True
|
|
||||||
if 'ai' in msg_type and all(token not in msg_type for token in ('human', 'tool', 'system')):
|
|
||||||
return True
|
|
||||||
return False
|
|
||||||
|
|
||||||
|
|
||||||
def extract_latest_ai_text(messages: Iterable[typing.Any]) -> str:
|
|
||||||
"""获取最近一条 AI 消息的文本内容"""
|
|
||||||
if isinstance(messages, (list, tuple)):
|
|
||||||
iterable = reversed(messages)
|
|
||||||
else:
|
|
||||||
iterable = reversed(list(messages))
|
|
||||||
|
|
||||||
for msg in iterable:
|
|
||||||
if not isinstance(msg, dict):
|
|
||||||
continue
|
|
||||||
if is_ai_message(msg):
|
|
||||||
text = extract_text(msg.get('content'))
|
|
||||||
if text:
|
|
||||||
return text
|
|
||||||
return ''
|
|
||||||
|
|
||||||
|
|
||||||
def extract_latest_ai_message(messages: Iterable[typing.Any]) -> dict[str, typing.Any] | None:
|
|
||||||
"""获取最近一条 AI 消息对象"""
|
|
||||||
if isinstance(messages, (list, tuple)):
|
|
||||||
iterable = reversed(messages)
|
|
||||||
else:
|
|
||||||
iterable = reversed(list(messages))
|
|
||||||
|
|
||||||
for msg in iterable:
|
|
||||||
if not isinstance(msg, dict):
|
|
||||||
continue
|
|
||||||
if is_ai_message(msg):
|
|
||||||
return msg
|
|
||||||
return None
|
|
||||||
|
|
||||||
|
|
||||||
def is_clarification_tool_message(message: dict[str, typing.Any]) -> bool:
|
|
||||||
"""判断是否为澄清问题工具消息"""
|
|
||||||
msg_type = str(message.get('type', '')).lower()
|
|
||||||
tool_name = str(message.get('name', '')).lower()
|
|
||||||
return msg_type == 'tool' and tool_name == 'ask_clarification'
|
|
||||||
|
|
||||||
|
|
||||||
def extract_latest_clarification_text(messages: Iterable[typing.Any]) -> str:
|
|
||||||
"""提取最近的澄清问题文本"""
|
|
||||||
if isinstance(messages, (list, tuple)):
|
|
||||||
iterable = reversed(messages)
|
|
||||||
else:
|
|
||||||
iterable = reversed(list(messages))
|
|
||||||
|
|
||||||
for msg in iterable:
|
|
||||||
if not isinstance(msg, dict):
|
|
||||||
continue
|
|
||||||
if is_clarification_tool_message(msg):
|
|
||||||
text = extract_text(msg.get('content'))
|
|
||||||
if text:
|
|
||||||
return text
|
|
||||||
return ''
|
|
||||||
|
|
||||||
|
|
||||||
def get_message_id(message: typing.Any) -> str:
|
|
||||||
"""提取消息 ID"""
|
|
||||||
if not isinstance(message, dict):
|
|
||||||
return ''
|
|
||||||
msg_id = message.get('id')
|
|
||||||
return msg_id if isinstance(msg_id, str) else ''
|
|
||||||
|
|
||||||
|
|
||||||
def extract_event_message_obj(data: typing.Any) -> dict[str, typing.Any] | None:
|
|
||||||
"""从事件 data 中提取消息对象"""
|
|
||||||
msg_obj = data
|
|
||||||
if isinstance(data, (list, tuple)) and data:
|
|
||||||
msg_obj = data[0]
|
|
||||||
if isinstance(msg_obj, dict) and isinstance(msg_obj.get('data'), dict):
|
|
||||||
msg_obj = msg_obj['data']
|
|
||||||
return msg_obj if isinstance(msg_obj, dict) else None
|
|
||||||
|
|
||||||
|
|
||||||
def extract_ai_delta_from_event_data(data: typing.Any) -> str:
|
|
||||||
"""从 messages-tuple 事件中提取 AI delta 文本"""
|
|
||||||
msg_obj = extract_event_message_obj(data)
|
|
||||||
if not msg_obj:
|
|
||||||
return ''
|
|
||||||
if is_ai_message(msg_obj):
|
|
||||||
return extract_text(msg_obj.get('content'))
|
|
||||||
return ''
|
|
||||||
|
|
||||||
|
|
||||||
def extract_clarification_from_event_data(data: typing.Any) -> str:
|
|
||||||
"""从事件中提取澄清问题"""
|
|
||||||
msg_obj = extract_event_message_obj(data)
|
|
||||||
if not msg_obj:
|
|
||||||
return ''
|
|
||||||
if is_clarification_tool_message(msg_obj):
|
|
||||||
return extract_text(msg_obj.get('content'))
|
|
||||||
return ''
|
|
||||||
|
|
||||||
|
|
||||||
def _iter_custom_event_items(data: typing.Any) -> list[dict[str, typing.Any]]:
|
|
||||||
items: list[dict[str, typing.Any]] = []
|
|
||||||
if isinstance(data, dict):
|
|
||||||
return [data]
|
|
||||||
if isinstance(data, list):
|
|
||||||
for item in data:
|
|
||||||
if isinstance(item, dict):
|
|
||||||
items.append(item)
|
|
||||||
elif isinstance(item, (list, tuple)):
|
|
||||||
for nested in item:
|
|
||||||
if isinstance(nested, dict):
|
|
||||||
items.append(nested)
|
|
||||||
return items
|
|
||||||
|
|
||||||
|
|
||||||
def extract_task_failures_from_custom_event(data: typing.Any) -> list[str]:
|
|
||||||
"""从 custom 事件中提取子任务失败信息"""
|
|
||||||
failures: list[str] = []
|
|
||||||
for item in _iter_custom_event_items(data):
|
|
||||||
event_type = str(item.get('type', '')).lower()
|
|
||||||
if event_type not in {'task_failed', 'task_timed_out'}:
|
|
||||||
continue
|
|
||||||
|
|
||||||
task_id = str(item.get('task_id', '')).strip()
|
|
||||||
error_text = extract_text(item.get('error')).strip()
|
|
||||||
if task_id and error_text:
|
|
||||||
failures.append(f'{task_id}: {error_text}')
|
|
||||||
elif error_text:
|
|
||||||
failures.append(error_text)
|
|
||||||
elif task_id:
|
|
||||||
failures.append(f'{task_id}: unknown error')
|
|
||||||
else:
|
|
||||||
failures.append('unknown task failure')
|
|
||||||
return failures
|
|
||||||
|
|
||||||
|
|
||||||
def build_task_failure_summary(failures: list[str]) -> str:
|
|
||||||
"""构建任务失败摘要"""
|
|
||||||
if not failures:
|
|
||||||
return ''
|
|
||||||
deduped: list[str] = []
|
|
||||||
seen: set[str] = set()
|
|
||||||
for failure in failures:
|
|
||||||
if failure not in seen:
|
|
||||||
seen.add(failure)
|
|
||||||
deduped.append(failure)
|
|
||||||
if len(deduped) == 1:
|
|
||||||
return f'DeerFlow subtask failed: {deduped[0]}'
|
|
||||||
joined = '\n'.join([f'- {item}' for item in deduped[:5]])
|
|
||||||
return f'DeerFlow subtasks failed:\n{joined}'
|
|
||||||
@@ -145,7 +145,7 @@ class AsyncDifyServiceClient:
|
|||||||
'file': file,
|
'file': file,
|
||||||
},
|
},
|
||||||
data={
|
data={
|
||||||
'user': user,
|
'user': (None, user),
|
||||||
},
|
},
|
||||||
)
|
)
|
||||||
|
|
||||||
|
|||||||
@@ -182,88 +182,6 @@ class DingTalkClient:
|
|||||||
for handler in self._message_handlers[msg_type]:
|
for handler in self._message_handlers[msg_type]:
|
||||||
await handler(event)
|
await handler(event)
|
||||||
|
|
||||||
async def _parse_quoted_message(self, replied_msg: dict) -> dict:
|
|
||||||
"""Parse the quoted/replied message and extract its content.
|
|
||||||
|
|
||||||
Args:
|
|
||||||
replied_msg: The repliedMsg object from DingTalk message
|
|
||||||
|
|
||||||
Returns:
|
|
||||||
A dict containing the quoted message info with keys:
|
|
||||||
- message_id: The original message ID
|
|
||||||
- msg_type: The message type (text, file, picture, audio, etc.)
|
|
||||||
- content: The text content (if any)
|
|
||||||
- file_url: The file download URL (if file type)
|
|
||||||
- file_name: The file name (if file type)
|
|
||||||
- picture: The picture base64 (if picture type)
|
|
||||||
- audio: The audio base64 (if audio type)
|
|
||||||
"""
|
|
||||||
quote_info = {
|
|
||||||
'message_id': replied_msg.get('msgId', ''),
|
|
||||||
'msg_type': replied_msg.get('msgType', ''),
|
|
||||||
'sender_id': replied_msg.get('senderId', ''),
|
|
||||||
}
|
|
||||||
|
|
||||||
msg_type = replied_msg.get('msgType', '')
|
|
||||||
content = replied_msg.get('content', {})
|
|
||||||
|
|
||||||
# Handle content as string (JSON) or dict
|
|
||||||
if isinstance(content, str):
|
|
||||||
try:
|
|
||||||
content = json.loads(content)
|
|
||||||
except (json.JSONDecodeError, TypeError):
|
|
||||||
content = {}
|
|
||||||
|
|
||||||
if msg_type == 'text':
|
|
||||||
# Text message
|
|
||||||
if isinstance(content, dict):
|
|
||||||
quote_info['content'] = content.get('content', '')
|
|
||||||
else:
|
|
||||||
quote_info['content'] = str(content)
|
|
||||||
|
|
||||||
elif msg_type == 'file':
|
|
||||||
# File message
|
|
||||||
download_code = content.get('downloadCode')
|
|
||||||
file_name = content.get('fileName')
|
|
||||||
if download_code and file_name:
|
|
||||||
try:
|
|
||||||
quote_info['file_url'] = await self.get_file_url(download_code)
|
|
||||||
quote_info['file_name'] = file_name
|
|
||||||
except Exception as e:
|
|
||||||
if self.logger:
|
|
||||||
await self.logger.error(f'Failed to get quoted file URL: {e}')
|
|
||||||
|
|
||||||
elif msg_type == 'picture':
|
|
||||||
# Picture message
|
|
||||||
download_code = content.get('downloadCode')
|
|
||||||
if download_code:
|
|
||||||
try:
|
|
||||||
quote_info['picture'] = await self.download_image(download_code)
|
|
||||||
except Exception as e:
|
|
||||||
if self.logger:
|
|
||||||
await self.logger.error(f'Failed to download quoted image: {e}')
|
|
||||||
|
|
||||||
elif msg_type == 'audio':
|
|
||||||
# Audio message
|
|
||||||
download_code = content.get('downloadCode')
|
|
||||||
if download_code:
|
|
||||||
try:
|
|
||||||
quote_info['audio'] = await self.get_audio_url(download_code)
|
|
||||||
except Exception as e:
|
|
||||||
if self.logger:
|
|
||||||
await self.logger.error(f'Failed to get quoted audio: {e}')
|
|
||||||
|
|
||||||
elif msg_type == 'richText':
|
|
||||||
# Rich text message - extract text content
|
|
||||||
rich_text = content.get('richText', [])
|
|
||||||
texts = []
|
|
||||||
for item in rich_text:
|
|
||||||
if 'text' in item and item['text'] != '\n':
|
|
||||||
texts.append(item['text'])
|
|
||||||
quote_info['content'] = '\n'.join(texts)
|
|
||||||
|
|
||||||
return quote_info
|
|
||||||
|
|
||||||
async def get_message(self, incoming_message: dingtalk_stream.chatbot.ChatbotMessage):
|
async def get_message(self, incoming_message: dingtalk_stream.chatbot.ChatbotMessage):
|
||||||
try:
|
try:
|
||||||
# print(json.dumps(incoming_message.to_dict(), indent=4, ensure_ascii=False))
|
# print(json.dumps(incoming_message.to_dict(), indent=4, ensure_ascii=False))
|
||||||
@@ -275,15 +193,6 @@ class DingTalkClient:
|
|||||||
elif str(incoming_message.conversation_type) == '2':
|
elif str(incoming_message.conversation_type) == '2':
|
||||||
message_data['conversation_type'] = 'GroupMessage'
|
message_data['conversation_type'] = 'GroupMessage'
|
||||||
|
|
||||||
# Check for quoted/replied message
|
|
||||||
raw_data = incoming_message.to_dict()
|
|
||||||
text_data = raw_data.get('text', {})
|
|
||||||
if isinstance(text_data, dict) and text_data.get('isReplyMsg'):
|
|
||||||
replied_msg = text_data.get('repliedMsg', {})
|
|
||||||
if replied_msg:
|
|
||||||
quote_info = await self._parse_quoted_message(replied_msg)
|
|
||||||
message_data['QuotedMessage'] = quote_info
|
|
||||||
|
|
||||||
if incoming_message.message_type == 'richText':
|
if incoming_message.message_type == 'richText':
|
||||||
data = incoming_message.rich_text_content.to_dict()
|
data = incoming_message.rich_text_content.to_dict()
|
||||||
|
|
||||||
@@ -359,25 +268,7 @@ class DingTalkClient:
|
|||||||
|
|
||||||
message_data['Type'] = 'image'
|
message_data['Type'] = 'image'
|
||||||
elif incoming_message.message_type == 'audio':
|
elif incoming_message.message_type == 'audio':
|
||||||
raw_content = incoming_message.to_dict().get('content', {})
|
message_data['Audio'] = await self.get_audio_url(incoming_message.to_dict()['content']['downloadCode'])
|
||||||
# 兼容处理:如果 content 仍为 JSON 字符串则进行解析
|
|
||||||
if isinstance(raw_content, str):
|
|
||||||
try:
|
|
||||||
raw_content = json.loads(raw_content)
|
|
||||||
except (json.JSONDecodeError, TypeError):
|
|
||||||
raw_content = {}
|
|
||||||
|
|
||||||
if self.logger:
|
|
||||||
await self.logger.info(f'DingTalk audio raw content: {json.dumps(raw_content, ensure_ascii=False)}')
|
|
||||||
|
|
||||||
# 提取钉钉自带的语音转写文字(Powered by Qwen)
|
|
||||||
recognition = raw_content.get('recognition', '')
|
|
||||||
if recognition:
|
|
||||||
message_data['Content'] = recognition
|
|
||||||
|
|
||||||
download_code = raw_content.get('downloadCode')
|
|
||||||
if download_code:
|
|
||||||
message_data['Audio'] = await self.get_audio_url(download_code)
|
|
||||||
|
|
||||||
message_data['Type'] = 'audio'
|
message_data['Type'] = 'audio'
|
||||||
elif incoming_message.message_type == 'file':
|
elif incoming_message.message_type == 'file':
|
||||||
@@ -438,13 +329,8 @@ class DingTalkClient:
|
|||||||
try:
|
try:
|
||||||
async with httpx.AsyncClient() as client:
|
async with httpx.AsyncClient() as client:
|
||||||
response = await client.post(url, headers=headers, json=data)
|
response = await client.post(url, headers=headers, json=data)
|
||||||
try:
|
|
||||||
body = response.json()
|
|
||||||
except Exception:
|
|
||||||
body = {'text': response.text}
|
|
||||||
if response.status_code == 200:
|
if response.status_code == 200:
|
||||||
return body
|
return
|
||||||
raise Exception(f'Error: {response.status_code}, {body}')
|
|
||||||
except Exception:
|
except Exception:
|
||||||
await self.logger.error(f'failed to send proactive massage to person: {traceback.format_exc()}')
|
await self.logger.error(f'failed to send proactive massage to person: {traceback.format_exc()}')
|
||||||
raise Exception(f'failed to send proactive massage to person: {traceback.format_exc()}')
|
raise Exception(f'failed to send proactive massage to person: {traceback.format_exc()}')
|
||||||
@@ -469,13 +355,8 @@ class DingTalkClient:
|
|||||||
try:
|
try:
|
||||||
async with httpx.AsyncClient() as client:
|
async with httpx.AsyncClient() as client:
|
||||||
response = await client.post(url, headers=headers, json=data)
|
response = await client.post(url, headers=headers, json=data)
|
||||||
try:
|
|
||||||
body = response.json()
|
|
||||||
except Exception:
|
|
||||||
body = {'text': response.text}
|
|
||||||
if response.status_code == 200:
|
if response.status_code == 200:
|
||||||
return body
|
return
|
||||||
raise Exception(f'Error: {response.status_code}, {body}')
|
|
||||||
except Exception:
|
except Exception:
|
||||||
await self.logger.error(f'failed to send proactive massage to group: {traceback.format_exc()}')
|
await self.logger.error(f'failed to send proactive massage to group: {traceback.format_exc()}')
|
||||||
raise Exception(f'failed to send proactive massage to group: {traceback.format_exc()}')
|
raise Exception(f'failed to send proactive massage to group: {traceback.format_exc()}')
|
||||||
@@ -491,12 +372,6 @@ class DingTalkClient:
|
|||||||
card_data['config'] = json.dumps({'autoLayout': card_auto_layout})
|
card_data['config'] = json.dumps({'autoLayout': card_auto_layout})
|
||||||
card_data['content'] = ''
|
card_data['content'] = ''
|
||||||
|
|
||||||
# 将用户的消息内容作为卡片的查询参数,方便后续处理
|
|
||||||
if incoming_message.message_type == 'text':
|
|
||||||
card_data['query'] = incoming_message.get_text_list()[0]
|
|
||||||
else:
|
|
||||||
card_data['query'] = '...'
|
|
||||||
|
|
||||||
card_instance = dingtalk_stream.AICardReplier(self.client, incoming_message)
|
card_instance = dingtalk_stream.AICardReplier(self.client, incoming_message)
|
||||||
# print(card_instance)
|
# print(card_instance)
|
||||||
# 先投放卡片: https://open.dingtalk.com/document/orgapp/create-and-deliver-cards
|
# 先投放卡片: https://open.dingtalk.com/document/orgapp/create-and-deliver-cards
|
||||||
|
|||||||
@@ -47,22 +47,6 @@ class DingTalkEvent(dict):
|
|||||||
def conversation(self):
|
def conversation(self):
|
||||||
return self.get('conversation_type', '')
|
return self.get('conversation_type', '')
|
||||||
|
|
||||||
@property
|
|
||||||
def quoted_message(self) -> Optional[Dict[str, Any]]:
|
|
||||||
"""Get the quoted/replied message info if this is a reply message.
|
|
||||||
|
|
||||||
Returns:
|
|
||||||
A dict containing:
|
|
||||||
- message_id: The original message ID
|
|
||||||
- msg_type: The message type (text, file, picture, audio, etc.)
|
|
||||||
- content: The text content (if any)
|
|
||||||
- file_url: The file download URL (if file type)
|
|
||||||
- file_name: The file name (if file type)
|
|
||||||
- picture: The picture base64 (if picture type)
|
|
||||||
- audio: The audio base64 (if audio type)
|
|
||||||
"""
|
|
||||||
return self.get('QuotedMessage')
|
|
||||||
|
|
||||||
def __getattr__(self, key: str) -> Optional[Any]:
|
def __getattr__(self, key: str) -> Optional[Any]:
|
||||||
"""
|
"""
|
||||||
允许通过属性访问数据中的任意字段。
|
允许通过属性访问数据中的任意字段。
|
||||||
|
|||||||
@@ -93,30 +93,15 @@ class OAClient:
|
|||||||
raise Exception('msg_signature不在请求体中')
|
raise Exception('msg_signature不在请求体中')
|
||||||
|
|
||||||
if req.method == 'GET':
|
if req.method == 'GET':
|
||||||
if msg_signature:
|
# 校验签名
|
||||||
wxcpt = WXBizMsgCrypt(self.token, self.aes, self.appid)
|
|
||||||
ret, reply_echo = wxcpt.VerifyURL(msg_signature, timestamp, nonce, echostr)
|
|
||||||
if ret == 0:
|
|
||||||
return reply_echo
|
|
||||||
await self.logger.error(
|
|
||||||
'OfficialAccount encrypted URL verification failed: '
|
|
||||||
f'ret={ret}, timestamp_present={bool(timestamp)}, nonce_present={bool(nonce)}, '
|
|
||||||
f'echostr_present={bool(echostr)}'
|
|
||||||
)
|
|
||||||
|
|
||||||
# Plaintext callback verification.
|
|
||||||
check_str = ''.join(sorted([self.token, timestamp, nonce]))
|
check_str = ''.join(sorted([self.token, timestamp, nonce]))
|
||||||
check_signature = hashlib.sha1(check_str.encode('utf-8')).hexdigest()
|
check_signature = hashlib.sha1(check_str.encode('utf-8')).hexdigest()
|
||||||
|
|
||||||
if check_signature == signature:
|
if check_signature == signature:
|
||||||
return echostr # 验证成功返回echostr
|
return echostr # 验证成功返回echostr
|
||||||
else:
|
else:
|
||||||
await self.logger.error(
|
await self.logger.error('拒绝请求')
|
||||||
'OfficialAccount plaintext URL verification failed: '
|
raise Exception('拒绝请求')
|
||||||
f'signature_present={bool(signature)}, timestamp_present={bool(timestamp)}, '
|
|
||||||
f'nonce_present={bool(nonce)}, echostr_present={bool(echostr)}'
|
|
||||||
)
|
|
||||||
return 'signature verification failed', 403
|
|
||||||
elif req.method == 'POST':
|
elif req.method == 'POST':
|
||||||
encryt_msg = await req.data
|
encryt_msg = await req.data
|
||||||
wxcpt = WXBizMsgCrypt(self.token, self.aes, self.appid)
|
wxcpt = WXBizMsgCrypt(self.token, self.aes, self.appid)
|
||||||
@@ -294,27 +279,9 @@ class OAClientForLongerResponse:
|
|||||||
raise Exception('msg_signature不在请求体中')
|
raise Exception('msg_signature不在请求体中')
|
||||||
|
|
||||||
if req.method == 'GET':
|
if req.method == 'GET':
|
||||||
if msg_signature:
|
|
||||||
wxcpt = WXBizMsgCrypt(self.token, self.aes, self.appid)
|
|
||||||
ret, reply_echo = wxcpt.VerifyURL(msg_signature, timestamp, nonce, echostr)
|
|
||||||
if ret == 0:
|
|
||||||
return reply_echo
|
|
||||||
await self.logger.error(
|
|
||||||
'OfficialAccount encrypted URL verification failed: '
|
|
||||||
f'ret={ret}, timestamp_present={bool(timestamp)}, nonce_present={bool(nonce)}, '
|
|
||||||
f'echostr_present={bool(echostr)}'
|
|
||||||
)
|
|
||||||
|
|
||||||
check_str = ''.join(sorted([self.token, timestamp, nonce]))
|
check_str = ''.join(sorted([self.token, timestamp, nonce]))
|
||||||
check_signature = hashlib.sha1(check_str.encode('utf-8')).hexdigest()
|
check_signature = hashlib.sha1(check_str.encode('utf-8')).hexdigest()
|
||||||
if check_signature == signature:
|
return echostr if check_signature == signature else '拒绝请求'
|
||||||
return echostr
|
|
||||||
await self.logger.error(
|
|
||||||
'OfficialAccount plaintext URL verification failed: '
|
|
||||||
f'signature_present={bool(signature)}, timestamp_present={bool(timestamp)}, '
|
|
||||||
f'nonce_present={bool(nonce)}, echostr_present={bool(echostr)}'
|
|
||||||
)
|
|
||||||
return 'signature verification failed', 403
|
|
||||||
|
|
||||||
elif req.method == 'POST':
|
elif req.method == 'POST':
|
||||||
encryt_msg = await req.data
|
encryt_msg = await req.data
|
||||||
|
|||||||
@@ -1,10 +1,8 @@
|
|||||||
import re
|
|
||||||
import time
|
import time
|
||||||
import asyncio
|
|
||||||
from quart import request
|
from quart import request
|
||||||
import httpx
|
import httpx
|
||||||
from quart import Quart
|
from quart import Quart
|
||||||
from typing import Callable, Dict, Any, Optional
|
from typing import Callable, Dict, Any
|
||||||
import langbot_plugin.api.entities.builtin.platform.events as platform_events
|
import langbot_plugin.api.entities.builtin.platform.events as platform_events
|
||||||
from .qqofficialevent import QQOfficialEvent
|
from .qqofficialevent import QQOfficialEvent
|
||||||
import json
|
import json
|
||||||
@@ -34,8 +32,6 @@ class QQOfficialClient:
|
|||||||
self.access_token = ''
|
self.access_token = ''
|
||||||
self.access_token_expiry_time = None
|
self.access_token_expiry_time = None
|
||||||
self.logger = logger
|
self.logger = logger
|
||||||
self._msg_seq_counter = 0
|
|
||||||
self._token_refresh_task: Optional[asyncio.Task] = None
|
|
||||||
|
|
||||||
async def check_access_token(self):
|
async def check_access_token(self):
|
||||||
"""检查access_token是否存在"""
|
"""检查access_token是否存在"""
|
||||||
@@ -54,18 +50,18 @@ class QQOfficialClient:
|
|||||||
headers = {
|
headers = {
|
||||||
'content-type': 'application/json',
|
'content-type': 'application/json',
|
||||||
}
|
}
|
||||||
|
try:
|
||||||
response = await client.post(url, json=params, headers=headers)
|
response = await client.post(url, json=params, headers=headers)
|
||||||
if response.status_code != 200:
|
if response.status_code == 200:
|
||||||
raise Exception(f'Failed to get access_token: HTTP {response.status_code} {response.text}')
|
|
||||||
response_data = response.json()
|
response_data = response.json()
|
||||||
access_token = response_data.get('access_token')
|
access_token = response_data.get('access_token')
|
||||||
expires_in = int(response_data.get('expires_in', 7200))
|
expires_in = int(response_data.get('expires_in', 7200))
|
||||||
self.access_token_expiry_time = time.time() + expires_in - 60
|
self.access_token_expiry_time = time.time() + expires_in - 60
|
||||||
if access_token:
|
if access_token:
|
||||||
self.access_token = access_token
|
self.access_token = access_token
|
||||||
await self.logger.info(f'access_token obtained, expires_in={expires_in}s')
|
except Exception as e:
|
||||||
else:
|
await self.logger.error(f'获取access_token失败: {response_data}')
|
||||||
raise Exception('Failed to get access_token: no access_token in response')
|
raise Exception(f'获取access_token失败: {e}')
|
||||||
|
|
||||||
async def handle_callback_request(self):
|
async def handle_callback_request(self):
|
||||||
"""处理回调请求(独立端口模式,使用全局 request)"""
|
"""处理回调请求(独立端口模式,使用全局 request)"""
|
||||||
@@ -91,10 +87,10 @@ class QQOfficialClient:
|
|||||||
try:
|
try:
|
||||||
body = await req.get_data()
|
body = await req.get_data()
|
||||||
|
|
||||||
await self.logger.info(f'Received request, body length: {len(body)}')
|
print(f'[QQ Official] Received request, body length: {len(body)}')
|
||||||
|
|
||||||
if not body or len(body) == 0:
|
if not body or len(body) == 0:
|
||||||
await self.logger.info('Received empty body, might be health check or GET request')
|
print('[QQ Official] Received empty body, might be health check or GET request')
|
||||||
return {'code': 0, 'message': 'ok'}, 200
|
return {'code': 0, 'message': 'ok'}, 200
|
||||||
|
|
||||||
payload = json.loads(body)
|
payload = json.loads(body)
|
||||||
@@ -115,6 +111,7 @@ class QQOfficialClient:
|
|||||||
return {'code': 0, 'message': 'success'}
|
return {'code': 0, 'message': 'success'}
|
||||||
|
|
||||||
except Exception as e:
|
except Exception as e:
|
||||||
|
print(f'[QQ Official] ERROR: {traceback.format_exc()}')
|
||||||
await self.logger.error(f'Error in handle_callback_request: {traceback.format_exc()}')
|
await self.logger.error(f'Error in handle_callback_request: {traceback.format_exc()}')
|
||||||
return {'error': str(e)}, 400
|
return {'error': str(e)}, 400
|
||||||
|
|
||||||
@@ -142,24 +139,21 @@ class QQOfficialClient:
|
|||||||
|
|
||||||
async def get_message(self, msg: dict) -> Dict[str, Any]:
|
async def get_message(self, msg: dict) -> Dict[str, Any]:
|
||||||
"""获取消息"""
|
"""获取消息"""
|
||||||
d = msg.get('d', {})
|
|
||||||
if not isinstance(d, dict):
|
|
||||||
return {}
|
|
||||||
message_data = {
|
message_data = {
|
||||||
't': msg.get('t', {}),
|
't': msg.get('t', {}),
|
||||||
'user_openid': d.get('author', {}).get('user_openid', {}),
|
'user_openid': msg.get('d', {}).get('author', {}).get('user_openid', {}),
|
||||||
'timestamp': d.get('timestamp', {}),
|
'timestamp': msg.get('d', {}).get('timestamp', {}),
|
||||||
'd_author_id': d.get('author', {}).get('id', {}),
|
'd_author_id': msg.get('d', {}).get('author', {}).get('id', {}),
|
||||||
'content': d.get('content', {}),
|
'content': msg.get('d', {}).get('content', {}),
|
||||||
'd_id': d.get('id', {}),
|
'd_id': msg.get('d', {}).get('id', {}),
|
||||||
'id': msg.get('id', {}),
|
'id': msg.get('id', {}),
|
||||||
'channel_id': d.get('channel_id', {}),
|
'channel_id': msg.get('d', {}).get('channel_id', {}),
|
||||||
'username': d.get('author', {}).get('username', {}),
|
'username': msg.get('d', {}).get('author', {}).get('username', {}),
|
||||||
'guild_id': d.get('guild_id', {}),
|
'guild_id': msg.get('d', {}).get('guild_id', {}),
|
||||||
'member_openid': d.get('author', {}).get('openid', {}),
|
'member_openid': msg.get('d', {}).get('author', {}).get('openid', {}),
|
||||||
'group_openid': d.get('group_openid', {}),
|
'group_openid': msg.get('d', {}).get('group_openid', {}),
|
||||||
}
|
}
|
||||||
attachments = d.get('attachments', [])
|
attachments = msg.get('d', {}).get('attachments', [])
|
||||||
image_attachments = [attachment['url'] for attachment in attachments if await self.is_image(attachment)]
|
image_attachments = [attachment['url'] for attachment in attachments if await self.is_image(attachment)]
|
||||||
image_attachments_type = [
|
image_attachments_type = [
|
||||||
attachment['content_type'] for attachment in attachments if await self.is_image(attachment)
|
attachment['content_type'] for attachment in attachments if await self.is_image(attachment)
|
||||||
@@ -198,7 +192,7 @@ class QQOfficialClient:
|
|||||||
if response.status_code == 200:
|
if response.status_code == 200:
|
||||||
return
|
return
|
||||||
else:
|
else:
|
||||||
await self.logger.error(f'Failed to send private message: {response_data}')
|
await self.logger.error(f'发送私聊消息失败: {response_data}')
|
||||||
raise ValueError(response)
|
raise ValueError(response)
|
||||||
|
|
||||||
async def send_group_text_msg(self, group_openid: str, content: str, msg_id: str):
|
async def send_group_text_msg(self, group_openid: str, content: str, msg_id: str):
|
||||||
@@ -221,7 +215,7 @@ class QQOfficialClient:
|
|||||||
if response.status_code == 200:
|
if response.status_code == 200:
|
||||||
return
|
return
|
||||||
else:
|
else:
|
||||||
await self.logger.error(f'Failed to send group message: {response.json()}')
|
await self.logger.error(f'发送群聊消息失败:{response.json()}')
|
||||||
raise Exception(response.read().decode())
|
raise Exception(response.read().decode())
|
||||||
|
|
||||||
async def send_channle_group_text_msg(self, channel_id: str, content: str, msg_id: str):
|
async def send_channle_group_text_msg(self, channel_id: str, content: str, msg_id: str):
|
||||||
@@ -244,7 +238,7 @@ class QQOfficialClient:
|
|||||||
if response.status_code == 200:
|
if response.status_code == 200:
|
||||||
return True
|
return True
|
||||||
else:
|
else:
|
||||||
await self.logger.error(f'Failed to send channel group message: {response.json()}')
|
await self.logger.error(f'发送频道群聊消息失败: {response.json()}')
|
||||||
raise Exception(response)
|
raise Exception(response)
|
||||||
|
|
||||||
async def send_channle_private_text_msg(self, guild_id: str, content: str, msg_id: str):
|
async def send_channle_private_text_msg(self, guild_id: str, content: str, msg_id: str):
|
||||||
@@ -267,224 +261,9 @@ class QQOfficialClient:
|
|||||||
if response.status_code == 200:
|
if response.status_code == 200:
|
||||||
return True
|
return True
|
||||||
else:
|
else:
|
||||||
await self.logger.error(f'Failed to send channel private message: {response.json()}')
|
await self.logger.error(f'发送频道私聊消息失败: {response.json()}')
|
||||||
raise Exception(response)
|
raise Exception(response)
|
||||||
|
|
||||||
# ---- 富媒体消息 ----
|
|
||||||
|
|
||||||
# 媒体文件类型
|
|
||||||
MEDIA_TYPE_IMAGE = 1
|
|
||||||
MEDIA_TYPE_VIDEO = 2
|
|
||||||
MEDIA_TYPE_VOICE = 3
|
|
||||||
MEDIA_TYPE_FILE = 4
|
|
||||||
|
|
||||||
async def upload_media(
|
|
||||||
self,
|
|
||||||
target_type: str,
|
|
||||||
target_id: str,
|
|
||||||
file_type: int,
|
|
||||||
file_url: str = None,
|
|
||||||
file_data: str = None,
|
|
||||||
file_name: str = None,
|
|
||||||
) -> str:
|
|
||||||
"""上传媒体文件,返回 file_info。
|
|
||||||
|
|
||||||
Args:
|
|
||||||
target_type: 'c2c' | 'group'
|
|
||||||
target_id: 用户 openid 或群 openid
|
|
||||||
file_type: 1=图片, 2=视频, 3=语音, 4=文件
|
|
||||||
file_url: 在线 URL(与 file_data 二选一)
|
|
||||||
file_data: base64 编码的文件数据或 data URL(与 file_url 二选一)
|
|
||||||
file_name: 文件名(file_type=4 时必填)
|
|
||||||
"""
|
|
||||||
if not await self.check_access_token():
|
|
||||||
await self.get_access_token()
|
|
||||||
|
|
||||||
if target_type == 'c2c':
|
|
||||||
url = f'{self.base_url}/v2/users/{target_id}/files'
|
|
||||||
elif target_type == 'group':
|
|
||||||
url = f'{self.base_url}/v2/groups/{target_id}/files'
|
|
||||||
else:
|
|
||||||
raise ValueError(f'Unsupported target_type: {target_type}')
|
|
||||||
|
|
||||||
body = {
|
|
||||||
'file_type': file_type,
|
|
||||||
'srv_send_msg': False,
|
|
||||||
}
|
|
||||||
if file_url:
|
|
||||||
body['url'] = file_url
|
|
||||||
elif file_data:
|
|
||||||
# 处理 data URL 格式: data:image/png;base64,xxxxx
|
|
||||||
if file_data.startswith('data:'):
|
|
||||||
match = re.match(r'^data:[^;]+;base64,(.+)$', file_data, re.DOTALL)
|
|
||||||
if match:
|
|
||||||
body['file_data'] = match.group(1)
|
|
||||||
else:
|
|
||||||
body['file_data'] = file_data
|
|
||||||
else:
|
|
||||||
body['file_data'] = file_data
|
|
||||||
else:
|
|
||||||
raise ValueError('file_url or file_data is required')
|
|
||||||
|
|
||||||
if file_type == self.MEDIA_TYPE_FILE and file_name:
|
|
||||||
body['file_name'] = file_name
|
|
||||||
|
|
||||||
async with httpx.AsyncClient(timeout=120) as client:
|
|
||||||
headers = {
|
|
||||||
'Authorization': f'QQBot {self.access_token}',
|
|
||||||
'Content-Type': 'application/json',
|
|
||||||
}
|
|
||||||
response = await client.post(url, headers=headers, json=body)
|
|
||||||
if response.status_code == 200:
|
|
||||||
data = response.json()
|
|
||||||
file_info = data.get('file_info', '')
|
|
||||||
preview = file_info[:80] + '...' if len(file_info) > 80 else file_info
|
|
||||||
await self.logger.info(f'Upload media success, file_info={preview}')
|
|
||||||
return file_info
|
|
||||||
else:
|
|
||||||
raise Exception(f'Failed to upload media: HTTP {response.status_code} {response.text}')
|
|
||||||
|
|
||||||
async def _send_media_msg(
|
|
||||||
self,
|
|
||||||
target_type: str,
|
|
||||||
target_id: str,
|
|
||||||
file_info: str,
|
|
||||||
msg_id: str = None,
|
|
||||||
content: str = None,
|
|
||||||
):
|
|
||||||
"""发送富媒体消息(msg_type=7)"""
|
|
||||||
if not await self.check_access_token():
|
|
||||||
await self.get_access_token()
|
|
||||||
|
|
||||||
if target_type == 'c2c':
|
|
||||||
url = f'{self.base_url}/v2/users/{target_id}/messages'
|
|
||||||
elif target_type == 'group':
|
|
||||||
url = f'{self.base_url}/v2/groups/{target_id}/messages'
|
|
||||||
else:
|
|
||||||
raise ValueError(f'Unsupported target_type: {target_type}')
|
|
||||||
|
|
||||||
self._msg_seq_counter += 1
|
|
||||||
msg_seq = self._msg_seq_counter
|
|
||||||
body = {
|
|
||||||
'msg_type': 7,
|
|
||||||
'media': {'file_info': file_info},
|
|
||||||
'msg_seq': msg_seq,
|
|
||||||
}
|
|
||||||
if content:
|
|
||||||
body['content'] = content
|
|
||||||
if msg_id:
|
|
||||||
body['msg_id'] = msg_id
|
|
||||||
|
|
||||||
async with httpx.AsyncClient(timeout=120) as client:
|
|
||||||
headers = {
|
|
||||||
'Authorization': f'QQBot {self.access_token}',
|
|
||||||
'Content-Type': 'application/json',
|
|
||||||
}
|
|
||||||
await self.logger.info(f'Sending rich media: {json.dumps(body, ensure_ascii=False)[:200]}')
|
|
||||||
response = await client.post(url, headers=headers, json=body)
|
|
||||||
if response.status_code != 200:
|
|
||||||
raise Exception(f'Failed to send rich media message: HTTP {response.status_code} {response.text}')
|
|
||||||
|
|
||||||
async def send_image_msg(
|
|
||||||
self,
|
|
||||||
target_type: str,
|
|
||||||
target_id: str,
|
|
||||||
file_url: str = None,
|
|
||||||
file_data: str = None,
|
|
||||||
msg_id: str = None,
|
|
||||||
content: str = None,
|
|
||||||
):
|
|
||||||
"""发送图片消息"""
|
|
||||||
file_info = await self.upload_media(
|
|
||||||
target_type,
|
|
||||||
target_id,
|
|
||||||
self.MEDIA_TYPE_IMAGE,
|
|
||||||
file_url=file_url,
|
|
||||||
file_data=file_data,
|
|
||||||
)
|
|
||||||
await self._send_media_msg(target_type, target_id, file_info, msg_id, content)
|
|
||||||
|
|
||||||
async def send_voice_msg(
|
|
||||||
self,
|
|
||||||
target_type: str,
|
|
||||||
target_id: str,
|
|
||||||
file_url: str = None,
|
|
||||||
file_data: str = None,
|
|
||||||
msg_id: str = None,
|
|
||||||
):
|
|
||||||
"""发送语音消息"""
|
|
||||||
file_info = await self.upload_media(
|
|
||||||
target_type,
|
|
||||||
target_id,
|
|
||||||
self.MEDIA_TYPE_VOICE,
|
|
||||||
file_url=file_url,
|
|
||||||
file_data=file_data,
|
|
||||||
)
|
|
||||||
await self._send_media_msg(target_type, target_id, file_info, msg_id)
|
|
||||||
|
|
||||||
async def send_file_msg(
|
|
||||||
self,
|
|
||||||
target_type: str,
|
|
||||||
target_id: str,
|
|
||||||
file_url: str = None,
|
|
||||||
file_data: str = None,
|
|
||||||
file_name: str = None,
|
|
||||||
msg_id: str = None,
|
|
||||||
):
|
|
||||||
"""发送文件消息(含视频)"""
|
|
||||||
file_info = await self.upload_media(
|
|
||||||
target_type,
|
|
||||||
target_id,
|
|
||||||
self.MEDIA_TYPE_FILE,
|
|
||||||
file_url=file_url,
|
|
||||||
file_data=file_data,
|
|
||||||
file_name=file_name,
|
|
||||||
)
|
|
||||||
await self._send_media_msg(target_type, target_id, file_info, msg_id)
|
|
||||||
|
|
||||||
async def send_stream_msg(
|
|
||||||
self,
|
|
||||||
user_openid: str,
|
|
||||||
content: str,
|
|
||||||
event_id: str,
|
|
||||||
msg_id: str,
|
|
||||||
msg_seq: int = 1,
|
|
||||||
index: int = 0,
|
|
||||||
stream_msg_id: str = None,
|
|
||||||
input_state: int = 1,
|
|
||||||
):
|
|
||||||
"""发送流式消息(C2C 私聊)。
|
|
||||||
|
|
||||||
Args:
|
|
||||||
input_state: 1=生成中, 10=生成结束
|
|
||||||
"""
|
|
||||||
if not await self.check_access_token():
|
|
||||||
await self.get_access_token()
|
|
||||||
|
|
||||||
url = f'{self.base_url}/v2/users/{user_openid}/stream_messages'
|
|
||||||
body = {
|
|
||||||
'input_mode': 'replace',
|
|
||||||
'input_state': input_state,
|
|
||||||
'content_type': 'markdown',
|
|
||||||
'content_raw': content,
|
|
||||||
'event_id': event_id,
|
|
||||||
'msg_id': msg_id,
|
|
||||||
'msg_seq': msg_seq,
|
|
||||||
'index': index,
|
|
||||||
}
|
|
||||||
if stream_msg_id:
|
|
||||||
body['stream_msg_id'] = stream_msg_id
|
|
||||||
|
|
||||||
async with httpx.AsyncClient(timeout=120) as client:
|
|
||||||
headers = {
|
|
||||||
'Authorization': f'QQBot {self.access_token}',
|
|
||||||
'Content-Type': 'application/json',
|
|
||||||
}
|
|
||||||
response = await client.post(url, headers=headers, json=body)
|
|
||||||
if response.status_code != 200:
|
|
||||||
raise Exception(f'Failed to send stream message: HTTP {response.status_code} {response.text}')
|
|
||||||
return response.json()
|
|
||||||
|
|
||||||
async def is_token_expired(self):
|
async def is_token_expired(self):
|
||||||
"""检查token是否过期"""
|
"""检查token是否过期"""
|
||||||
if self.access_token_expiry_time is None:
|
if self.access_token_expiry_time is None:
|
||||||
@@ -513,325 +292,3 @@ class QQOfficialClient:
|
|||||||
'signature': signature,
|
'signature': signature,
|
||||||
}
|
}
|
||||||
return response
|
return response
|
||||||
|
|
||||||
# ---- WebSocket Gateway ----
|
|
||||||
# Reference: https://bot.q.qq.com/wiki/develop/api-v2/dev-prepare/interface-framework/event-emit.html
|
|
||||||
|
|
||||||
INTENT_GUILDS = 1 << 0
|
|
||||||
INTENT_GUILD_MEMBERS = 1 << 1
|
|
||||||
INTENT_PUBLIC_GUILD_MESSAGES = 1 << 30
|
|
||||||
INTENT_DIRECT_MESSAGE = 1 << 12
|
|
||||||
INTENT_GROUP_AND_C2C = 1 << 25
|
|
||||||
INTENT_INTERACTION = 1 << 26
|
|
||||||
|
|
||||||
FULL_INTENTS = (
|
|
||||||
INTENT_GUILDS
|
|
||||||
| INTENT_GUILD_MEMBERS
|
|
||||||
| INTENT_PUBLIC_GUILD_MESSAGES
|
|
||||||
| INTENT_DIRECT_MESSAGE
|
|
||||||
| INTENT_GROUP_AND_C2C
|
|
||||||
| INTENT_INTERACTION
|
|
||||||
)
|
|
||||||
|
|
||||||
async def get_gateway_url(self) -> str:
|
|
||||||
"""获取 WebSocket 网关地址"""
|
|
||||||
if not await self.check_access_token():
|
|
||||||
await self.get_access_token()
|
|
||||||
|
|
||||||
url = f'{self.base_url}/gateway'
|
|
||||||
async with httpx.AsyncClient() as client:
|
|
||||||
headers = {
|
|
||||||
'Authorization': f'QQBot {self.access_token}',
|
|
||||||
}
|
|
||||||
response = await client.get(url, headers=headers)
|
|
||||||
if response.status_code == 200:
|
|
||||||
data = response.json()
|
|
||||||
ws_url = data.get('url', '')
|
|
||||||
if not ws_url:
|
|
||||||
raise Exception('Gateway URL is empty')
|
|
||||||
return ws_url
|
|
||||||
else:
|
|
||||||
raise Exception(f'Failed to get Gateway URL: HTTP {response.status_code} {response.text}')
|
|
||||||
|
|
||||||
async def _background_token_refresh(self):
|
|
||||||
"""在 token 到期前主动刷新"""
|
|
||||||
try:
|
|
||||||
while True:
|
|
||||||
if self.access_token_expiry_time:
|
|
||||||
remain = self.access_token_expiry_time - time.time()
|
|
||||||
if remain > 120:
|
|
||||||
await asyncio.sleep(remain - 60)
|
|
||||||
continue
|
|
||||||
self.access_token = ''
|
|
||||||
self.access_token_expiry_time = None
|
|
||||||
if await self.check_access_token():
|
|
||||||
await asyncio.sleep(60)
|
|
||||||
else:
|
|
||||||
await self.get_access_token()
|
|
||||||
await asyncio.sleep(60)
|
|
||||||
except asyncio.CancelledError:
|
|
||||||
pass
|
|
||||||
|
|
||||||
async def connect_gateway(
|
|
||||||
self,
|
|
||||||
on_event: Callable[[str, dict], Any],
|
|
||||||
on_ready: Optional[Callable[[], Any]] = None,
|
|
||||||
on_error: Optional[Callable[[Exception], Any]] = None,
|
|
||||||
):
|
|
||||||
"""WebSocket 网关连接,含重连逻辑。持续重连直到达到最大次数或被取消。
|
|
||||||
|
|
||||||
Args:
|
|
||||||
on_event: 收到 op=0 Dispatch 事件时的回调,参数为 (event_type, event_data)
|
|
||||||
on_ready: 连接就绪 (收到 READY) 时的回调
|
|
||||||
on_error: 发生错误时的回调
|
|
||||||
"""
|
|
||||||
import websockets
|
|
||||||
|
|
||||||
session_id = ''
|
|
||||||
last_seq = 0
|
|
||||||
reconnect_attempts = 0
|
|
||||||
max_reconnect_attempts = 100
|
|
||||||
backoff_delays = [1, 2, 5, 10, 30, 60]
|
|
||||||
rate_limit_delay = 60
|
|
||||||
|
|
||||||
# Cancel previous token refresh task if any
|
|
||||||
if self._token_refresh_task and not self._token_refresh_task.done():
|
|
||||||
self._token_refresh_task.cancel()
|
|
||||||
try:
|
|
||||||
await self._token_refresh_task
|
|
||||||
except asyncio.CancelledError:
|
|
||||||
pass
|
|
||||||
self._token_refresh_task = None
|
|
||||||
|
|
||||||
while reconnect_attempts <= max_reconnect_attempts:
|
|
||||||
heartbeat_interval = 45000
|
|
||||||
should_refresh_token = False
|
|
||||||
ws = None
|
|
||||||
heartbeat_task = None
|
|
||||||
|
|
||||||
# Refresh token if needed
|
|
||||||
if should_refresh_token:
|
|
||||||
self.access_token = ''
|
|
||||||
self.access_token_expiry_time = None
|
|
||||||
|
|
||||||
try:
|
|
||||||
ws_url = await self.get_gateway_url()
|
|
||||||
await self.logger.info(f'Gateway URL obtained: {ws_url[:60]}...')
|
|
||||||
except Exception as e:
|
|
||||||
error_msg = str(e)
|
|
||||||
await self.logger.error(f'Failed to get gateway URL: {e}')
|
|
||||||
reconnect_attempts += 1
|
|
||||||
if '100017' in error_msg or '频率' in error_msg or 'Too many' in error_msg:
|
|
||||||
delay = rate_limit_delay
|
|
||||||
else:
|
|
||||||
delay = backoff_delays[min(reconnect_attempts - 1, len(backoff_delays) - 1)]
|
|
||||||
await self.logger.info(f'Reconnecting in {delay}s (attempt {reconnect_attempts})')
|
|
||||||
await asyncio.sleep(delay)
|
|
||||||
continue
|
|
||||||
|
|
||||||
try:
|
|
||||||
await self.logger.info('Connecting to WebSocket gateway...')
|
|
||||||
ws = await websockets.connect(ws_url)
|
|
||||||
await self.logger.info('WebSocket connected')
|
|
||||||
except Exception as e:
|
|
||||||
await self.logger.error(f'WebSocket connection failed: {e}')
|
|
||||||
reconnect_attempts += 1
|
|
||||||
delay = backoff_delays[min(reconnect_attempts - 1, len(backoff_delays) - 1)]
|
|
||||||
await self.logger.info(f'Reconnecting in {delay}s (attempt {reconnect_attempts})')
|
|
||||||
await asyncio.sleep(delay)
|
|
||||||
continue
|
|
||||||
|
|
||||||
try:
|
|
||||||
async for raw_msg in ws:
|
|
||||||
try:
|
|
||||||
payload = json.loads(raw_msg)
|
|
||||||
except json.JSONDecodeError:
|
|
||||||
await self.logger.error(f'Failed to parse message: {raw_msg}')
|
|
||||||
continue
|
|
||||||
|
|
||||||
op = payload.get('op')
|
|
||||||
d = payload.get('d', {})
|
|
||||||
s = payload.get('s')
|
|
||||||
t = payload.get('t')
|
|
||||||
|
|
||||||
if not isinstance(d, dict):
|
|
||||||
d = {}
|
|
||||||
|
|
||||||
if op == 10: # Hello
|
|
||||||
heartbeat_interval = d.get('heartbeat_interval', 45000)
|
|
||||||
await self.logger.info(f'Received Hello, heartbeat_interval={heartbeat_interval}ms')
|
|
||||||
|
|
||||||
# Send Identify or Resume
|
|
||||||
if session_id and last_seq > 0:
|
|
||||||
resume_payload = {
|
|
||||||
'op': 6,
|
|
||||||
'd': {
|
|
||||||
'token': f'QQBot {self.access_token}',
|
|
||||||
'session_id': session_id,
|
|
||||||
'seq': last_seq,
|
|
||||||
},
|
|
||||||
}
|
|
||||||
await ws.send(json.dumps(resume_payload))
|
|
||||||
await self.logger.info(f'Sent Resume, session_id={session_id}, seq={last_seq}')
|
|
||||||
else:
|
|
||||||
identify_payload = {
|
|
||||||
'op': 2,
|
|
||||||
'd': {
|
|
||||||
'token': f'QQBot {self.access_token}',
|
|
||||||
'intents': self.FULL_INTENTS,
|
|
||||||
'shard': [0, 1],
|
|
||||||
},
|
|
||||||
}
|
|
||||||
await ws.send(json.dumps(identify_payload))
|
|
||||||
await self.logger.info(f'Sent Identify, intents={self.FULL_INTENTS}')
|
|
||||||
|
|
||||||
# Start heartbeat
|
|
||||||
async def _heartbeat_loop(conn, interval_ms):
|
|
||||||
interval_sec = interval_ms / 1000.0
|
|
||||||
try:
|
|
||||||
while True:
|
|
||||||
await asyncio.sleep(interval_sec)
|
|
||||||
try:
|
|
||||||
hb_payload = {'op': 1, 'd': last_seq}
|
|
||||||
await conn.send(json.dumps(hb_payload))
|
|
||||||
except Exception:
|
|
||||||
break
|
|
||||||
except asyncio.CancelledError:
|
|
||||||
pass
|
|
||||||
|
|
||||||
heartbeat_task = asyncio.create_task(_heartbeat_loop(ws, heartbeat_interval))
|
|
||||||
|
|
||||||
elif op == 0: # Dispatch
|
|
||||||
if s is not None:
|
|
||||||
last_seq = s
|
|
||||||
|
|
||||||
if t == 'READY':
|
|
||||||
session_id = d.get('session_id', '')
|
|
||||||
reconnect_attempts = 0
|
|
||||||
await self.logger.info(f'READY, session_id={session_id}')
|
|
||||||
if on_ready:
|
|
||||||
try:
|
|
||||||
result = on_ready()
|
|
||||||
if asyncio.iscoroutine(result):
|
|
||||||
await result
|
|
||||||
except Exception:
|
|
||||||
pass
|
|
||||||
# Track token refresh task to avoid leaks
|
|
||||||
if self._token_refresh_task and not self._token_refresh_task.done():
|
|
||||||
self._token_refresh_task.cancel()
|
|
||||||
try:
|
|
||||||
await self._token_refresh_task
|
|
||||||
except asyncio.CancelledError:
|
|
||||||
pass
|
|
||||||
self._token_refresh_task = asyncio.create_task(self._background_token_refresh())
|
|
||||||
|
|
||||||
elif t == 'RESUMED':
|
|
||||||
reconnect_attempts = 0
|
|
||||||
await self.logger.info('RESUMED')
|
|
||||||
|
|
||||||
else:
|
|
||||||
await self.logger.debug(f'Received event: {t}, seq={s}')
|
|
||||||
if on_event:
|
|
||||||
try:
|
|
||||||
result = on_event(t, d)
|
|
||||||
if asyncio.iscoroutine(result):
|
|
||||||
await result
|
|
||||||
except Exception:
|
|
||||||
await self.logger.error(f'Error handling event {t}: {traceback.format_exc()}')
|
|
||||||
|
|
||||||
elif op == 11: # Heartbeat ACK
|
|
||||||
pass
|
|
||||||
|
|
||||||
elif op == 7: # Reconnect
|
|
||||||
await self.logger.info('Received Reconnect directive')
|
|
||||||
break
|
|
||||||
|
|
||||||
elif op == 9: # Invalid Session
|
|
||||||
can_resume = d.get('can_resume', False)
|
|
||||||
await self.logger.warning(f'Invalid Session, can_resume={can_resume}')
|
|
||||||
if not can_resume:
|
|
||||||
session_id = ''
|
|
||||||
last_seq = 0
|
|
||||||
should_refresh_token = True
|
|
||||||
break
|
|
||||||
|
|
||||||
# Connection closed normally (end of async for)
|
|
||||||
try:
|
|
||||||
close_code = ws.close_code
|
|
||||||
close_reason = ws.close_reason or ''
|
|
||||||
except Exception:
|
|
||||||
close_code = None
|
|
||||||
close_reason = ''
|
|
||||||
await self.logger.info(f'Connection closed, code={close_code}, reason={close_reason}')
|
|
||||||
|
|
||||||
if close_code == 4004:
|
|
||||||
should_refresh_token = True
|
|
||||||
elif close_code in (4006, 4007, 4009):
|
|
||||||
session_id = ''
|
|
||||||
last_seq = 0
|
|
||||||
should_refresh_token = True
|
|
||||||
elif close_code == 4008:
|
|
||||||
reconnect_attempts += 1
|
|
||||||
delay = rate_limit_delay
|
|
||||||
await self.logger.info(
|
|
||||||
f'Rate limited, waiting {delay}s before reconnect (attempt {reconnect_attempts})'
|
|
||||||
)
|
|
||||||
await asyncio.sleep(delay)
|
|
||||||
continue
|
|
||||||
elif close_code in (4914, 4915):
|
|
||||||
err = Exception(f'Bot disconnected/banned (close_code={close_code})')
|
|
||||||
if on_error:
|
|
||||||
await self._safe_callback(on_error, err)
|
|
||||||
return
|
|
||||||
elif close_code in (4900, 4901, 4902, 4903, 4904, 4905, 4906, 4907, 4908, 4909, 4910, 4911, 4912, 4913):
|
|
||||||
session_id = ''
|
|
||||||
last_seq = 0
|
|
||||||
|
|
||||||
if close_code == 1000:
|
|
||||||
return
|
|
||||||
|
|
||||||
except asyncio.CancelledError:
|
|
||||||
raise
|
|
||||||
except Exception:
|
|
||||||
await self.logger.error(f'Unexpected error in WebSocket loop: {traceback.format_exc()}')
|
|
||||||
finally:
|
|
||||||
if heartbeat_task:
|
|
||||||
heartbeat_task.cancel()
|
|
||||||
try:
|
|
||||||
await heartbeat_task
|
|
||||||
except asyncio.CancelledError:
|
|
||||||
pass
|
|
||||||
if ws:
|
|
||||||
try:
|
|
||||||
await ws.close()
|
|
||||||
except Exception:
|
|
||||||
pass
|
|
||||||
|
|
||||||
# If we reach here, we need to reconnect
|
|
||||||
reconnect_attempts += 1
|
|
||||||
if reconnect_attempts > max_reconnect_attempts:
|
|
||||||
await self.logger.error(f'Max reconnect attempts ({max_reconnect_attempts}) reached, stopping')
|
|
||||||
if on_error:
|
|
||||||
await self._safe_callback(on_error, Exception('Max reconnect attempts reached'))
|
|
||||||
return
|
|
||||||
delay = backoff_delays[min(reconnect_attempts - 1, len(backoff_delays) - 1)]
|
|
||||||
await self.logger.info(f'Reconnecting in {delay}s (attempt {reconnect_attempts})')
|
|
||||||
await asyncio.sleep(delay)
|
|
||||||
|
|
||||||
async def _safe_callback(self, callback, *args):
|
|
||||||
"""Safely invoke a callback, handling both sync and async functions."""
|
|
||||||
try:
|
|
||||||
result = callback(*args)
|
|
||||||
if asyncio.iscoroutine(result):
|
|
||||||
await result
|
|
||||||
except Exception:
|
|
||||||
pass
|
|
||||||
|
|
||||||
async def connect_gateway_loop(
|
|
||||||
self,
|
|
||||||
on_event: Callable[[str, dict], Any],
|
|
||||||
on_ready: Optional[Callable[[], Any]] = None,
|
|
||||||
on_error: Optional[Callable[[Exception], Any]] = None,
|
|
||||||
):
|
|
||||||
"""持续重连的网关循环。"""
|
|
||||||
await self.connect_gateway(on_event, on_ready, on_error)
|
|
||||||
|
|||||||
@@ -1,5 +1,3 @@
|
|||||||
from __future__ import annotations
|
|
||||||
|
|
||||||
import asyncio
|
import asyncio
|
||||||
import base64
|
import base64
|
||||||
import json
|
import json
|
||||||
@@ -9,7 +7,7 @@ import uuid
|
|||||||
import xml.etree.ElementTree as ET
|
import xml.etree.ElementTree as ET
|
||||||
from dataclasses import dataclass, field
|
from dataclasses import dataclass, field
|
||||||
import re
|
import re
|
||||||
from typing import TYPE_CHECKING, Any, Callable, Optional, Tuple
|
from typing import Any, Callable, Optional, Tuple
|
||||||
from urllib.parse import unquote
|
from urllib.parse import unquote
|
||||||
|
|
||||||
import httpx
|
import httpx
|
||||||
@@ -18,8 +16,6 @@ from quart import Quart, request, Response, jsonify
|
|||||||
|
|
||||||
from langbot.libs.wecom_ai_bot_api import wecombotevent
|
from langbot.libs.wecom_ai_bot_api import wecombotevent
|
||||||
from langbot.libs.wecom_ai_bot_api.WXBizMsgCrypt3 import WXBizMsgCrypt
|
from langbot.libs.wecom_ai_bot_api.WXBizMsgCrypt3 import WXBizMsgCrypt
|
||||||
|
|
||||||
if TYPE_CHECKING:
|
|
||||||
from langbot.pkg.platform.logger import EventLogger
|
from langbot.pkg.platform.logger import EventLogger
|
||||||
|
|
||||||
|
|
||||||
@@ -75,11 +71,6 @@ class StreamSession:
|
|||||||
class StreamSessionManager:
|
class StreamSessionManager:
|
||||||
"""管理 stream 会话的生命周期,并负责队列的生产消费。"""
|
"""管理 stream 会话的生命周期,并负责队列的生产消费。"""
|
||||||
|
|
||||||
# Sessions with registered feedback_ids use a longer TTL to survive the
|
|
||||||
# full like → cancel → dislike feedback flow. Must align with the adapter's
|
|
||||||
# _stream_to_monitoring_msg TTL (wecombot.py).
|
|
||||||
_FEEDBACK_SESSION_TTL = 600 # 10 minutes
|
|
||||||
|
|
||||||
def __init__(self, logger: EventLogger, ttl: int = 60) -> None:
|
def __init__(self, logger: EventLogger, ttl: int = 60) -> None:
|
||||||
self.logger = logger
|
self.logger = logger
|
||||||
|
|
||||||
@@ -223,17 +214,11 @@ class StreamSessionManager:
|
|||||||
session.last_access = time.time()
|
session.last_access = time.time()
|
||||||
|
|
||||||
def cleanup(self) -> None:
|
def cleanup(self) -> None:
|
||||||
"""定期清理过期会话,防止队列与映射无上限累积。
|
"""定期清理过期会话,防止队列与映射无上限累积。"""
|
||||||
|
|
||||||
已注册 feedback_id 的会话使用更长的 TTL,确保用户在点赞/取消/点踩流程中
|
|
||||||
不会因为 session 被提前清除而丢失上下文信息。
|
|
||||||
"""
|
|
||||||
now = time.time()
|
now = time.time()
|
||||||
expired: list[str] = []
|
expired: list[str] = []
|
||||||
for stream_id, session in self._sessions.items():
|
for stream_id, session in self._sessions.items():
|
||||||
# Sessions with registered feedback_ids use a longer TTL
|
if now - session.last_access > self.ttl:
|
||||||
effective_ttl = self._FEEDBACK_SESSION_TTL if session.feedback_id else self.ttl
|
|
||||||
if now - session.last_access > effective_ttl:
|
|
||||||
expired.append(stream_id)
|
expired.append(stream_id)
|
||||||
|
|
||||||
for stream_id in expired:
|
for stream_id in expired:
|
||||||
@@ -243,9 +228,6 @@ class StreamSessionManager:
|
|||||||
msg_id = session.msg_id
|
msg_id = session.msg_id
|
||||||
if msg_id and self._msg_index.get(msg_id) == stream_id:
|
if msg_id and self._msg_index.get(msg_id) == stream_id:
|
||||||
self._msg_index.pop(msg_id, None)
|
self._msg_index.pop(msg_id, None)
|
||||||
# Clean up feedback index for expired sessions
|
|
||||||
if session.feedback_id:
|
|
||||||
self._feedback_index.pop(session.feedback_id, None)
|
|
||||||
|
|
||||||
|
|
||||||
def _decrypt_file(encrypted_data: bytes, aes_key_str: str) -> bytes:
|
def _decrypt_file(encrypted_data: bytes, aes_key_str: str) -> bytes:
|
||||||
@@ -610,120 +592,6 @@ async def parse_wecom_bot_message(
|
|||||||
if msg_json.get('aibotid'):
|
if msg_json.get('aibotid'):
|
||||||
message_data['aibotid'] = msg_json.get('aibotid', '')
|
message_data['aibotid'] = msg_json.get('aibotid', '')
|
||||||
|
|
||||||
# Handle quote (referenced message) - important for group chat file references
|
|
||||||
quote_info = msg_json.get('quote')
|
|
||||||
if quote_info:
|
|
||||||
quote_data: dict[str, Any] = {}
|
|
||||||
quote_type = quote_info.get('msgtype', '')
|
|
||||||
quote_data['msgtype'] = quote_type
|
|
||||||
|
|
||||||
if quote_type == 'text':
|
|
||||||
quote_data['content'] = quote_info.get('text', {}).get('content', '')
|
|
||||||
elif quote_type == 'image':
|
|
||||||
img_info = quote_info.get('image', {})
|
|
||||||
img_url = img_info.get('url', '')
|
|
||||||
img_aeskey = img_info.get('aeskey', '')
|
|
||||||
base64_data = await _safe_download_as_data_uri(img_url, img_aeskey)
|
|
||||||
if base64_data:
|
|
||||||
quote_data['picurl'] = base64_data
|
|
||||||
quote_data['images'] = [base64_data]
|
|
||||||
elif quote_type == 'file':
|
|
||||||
file_info = quote_info.get('file', {}) or {}
|
|
||||||
download_url = file_info.get('url') or file_info.get('fileurl')
|
|
||||||
item_aeskey = file_info.get('aeskey', '')
|
|
||||||
file_data = {
|
|
||||||
'filename': file_info.get('filename') or file_info.get('name'),
|
|
||||||
'filesize': file_info.get('filesize') or file_info.get('size'),
|
|
||||||
'md5sum': file_info.get('md5sum') or file_info.get('md5'),
|
|
||||||
'sdkfileid': file_info.get('sdkfileid') or file_info.get('fileid'),
|
|
||||||
'download_url': download_url,
|
|
||||||
'extra': file_info,
|
|
||||||
}
|
|
||||||
# Same as private chat: append aeskey to download_url for plugin processing
|
|
||||||
if download_url and item_aeskey:
|
|
||||||
file_data['download_url'] = download_url + f'?aeskey={item_aeskey}'
|
|
||||||
quote_data['file'] = file_data
|
|
||||||
elif quote_type == 'voice':
|
|
||||||
voice_info = quote_info.get('voice', {}) or {}
|
|
||||||
download_url = voice_info.get('url')
|
|
||||||
item_aeskey = voice_info.get('aeskey', '')
|
|
||||||
voice_data = {
|
|
||||||
'url': download_url,
|
|
||||||
'md5sum': voice_info.get('md5sum') or voice_info.get('md5'),
|
|
||||||
'filesize': voice_info.get('filesize') or voice_info.get('size'),
|
|
||||||
'sdkfileid': voice_info.get('sdkfileid') or voice_info.get('fileid'),
|
|
||||||
}
|
|
||||||
if voice_info.get('content'):
|
|
||||||
quote_data['content'] = voice_info.get('content')
|
|
||||||
# Same as private chat: append aeskey to url for plugin processing
|
|
||||||
if download_url and item_aeskey:
|
|
||||||
voice_data['url'] = download_url + f'?aeskey={item_aeskey}'
|
|
||||||
quote_data['voice'] = voice_data
|
|
||||||
elif quote_type == 'video':
|
|
||||||
video_info = quote_info.get('video', {}) or {}
|
|
||||||
download_url = video_info.get('url')
|
|
||||||
item_aeskey = video_info.get('aeskey', '')
|
|
||||||
video_data = {
|
|
||||||
'url': download_url,
|
|
||||||
'filesize': video_info.get('filesize') or video_info.get('size'),
|
|
||||||
'sdkfileid': video_info.get('sdkfileid') or video_info.get('fileid'),
|
|
||||||
'md5sum': video_info.get('md5sum') or video_info.get('md5'),
|
|
||||||
'filename': video_info.get('filename') or video_info.get('name'),
|
|
||||||
}
|
|
||||||
# Same as private chat: append aeskey to download_url for plugin processing
|
|
||||||
if download_url and item_aeskey:
|
|
||||||
video_data['download_url'] = download_url + f'?aeskey={item_aeskey}'
|
|
||||||
quote_data['video'] = video_data
|
|
||||||
elif quote_type == 'link':
|
|
||||||
quote_data['link'] = quote_info.get('link', {})
|
|
||||||
link = quote_data['link']
|
|
||||||
title = link.get('title', '')
|
|
||||||
desc = link.get('description') or link.get('digest', '')
|
|
||||||
quote_data['content'] = '\n'.join(filter(None, [title, desc]))
|
|
||||||
elif quote_type == 'mixed':
|
|
||||||
# Handle mixed type in quote (text + images + files etc.)
|
|
||||||
items = quote_info.get('mixed', {}).get('msg_item', [])
|
|
||||||
texts = []
|
|
||||||
images = []
|
|
||||||
files = []
|
|
||||||
for item in items:
|
|
||||||
item_type = item.get('msgtype')
|
|
||||||
if item_type == 'text':
|
|
||||||
texts.append(item.get('text', {}).get('content', ''))
|
|
||||||
elif item_type == 'image':
|
|
||||||
img_info = item.get('image', {})
|
|
||||||
img_url = img_info.get('url')
|
|
||||||
img_aeskey = img_info.get('aeskey', '')
|
|
||||||
base64_data = await _safe_download_as_data_uri(img_url, img_aeskey)
|
|
||||||
if base64_data:
|
|
||||||
images.append(base64_data)
|
|
||||||
elif item_type == 'file':
|
|
||||||
file_info = item.get('file', {}) or {}
|
|
||||||
download_url = file_info.get('url') or file_info.get('fileurl')
|
|
||||||
item_aeskey = file_info.get('aeskey', '')
|
|
||||||
file_data = {
|
|
||||||
'filename': file_info.get('filename') or file_info.get('name'),
|
|
||||||
'filesize': file_info.get('filesize') or file_info.get('size'),
|
|
||||||
'md5sum': file_info.get('md5sum') or file_info.get('md5'),
|
|
||||||
'sdkfileid': file_info.get('sdkfileid') or file_info.get('fileid'),
|
|
||||||
'download_url': download_url,
|
|
||||||
'extra': file_info,
|
|
||||||
}
|
|
||||||
# Same as private chat: append aeskey to download_url for plugin processing
|
|
||||||
if download_url and item_aeskey:
|
|
||||||
file_data['download_url'] = download_url + f'?aeskey={item_aeskey}'
|
|
||||||
files.append(file_data)
|
|
||||||
if texts:
|
|
||||||
quote_data['content'] = ' '.join(texts)
|
|
||||||
if images:
|
|
||||||
quote_data['images'] = images
|
|
||||||
quote_data['picurl'] = images[0]
|
|
||||||
if files:
|
|
||||||
quote_data['files'] = files
|
|
||||||
quote_data['file'] = files[0]
|
|
||||||
|
|
||||||
message_data['quote'] = quote_data
|
|
||||||
|
|
||||||
return message_data
|
return message_data
|
||||||
|
|
||||||
|
|
||||||
@@ -1035,15 +903,10 @@ class WecomBotClient:
|
|||||||
)
|
)
|
||||||
|
|
||||||
session = self.stream_sessions.get_session_by_feedback_id(feedback_id)
|
session = self.stream_sessions.get_session_by_feedback_id(feedback_id)
|
||||||
|
|
||||||
if session:
|
if session:
|
||||||
await self.logger.info(
|
await self.logger.info(
|
||||||
f'反馈关联到会话: stream_id={session.stream_id}, msg_id={session.msg_id}, user_id={session.user_id}'
|
f'反馈关联到会话: stream_id={session.stream_id}, msg_id={session.msg_id}, user_id={session.user_id}'
|
||||||
)
|
)
|
||||||
else:
|
|
||||||
await self.logger.warning(f'未找到 feedback_id={feedback_id} 对应的会话,仍将记录反馈')
|
|
||||||
|
|
||||||
# Dispatch feedback event regardless of session availability
|
|
||||||
for handler in self._message_handlers.get('feedback', []):
|
for handler in self._message_handlers.get('feedback', []):
|
||||||
try:
|
try:
|
||||||
await handler(
|
await handler(
|
||||||
@@ -1067,6 +930,8 @@ class WecomBotClient:
|
|||||||
)
|
)
|
||||||
except Exception:
|
except Exception:
|
||||||
await self.logger.error(traceback.format_exc())
|
await self.logger.error(traceback.format_exc())
|
||||||
|
else:
|
||||||
|
await self.logger.warning(f'未找到 feedback_id={feedback_id} 对应的会话')
|
||||||
|
|
||||||
except Exception:
|
except Exception:
|
||||||
await self.logger.error(traceback.format_exc())
|
await self.logger.error(traceback.format_exc())
|
||||||
|
|||||||
@@ -147,10 +147,3 @@ class WecomBotEvent(dict):
|
|||||||
流式消息 ID
|
流式消息 ID
|
||||||
"""
|
"""
|
||||||
return self.get('stream_id', '')
|
return self.get('stream_id', '')
|
||||||
|
|
||||||
@property
|
|
||||||
def quote(self):
|
|
||||||
"""
|
|
||||||
引用消息信息(群聊中用户引用其他消息时返回)
|
|
||||||
"""
|
|
||||||
return self.get('quote', {})
|
|
||||||
|
|||||||
@@ -15,14 +15,12 @@ import json
|
|||||||
import secrets
|
import secrets
|
||||||
import time
|
import time
|
||||||
import traceback
|
import traceback
|
||||||
from typing import TYPE_CHECKING, Any, Callable, Optional
|
from typing import Any, Callable, Optional
|
||||||
|
|
||||||
import aiohttp
|
import aiohttp
|
||||||
|
|
||||||
from langbot.libs.wecom_ai_bot_api import wecombotevent
|
from langbot.libs.wecom_ai_bot_api import wecombotevent
|
||||||
from langbot.libs.wecom_ai_bot_api.api import parse_wecom_bot_message, StreamSession
|
from langbot.libs.wecom_ai_bot_api.api import parse_wecom_bot_message, StreamSession
|
||||||
|
|
||||||
if TYPE_CHECKING:
|
|
||||||
from langbot.pkg.platform.logger import EventLogger
|
from langbot.pkg.platform.logger import EventLogger
|
||||||
|
|
||||||
DEFAULT_WS_URL = 'wss://openws.work.weixin.qq.com'
|
DEFAULT_WS_URL = 'wss://openws.work.weixin.qq.com'
|
||||||
|
|||||||
@@ -207,33 +207,7 @@ class WecomCSClient:
|
|||||||
return await self.send_text_msg(open_kfid, external_userid, msgid, content)
|
return await self.send_text_msg(open_kfid, external_userid, msgid, content)
|
||||||
if data['errcode'] != 0:
|
if data['errcode'] != 0:
|
||||||
await self.logger.error(f'发送消息失败:{data}')
|
await self.logger.error(f'发送消息失败:{data}')
|
||||||
raise Exception(f'Failed to send message: {data}')
|
raise Exception('Failed to send message')
|
||||||
return data
|
|
||||||
|
|
||||||
async def send_image_msg(self, open_kfid: str, external_userid: str, msgid: str, media_id: str):
|
|
||||||
if not await self.check_access_token():
|
|
||||||
self.access_token = await self.get_access_token(self.secret)
|
|
||||||
|
|
||||||
url = f'{self.base_url}/kf/send_msg?access_token={self.access_token}'
|
|
||||||
payload = {
|
|
||||||
'touser': external_userid,
|
|
||||||
'open_kfid': open_kfid,
|
|
||||||
'msgid': msgid,
|
|
||||||
'msgtype': 'image',
|
|
||||||
'image': {
|
|
||||||
'media_id': media_id,
|
|
||||||
},
|
|
||||||
}
|
|
||||||
|
|
||||||
async with httpx.AsyncClient() as client:
|
|
||||||
response = await client.post(url, json=payload)
|
|
||||||
data = response.json()
|
|
||||||
if data['errcode'] == 40014 or data['errcode'] == 42001:
|
|
||||||
self.access_token = await self.get_access_token(self.secret)
|
|
||||||
return await self.send_image_msg(open_kfid, external_userid, msgid, media_id)
|
|
||||||
if data['errcode'] != 0:
|
|
||||||
await self.logger.error(f'发送图片消息失败:{data}')
|
|
||||||
raise Exception('Failed to send image message')
|
|
||||||
return data
|
return data
|
||||||
|
|
||||||
async def handle_callback_request(self):
|
async def handle_callback_request(self):
|
||||||
@@ -348,7 +322,7 @@ class WecomCSClient:
|
|||||||
if not await self.check_access_token():
|
if not await self.check_access_token():
|
||||||
self.access_token = await self.get_access_token(self.secret)
|
self.access_token = await self.get_access_token(self.secret)
|
||||||
|
|
||||||
url = self.base_url + '/media/upload?access_token=' + self.access_token + '&type=image'
|
url = self.base_url + '/media/upload?access_token=' + self.access_token + '&type=file'
|
||||||
file_bytes = None
|
file_bytes = None
|
||||||
file_name = 'uploaded_file.txt'
|
file_name = 'uploaded_file.txt'
|
||||||
|
|
||||||
@@ -394,7 +368,7 @@ class WecomCSClient:
|
|||||||
self.access_token = await self.get_access_token(self.secret)
|
self.access_token = await self.get_access_token(self.secret)
|
||||||
media_id = await self.upload_to_work(image)
|
media_id = await self.upload_to_work(image)
|
||||||
if data.get('errcode', 0) != 0:
|
if data.get('errcode', 0) != 0:
|
||||||
raise Exception(f'failed to upload image: {data}')
|
raise Exception('failed to upload file')
|
||||||
|
|
||||||
media_id = data.get('media_id')
|
media_id = data.get('media_id')
|
||||||
return media_id
|
return media_id
|
||||||
|
|||||||
@@ -1,4 +0,0 @@
|
|||||||
from .client import AsyncWeKnoraClient
|
|
||||||
from .errors import WeKnoraAPIError
|
|
||||||
|
|
||||||
__all__ = ['AsyncWeKnoraClient', 'WeKnoraAPIError']
|
|
||||||
@@ -1,180 +0,0 @@
|
|||||||
from __future__ import annotations
|
|
||||||
|
|
||||||
import httpx
|
|
||||||
import typing
|
|
||||||
import json
|
|
||||||
|
|
||||||
from .errors import WeKnoraAPIError
|
|
||||||
|
|
||||||
|
|
||||||
class AsyncWeKnoraClient:
|
|
||||||
"""WeKnora API 客户端"""
|
|
||||||
|
|
||||||
api_key: str
|
|
||||||
base_url: str
|
|
||||||
|
|
||||||
def __init__(
|
|
||||||
self,
|
|
||||||
api_key: str,
|
|
||||||
base_url: str = 'http://localhost:80/api/v1',
|
|
||||||
) -> None:
|
|
||||||
self.api_key = api_key
|
|
||||||
self.base_url = base_url
|
|
||||||
|
|
||||||
async def create_session(
|
|
||||||
self,
|
|
||||||
title: str = '',
|
|
||||||
description: str = '',
|
|
||||||
timeout: float = 30.0,
|
|
||||||
) -> str:
|
|
||||||
"""创建会话,返回 session_id"""
|
|
||||||
async with httpx.AsyncClient(
|
|
||||||
base_url=self.base_url,
|
|
||||||
trust_env=True,
|
|
||||||
timeout=timeout,
|
|
||||||
) as client:
|
|
||||||
payload: dict[str, typing.Any] = {}
|
|
||||||
if title:
|
|
||||||
payload['title'] = title
|
|
||||||
if description:
|
|
||||||
payload['description'] = description
|
|
||||||
|
|
||||||
response = await client.post(
|
|
||||||
'/sessions',
|
|
||||||
headers={
|
|
||||||
'X-API-Key': self.api_key,
|
|
||||||
'Content-Type': 'application/json',
|
|
||||||
},
|
|
||||||
json=payload,
|
|
||||||
)
|
|
||||||
|
|
||||||
if response.status_code not in (200, 201):
|
|
||||||
raise WeKnoraAPIError(f'{response.status_code} {response.text}')
|
|
||||||
|
|
||||||
data = response.json()
|
|
||||||
return data['data']['id']
|
|
||||||
|
|
||||||
async def agent_chat(
|
|
||||||
self,
|
|
||||||
session_id: str,
|
|
||||||
query: str,
|
|
||||||
user: str,
|
|
||||||
agent_id: str = '',
|
|
||||||
knowledge_base_ids: list[str] | None = None,
|
|
||||||
web_search_enabled: bool = False,
|
|
||||||
timeout: float = 120.0,
|
|
||||||
) -> typing.AsyncGenerator[dict[str, typing.Any], None]:
|
|
||||||
"""
|
|
||||||
Agent 智能对话(SSE 流式)
|
|
||||||
|
|
||||||
响应事件类型:
|
|
||||||
- agent_query: Agent 开始处理
|
|
||||||
- thinking: 思考过程
|
|
||||||
- tool_call: 工具调用
|
|
||||||
- tool_result: 工具结果
|
|
||||||
- references: 知识库引用
|
|
||||||
- answer: 回答内容
|
|
||||||
- reflection: 反思
|
|
||||||
- session_title: 会话标题
|
|
||||||
- error: 错误
|
|
||||||
"""
|
|
||||||
if knowledge_base_ids is None:
|
|
||||||
knowledge_base_ids = []
|
|
||||||
|
|
||||||
async with httpx.AsyncClient(
|
|
||||||
base_url=self.base_url,
|
|
||||||
trust_env=True,
|
|
||||||
timeout=timeout,
|
|
||||||
) as client:
|
|
||||||
payload: dict[str, typing.Any] = {
|
|
||||||
'query': query,
|
|
||||||
'agent_enabled': True,
|
|
||||||
'channel': 'im',
|
|
||||||
}
|
|
||||||
if agent_id:
|
|
||||||
payload['agent_id'] = agent_id
|
|
||||||
if knowledge_base_ids:
|
|
||||||
payload['knowledge_base_ids'] = knowledge_base_ids
|
|
||||||
if web_search_enabled:
|
|
||||||
payload['web_search_enabled'] = True
|
|
||||||
|
|
||||||
async with client.stream(
|
|
||||||
'POST',
|
|
||||||
f'/agent-chat/{session_id}',
|
|
||||||
headers={
|
|
||||||
'X-API-Key': self.api_key,
|
|
||||||
'Content-Type': 'application/json',
|
|
||||||
},
|
|
||||||
json=payload,
|
|
||||||
) as r:
|
|
||||||
async for chunk in r.aiter_lines():
|
|
||||||
if r.status_code != 200:
|
|
||||||
raise WeKnoraAPIError(f'{r.status_code} {chunk}')
|
|
||||||
if chunk.strip() == '':
|
|
||||||
continue
|
|
||||||
if chunk.startswith('data:'):
|
|
||||||
try:
|
|
||||||
data = json.loads(chunk[5:].strip())
|
|
||||||
except json.JSONDecodeError:
|
|
||||||
continue
|
|
||||||
yield data
|
|
||||||
# 收到 error 事件后主动结束流,避免上层未 raise 时持续等待
|
|
||||||
if data.get('response_type') == 'error':
|
|
||||||
return
|
|
||||||
|
|
||||||
async def knowledge_chat(
|
|
||||||
self,
|
|
||||||
session_id: str,
|
|
||||||
query: str,
|
|
||||||
user: str,
|
|
||||||
agent_id: str = 'builtin-quick-answer',
|
|
||||||
knowledge_base_ids: list[str] | None = None,
|
|
||||||
timeout: float = 120.0,
|
|
||||||
) -> typing.AsyncGenerator[dict[str, typing.Any], None]:
|
|
||||||
"""
|
|
||||||
知识库 RAG 问答(SSE 流式)
|
|
||||||
|
|
||||||
响应事件类型:
|
|
||||||
- references: 知识库引用
|
|
||||||
- answer: 回答内容
|
|
||||||
"""
|
|
||||||
if knowledge_base_ids is None:
|
|
||||||
knowledge_base_ids = []
|
|
||||||
|
|
||||||
async with httpx.AsyncClient(
|
|
||||||
base_url=self.base_url,
|
|
||||||
trust_env=True,
|
|
||||||
timeout=timeout,
|
|
||||||
) as client:
|
|
||||||
payload: dict[str, typing.Any] = {
|
|
||||||
'query': query,
|
|
||||||
'channel': 'im',
|
|
||||||
}
|
|
||||||
if agent_id:
|
|
||||||
payload['agent_id'] = agent_id
|
|
||||||
if knowledge_base_ids:
|
|
||||||
payload['knowledge_base_ids'] = knowledge_base_ids
|
|
||||||
|
|
||||||
async with client.stream(
|
|
||||||
'POST',
|
|
||||||
f'/knowledge-chat/{session_id}',
|
|
||||||
headers={
|
|
||||||
'X-API-Key': self.api_key,
|
|
||||||
'Content-Type': 'application/json',
|
|
||||||
},
|
|
||||||
json=payload,
|
|
||||||
) as r:
|
|
||||||
async for chunk in r.aiter_lines():
|
|
||||||
if r.status_code != 200:
|
|
||||||
raise WeKnoraAPIError(f'{r.status_code} {chunk}')
|
|
||||||
if chunk.strip() == '':
|
|
||||||
continue
|
|
||||||
if chunk.startswith('data:'):
|
|
||||||
try:
|
|
||||||
data = json.loads(chunk[5:].strip())
|
|
||||||
except json.JSONDecodeError:
|
|
||||||
continue
|
|
||||||
yield data
|
|
||||||
# 收到 error 事件后主动结束流,避免上层未 raise 时持续等待
|
|
||||||
if data.get('response_type') == 'error':
|
|
||||||
return
|
|
||||||
@@ -1,6 +0,0 @@
|
|||||||
class WeKnoraAPIError(Exception):
|
|
||||||
"""WeKnora API 请求失败"""
|
|
||||||
|
|
||||||
def __init__(self, message: str = ''):
|
|
||||||
self.message = message
|
|
||||||
super().__init__(self.message)
|
|
||||||
@@ -1,22 +0,0 @@
|
|||||||
from __future__ import annotations
|
|
||||||
|
|
||||||
from .. import group
|
|
||||||
|
|
||||||
|
|
||||||
@group.group_class('box', '/api/v1/box')
|
|
||||||
class BoxRouterGroup(group.RouterGroup):
|
|
||||||
async def initialize(self) -> None:
|
|
||||||
@self.route('/status', methods=['GET'], auth_type=group.AuthType.USER_TOKEN)
|
|
||||||
async def _() -> str:
|
|
||||||
status = await self.ap.box_service.get_status()
|
|
||||||
return self.success(data=status)
|
|
||||||
|
|
||||||
@self.route('/sessions', methods=['GET'], auth_type=group.AuthType.USER_TOKEN)
|
|
||||||
async def _() -> str:
|
|
||||||
sessions = await self.ap.box_service.get_sessions()
|
|
||||||
return self.success(data=sessions)
|
|
||||||
|
|
||||||
@self.route('/errors', methods=['GET'], auth_type=group.AuthType.USER_TOKEN)
|
|
||||||
async def _() -> str:
|
|
||||||
errors = self.ap.box_service.get_recent_errors()
|
|
||||||
return self.success(data=errors)
|
|
||||||
@@ -1,52 +0,0 @@
|
|||||||
from __future__ import annotations
|
|
||||||
|
|
||||||
import asyncio
|
|
||||||
import quart
|
|
||||||
|
|
||||||
from .. import group
|
|
||||||
|
|
||||||
|
|
||||||
@group.group_class('extensions', '/api/v1/extensions')
|
|
||||||
class ExtensionsRouterGroup(group.RouterGroup):
|
|
||||||
"""Unified API for installed extensions (plugins, MCP servers, skills)."""
|
|
||||||
|
|
||||||
async def initialize(self) -> None:
|
|
||||||
@self.route('', methods=['GET'], auth_type=group.AuthType.USER_TOKEN_OR_API_KEY)
|
|
||||||
async def _() -> quart.Response:
|
|
||||||
plugins, mcp_servers, skills = await asyncio.gather(
|
|
||||||
self.ap.plugin_connector.list_plugins(),
|
|
||||||
self.ap.mcp_service.get_mcp_servers(contain_runtime_info=True),
|
|
||||||
self.ap.skill_service.list_skills(),
|
|
||||||
return_exceptions=True,
|
|
||||||
)
|
|
||||||
|
|
||||||
def _sort_key(item: dict) -> str:
|
|
||||||
if item['type'] == 'plugin':
|
|
||||||
return (
|
|
||||||
item['plugin']
|
|
||||||
.get('manifest', {})
|
|
||||||
.get('manifest', {})
|
|
||||||
.get('metadata', {})
|
|
||||||
.get('name', '')
|
|
||||||
.lower()
|
|
||||||
)
|
|
||||||
if item['type'] == 'mcp':
|
|
||||||
return (item['server'].get('name') or '').lower()
|
|
||||||
if item['type'] == 'skill':
|
|
||||||
return (item['skill'].get('display_name') or item['skill'].get('name') or '').lower()
|
|
||||||
return ''
|
|
||||||
|
|
||||||
extensions: list[dict] = []
|
|
||||||
if isinstance(plugins, list):
|
|
||||||
for plugin in plugins:
|
|
||||||
extensions.append({'type': 'plugin', 'plugin': plugin})
|
|
||||||
if isinstance(mcp_servers, list):
|
|
||||||
for server in mcp_servers:
|
|
||||||
extensions.append({'type': 'mcp', 'server': server})
|
|
||||||
if isinstance(skills, list):
|
|
||||||
for skill in skills:
|
|
||||||
extensions.append({'type': 'skill', 'skill': skill})
|
|
||||||
|
|
||||||
extensions.sort(key=_sort_key)
|
|
||||||
|
|
||||||
return self.success(data={'extensions': extensions})
|
|
||||||
97
src/langbot/pkg/api/http/controller/groups/human_takeover.py
Normal file
97
src/langbot/pkg/api/http/controller/groups/human_takeover.py
Normal file
@@ -0,0 +1,97 @@
|
|||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
import quart
|
||||||
|
|
||||||
|
from .. import group
|
||||||
|
|
||||||
|
|
||||||
|
@group.group_class('human-takeover', '/api/v1/human-takeover')
|
||||||
|
class HumanTakeoverRouterGroup(group.RouterGroup):
|
||||||
|
async def initialize(self) -> None:
|
||||||
|
@self.route('/sessions', methods=['GET'], auth_type=group.AuthType.USER_TOKEN)
|
||||||
|
async def get_sessions():
|
||||||
|
"""Get list of takeover sessions, optionally filtered by bot UUID."""
|
||||||
|
bot_uuid = quart.request.args.get('botUuid')
|
||||||
|
limit = int(quart.request.args.get('limit', 100))
|
||||||
|
offset = int(quart.request.args.get('offset', 0))
|
||||||
|
|
||||||
|
sessions, total = await self.ap.human_takeover_service.get_active_sessions(
|
||||||
|
bot_uuid=bot_uuid if bot_uuid else None,
|
||||||
|
limit=limit,
|
||||||
|
offset=offset,
|
||||||
|
)
|
||||||
|
|
||||||
|
return self.success(
|
||||||
|
data={
|
||||||
|
'sessions': sessions,
|
||||||
|
'total': total,
|
||||||
|
'limit': limit,
|
||||||
|
'offset': offset,
|
||||||
|
}
|
||||||
|
)
|
||||||
|
|
||||||
|
@self.route('/sessions/<session_id>', methods=['GET'], auth_type=group.AuthType.USER_TOKEN)
|
||||||
|
async def get_session_detail(session_id: str):
|
||||||
|
"""Get detail for a specific takeover session."""
|
||||||
|
detail = await self.ap.human_takeover_service.get_session_detail(session_id)
|
||||||
|
if not detail:
|
||||||
|
return self.success(data={'found': False, 'session_id': session_id})
|
||||||
|
return self.success(data={'found': True, 'session': detail})
|
||||||
|
|
||||||
|
@self.route('/sessions/<session_id>/takeover', methods=['POST'], auth_type=group.AuthType.USER_TOKEN)
|
||||||
|
async def takeover_session(session_id: str, user_email: str = None):
|
||||||
|
"""Take over a conversation session."""
|
||||||
|
data = await quart.request.get_json(silent=True) or {}
|
||||||
|
|
||||||
|
bot_uuid = data.get('bot_uuid')
|
||||||
|
if not bot_uuid:
|
||||||
|
return self.fail(-1, 'bot_uuid is required')
|
||||||
|
|
||||||
|
platform = data.get('platform')
|
||||||
|
user_id = data.get('user_id')
|
||||||
|
user_name = data.get('user_name')
|
||||||
|
|
||||||
|
try:
|
||||||
|
result = await self.ap.human_takeover_service.takeover_session(
|
||||||
|
session_id=session_id,
|
||||||
|
bot_uuid=bot_uuid,
|
||||||
|
taken_by=user_email or data.get('taken_by'),
|
||||||
|
platform=platform,
|
||||||
|
user_id=user_id,
|
||||||
|
user_name=user_name,
|
||||||
|
)
|
||||||
|
return self.success(data=result)
|
||||||
|
except ValueError as e:
|
||||||
|
return self.fail(-1, str(e))
|
||||||
|
|
||||||
|
@self.route('/sessions/<session_id>/release', methods=['POST'], auth_type=group.AuthType.USER_TOKEN)
|
||||||
|
async def release_session(session_id: str):
|
||||||
|
"""Release a taken-over session back to AI pipeline."""
|
||||||
|
try:
|
||||||
|
result = await self.ap.human_takeover_service.release_session(session_id)
|
||||||
|
return self.success(data=result)
|
||||||
|
except ValueError as e:
|
||||||
|
return self.fail(-1, str(e))
|
||||||
|
|
||||||
|
@self.route('/sessions/<session_id>/message', methods=['POST'], auth_type=group.AuthType.USER_TOKEN)
|
||||||
|
async def send_message(session_id: str, user_email: str = None):
|
||||||
|
"""Send a message from the operator to the user."""
|
||||||
|
data = await quart.request.get_json(silent=True) or {}
|
||||||
|
|
||||||
|
message_text = data.get('message')
|
||||||
|
if not message_text:
|
||||||
|
return self.fail(-1, 'message is required')
|
||||||
|
|
||||||
|
operator_name = user_email or data.get('operator_name', 'Operator')
|
||||||
|
|
||||||
|
try:
|
||||||
|
result = await self.ap.human_takeover_service.send_message(
|
||||||
|
session_id=session_id,
|
||||||
|
message_text=message_text,
|
||||||
|
operator_name=operator_name,
|
||||||
|
)
|
||||||
|
return self.success(data=result)
|
||||||
|
except ValueError as e:
|
||||||
|
return self.fail(-1, str(e))
|
||||||
|
except RuntimeError as e:
|
||||||
|
return self.fail(-2, str(e))
|
||||||
@@ -1,384 +0,0 @@
|
|||||||
"""Embed widget routes - serve embeddable chat widget for external websites.
|
|
||||||
|
|
||||||
All user-facing URLs are keyed by **bot_uuid** (not pipeline_uuid) so that
|
|
||||||
internal pipeline identifiers are never exposed to end-users. Each handler
|
|
||||||
resolves the bot_uuid to the owning ``web_page_bot`` RuntimeBot and extracts
|
|
||||||
the bound pipeline_uuid for internal routing.
|
|
||||||
"""
|
|
||||||
|
|
||||||
import asyncio
|
|
||||||
import datetime
|
|
||||||
import json
|
|
||||||
import logging
|
|
||||||
import uuid
|
|
||||||
import hmac
|
|
||||||
import hashlib
|
|
||||||
import time
|
|
||||||
import re
|
|
||||||
import httpx
|
|
||||||
|
|
||||||
import quart
|
|
||||||
|
|
||||||
from ... import group
|
|
||||||
from ......utils import paths
|
|
||||||
from ......platform.sources.websocket_manager import ws_connection_manager
|
|
||||||
|
|
||||||
logger = logging.getLogger(__name__)
|
|
||||||
|
|
||||||
# Cache the widget template content
|
|
||||||
_widget_template_cache: str | None = None
|
|
||||||
_logo_bytes_cache: bytes | None = None
|
|
||||||
|
|
||||||
|
|
||||||
def _is_valid_uuid(s: str) -> bool:
|
|
||||||
return bool(re.match(r'^[a-f0-9]{8}-[a-f0-9]{4}-[a-f0-9]{4}-[a-f0-9]{4}-[a-f0-9]{12}$', s))
|
|
||||||
|
|
||||||
|
|
||||||
def _get_widget_template() -> str:
|
|
||||||
"""Load and cache the widget JS template."""
|
|
||||||
global _widget_template_cache
|
|
||||||
if _widget_template_cache is None:
|
|
||||||
template_path = paths.get_resource_path('templates/embed/widget.js')
|
|
||||||
with open(template_path, 'r', encoding='utf-8') as f:
|
|
||||||
_widget_template_cache = f.read()
|
|
||||||
return _widget_template_cache
|
|
||||||
|
|
||||||
|
|
||||||
def _get_logo_bytes() -> bytes:
|
|
||||||
"""Load and cache the logo image."""
|
|
||||||
global _logo_bytes_cache
|
|
||||||
if _logo_bytes_cache is None:
|
|
||||||
logo_path = paths.get_resource_path('templates/embed/logo.webp')
|
|
||||||
with open(logo_path, 'rb') as f:
|
|
||||||
_logo_bytes_cache = f.read()
|
|
||||||
return _logo_bytes_cache
|
|
||||||
|
|
||||||
|
|
||||||
@group.group_class('embed', '/api/v1/embed')
|
|
||||||
class EmbedRouterGroup(group.RouterGroup):
|
|
||||||
# -- helpers -------------------------------------------------------------
|
|
||||||
|
|
||||||
def _resolve_bot(self, bot_uuid: str):
|
|
||||||
"""Resolve *bot_uuid* to ``(runtime_bot, pipeline_uuid)``.
|
|
||||||
|
|
||||||
Returns ``(None, None)`` when the bot does not exist, is not a
|
|
||||||
``web_page_bot``, is disabled, or has no pipeline bound.
|
|
||||||
"""
|
|
||||||
for bot in self.ap.platform_mgr.bots:
|
|
||||||
if (
|
|
||||||
bot.bot_entity.uuid == bot_uuid
|
|
||||||
and bot.bot_entity.adapter == 'web_page_bot'
|
|
||||||
and bot.bot_entity.enable
|
|
||||||
and bot.bot_entity.use_pipeline_uuid
|
|
||||||
):
|
|
||||||
return bot, bot.bot_entity.use_pipeline_uuid
|
|
||||||
return None, None
|
|
||||||
|
|
||||||
def _get_bot_config(self, bot_uuid: str) -> dict:
|
|
||||||
for bot in self.ap.platform_mgr.bots:
|
|
||||||
if bot.bot_entity.uuid == bot_uuid and bot.bot_entity.adapter == 'web_page_bot':
|
|
||||||
return bot.bot_entity.adapter_config
|
|
||||||
return {}
|
|
||||||
|
|
||||||
async def _verify_session_token(self, request, bot_uuid: str) -> bool:
|
|
||||||
config = self._get_bot_config(bot_uuid)
|
|
||||||
secret = config.get('turnstile_secret_key', '')
|
|
||||||
if not secret:
|
|
||||||
return True
|
|
||||||
auth_header = request.headers.get('Authorization', '')
|
|
||||||
if not auth_header.startswith('Bearer '):
|
|
||||||
return False
|
|
||||||
token = auth_header[7:]
|
|
||||||
try:
|
|
||||||
ts_str, mac = token.split('.', 1)
|
|
||||||
ts = float(ts_str)
|
|
||||||
if time.time() - ts > 86400:
|
|
||||||
return False
|
|
||||||
expected_mac = hmac.new(secret.encode(), f'{ts_str}'.encode(), hashlib.sha256).hexdigest()
|
|
||||||
return hmac.compare_digest(mac, expected_mac)
|
|
||||||
except Exception:
|
|
||||||
return False
|
|
||||||
|
|
||||||
# -- routes --------------------------------------------------------------
|
|
||||||
|
|
||||||
async def initialize(self) -> None:
|
|
||||||
@self.route('/<bot_uuid>/turnstile/verify', methods=['POST'], auth_type=group.AuthType.NONE)
|
|
||||||
async def verify_turnstile(bot_uuid: str) -> str:
|
|
||||||
if not _is_valid_uuid(bot_uuid):
|
|
||||||
return self.http_status(400, -1, 'Invalid bot_uuid format')
|
|
||||||
runtime_bot, pipeline_uuid = self._resolve_bot(bot_uuid)
|
|
||||||
if runtime_bot is None:
|
|
||||||
return self.http_status(404, -1, 'Bot not found or not available')
|
|
||||||
try:
|
|
||||||
data = await quart.request.get_json()
|
|
||||||
token = data.get('token')
|
|
||||||
if not token:
|
|
||||||
return self.http_status(400, -1, 'Token is required')
|
|
||||||
|
|
||||||
config = self._get_bot_config(bot_uuid)
|
|
||||||
secret = config.get('turnstile_secret_key', '')
|
|
||||||
if not secret:
|
|
||||||
ts = time.time()
|
|
||||||
return self.success(data={'token': f'{ts}.dummy'})
|
|
||||||
|
|
||||||
async with httpx.AsyncClient() as client:
|
|
||||||
resp = await client.post(
|
|
||||||
'https://challenges.cloudflare.com/turnstile/v0/siteverify',
|
|
||||||
data={'secret': secret, 'response': token},
|
|
||||||
)
|
|
||||||
result = resp.json()
|
|
||||||
|
|
||||||
if not result.get('success'):
|
|
||||||
return self.http_status(403, -1, 'Turnstile verification failed')
|
|
||||||
|
|
||||||
ts = time.time()
|
|
||||||
mac = hmac.new(secret.encode(), f'{ts}'.encode(), hashlib.sha256).hexdigest()
|
|
||||||
session_token = f'{ts}.{mac}'
|
|
||||||
|
|
||||||
return self.success(data={'token': session_token})
|
|
||||||
|
|
||||||
except Exception as e:
|
|
||||||
logger.error(f'Turnstile verify failed: {e}', exc_info=True)
|
|
||||||
return self.http_status(500, -1, 'Internal server error')
|
|
||||||
|
|
||||||
@self.route('/<bot_uuid>/widget.js', methods=['GET'], auth_type=group.AuthType.NONE)
|
|
||||||
async def serve_widget(bot_uuid: str) -> quart.Response:
|
|
||||||
"""Serve the embed widget JavaScript with injected configuration."""
|
|
||||||
if not _is_valid_uuid(bot_uuid):
|
|
||||||
return self.http_status(400, -1, 'Invalid bot_uuid format')
|
|
||||||
runtime_bot, pipeline_uuid = self._resolve_bot(bot_uuid)
|
|
||||||
if runtime_bot is None:
|
|
||||||
return quart.Response(
|
|
||||||
'// Bot not found or not available', status=404, content_type='application/javascript'
|
|
||||||
)
|
|
||||||
try:
|
|
||||||
template = _get_widget_template()
|
|
||||||
except FileNotFoundError:
|
|
||||||
return quart.Response('// Widget template not found', status=404, content_type='application/javascript')
|
|
||||||
|
|
||||||
base_url = quart.request.host_url.rstrip('/')
|
|
||||||
webhook_prefix = self.ap.instance_config.data.get('api', {}).get('webhook_prefix', '')
|
|
||||||
if webhook_prefix:
|
|
||||||
base_url = webhook_prefix.rstrip('/')
|
|
||||||
|
|
||||||
if not re.match(r'^https?://[a-zA-Z0-9._:/-]+$', base_url):
|
|
||||||
base_url = quart.request.host_url.rstrip('/')
|
|
||||||
|
|
||||||
config = self._get_bot_config(bot_uuid)
|
|
||||||
site_key = config.get('turnstile_site_key', '')
|
|
||||||
locale = config.get('language', 'en_US') or 'en_US'
|
|
||||||
bubble_icon = config.get('bubble_icon', 'logo') or 'logo'
|
|
||||||
widget_js = template.replace('__LANGBOT_TURNSTILE_SITE_KEY__', site_key)
|
|
||||||
widget_js = widget_js.replace('__LANGBOT_BOT_UUID__', bot_uuid)
|
|
||||||
widget_js = widget_js.replace('__LANGBOT_BASE_URL__', base_url)
|
|
||||||
widget_js = widget_js.replace('__LANGBOT_LOCALE__', locale)
|
|
||||||
widget_js = widget_js.replace('__LANGBOT_BUBBLE_ICON__', bubble_icon)
|
|
||||||
|
|
||||||
response = quart.Response(widget_js, content_type='application/javascript; charset=utf-8')
|
|
||||||
response.headers['Cache-Control'] = 'public, max-age=300'
|
|
||||||
return response
|
|
||||||
|
|
||||||
@self.route('/logo', methods=['GET'], auth_type=group.AuthType.NONE)
|
|
||||||
async def serve_logo() -> quart.Response:
|
|
||||||
"""Serve the LangBot logo for the embed widget."""
|
|
||||||
try:
|
|
||||||
logo_data = _get_logo_bytes()
|
|
||||||
except FileNotFoundError:
|
|
||||||
return quart.Response('', status=404)
|
|
||||||
|
|
||||||
response = quart.Response(logo_data, content_type='image/webp')
|
|
||||||
response.headers['Cache-Control'] = 'public, max-age=86400'
|
|
||||||
return response
|
|
||||||
|
|
||||||
@self.route('/<bot_uuid>/messages/<session_type>', methods=['GET'], auth_type=group.AuthType.NONE)
|
|
||||||
async def get_embed_messages(bot_uuid: str, session_type: str) -> str:
|
|
||||||
if not _is_valid_uuid(bot_uuid):
|
|
||||||
return self.http_status(400, -1, 'Invalid bot_uuid format')
|
|
||||||
runtime_bot, pipeline_uuid = self._resolve_bot(bot_uuid)
|
|
||||||
if runtime_bot is None:
|
|
||||||
return self.http_status(404, -1, 'Bot not found or not available')
|
|
||||||
if not await self._verify_session_token(quart.request, bot_uuid):
|
|
||||||
return self.http_status(403, -1, 'Unauthorized or session expired')
|
|
||||||
try:
|
|
||||||
if session_type not in ['person', 'group']:
|
|
||||||
return self.http_status(400, -1, 'session_type must be person or group')
|
|
||||||
|
|
||||||
websocket_adapter = self.ap.platform_mgr.websocket_proxy_bot.adapter
|
|
||||||
if not websocket_adapter:
|
|
||||||
return self.http_status(404, -1, 'WebSocket adapter not found')
|
|
||||||
|
|
||||||
messages = websocket_adapter.get_websocket_messages(pipeline_uuid, session_type)
|
|
||||||
return self.success(data={'messages': messages})
|
|
||||||
|
|
||||||
except Exception as e:
|
|
||||||
logger.error(f'Failed to get embed messages: {e}', exc_info=True)
|
|
||||||
return self.http_status(500, -1, 'Internal server error')
|
|
||||||
|
|
||||||
@self.route('/<bot_uuid>/reset/<session_type>', methods=['POST'], auth_type=group.AuthType.NONE)
|
|
||||||
async def reset_embed_session(bot_uuid: str, session_type: str) -> str:
|
|
||||||
if not _is_valid_uuid(bot_uuid):
|
|
||||||
return self.http_status(400, -1, 'Invalid bot_uuid format')
|
|
||||||
runtime_bot, pipeline_uuid = self._resolve_bot(bot_uuid)
|
|
||||||
if runtime_bot is None:
|
|
||||||
return self.http_status(404, -1, 'Bot not found or not available')
|
|
||||||
if not await self._verify_session_token(quart.request, bot_uuid):
|
|
||||||
return self.http_status(403, -1, 'Unauthorized or session expired')
|
|
||||||
try:
|
|
||||||
if session_type not in ['person', 'group']:
|
|
||||||
return self.http_status(400, -1, 'session_type must be person or group')
|
|
||||||
|
|
||||||
websocket_adapter = self.ap.platform_mgr.websocket_proxy_bot.adapter
|
|
||||||
if not websocket_adapter:
|
|
||||||
return self.http_status(404, -1, 'WebSocket adapter not found')
|
|
||||||
|
|
||||||
websocket_adapter.reset_session(pipeline_uuid, session_type)
|
|
||||||
return self.success(data={'message': 'Session reset successfully'})
|
|
||||||
|
|
||||||
except Exception as e:
|
|
||||||
logger.error(f'Failed to reset embed session: {e}', exc_info=True)
|
|
||||||
return self.http_status(500, -1, 'Internal server error')
|
|
||||||
|
|
||||||
@self.route('/<bot_uuid>/feedback', methods=['POST'], auth_type=group.AuthType.NONE)
|
|
||||||
async def submit_feedback(bot_uuid: str) -> str:
|
|
||||||
if not _is_valid_uuid(bot_uuid):
|
|
||||||
return self.http_status(400, -1, 'Invalid bot_uuid format')
|
|
||||||
runtime_bot, pipeline_uuid = self._resolve_bot(bot_uuid)
|
|
||||||
if runtime_bot is None:
|
|
||||||
return self.http_status(404, -1, 'Bot not found or not available')
|
|
||||||
if not await self._verify_session_token(quart.request, bot_uuid):
|
|
||||||
return self.http_status(403, -1, 'Unauthorized or session expired')
|
|
||||||
try:
|
|
||||||
data = await quart.request.get_json()
|
|
||||||
message_id = data.get('message_id', '')
|
|
||||||
feedback_type = data.get('feedback_type')
|
|
||||||
|
|
||||||
if feedback_type not in (1, 2, 3):
|
|
||||||
return self.http_status(400, -1, 'feedback_type must be 1 (like), 2 (dislike), or 3 (cancel)')
|
|
||||||
|
|
||||||
feedback_id = f'embed_{uuid.uuid4().hex[:12]}'
|
|
||||||
|
|
||||||
await self.ap.monitoring_service.record_feedback(
|
|
||||||
feedback_id=feedback_id,
|
|
||||||
feedback_type=feedback_type,
|
|
||||||
bot_id=runtime_bot.bot_entity.uuid,
|
|
||||||
bot_name=runtime_bot.bot_entity.name or bot_uuid,
|
|
||||||
pipeline_id=pipeline_uuid,
|
|
||||||
message_id=str(message_id),
|
|
||||||
platform='web_page_bot',
|
|
||||||
)
|
|
||||||
|
|
||||||
return self.success(data={'feedback_id': feedback_id})
|
|
||||||
|
|
||||||
except Exception as e:
|
|
||||||
logger.error(f'Failed to record feedback: {e}', exc_info=True)
|
|
||||||
return self.http_status(500, -1, 'Internal server error')
|
|
||||||
|
|
||||||
# -- Embed WebSocket endpoint ----------------------------------------
|
|
||||||
|
|
||||||
@self.quart_app.websocket(self.path + '/<bot_uuid>/ws/connect')
|
|
||||||
async def embed_websocket_connect(bot_uuid: str):
|
|
||||||
"""WebSocket connection for embed widget, keyed by bot_uuid."""
|
|
||||||
if not _is_valid_uuid(bot_uuid):
|
|
||||||
await quart.websocket.send(json.dumps({'type': 'error', 'message': 'Invalid bot_uuid format'}))
|
|
||||||
return
|
|
||||||
|
|
||||||
runtime_bot, pipeline_uuid = self._resolve_bot(bot_uuid)
|
|
||||||
if runtime_bot is None:
|
|
||||||
await quart.websocket.send(json.dumps({'type': 'error', 'message': 'Bot not found or not available'}))
|
|
||||||
return
|
|
||||||
|
|
||||||
session_type = quart.websocket.args.get('session_type', 'person')
|
|
||||||
if session_type not in ['person', 'group']:
|
|
||||||
await quart.websocket.send(
|
|
||||||
json.dumps({'type': 'error', 'message': 'session_type must be person or group'})
|
|
||||||
)
|
|
||||||
return
|
|
||||||
|
|
||||||
websocket_adapter = self.ap.platform_mgr.websocket_proxy_bot.adapter
|
|
||||||
if not websocket_adapter:
|
|
||||||
await quart.websocket.send(json.dumps({'type': 'error', 'message': 'WebSocket adapter not found'}))
|
|
||||||
return
|
|
||||||
|
|
||||||
try:
|
|
||||||
connection = await ws_connection_manager.add_connection(
|
|
||||||
websocket=quart.websocket._get_current_object(),
|
|
||||||
pipeline_uuid=pipeline_uuid,
|
|
||||||
session_type=session_type,
|
|
||||||
metadata={'user_agent': quart.websocket.headers.get('User-Agent', '')},
|
|
||||||
)
|
|
||||||
|
|
||||||
await quart.websocket.send(
|
|
||||||
json.dumps(
|
|
||||||
{
|
|
||||||
'type': 'connected',
|
|
||||||
'connection_id': connection.connection_id,
|
|
||||||
'bot_uuid': bot_uuid,
|
|
||||||
'session_type': session_type,
|
|
||||||
'timestamp': connection.created_at.isoformat(),
|
|
||||||
}
|
|
||||||
)
|
|
||||||
)
|
|
||||||
|
|
||||||
logger.debug(
|
|
||||||
f'Embed WebSocket connected: {connection.connection_id} '
|
|
||||||
f'(bot={bot_uuid}, pipeline={pipeline_uuid}, session_type={session_type})'
|
|
||||||
)
|
|
||||||
|
|
||||||
receive_task = asyncio.create_task(self._handle_receive(connection, websocket_adapter, runtime_bot))
|
|
||||||
send_task = asyncio.create_task(self._handle_send(connection))
|
|
||||||
|
|
||||||
try:
|
|
||||||
await asyncio.gather(receive_task, send_task)
|
|
||||||
except Exception as e:
|
|
||||||
logger.error(f'Embed WebSocket task error: {e}')
|
|
||||||
finally:
|
|
||||||
await ws_connection_manager.remove_connection(connection.connection_id)
|
|
||||||
|
|
||||||
except Exception as e:
|
|
||||||
logger.error(f'Embed WebSocket connection error: {e}', exc_info=True)
|
|
||||||
try:
|
|
||||||
await quart.websocket.send(json.dumps({'type': 'error', 'message': 'Internal server error'}))
|
|
||||||
except Exception:
|
|
||||||
pass
|
|
||||||
|
|
||||||
# -- WebSocket receive/send helpers --------------------------------------
|
|
||||||
|
|
||||||
async def _handle_receive(self, connection, websocket_adapter, owner_bot):
|
|
||||||
try:
|
|
||||||
while connection.is_active:
|
|
||||||
message = await quart.websocket.receive()
|
|
||||||
await ws_connection_manager.update_activity(connection.connection_id)
|
|
||||||
|
|
||||||
try:
|
|
||||||
data = json.loads(message)
|
|
||||||
message_type = data.get('type', 'message')
|
|
||||||
|
|
||||||
if message_type == 'ping':
|
|
||||||
await connection.send_queue.put(
|
|
||||||
{'type': 'pong', 'timestamp': datetime.datetime.now().isoformat()}
|
|
||||||
)
|
|
||||||
elif message_type == 'message':
|
|
||||||
await websocket_adapter.handle_websocket_message(connection, data, owner_bot=owner_bot)
|
|
||||||
elif message_type == 'disconnect':
|
|
||||||
break
|
|
||||||
|
|
||||||
except json.JSONDecodeError:
|
|
||||||
await connection.send_queue.put({'type': 'error', 'message': 'Invalid JSON format'})
|
|
||||||
|
|
||||||
except Exception as e:
|
|
||||||
logger.error(f'Embed receive error: {e}', exc_info=True)
|
|
||||||
finally:
|
|
||||||
connection.is_active = False
|
|
||||||
|
|
||||||
async def _handle_send(self, connection):
|
|
||||||
try:
|
|
||||||
while connection.is_active:
|
|
||||||
try:
|
|
||||||
message = await asyncio.wait_for(connection.send_queue.get(), timeout=1.0)
|
|
||||||
await quart.websocket.send(json.dumps(message))
|
|
||||||
except asyncio.TimeoutError:
|
|
||||||
continue
|
|
||||||
except Exception as e:
|
|
||||||
logger.error(f'Embed send error: {e}', exc_info=True)
|
|
||||||
finally:
|
|
||||||
connection.is_active = False
|
|
||||||
@@ -73,21 +73,15 @@ class PipelinesRouterGroup(group.RouterGroup):
|
|||||||
plugins = await self.ap.plugin_connector.list_plugins(component_kinds=pipeline_component_kinds)
|
plugins = await self.ap.plugin_connector.list_plugins(component_kinds=pipeline_component_kinds)
|
||||||
mcp_servers = await self.ap.mcp_service.get_mcp_servers(contain_runtime_info=True)
|
mcp_servers = await self.ap.mcp_service.get_mcp_servers(contain_runtime_info=True)
|
||||||
|
|
||||||
# Get available skills
|
|
||||||
available_skills = await self.ap.skill_service.list_skills()
|
|
||||||
|
|
||||||
extensions_prefs = pipeline.get('extensions_preferences', {})
|
extensions_prefs = pipeline.get('extensions_preferences', {})
|
||||||
return self.success(
|
return self.success(
|
||||||
data={
|
data={
|
||||||
'enable_all_plugins': extensions_prefs.get('enable_all_plugins', True),
|
'enable_all_plugins': extensions_prefs.get('enable_all_plugins', True),
|
||||||
'enable_all_mcp_servers': extensions_prefs.get('enable_all_mcp_servers', True),
|
'enable_all_mcp_servers': extensions_prefs.get('enable_all_mcp_servers', True),
|
||||||
'enable_all_skills': extensions_prefs.get('enable_all_skills', True),
|
|
||||||
'bound_plugins': extensions_prefs.get('plugins', []),
|
'bound_plugins': extensions_prefs.get('plugins', []),
|
||||||
'available_plugins': plugins,
|
'available_plugins': plugins,
|
||||||
'bound_mcp_servers': extensions_prefs.get('mcp_servers', []),
|
'bound_mcp_servers': extensions_prefs.get('mcp_servers', []),
|
||||||
'available_mcp_servers': mcp_servers,
|
'available_mcp_servers': mcp_servers,
|
||||||
'bound_skills': extensions_prefs.get('skills', []),
|
|
||||||
'available_skills': available_skills,
|
|
||||||
}
|
}
|
||||||
)
|
)
|
||||||
elif quart.request.method == 'PUT':
|
elif quart.request.method == 'PUT':
|
||||||
@@ -95,19 +89,11 @@ class PipelinesRouterGroup(group.RouterGroup):
|
|||||||
json_data = await quart.request.json
|
json_data = await quart.request.json
|
||||||
enable_all_plugins = json_data.get('enable_all_plugins', True)
|
enable_all_plugins = json_data.get('enable_all_plugins', True)
|
||||||
enable_all_mcp_servers = json_data.get('enable_all_mcp_servers', True)
|
enable_all_mcp_servers = json_data.get('enable_all_mcp_servers', True)
|
||||||
enable_all_skills = json_data.get('enable_all_skills', True)
|
|
||||||
bound_plugins = json_data.get('bound_plugins', [])
|
bound_plugins = json_data.get('bound_plugins', [])
|
||||||
bound_mcp_servers = json_data.get('bound_mcp_servers', [])
|
bound_mcp_servers = json_data.get('bound_mcp_servers', [])
|
||||||
bound_skills = json_data.get('bound_skills', [])
|
|
||||||
|
|
||||||
await self.ap.pipeline_service.update_pipeline_extensions(
|
await self.ap.pipeline_service.update_pipeline_extensions(
|
||||||
pipeline_uuid,
|
pipeline_uuid, bound_plugins, bound_mcp_servers, enable_all_plugins, enable_all_mcp_servers
|
||||||
bound_plugins,
|
|
||||||
bound_mcp_servers,
|
|
||||||
enable_all_plugins,
|
|
||||||
enable_all_mcp_servers,
|
|
||||||
bound_skills=bound_skills,
|
|
||||||
enable_all_skills=enable_all_skills,
|
|
||||||
)
|
)
|
||||||
|
|
||||||
return self.success()
|
return self.success()
|
||||||
|
|||||||
@@ -43,13 +43,6 @@ class WebSocketChatRouterGroup(group.RouterGroup):
|
|||||||
await quart.websocket.send(json.dumps({'type': 'error', 'message': 'WebSocket adapter not found'}))
|
await quart.websocket.send(json.dumps({'type': 'error', 'message': 'WebSocket adapter not found'}))
|
||||||
return
|
return
|
||||||
|
|
||||||
# Dashboard pipeline-debug sessions must always run under the
|
|
||||||
# built-in websocket_proxy_bot identity. We deliberately do NOT
|
|
||||||
# resolve a web_page_bot owner here — even if one is bound to
|
|
||||||
# the same pipeline, debug requests must not be attributed to
|
|
||||||
# it. The embed widget path (`/api/v1/embed/<bot>/ws/connect`)
|
|
||||||
# is the one that carries the page-bot identity.
|
|
||||||
|
|
||||||
# 注册连接
|
# 注册连接
|
||||||
connection = await ws_connection_manager.add_connection(
|
connection = await ws_connection_manager.add_connection(
|
||||||
websocket=quart.websocket._get_current_object(),
|
websocket=quart.websocket._get_current_object(),
|
||||||
@@ -210,9 +203,6 @@ class WebSocketChatRouterGroup(group.RouterGroup):
|
|||||||
logger.debug(f'收到消息: {data} from {connection.connection_id}')
|
logger.debug(f'收到消息: {data} from {connection.connection_id}')
|
||||||
|
|
||||||
# 处理消息(不等待响应,响应会通过broadcast异步发送)
|
# 处理消息(不等待响应,响应会通过broadcast异步发送)
|
||||||
# owner_bot is intentionally NOT passed: the dashboard
|
|
||||||
# debug WebSocket must always run under the proxy bot,
|
|
||||||
# never under a coincidentally-bound web_page_bot.
|
|
||||||
await websocket_adapter.handle_websocket_message(connection, data)
|
await websocket_adapter.handle_websocket_message(connection, data)
|
||||||
|
|
||||||
elif message_type == 'disconnect':
|
elif message_type == 'disconnect':
|
||||||
|
|||||||
@@ -1,6 +1,5 @@
|
|||||||
import quart
|
import quart
|
||||||
import mimetypes
|
import mimetypes
|
||||||
import asyncio
|
|
||||||
from ... import group
|
from ... import group
|
||||||
from langbot.pkg.utils import importutil
|
from langbot.pkg.utils import importutil
|
||||||
|
|
||||||
@@ -36,617 +35,3 @@ class AdaptersRouterGroup(group.RouterGroup):
|
|||||||
return quart.Response(
|
return quart.Response(
|
||||||
importutil.read_resource_file_bytes(icon_path), mimetype=mimetypes.guess_type(icon_path)[0]
|
importutil.read_resource_file_bytes(icon_path), mimetype=mimetypes.guess_type(icon_path)[0]
|
||||||
)
|
)
|
||||||
|
|
||||||
# In-memory session store for active registrations
|
|
||||||
_create_app_sessions: dict = {}
|
|
||||||
_SESSION_TTL = 900 # 15 minutes
|
|
||||||
|
|
||||||
def _cleanup_expired_sessions():
|
|
||||||
"""Remove sessions that have exceeded their TTL."""
|
|
||||||
import time
|
|
||||||
|
|
||||||
now = time.time()
|
|
||||||
expired = [sid for sid, s in _create_app_sessions.items() if now - s.get('created_at', 0) > _SESSION_TTL]
|
|
||||||
for sid in expired:
|
|
||||||
session = _create_app_sessions.pop(sid, None)
|
|
||||||
if session and session.get('task') and not session['task'].done():
|
|
||||||
session['task'].cancel()
|
|
||||||
|
|
||||||
@self.route('/lark/create-app', methods=['POST'])
|
|
||||||
async def _() -> str:
|
|
||||||
"""Start Feishu one-click app registration. Returns session_id + QR code URL."""
|
|
||||||
import uuid
|
|
||||||
import time
|
|
||||||
import lark_oapi as lark
|
|
||||||
from lark_oapi.scene.registration.errors import AppAccessDeniedError, AppExpiredError
|
|
||||||
|
|
||||||
_cleanup_expired_sessions()
|
|
||||||
|
|
||||||
session_id = str(uuid.uuid4())
|
|
||||||
loop = asyncio.get_running_loop()
|
|
||||||
|
|
||||||
session = {
|
|
||||||
'status': 'pending',
|
|
||||||
'qr_url': None,
|
|
||||||
'expire_at': None,
|
|
||||||
'app_id': None,
|
|
||||||
'app_secret': None,
|
|
||||||
'error': None,
|
|
||||||
'created_at': time.time(),
|
|
||||||
}
|
|
||||||
_create_app_sessions[session_id] = session
|
|
||||||
|
|
||||||
def on_qr_code(info):
|
|
||||||
# May be called from a background thread by the SDK;
|
|
||||||
# use call_soon_threadsafe to safely update session state.
|
|
||||||
def _update():
|
|
||||||
session['qr_url'] = info['url']
|
|
||||||
session['expire_at'] = time.time() + 600 # 10 minutes
|
|
||||||
session['status'] = 'waiting'
|
|
||||||
|
|
||||||
loop.call_soon_threadsafe(_update)
|
|
||||||
|
|
||||||
async def run_registration():
|
|
||||||
try:
|
|
||||||
result = await lark.aregister_app(
|
|
||||||
on_qr_code=on_qr_code,
|
|
||||||
source='langbot',
|
|
||||||
)
|
|
||||||
session['status'] = 'success'
|
|
||||||
session['app_id'] = result['client_id']
|
|
||||||
session['app_secret'] = result['client_secret']
|
|
||||||
except AppAccessDeniedError:
|
|
||||||
session['status'] = 'error'
|
|
||||||
session['error'] = 'User denied authorization'
|
|
||||||
except AppExpiredError:
|
|
||||||
session['status'] = 'error'
|
|
||||||
session['error'] = 'QR code expired'
|
|
||||||
except Exception as e:
|
|
||||||
session['status'] = 'error'
|
|
||||||
session['error'] = str(e)
|
|
||||||
|
|
||||||
task = asyncio.create_task(run_registration())
|
|
||||||
session['task'] = task
|
|
||||||
|
|
||||||
# Wait for QR code to be ready (max 10 seconds)
|
|
||||||
for _ in range(20):
|
|
||||||
if session['qr_url']:
|
|
||||||
break
|
|
||||||
await asyncio.sleep(0.5)
|
|
||||||
|
|
||||||
if not session['qr_url']:
|
|
||||||
task.cancel()
|
|
||||||
session['status'] = 'error'
|
|
||||||
session['error'] = 'Timeout waiting for QR code'
|
|
||||||
return self.http_status(504, -1, 'Timeout waiting for QR code')
|
|
||||||
|
|
||||||
return self.success(
|
|
||||||
data={
|
|
||||||
'session_id': session_id,
|
|
||||||
'qr_url': session['qr_url'],
|
|
||||||
'expire_at': session['expire_at'],
|
|
||||||
}
|
|
||||||
)
|
|
||||||
|
|
||||||
@self.route('/lark/create-app/status/<session_id>', methods=['GET'])
|
|
||||||
async def _(session_id: str) -> str:
|
|
||||||
"""Poll registration status."""
|
|
||||||
session = _create_app_sessions.get(session_id)
|
|
||||||
if not session:
|
|
||||||
return self.http_status(404, -1, 'Session not found')
|
|
||||||
|
|
||||||
data = {'status': session['status']}
|
|
||||||
|
|
||||||
if session['status'] == 'success':
|
|
||||||
data['app_id'] = session['app_id']
|
|
||||||
data['app_secret'] = session['app_secret']
|
|
||||||
_create_app_sessions.pop(session_id, None)
|
|
||||||
elif session['status'] == 'error':
|
|
||||||
data['error'] = session['error']
|
|
||||||
_create_app_sessions.pop(session_id, None)
|
|
||||||
|
|
||||||
return self.success(data=data)
|
|
||||||
|
|
||||||
@self.route('/lark/create-app/<session_id>', methods=['DELETE'])
|
|
||||||
async def _(session_id: str) -> str:
|
|
||||||
"""Cancel and clean up a registration session."""
|
|
||||||
session = _create_app_sessions.pop(session_id, None)
|
|
||||||
if session and session.get('task') and not session['task'].done():
|
|
||||||
session['task'].cancel()
|
|
||||||
return self.success(data={})
|
|
||||||
|
|
||||||
# -----------------------------------------------------------------------
|
|
||||||
# WeChat QR Code Login
|
|
||||||
# -----------------------------------------------------------------------
|
|
||||||
|
|
||||||
_weixin_login_sessions: dict = {}
|
|
||||||
_WEIXIN_SESSION_TTL = 600 # 10 minutes (3 retries × 3 min QR validity)
|
|
||||||
|
|
||||||
def _cleanup_expired_weixin_sessions():
|
|
||||||
import time
|
|
||||||
|
|
||||||
now = time.time()
|
|
||||||
expired = [
|
|
||||||
sid for sid, s in _weixin_login_sessions.items() if now - s.get('created_at', 0) > _WEIXIN_SESSION_TTL
|
|
||||||
]
|
|
||||||
for sid in expired:
|
|
||||||
session = _weixin_login_sessions.pop(sid, None)
|
|
||||||
if session and session.get('task') and not session['task'].done():
|
|
||||||
session['task'].cancel()
|
|
||||||
|
|
||||||
@self.route('/weixin/login', methods=['POST'])
|
|
||||||
async def _() -> str:
|
|
||||||
"""Start WeChat QR code login. Returns session_id + QR code data URL."""
|
|
||||||
import uuid
|
|
||||||
import time
|
|
||||||
|
|
||||||
from langbot.libs.openclaw_weixin_api.client import OpenClawWeixinClient, DEFAULT_BASE_URL
|
|
||||||
|
|
||||||
_cleanup_expired_weixin_sessions()
|
|
||||||
|
|
||||||
session_id = str(uuid.uuid4())
|
|
||||||
loop = asyncio.get_running_loop()
|
|
||||||
|
|
||||||
session = {
|
|
||||||
'status': 'pending',
|
|
||||||
'qr_data_url': None,
|
|
||||||
'expire_at': None,
|
|
||||||
'token': None,
|
|
||||||
'base_url': None,
|
|
||||||
'account_id': None,
|
|
||||||
'error': None,
|
|
||||||
'created_at': time.time(),
|
|
||||||
}
|
|
||||||
_weixin_login_sessions[session_id] = session
|
|
||||||
|
|
||||||
client = OpenClawWeixinClient(
|
|
||||||
base_url=DEFAULT_BASE_URL,
|
|
||||||
token='',
|
|
||||||
)
|
|
||||||
|
|
||||||
async def run_login():
|
|
||||||
try:
|
|
||||||
|
|
||||||
def on_qrcode(qr_data_url: str, _qr_url: str):
|
|
||||||
def _update():
|
|
||||||
session['qr_data_url'] = qr_data_url
|
|
||||||
session['expire_at'] = time.time() + 180
|
|
||||||
session['status'] = 'waiting'
|
|
||||||
|
|
||||||
loop.call_soon_threadsafe(_update)
|
|
||||||
|
|
||||||
result = await client.login(
|
|
||||||
max_retries=1,
|
|
||||||
poll_timeout_ms=180_000,
|
|
||||||
on_qrcode=on_qrcode,
|
|
||||||
)
|
|
||||||
session['status'] = 'success'
|
|
||||||
session['token'] = result.token
|
|
||||||
session['base_url'] = result.base_url
|
|
||||||
session['account_id'] = result.account_id
|
|
||||||
except Exception as e:
|
|
||||||
error_message = str(e)
|
|
||||||
if 'expired' in error_message.lower() or 'max retries exceeded' in error_message.lower():
|
|
||||||
session['status'] = 'expired'
|
|
||||||
session['error'] = 'QR code expired'
|
|
||||||
else:
|
|
||||||
session['status'] = 'error'
|
|
||||||
session['error'] = error_message
|
|
||||||
finally:
|
|
||||||
await client.close()
|
|
||||||
|
|
||||||
task = asyncio.create_task(run_login())
|
|
||||||
session['task'] = task
|
|
||||||
|
|
||||||
# Wait for QR code to be ready (max 10 seconds)
|
|
||||||
for _ in range(20):
|
|
||||||
if session['qr_data_url']:
|
|
||||||
break
|
|
||||||
await asyncio.sleep(0.5)
|
|
||||||
|
|
||||||
if not session['qr_data_url']:
|
|
||||||
task.cancel()
|
|
||||||
session['status'] = 'error'
|
|
||||||
session['error'] = 'Timeout waiting for QR code'
|
|
||||||
return self.http_status(504, -1, 'Timeout waiting for QR code')
|
|
||||||
|
|
||||||
return self.success(
|
|
||||||
data={
|
|
||||||
'session_id': session_id,
|
|
||||||
'qr_data_url': session['qr_data_url'],
|
|
||||||
'expire_at': session['expire_at'],
|
|
||||||
}
|
|
||||||
)
|
|
||||||
|
|
||||||
@self.route('/weixin/login/status/<session_id>', methods=['GET'])
|
|
||||||
async def _(session_id: str) -> str:
|
|
||||||
"""Poll WeChat login status."""
|
|
||||||
session = _weixin_login_sessions.get(session_id)
|
|
||||||
if not session:
|
|
||||||
return self.http_status(404, -1, 'Session not found')
|
|
||||||
|
|
||||||
data = {
|
|
||||||
'status': session['status'],
|
|
||||||
'qr_data_url': session['qr_data_url'],
|
|
||||||
'expire_at': session['expire_at'],
|
|
||||||
}
|
|
||||||
|
|
||||||
if session['status'] == 'success':
|
|
||||||
data['token'] = session['token']
|
|
||||||
data['base_url'] = session['base_url']
|
|
||||||
data['account_id'] = session['account_id']
|
|
||||||
_weixin_login_sessions.pop(session_id, None)
|
|
||||||
elif session['status'] == 'error':
|
|
||||||
data['error'] = session['error']
|
|
||||||
_weixin_login_sessions.pop(session_id, None)
|
|
||||||
elif session['status'] == 'expired':
|
|
||||||
data['error'] = session['error']
|
|
||||||
_weixin_login_sessions.pop(session_id, None)
|
|
||||||
|
|
||||||
return self.success(data=data)
|
|
||||||
|
|
||||||
@self.route('/weixin/login/<session_id>', methods=['DELETE'])
|
|
||||||
async def _(session_id: str) -> str:
|
|
||||||
"""Cancel and clean up a WeChat login session."""
|
|
||||||
session = _weixin_login_sessions.pop(session_id, None)
|
|
||||||
if session and session.get('task') and not session['task'].done():
|
|
||||||
session['task'].cancel()
|
|
||||||
return self.success(data={})
|
|
||||||
|
|
||||||
# -----------------------------------------------------------------------
|
|
||||||
# DingTalk Device Flow QR Code Login
|
|
||||||
# -----------------------------------------------------------------------
|
|
||||||
|
|
||||||
_dingtalk_sessions: dict = {}
|
|
||||||
_DINGTALK_SESSION_TTL = 600 # 10 minutes (QR code validity window)
|
|
||||||
|
|
||||||
def _cleanup_expired_dingtalk_sessions():
|
|
||||||
import time
|
|
||||||
|
|
||||||
now = time.time()
|
|
||||||
expired = [
|
|
||||||
sid for sid, s in _dingtalk_sessions.items() if now - s.get('created_at', 0) > _DINGTALK_SESSION_TTL
|
|
||||||
]
|
|
||||||
for sid in expired:
|
|
||||||
session = _dingtalk_sessions.pop(sid, None)
|
|
||||||
if session and session.get('task') and not session['task'].done():
|
|
||||||
session['task'].cancel()
|
|
||||||
|
|
||||||
@self.route('/dingtalk/create-app', methods=['POST'])
|
|
||||||
async def _() -> str:
|
|
||||||
"""Start DingTalk one-click app creation via Device Flow. Returns session_id + QR code URL."""
|
|
||||||
import uuid
|
|
||||||
import time
|
|
||||||
import aiohttp
|
|
||||||
|
|
||||||
DINGTALK_BASE_URL = 'https://oapi.dingtalk.com'
|
|
||||||
|
|
||||||
_cleanup_expired_dingtalk_sessions()
|
|
||||||
|
|
||||||
session_id = str(uuid.uuid4())
|
|
||||||
|
|
||||||
session = {
|
|
||||||
'status': 'pending',
|
|
||||||
'qr_url': None,
|
|
||||||
'expire_at': None,
|
|
||||||
'client_id': None,
|
|
||||||
'client_secret': None,
|
|
||||||
'error': None,
|
|
||||||
'created_at': time.time(),
|
|
||||||
'device_code': None,
|
|
||||||
'interval': 5,
|
|
||||||
}
|
|
||||||
_dingtalk_sessions[session_id] = session
|
|
||||||
|
|
||||||
async def run_device_flow():
|
|
||||||
try:
|
|
||||||
timeout = aiohttp.ClientTimeout(total=10)
|
|
||||||
async with aiohttp.ClientSession(timeout=timeout) as http:
|
|
||||||
# Step 1: Init — get nonce
|
|
||||||
async with http.post(
|
|
||||||
f'{DINGTALK_BASE_URL}/app/registration/init',
|
|
||||||
json={'source': 'langbot'},
|
|
||||||
) as resp:
|
|
||||||
try:
|
|
||||||
data = await resp.json()
|
|
||||||
except (aiohttp.ContentTypeError, ValueError):
|
|
||||||
session['status'] = 'error'
|
|
||||||
session['error'] = 'Invalid response from DingTalk service'
|
|
||||||
return
|
|
||||||
if data.get('errcode', -1) != 0:
|
|
||||||
session['status'] = 'error'
|
|
||||||
session['error'] = data.get('errmsg', 'Failed to init')
|
|
||||||
return
|
|
||||||
nonce = data['nonce']
|
|
||||||
|
|
||||||
# Step 2: Begin — get device_code + QR URL
|
|
||||||
async with http.post(
|
|
||||||
f'{DINGTALK_BASE_URL}/app/registration/begin',
|
|
||||||
json={'nonce': nonce},
|
|
||||||
) as resp:
|
|
||||||
try:
|
|
||||||
data = await resp.json()
|
|
||||||
except (aiohttp.ContentTypeError, ValueError):
|
|
||||||
session['status'] = 'error'
|
|
||||||
session['error'] = 'Invalid response from DingTalk service'
|
|
||||||
return
|
|
||||||
if data.get('errcode', -1) != 0:
|
|
||||||
session['status'] = 'error'
|
|
||||||
session['error'] = data.get('errmsg', 'Failed to begin authorization')
|
|
||||||
return
|
|
||||||
|
|
||||||
device_code = data['device_code']
|
|
||||||
verification_uri_complete = data.get('verification_uri_complete', '')
|
|
||||||
expires_in = data.get('expires_in', 7200)
|
|
||||||
interval = data.get('interval', 5)
|
|
||||||
|
|
||||||
session['device_code'] = device_code
|
|
||||||
session['interval'] = interval
|
|
||||||
session['qr_url'] = verification_uri_complete
|
|
||||||
session['expire_at'] = time.time() + 600 # QR code valid for ~10 min
|
|
||||||
session['status'] = 'waiting'
|
|
||||||
|
|
||||||
# Step 3: Poll for authorization result
|
|
||||||
deadline = time.time() + expires_in
|
|
||||||
while time.time() < deadline:
|
|
||||||
await asyncio.sleep(interval)
|
|
||||||
|
|
||||||
async with http.post(
|
|
||||||
f'{DINGTALK_BASE_URL}/app/registration/poll',
|
|
||||||
json={'device_code': device_code},
|
|
||||||
) as poll_resp:
|
|
||||||
try:
|
|
||||||
poll_data = await poll_resp.json()
|
|
||||||
except (aiohttp.ContentTypeError, ValueError):
|
|
||||||
continue
|
|
||||||
|
|
||||||
if poll_data.get('errcode', -1) != 0:
|
|
||||||
session['status'] = 'error'
|
|
||||||
session['error'] = poll_data.get('errmsg', 'Poll failed')
|
|
||||||
return
|
|
||||||
|
|
||||||
status = poll_data.get('status', '')
|
|
||||||
|
|
||||||
if status == 'SUCCESS':
|
|
||||||
session['status'] = 'success'
|
|
||||||
session['client_id'] = poll_data.get('client_id', '')
|
|
||||||
session['client_secret'] = poll_data.get('client_secret', '')
|
|
||||||
return
|
|
||||||
elif status == 'FAIL':
|
|
||||||
session['status'] = 'error'
|
|
||||||
session['error'] = poll_data.get('fail_reason', 'Authorization failed')
|
|
||||||
return
|
|
||||||
elif status == 'EXPIRED':
|
|
||||||
session['status'] = 'error'
|
|
||||||
session['error'] = 'QR code expired'
|
|
||||||
return
|
|
||||||
# status == 'WAITING': continue polling
|
|
||||||
|
|
||||||
# Timeout
|
|
||||||
session['status'] = 'error'
|
|
||||||
session['error'] = 'QR code expired'
|
|
||||||
|
|
||||||
except asyncio.CancelledError:
|
|
||||||
return
|
|
||||||
except Exception as e:
|
|
||||||
session['status'] = 'error'
|
|
||||||
session['error'] = str(e)
|
|
||||||
|
|
||||||
task = asyncio.create_task(run_device_flow())
|
|
||||||
session['task'] = task
|
|
||||||
|
|
||||||
# Wait for QR code to be ready (max 10 seconds)
|
|
||||||
for _ in range(20):
|
|
||||||
if session['qr_url'] or session['error']:
|
|
||||||
break
|
|
||||||
await asyncio.sleep(0.5)
|
|
||||||
|
|
||||||
if session['error']:
|
|
||||||
task.cancel()
|
|
||||||
return self.http_status(502, -1, session['error'])
|
|
||||||
|
|
||||||
if not session['qr_url']:
|
|
||||||
task.cancel()
|
|
||||||
session['status'] = 'error'
|
|
||||||
session['error'] = 'Timeout waiting for QR code'
|
|
||||||
return self.http_status(504, -1, 'Timeout waiting for QR code')
|
|
||||||
|
|
||||||
return self.success(
|
|
||||||
data={
|
|
||||||
'session_id': session_id,
|
|
||||||
'qr_url': session['qr_url'],
|
|
||||||
'expire_at': session['expire_at'],
|
|
||||||
}
|
|
||||||
)
|
|
||||||
|
|
||||||
@self.route('/dingtalk/create-app/status/<session_id>', methods=['GET'])
|
|
||||||
async def _(session_id: str) -> str:
|
|
||||||
"""Poll DingTalk Device Flow status."""
|
|
||||||
_cleanup_expired_dingtalk_sessions()
|
|
||||||
session = _dingtalk_sessions.get(session_id)
|
|
||||||
if not session:
|
|
||||||
return self.http_status(404, -1, 'Session not found')
|
|
||||||
|
|
||||||
data = {'status': session['status']}
|
|
||||||
|
|
||||||
if session['status'] == 'success':
|
|
||||||
data['client_id'] = session['client_id']
|
|
||||||
data['client_secret'] = session['client_secret']
|
|
||||||
_dingtalk_sessions.pop(session_id, None)
|
|
||||||
elif session['status'] == 'error':
|
|
||||||
data['error'] = session['error']
|
|
||||||
_dingtalk_sessions.pop(session_id, None)
|
|
||||||
|
|
||||||
return self.success(data=data)
|
|
||||||
|
|
||||||
@self.route('/dingtalk/create-app/<session_id>', methods=['DELETE'])
|
|
||||||
async def _(session_id: str) -> str:
|
|
||||||
"""Cancel and clean up a DingTalk Device Flow session."""
|
|
||||||
session = _dingtalk_sessions.pop(session_id, None)
|
|
||||||
if session and session.get('task') and not session['task'].done():
|
|
||||||
session['task'].cancel()
|
|
||||||
return self.success(data={})
|
|
||||||
|
|
||||||
# -----------------------------------------------------------------------
|
|
||||||
# WeComBot QR Code One-Click Create
|
|
||||||
# -----------------------------------------------------------------------
|
|
||||||
|
|
||||||
_wecombot_sessions: dict = {}
|
|
||||||
_WECOMBOT_SESSION_TTL = 300 # 5 minutes (WeCom QR validity window)
|
|
||||||
|
|
||||||
def _cleanup_expired_wecombot_sessions():
|
|
||||||
import time
|
|
||||||
|
|
||||||
now = time.time()
|
|
||||||
expired = [
|
|
||||||
sid for sid, s in _wecombot_sessions.items() if now - s.get('created_at', 0) > _WECOMBOT_SESSION_TTL
|
|
||||||
]
|
|
||||||
for sid in expired:
|
|
||||||
session = _wecombot_sessions.pop(sid, None)
|
|
||||||
if session and session.get('task') and not session['task'].done():
|
|
||||||
session['task'].cancel()
|
|
||||||
|
|
||||||
@self.route('/wecombot/create-bot', methods=['POST'])
|
|
||||||
async def _() -> str:
|
|
||||||
"""Start WeComBot one-click creation via QR code. Returns session_id + QR code URL."""
|
|
||||||
import uuid
|
|
||||||
import time
|
|
||||||
import aiohttp
|
|
||||||
|
|
||||||
WECOM_QC_GENERATE_URL = 'https://work.weixin.qq.com/ai/qc/generate'
|
|
||||||
WECOM_QC_QUERY_URL = 'https://work.weixin.qq.com/ai/qc/query_result'
|
|
||||||
|
|
||||||
_cleanup_expired_wecombot_sessions()
|
|
||||||
|
|
||||||
session_id = str(uuid.uuid4())
|
|
||||||
|
|
||||||
session = {
|
|
||||||
'status': 'pending',
|
|
||||||
'qr_url': None,
|
|
||||||
'expire_at': None,
|
|
||||||
'botid': None,
|
|
||||||
'secret': None,
|
|
||||||
'error': None,
|
|
||||||
'created_at': time.time(),
|
|
||||||
'scode': None,
|
|
||||||
'task': None,
|
|
||||||
}
|
|
||||||
_wecombot_sessions[session_id] = session
|
|
||||||
|
|
||||||
async def run_qr_flow():
|
|
||||||
try:
|
|
||||||
timeout = aiohttp.ClientTimeout(total=10)
|
|
||||||
async with aiohttp.ClientSession(timeout=timeout) as http:
|
|
||||||
# Step 1: Generate QR code
|
|
||||||
async with http.get(
|
|
||||||
f'{WECOM_QC_GENERATE_URL}?source=langbot&plat=0',
|
|
||||||
) as resp:
|
|
||||||
try:
|
|
||||||
data = await resp.json()
|
|
||||||
except (aiohttp.ContentTypeError, ValueError):
|
|
||||||
session['status'] = 'error'
|
|
||||||
session['error'] = 'Invalid response from WeCom service'
|
|
||||||
return
|
|
||||||
if not data.get('data', {}).get('scode') or not data.get('data', {}).get('auth_url'):
|
|
||||||
session['status'] = 'error'
|
|
||||||
session['error'] = data.get('errmsg', 'Failed to generate QR code')
|
|
||||||
return
|
|
||||||
|
|
||||||
scode = data['data']['scode']
|
|
||||||
auth_url = data['data']['auth_url']
|
|
||||||
|
|
||||||
session['scode'] = scode
|
|
||||||
session['qr_url'] = auth_url
|
|
||||||
session['expire_at'] = time.time() + _WECOMBOT_SESSION_TTL
|
|
||||||
session['status'] = 'waiting'
|
|
||||||
|
|
||||||
# Step 2: Poll for scan result
|
|
||||||
deadline = time.time() + _WECOMBOT_SESSION_TTL
|
|
||||||
while time.time() < deadline:
|
|
||||||
await asyncio.sleep(3)
|
|
||||||
|
|
||||||
async with http.get(
|
|
||||||
f'{WECOM_QC_QUERY_URL}?scode={scode}',
|
|
||||||
) as poll_resp:
|
|
||||||
try:
|
|
||||||
poll_data = await poll_resp.json()
|
|
||||||
except (aiohttp.ContentTypeError, ValueError):
|
|
||||||
continue
|
|
||||||
|
|
||||||
status = poll_data.get('data', {}).get('status', '')
|
|
||||||
if status == 'success':
|
|
||||||
bot_info = poll_data.get('data', {}).get('bot_info', {})
|
|
||||||
if bot_info.get('botid') and bot_info.get('secret'):
|
|
||||||
session['status'] = 'success'
|
|
||||||
session['botid'] = bot_info['botid']
|
|
||||||
session['secret'] = bot_info['secret']
|
|
||||||
return
|
|
||||||
else:
|
|
||||||
session['status'] = 'error'
|
|
||||||
session['error'] = 'Scan succeeded but bot info is incomplete'
|
|
||||||
return
|
|
||||||
|
|
||||||
# Timeout
|
|
||||||
session['status'] = 'error'
|
|
||||||
session['error'] = 'QR code expired'
|
|
||||||
|
|
||||||
except asyncio.CancelledError:
|
|
||||||
return
|
|
||||||
except Exception as e:
|
|
||||||
session['status'] = 'error'
|
|
||||||
session['error'] = str(e)
|
|
||||||
|
|
||||||
task = asyncio.create_task(run_qr_flow())
|
|
||||||
session['task'] = task
|
|
||||||
|
|
||||||
# Wait for QR code to be ready (max 10 seconds)
|
|
||||||
for _ in range(20):
|
|
||||||
if session['qr_url'] or session['error']:
|
|
||||||
break
|
|
||||||
await asyncio.sleep(0.5)
|
|
||||||
|
|
||||||
if session['error']:
|
|
||||||
task.cancel()
|
|
||||||
return self.http_status(502, -1, session['error'])
|
|
||||||
|
|
||||||
if not session['qr_url']:
|
|
||||||
task.cancel()
|
|
||||||
session['status'] = 'error'
|
|
||||||
session['error'] = 'Timeout waiting for QR code'
|
|
||||||
return self.http_status(504, -1, 'Timeout waiting for QR code')
|
|
||||||
|
|
||||||
return self.success(
|
|
||||||
data={
|
|
||||||
'session_id': session_id,
|
|
||||||
'qr_url': session['qr_url'],
|
|
||||||
'expire_at': session['expire_at'],
|
|
||||||
}
|
|
||||||
)
|
|
||||||
|
|
||||||
@self.route('/wecombot/create-bot/status/<session_id>', methods=['GET'])
|
|
||||||
async def _(session_id: str) -> str:
|
|
||||||
"""Poll WeComBot creation status."""
|
|
||||||
_cleanup_expired_wecombot_sessions()
|
|
||||||
session = _wecombot_sessions.get(session_id)
|
|
||||||
if not session:
|
|
||||||
return self.http_status(404, -1, 'Session not found')
|
|
||||||
|
|
||||||
data = {'status': session['status']}
|
|
||||||
|
|
||||||
if session['status'] == 'success':
|
|
||||||
data['botid'] = session['botid']
|
|
||||||
data['secret'] = session['secret']
|
|
||||||
_wecombot_sessions.pop(session_id, None)
|
|
||||||
elif session['status'] == 'error':
|
|
||||||
data['error'] = session['error']
|
|
||||||
_wecombot_sessions.pop(session_id, None)
|
|
||||||
|
|
||||||
return self.success(data=data)
|
|
||||||
|
|
||||||
@self.route('/wecombot/create-bot/<session_id>', methods=['DELETE'])
|
|
||||||
async def _(session_id: str) -> str:
|
|
||||||
"""Cancel and clean up a WeComBot creation session."""
|
|
||||||
session = _wecombot_sessions.pop(session_id, None)
|
|
||||||
if session and session.get('task') and not session['task'].done():
|
|
||||||
session['task'].cancel()
|
|
||||||
return self.success(data={})
|
|
||||||
|
|||||||
@@ -1,153 +1,19 @@
|
|||||||
from __future__ import annotations
|
from __future__ import annotations
|
||||||
|
|
||||||
import base64
|
import base64
|
||||||
import io
|
|
||||||
import quart
|
import quart
|
||||||
import re
|
import re
|
||||||
import httpx
|
import httpx
|
||||||
import uuid
|
import uuid
|
||||||
import os
|
import os
|
||||||
import zipfile
|
|
||||||
import yaml
|
|
||||||
from urllib.parse import urlparse
|
|
||||||
import posixpath
|
|
||||||
import sqlalchemy
|
|
||||||
|
|
||||||
from .....core import taskmgr
|
from .....core import taskmgr
|
||||||
from .....entity.persistence import plugin as persistence_plugin
|
|
||||||
from .. import group
|
from .. import group
|
||||||
from langbot_plugin.runtime.plugin.mgr import PluginInstallSource
|
from langbot_plugin.runtime.plugin.mgr import PluginInstallSource
|
||||||
|
|
||||||
# Resolve the built-in page SDK JS from the langbot_plugin package
|
|
||||||
_PAGE_SDK_PATH = None
|
|
||||||
try:
|
|
||||||
import langbot_plugin.assets as _assets_pkg
|
|
||||||
|
|
||||||
_candidate = os.path.join(os.path.dirname(_assets_pkg.__file__), 'langbot-page-sdk.js')
|
|
||||||
if os.path.exists(_candidate):
|
|
||||||
_PAGE_SDK_PATH = _candidate
|
|
||||||
except Exception:
|
|
||||||
pass
|
|
||||||
|
|
||||||
|
|
||||||
def _normalize_plugin_asset_path(filepath: str) -> str | None:
|
|
||||||
filepath = filepath.replace('\\', '/')
|
|
||||||
if filepath.startswith('/'):
|
|
||||||
return None
|
|
||||||
|
|
||||||
normalized = posixpath.normpath(filepath)
|
|
||||||
if normalized == '.' or normalized.startswith('../') or normalized == '..':
|
|
||||||
return None
|
|
||||||
|
|
||||||
if normalized.startswith('components/pages/'):
|
|
||||||
return normalized
|
|
||||||
|
|
||||||
return f'assets/{normalized}'
|
|
||||||
|
|
||||||
|
|
||||||
def _get_request_origin() -> str:
|
|
||||||
"""Return the public request origin, respecting reverse-proxy headers."""
|
|
||||||
forwarded_proto = quart.request.headers.get('X-Forwarded-Proto', '').split(',')[0].strip()
|
|
||||||
forwarded_host = quart.request.headers.get('X-Forwarded-Host', '').split(',')[0].strip()
|
|
||||||
|
|
||||||
scheme = forwarded_proto or quart.request.scheme
|
|
||||||
host = forwarded_host or quart.request.host
|
|
||||||
return f'{scheme}://{host}'
|
|
||||||
|
|
||||||
|
|
||||||
@group.group_class('plugins', '/api/v1/plugins')
|
@group.group_class('plugins', '/api/v1/plugins')
|
||||||
class PluginsRouterGroup(group.RouterGroup):
|
class PluginsRouterGroup(group.RouterGroup):
|
||||||
@staticmethod
|
|
||||||
def _normalize_archive_path(path: str) -> str:
|
|
||||||
normalized = str(path or '').replace('\\', '/').strip('/')
|
|
||||||
return posixpath.normpath(normalized) if normalized else ''
|
|
||||||
|
|
||||||
@classmethod
|
|
||||||
def _component_source_path(cls, entry) -> str:
|
|
||||||
if isinstance(entry, dict):
|
|
||||||
return cls._normalize_archive_path(entry.get('path') or '')
|
|
||||||
return cls._normalize_archive_path(str(entry or ''))
|
|
||||||
|
|
||||||
@classmethod
|
|
||||||
def _count_component_configs(cls, component_config, archive_names: list[str]) -> int:
|
|
||||||
normalized_names = [cls._normalize_archive_path(name) for name in archive_names]
|
|
||||||
component_files: set[str] = set()
|
|
||||||
|
|
||||||
if isinstance(component_config, list):
|
|
||||||
return len(component_config)
|
|
||||||
if not isinstance(component_config, dict):
|
|
||||||
return 1 if component_config else 0
|
|
||||||
|
|
||||||
for entry in component_config.get('fromFiles') or []:
|
|
||||||
source_path = cls._component_source_path(entry)
|
|
||||||
if source_path and source_path in normalized_names:
|
|
||||||
component_files.add(source_path)
|
|
||||||
|
|
||||||
for entry in component_config.get('fromDirs') or []:
|
|
||||||
source_dir = cls._component_source_path(entry).rstrip('/')
|
|
||||||
if not source_dir:
|
|
||||||
continue
|
|
||||||
prefix = f'{source_dir}/'
|
|
||||||
for archive_name in normalized_names:
|
|
||||||
if not archive_name.startswith(prefix):
|
|
||||||
continue
|
|
||||||
if archive_name.lower().endswith(('.yaml', '.yml')):
|
|
||||||
component_files.add(archive_name)
|
|
||||||
|
|
||||||
if component_files:
|
|
||||||
return len(component_files)
|
|
||||||
|
|
||||||
return 1 if any(key in component_config for key in ('path', 'name', 'kind')) else 0
|
|
||||||
|
|
||||||
@classmethod
|
|
||||||
def _count_plugin_components(cls, components, archive_names: list[str]) -> dict[str, int]:
|
|
||||||
if not isinstance(components, dict):
|
|
||||||
return {}
|
|
||||||
|
|
||||||
component_counts: dict[str, int] = {}
|
|
||||||
for kind, component_config in components.items():
|
|
||||||
count = cls._count_component_configs(component_config, archive_names)
|
|
||||||
if count > 0:
|
|
||||||
component_counts[str(kind)] = count
|
|
||||||
return component_counts
|
|
||||||
|
|
||||||
@staticmethod
|
|
||||||
def _parse_github_repo_url(repo_url: str) -> dict | None:
|
|
||||||
raw_url = str(repo_url or '').strip()
|
|
||||||
if not raw_url:
|
|
||||||
return None
|
|
||||||
|
|
||||||
if not re.match(r'^[a-zA-Z][a-zA-Z0-9+.-]*://', raw_url):
|
|
||||||
raw_url = f'https://{raw_url}'
|
|
||||||
|
|
||||||
parsed = urlparse(raw_url)
|
|
||||||
if parsed.netloc.lower() not in ('github.com', 'www.github.com'):
|
|
||||||
return None
|
|
||||||
|
|
||||||
parts = [part for part in parsed.path.strip('/').split('/') if part]
|
|
||||||
if len(parts) < 2:
|
|
||||||
return None
|
|
||||||
|
|
||||||
owner = parts[0]
|
|
||||||
repo = parts[1]
|
|
||||||
if repo.endswith('.git'):
|
|
||||||
repo = repo[:-4]
|
|
||||||
if not owner or not repo:
|
|
||||||
return None
|
|
||||||
|
|
||||||
ref = ''
|
|
||||||
subdir = ''
|
|
||||||
if len(parts) >= 4 and parts[2] in ('tree', 'blob'):
|
|
||||||
ref = parts[3]
|
|
||||||
subdir = '/'.join(parts[4:]).strip('/')
|
|
||||||
|
|
||||||
return {
|
|
||||||
'owner': owner,
|
|
||||||
'repo': repo,
|
|
||||||
'ref': ref,
|
|
||||||
'subdir': subdir,
|
|
||||||
}
|
|
||||||
|
|
||||||
async def _check_extensions_limit(self) -> str | None:
|
async def _check_extensions_limit(self) -> str | None:
|
||||||
"""Check if extensions limit is reached. Returns error response if limit exceeded, None otherwise."""
|
"""Check if extensions limit is reached. Returns error response if limit exceeded, None otherwise."""
|
||||||
limitation = self.ap.instance_config.data.get('system', {}).get('limitation', {})
|
limitation = self.ap.instance_config.data.get('system', {}).get('limitation', {})
|
||||||
@@ -161,15 +27,6 @@ class PluginsRouterGroup(group.RouterGroup):
|
|||||||
return None
|
return None
|
||||||
|
|
||||||
async def initialize(self) -> None:
|
async def initialize(self) -> None:
|
||||||
@self.route('/_sdk/page-sdk.js', methods=['GET'], auth_type=group.AuthType.NONE)
|
|
||||||
async def _() -> quart.Response:
|
|
||||||
"""Serve the built-in LangBot page SDK JavaScript."""
|
|
||||||
if _PAGE_SDK_PATH and os.path.exists(_PAGE_SDK_PATH):
|
|
||||||
with open(_PAGE_SDK_PATH, 'r') as f:
|
|
||||||
content = f.read()
|
|
||||||
return quart.Response(content, mimetype='application/javascript')
|
|
||||||
return quart.Response('// SDK not found', status=404, mimetype='application/javascript')
|
|
||||||
|
|
||||||
@self.route('', methods=['GET'], auth_type=group.AuthType.USER_TOKEN_OR_API_KEY)
|
@self.route('', methods=['GET'], auth_type=group.AuthType.USER_TOKEN_OR_API_KEY)
|
||||||
async def _() -> str:
|
async def _() -> str:
|
||||||
plugins = await self.ap.plugin_connector.list_plugins()
|
plugins = await self.ap.plugin_connector.list_plugins()
|
||||||
@@ -245,15 +102,7 @@ class PluginsRouterGroup(group.RouterGroup):
|
|||||||
return self.http_status(404, -1, 'plugin not found')
|
return self.http_status(404, -1, 'plugin not found')
|
||||||
|
|
||||||
if quart.request.method == 'GET':
|
if quart.request.method == 'GET':
|
||||||
result = await self.ap.persistence_mgr.execute_async(
|
return self.success(data={'config': plugin['plugin_config']})
|
||||||
sqlalchemy.select(persistence_plugin.PluginSetting.config)
|
|
||||||
.where(persistence_plugin.PluginSetting.plugin_author == author)
|
|
||||||
.where(persistence_plugin.PluginSetting.plugin_name == plugin_name)
|
|
||||||
)
|
|
||||||
persisted_config = result.scalar_one_or_none()
|
|
||||||
|
|
||||||
config = persisted_config if persisted_config is not None else plugin['plugin_config']
|
|
||||||
return self.success(data={'config': config})
|
|
||||||
elif quart.request.method == 'PUT':
|
elif quart.request.method == 'PUT':
|
||||||
data = await quart.request.json
|
data = await quart.request.json
|
||||||
|
|
||||||
@@ -286,62 +135,15 @@ class PluginsRouterGroup(group.RouterGroup):
|
|||||||
return quart.Response(icon_data, mimetype=mime_type)
|
return quart.Response(icon_data, mimetype=mime_type)
|
||||||
|
|
||||||
@self.route(
|
@self.route(
|
||||||
'/<author>/<plugin_name>/assets/<path:filepath>',
|
'/<author>/<plugin_name>/assets/<filepath>',
|
||||||
methods=['GET'],
|
methods=['GET'],
|
||||||
auth_type=group.AuthType.NONE,
|
auth_type=group.AuthType.NONE,
|
||||||
)
|
)
|
||||||
async def _(author: str, plugin_name: str, filepath: str) -> quart.Response:
|
async def _(author: str, plugin_name: str, filepath: str) -> quart.Response:
|
||||||
asset_path = _normalize_plugin_asset_path(filepath)
|
asset_data = await self.ap.plugin_connector.get_plugin_assets(author, plugin_name, filepath)
|
||||||
if asset_path is None:
|
|
||||||
return quart.Response('Asset not found', status=404)
|
|
||||||
|
|
||||||
asset_data = await self.ap.plugin_connector.get_plugin_assets(author, plugin_name, asset_path)
|
|
||||||
if not asset_data.get('asset_base64'):
|
|
||||||
return quart.Response('Asset not found', status=404)
|
|
||||||
asset_bytes = base64.b64decode(asset_data['asset_base64'])
|
asset_bytes = base64.b64decode(asset_data['asset_base64'])
|
||||||
mime_type = asset_data['mime_type']
|
mime_type = asset_data['mime_type']
|
||||||
resp = quart.Response(asset_bytes, mimetype=mime_type)
|
return quart.Response(asset_bytes, mimetype=mime_type)
|
||||||
# CSP for HTML pages served to sandboxed iframes (opaque origin).
|
|
||||||
# 'self' doesn't work in sandboxed iframes — use actual server origin.
|
|
||||||
if mime_type and mime_type.startswith('text/html'):
|
|
||||||
origin = _get_request_origin()
|
|
||||||
resp.headers['Content-Security-Policy'] = (
|
|
||||||
f'default-src {origin}; '
|
|
||||||
f"script-src {origin} 'unsafe-inline'; "
|
|
||||||
f"style-src {origin} 'unsafe-inline'; "
|
|
||||||
f'img-src {origin} data:; '
|
|
||||||
f'connect-src {origin}; '
|
|
||||||
"frame-src 'none'; "
|
|
||||||
"object-src 'none'"
|
|
||||||
)
|
|
||||||
return resp
|
|
||||||
|
|
||||||
@self.route(
|
|
||||||
'/<author>/<plugin_name>/page-api',
|
|
||||||
methods=['POST'],
|
|
||||||
auth_type=group.AuthType.USER_TOKEN_OR_API_KEY,
|
|
||||||
)
|
|
||||||
async def _(author: str, plugin_name: str) -> str:
|
|
||||||
"""Forward a page API request to the plugin."""
|
|
||||||
data = await quart.request.json
|
|
||||||
if not isinstance(data, dict):
|
|
||||||
return self.http_status(400, -1, 'invalid request body')
|
|
||||||
|
|
||||||
page_id = data.get('page_id', '')
|
|
||||||
endpoint = data.get('endpoint', '')
|
|
||||||
method = data.get('method', 'POST')
|
|
||||||
body = data.get('body')
|
|
||||||
if not isinstance(page_id, str) or not isinstance(endpoint, str) or not isinstance(method, str):
|
|
||||||
return self.http_status(400, -1, 'invalid page api request')
|
|
||||||
if not endpoint.startswith('/') or '..' in endpoint:
|
|
||||||
return self.http_status(400, -1, 'invalid endpoint')
|
|
||||||
|
|
||||||
result = await self.ap.plugin_connector.handle_page_api(
|
|
||||||
author, plugin_name, page_id, endpoint, method.upper(), body
|
|
||||||
)
|
|
||||||
if result.get('error'):
|
|
||||||
return self.http_status(400, -1, result['error'])
|
|
||||||
return self.success(data=result.get('data'))
|
|
||||||
|
|
||||||
@self.route('/github/releases', methods=['POST'], auth_type=group.AuthType.USER_TOKEN_OR_API_KEY)
|
@self.route('/github/releases', methods=['POST'], auth_type=group.AuthType.USER_TOKEN_OR_API_KEY)
|
||||||
async def _() -> str:
|
async def _() -> str:
|
||||||
@@ -349,37 +151,17 @@ class PluginsRouterGroup(group.RouterGroup):
|
|||||||
data = await quart.request.json
|
data = await quart.request.json
|
||||||
repo_url = data.get('repo_url', '')
|
repo_url = data.get('repo_url', '')
|
||||||
|
|
||||||
parsed_repo = self._parse_github_repo_url(repo_url)
|
# Parse GitHub repository URL to extract owner and repo
|
||||||
if not parsed_repo:
|
# Supports: https://github.com/owner/repo or github.com/owner/repo
|
||||||
|
pattern = r'github\.com/([^/]+)/([^/]+?)(?:\.git)?(?:/.*)?$'
|
||||||
|
match = re.search(pattern, repo_url)
|
||||||
|
|
||||||
|
if not match:
|
||||||
return self.http_status(400, -1, 'Invalid GitHub repository URL')
|
return self.http_status(400, -1, 'Invalid GitHub repository URL')
|
||||||
|
|
||||||
owner = parsed_repo['owner']
|
owner, repo = match.groups()
|
||||||
repo = parsed_repo['repo']
|
|
||||||
requested_ref = parsed_repo['ref']
|
|
||||||
requested_subdir = parsed_repo['subdir']
|
|
||||||
|
|
||||||
try:
|
try:
|
||||||
if requested_ref:
|
|
||||||
return self.success(
|
|
||||||
data={
|
|
||||||
'releases': [
|
|
||||||
{
|
|
||||||
'id': 0,
|
|
||||||
'tag_name': requested_ref,
|
|
||||||
'name': requested_ref,
|
|
||||||
'published_at': '',
|
|
||||||
'prerelease': False,
|
|
||||||
'draft': False,
|
|
||||||
'source_type': 'branch',
|
|
||||||
'archive_url': f'https://api.github.com/repos/{owner}/{repo}/zipball/{requested_ref}',
|
|
||||||
}
|
|
||||||
],
|
|
||||||
'owner': owner,
|
|
||||||
'repo': repo,
|
|
||||||
'source_subdir': requested_subdir,
|
|
||||||
}
|
|
||||||
)
|
|
||||||
|
|
||||||
# Fetch releases from GitHub API
|
# Fetch releases from GitHub API
|
||||||
url = f'https://api.github.com/repos/{owner}/{repo}/releases'
|
url = f'https://api.github.com/repos/{owner}/{repo}/releases'
|
||||||
async with httpx.AsyncClient(
|
async with httpx.AsyncClient(
|
||||||
@@ -405,14 +187,7 @@ class PluginsRouterGroup(group.RouterGroup):
|
|||||||
}
|
}
|
||||||
)
|
)
|
||||||
|
|
||||||
return self.success(
|
return self.success(data={'releases': formatted_releases, 'owner': owner, 'repo': repo})
|
||||||
data={
|
|
||||||
'releases': formatted_releases,
|
|
||||||
'owner': owner,
|
|
||||||
'repo': repo,
|
|
||||||
'source_subdir': requested_subdir,
|
|
||||||
}
|
|
||||||
)
|
|
||||||
except httpx.RequestError as e:
|
except httpx.RequestError as e:
|
||||||
return self.http_status(500, -1, f'Failed to fetch releases: {str(e)}')
|
return self.http_status(500, -1, f'Failed to fetch releases: {str(e)}')
|
||||||
|
|
||||||
@@ -567,62 +342,6 @@ class PluginsRouterGroup(group.RouterGroup):
|
|||||||
|
|
||||||
return self.success(data={'task_id': wrapper.id})
|
return self.success(data={'task_id': wrapper.id})
|
||||||
|
|
||||||
@self.route('/install/local/preview', methods=['POST'], auth_type=group.AuthType.USER_TOKEN_OR_API_KEY)
|
|
||||||
async def _() -> str:
|
|
||||||
file = (await quart.request.files).get('file')
|
|
||||||
if file is None:
|
|
||||||
return self.http_status(400, -1, 'file is required')
|
|
||||||
|
|
||||||
file_bytes = file.read()
|
|
||||||
try:
|
|
||||||
with zipfile.ZipFile(io.BytesIO(file_bytes)) as zf:
|
|
||||||
names = [name for name in zf.namelist() if not name.endswith('/')]
|
|
||||||
manifest_name = next(
|
|
||||||
(
|
|
||||||
name
|
|
||||||
for name in names
|
|
||||||
if name.replace('\\', '/').strip('/').lower() in ('manifest.yaml', 'manifest.yml')
|
|
||||||
),
|
|
||||||
None,
|
|
||||||
)
|
|
||||||
if manifest_name is None:
|
|
||||||
return self.http_status(400, -1, 'manifest.yaml is required')
|
|
||||||
|
|
||||||
manifest = yaml.safe_load(zf.read(manifest_name).decode('utf-8')) or {}
|
|
||||||
requirements: list[str] = []
|
|
||||||
requirements_name = next(
|
|
||||||
(name for name in names if name.replace('\\', '/').strip('/').lower() == 'requirements.txt'),
|
|
||||||
None,
|
|
||||||
)
|
|
||||||
if requirements_name is not None:
|
|
||||||
requirements = [
|
|
||||||
line.strip()
|
|
||||||
for line in zf.read(requirements_name).decode('utf-8', errors='ignore').splitlines()
|
|
||||||
if line.strip() and not line.strip().startswith('#')
|
|
||||||
]
|
|
||||||
|
|
||||||
spec = manifest.get('spec') or {}
|
|
||||||
components = spec.get('components') or {}
|
|
||||||
component_counts = self._count_plugin_components(components, names)
|
|
||||||
component_types = list(component_counts.keys())
|
|
||||||
|
|
||||||
return self.success(
|
|
||||||
data={
|
|
||||||
'filename': file.filename or 'local plugin',
|
|
||||||
'size': len(file_bytes),
|
|
||||||
'manifest': manifest,
|
|
||||||
'metadata': manifest.get('metadata') or {},
|
|
||||||
'component_types': component_types,
|
|
||||||
'component_counts': component_counts,
|
|
||||||
'requirements': requirements,
|
|
||||||
'file_count': len(names),
|
|
||||||
}
|
|
||||||
)
|
|
||||||
except zipfile.BadZipFile:
|
|
||||||
return self.http_status(400, -1, 'invalid .lbpkg file')
|
|
||||||
except Exception as exc:
|
|
||||||
return self.http_status(500, -1, f'Failed to preview plugin package: {exc}')
|
|
||||||
|
|
||||||
@self.route('/config-files', methods=['POST'], auth_type=group.AuthType.USER_TOKEN)
|
@self.route('/config-files', methods=['POST'], auth_type=group.AuthType.USER_TOKEN)
|
||||||
async def _() -> str:
|
async def _() -> str:
|
||||||
"""Upload a file for plugin configuration"""
|
"""Upload a file for plugin configuration"""
|
||||||
|
|||||||
@@ -97,51 +97,3 @@ class EmbeddingModelsRouterGroup(group.RouterGroup):
|
|||||||
await self.ap.embedding_models_service.test_embedding_model(model_uuid, json_data)
|
await self.ap.embedding_models_service.test_embedding_model(model_uuid, json_data)
|
||||||
|
|
||||||
return self.success()
|
return self.success()
|
||||||
|
|
||||||
|
|
||||||
@group.group_class('models/rerank', '/api/v1/provider/models/rerank')
|
|
||||||
class RerankModelsRouterGroup(group.RouterGroup):
|
|
||||||
async def initialize(self) -> None:
|
|
||||||
@self.route('', methods=['GET', 'POST'], auth_type=group.AuthType.USER_TOKEN_OR_API_KEY)
|
|
||||||
async def _() -> str:
|
|
||||||
if quart.request.method == 'GET':
|
|
||||||
provider_uuid = quart.request.args.get('provider_uuid')
|
|
||||||
if provider_uuid:
|
|
||||||
return self.success(
|
|
||||||
data={
|
|
||||||
'models': await self.ap.rerank_models_service.get_rerank_models_by_provider(provider_uuid)
|
|
||||||
}
|
|
||||||
)
|
|
||||||
return self.success(data={'models': await self.ap.rerank_models_service.get_rerank_models()})
|
|
||||||
elif quart.request.method == 'POST':
|
|
||||||
json_data = await quart.request.json
|
|
||||||
model_uuid = await self.ap.rerank_models_service.create_rerank_model(json_data)
|
|
||||||
return self.success(data={'uuid': model_uuid})
|
|
||||||
|
|
||||||
@self.route('/<model_uuid>', methods=['GET', 'PUT', 'DELETE'], auth_type=group.AuthType.USER_TOKEN_OR_API_KEY)
|
|
||||||
async def _(model_uuid: str) -> str:
|
|
||||||
if quart.request.method == 'GET':
|
|
||||||
model = await self.ap.rerank_models_service.get_rerank_model(model_uuid)
|
|
||||||
|
|
||||||
if model is None:
|
|
||||||
return self.http_status(404, -1, 'model not found')
|
|
||||||
|
|
||||||
return self.success(data={'model': model})
|
|
||||||
elif quart.request.method == 'PUT':
|
|
||||||
json_data = await quart.request.json
|
|
||||||
|
|
||||||
await self.ap.rerank_models_service.update_rerank_model(model_uuid, json_data)
|
|
||||||
|
|
||||||
return self.success()
|
|
||||||
elif quart.request.method == 'DELETE':
|
|
||||||
await self.ap.rerank_models_service.delete_rerank_model(model_uuid)
|
|
||||||
|
|
||||||
return self.success()
|
|
||||||
|
|
||||||
@self.route('/<model_uuid>/test', methods=['POST'], auth_type=group.AuthType.USER_TOKEN_OR_API_KEY)
|
|
||||||
async def _(model_uuid: str) -> str:
|
|
||||||
json_data = await quart.request.json
|
|
||||||
|
|
||||||
await self.ap.rerank_models_service.test_rerank_model(model_uuid, json_data)
|
|
||||||
|
|
||||||
return self.success()
|
|
||||||
|
|||||||
@@ -15,7 +15,6 @@ class ModelProvidersRouterGroup(group.RouterGroup):
|
|||||||
counts = await self.ap.provider_service.get_provider_model_counts(provider['uuid'])
|
counts = await self.ap.provider_service.get_provider_model_counts(provider['uuid'])
|
||||||
provider['llm_count'] = counts['llm_count']
|
provider['llm_count'] = counts['llm_count']
|
||||||
provider['embedding_count'] = counts['embedding_count']
|
provider['embedding_count'] = counts['embedding_count']
|
||||||
provider['rerank_count'] = counts['rerank_count']
|
|
||||||
return self.success(data={'providers': providers})
|
return self.success(data={'providers': providers})
|
||||||
elif quart.request.method == 'POST':
|
elif quart.request.method == 'POST':
|
||||||
json_data = await quart.request.json
|
json_data = await quart.request.json
|
||||||
@@ -33,7 +32,6 @@ class ModelProvidersRouterGroup(group.RouterGroup):
|
|||||||
counts = await self.ap.provider_service.get_provider_model_counts(provider_uuid)
|
counts = await self.ap.provider_service.get_provider_model_counts(provider_uuid)
|
||||||
provider['llm_count'] = counts['llm_count']
|
provider['llm_count'] = counts['llm_count']
|
||||||
provider['embedding_count'] = counts['embedding_count']
|
provider['embedding_count'] = counts['embedding_count']
|
||||||
provider['rerank_count'] = counts['rerank_count']
|
|
||||||
return self.success(data={'provider': provider})
|
return self.success(data={'provider': provider})
|
||||||
elif quart.request.method == 'PUT':
|
elif quart.request.method == 'PUT':
|
||||||
json_data = await quart.request.json
|
json_data = await quart.request.json
|
||||||
@@ -45,12 +43,3 @@ class ModelProvidersRouterGroup(group.RouterGroup):
|
|||||||
return self.success()
|
return self.success()
|
||||||
except ValueError as e:
|
except ValueError as e:
|
||||||
return self.http_status(400, -1, str(e))
|
return self.http_status(400, -1, str(e))
|
||||||
|
|
||||||
@self.route('/<provider_uuid>/scan-models', methods=['GET'], auth_type=group.AuthType.USER_TOKEN_OR_API_KEY)
|
|
||||||
async def _(provider_uuid: str) -> str:
|
|
||||||
try:
|
|
||||||
model_type = quart.request.args.get('type')
|
|
||||||
result = await self.ap.provider_service.scan_provider_models(provider_uuid, model_type)
|
|
||||||
return self.success(data=result)
|
|
||||||
except ValueError as e:
|
|
||||||
return self.http_status(400, -1, str(e))
|
|
||||||
|
|||||||
@@ -31,9 +31,6 @@ class MCPRouterGroup(group.RouterGroup):
|
|||||||
@self.route('/servers/<server_name>', methods=['GET', 'PUT', 'DELETE'], auth_type=group.AuthType.USER_TOKEN)
|
@self.route('/servers/<server_name>', methods=['GET', 'PUT', 'DELETE'], auth_type=group.AuthType.USER_TOKEN)
|
||||||
async def _(server_name: str) -> str:
|
async def _(server_name: str) -> str:
|
||||||
"""获取、更新或删除MCP服务器配置"""
|
"""获取、更新或删除MCP服务器配置"""
|
||||||
from urllib.parse import unquote
|
|
||||||
|
|
||||||
server_name = unquote(server_name)
|
|
||||||
|
|
||||||
server_data = await self.ap.mcp_service.get_mcp_server_by_name(server_name)
|
server_data = await self.ap.mcp_service.get_mcp_server_by_name(server_name)
|
||||||
if server_data is None:
|
if server_data is None:
|
||||||
@@ -60,9 +57,6 @@ class MCPRouterGroup(group.RouterGroup):
|
|||||||
@self.route('/servers/<server_name>/test', methods=['POST'], auth_type=group.AuthType.USER_TOKEN)
|
@self.route('/servers/<server_name>/test', methods=['POST'], auth_type=group.AuthType.USER_TOKEN)
|
||||||
async def _(server_name: str) -> str:
|
async def _(server_name: str) -> str:
|
||||||
"""测试MCP服务器连接"""
|
"""测试MCP服务器连接"""
|
||||||
from urllib.parse import unquote
|
|
||||||
|
|
||||||
server_name = unquote(server_name)
|
|
||||||
server_data = await quart.request.json
|
server_data = await quart.request.json
|
||||||
task_id = await self.ap.mcp_service.test_mcp_server(server_name=server_name, server_data=server_data)
|
task_id = await self.ap.mcp_service.test_mcp_server(server_name=server_name, server_data=server_data)
|
||||||
return self.success(data={'task_id': task_id})
|
return self.success(data={'task_id': task_id})
|
||||||
|
|||||||
@@ -1,190 +0,0 @@
|
|||||||
from __future__ import annotations
|
|
||||||
|
|
||||||
import quart
|
|
||||||
|
|
||||||
from langbot_plugin.box.errors import BoxError
|
|
||||||
|
|
||||||
from .. import group
|
|
||||||
|
|
||||||
|
|
||||||
@group.group_class('skills', '/api/v1/skills')
|
|
||||||
class SkillsRouterGroup(group.RouterGroup):
|
|
||||||
"""Skills management API endpoints."""
|
|
||||||
|
|
||||||
async def initialize(self) -> None:
|
|
||||||
@self.route('', methods=['GET', 'POST'], auth_type=group.AuthType.USER_TOKEN_OR_API_KEY)
|
|
||||||
async def list_or_create_skills() -> quart.Response:
|
|
||||||
if quart.request.method == 'GET':
|
|
||||||
try:
|
|
||||||
skills = await self.ap.skill_service.list_skills()
|
|
||||||
except (ValueError, BoxError) as exc:
|
|
||||||
return self.http_status(400, -1, str(exc))
|
|
||||||
return self.success(data={'skills': skills})
|
|
||||||
|
|
||||||
data = await quart.request.json
|
|
||||||
if 'name' not in data or not data['name']:
|
|
||||||
return self.http_status(400, -1, 'Missing required field: name')
|
|
||||||
|
|
||||||
try:
|
|
||||||
skill = await self.ap.skill_service.create_skill(data)
|
|
||||||
return self.success(data={'skill': skill})
|
|
||||||
except (ValueError, BoxError) as exc:
|
|
||||||
return self.http_status(400, -1, str(exc))
|
|
||||||
|
|
||||||
@self.route('/<skill_name>', methods=['GET', 'PUT', 'DELETE'], auth_type=group.AuthType.USER_TOKEN_OR_API_KEY)
|
|
||||||
async def get_update_delete_skill(skill_name: str) -> quart.Response:
|
|
||||||
if quart.request.method == 'GET':
|
|
||||||
try:
|
|
||||||
skill = await self.ap.skill_service.get_skill(skill_name)
|
|
||||||
except (ValueError, BoxError) as exc:
|
|
||||||
return self.http_status(400, -1, str(exc))
|
|
||||||
if not skill:
|
|
||||||
return self.http_status(404, -1, 'Skill not found')
|
|
||||||
return self.success(data={'skill': skill})
|
|
||||||
|
|
||||||
if quart.request.method == 'PUT':
|
|
||||||
data = await quart.request.json
|
|
||||||
try:
|
|
||||||
skill = await self.ap.skill_service.update_skill(skill_name, data)
|
|
||||||
return self.success(data={'skill': skill})
|
|
||||||
except (ValueError, BoxError) as exc:
|
|
||||||
return self.http_status(400, -1, str(exc))
|
|
||||||
|
|
||||||
try:
|
|
||||||
await self.ap.skill_service.delete_skill(skill_name)
|
|
||||||
return self.success()
|
|
||||||
except (ValueError, BoxError) as exc:
|
|
||||||
return self.http_status(400, -1, str(exc))
|
|
||||||
|
|
||||||
@self.route('/<skill_name>/files', methods=['GET'], auth_type=group.AuthType.USER_TOKEN_OR_API_KEY)
|
|
||||||
async def list_skill_files(skill_name: str) -> quart.Response:
|
|
||||||
"""List files in skill package directory."""
|
|
||||||
path = quart.request.args.get('path', '.').strip()
|
|
||||||
include_hidden = quart.request.args.get('include_hidden', 'false').lower() == 'true'
|
|
||||||
|
|
||||||
try:
|
|
||||||
result = await self.ap.skill_service.list_skill_files(
|
|
||||||
skill_name,
|
|
||||||
path=path,
|
|
||||||
include_hidden=include_hidden,
|
|
||||||
)
|
|
||||||
return self.success(data=result)
|
|
||||||
except (ValueError, BoxError) as exc:
|
|
||||||
return self.http_status(400, -1, str(exc))
|
|
||||||
|
|
||||||
@self.route(
|
|
||||||
'/<skill_name>/files/<path:path>', methods=['GET', 'PUT'], auth_type=group.AuthType.USER_TOKEN_OR_API_KEY
|
|
||||||
)
|
|
||||||
async def read_or_write_skill_file(skill_name: str, path: str) -> quart.Response:
|
|
||||||
"""Read or write a file in skill package."""
|
|
||||||
if quart.request.method == 'GET':
|
|
||||||
try:
|
|
||||||
result = await self.ap.skill_service.read_skill_file(skill_name, path)
|
|
||||||
return self.success(data=result)
|
|
||||||
except (ValueError, BoxError) as exc:
|
|
||||||
return self.http_status(400, -1, str(exc))
|
|
||||||
|
|
||||||
# PUT - write file
|
|
||||||
data = await quart.request.json
|
|
||||||
content = data.get('content', '')
|
|
||||||
if content is None:
|
|
||||||
return self.http_status(400, -1, 'Missing required field: content')
|
|
||||||
|
|
||||||
try:
|
|
||||||
result = await self.ap.skill_service.write_skill_file(skill_name, path, content)
|
|
||||||
return self.success(data=result)
|
|
||||||
except (ValueError, BoxError) as exc:
|
|
||||||
return self.http_status(400, -1, str(exc))
|
|
||||||
|
|
||||||
@self.route('/<skill_name>/preview', methods=['GET'], auth_type=group.AuthType.USER_TOKEN_OR_API_KEY)
|
|
||||||
async def preview_skill(skill_name: str) -> quart.Response:
|
|
||||||
skill = self.ap.skill_mgr.get_skill_by_name(skill_name)
|
|
||||||
if not skill:
|
|
||||||
return self.http_status(404, -1, 'Skill not found')
|
|
||||||
return self.success(data={'instructions': skill.get('instructions', '')})
|
|
||||||
|
|
||||||
@self.route('/install/github', methods=['POST'], auth_type=group.AuthType.USER_TOKEN_OR_API_KEY)
|
|
||||||
async def install_skill_from_github() -> quart.Response:
|
|
||||||
data = await quart.request.json
|
|
||||||
required_fields = ['asset_url', 'owner', 'repo']
|
|
||||||
for field in required_fields:
|
|
||||||
if field not in data or not data[field]:
|
|
||||||
return self.http_status(400, -1, f'Missing required field: {field}')
|
|
||||||
asset_url = str(data['asset_url']).strip().lower().split('?', 1)[0].split('#', 1)[0]
|
|
||||||
if not asset_url.endswith('skill.md') and not data.get('release_tag'):
|
|
||||||
return self.http_status(400, -1, 'Missing required field: release_tag')
|
|
||||||
|
|
||||||
try:
|
|
||||||
skill = await self.ap.skill_service.install_from_github(data)
|
|
||||||
return self.success(data={'skills': skill})
|
|
||||||
except (ValueError, BoxError) as exc:
|
|
||||||
return self.http_status(400, -1, str(exc))
|
|
||||||
except Exception as exc:
|
|
||||||
return self.http_status(500, -1, f'Failed to install skill: {exc}')
|
|
||||||
|
|
||||||
@self.route('/install/github/preview', methods=['POST'], auth_type=group.AuthType.USER_TOKEN_OR_API_KEY)
|
|
||||||
async def preview_skill_from_github() -> quart.Response:
|
|
||||||
data = await quart.request.json
|
|
||||||
required_fields = ['asset_url', 'owner', 'repo']
|
|
||||||
for field in required_fields:
|
|
||||||
if field not in data or not data[field]:
|
|
||||||
return self.http_status(400, -1, f'Missing required field: {field}')
|
|
||||||
asset_url = str(data['asset_url']).strip().lower().split('?', 1)[0].split('#', 1)[0]
|
|
||||||
if not asset_url.endswith('skill.md') and not data.get('release_tag'):
|
|
||||||
return self.http_status(400, -1, 'Missing required field: release_tag')
|
|
||||||
|
|
||||||
try:
|
|
||||||
preview = await self.ap.skill_service.preview_install_from_github(data)
|
|
||||||
return self.success(data={'skills': preview})
|
|
||||||
except (ValueError, BoxError) as exc:
|
|
||||||
return self.http_status(400, -1, str(exc))
|
|
||||||
except Exception as exc:
|
|
||||||
return self.http_status(500, -1, f'Failed to preview skill: {exc}')
|
|
||||||
|
|
||||||
@self.route('/install/upload', methods=['POST'], auth_type=group.AuthType.USER_TOKEN_OR_API_KEY)
|
|
||||||
async def install_skill_from_upload() -> quart.Response:
|
|
||||||
file = (await quart.request.files).get('file')
|
|
||||||
if file is None:
|
|
||||||
return self.http_status(400, -1, 'file is required')
|
|
||||||
form = await quart.request.form
|
|
||||||
|
|
||||||
try:
|
|
||||||
skill = await self.ap.skill_service.install_from_zip_upload(
|
|
||||||
file_bytes=file.read(),
|
|
||||||
filename=file.filename or '',
|
|
||||||
source_paths=form.getlist('source_paths'),
|
|
||||||
)
|
|
||||||
return self.success(data={'skills': skill})
|
|
||||||
except (ValueError, BoxError) as exc:
|
|
||||||
return self.http_status(400, -1, str(exc))
|
|
||||||
except Exception as exc:
|
|
||||||
return self.http_status(500, -1, f'Failed to install skill: {exc}')
|
|
||||||
|
|
||||||
@self.route('/install/upload/preview', methods=['POST'], auth_type=group.AuthType.USER_TOKEN_OR_API_KEY)
|
|
||||||
async def preview_skill_from_upload() -> quart.Response:
|
|
||||||
file = (await quart.request.files).get('file')
|
|
||||||
if file is None:
|
|
||||||
return self.http_status(400, -1, 'file is required')
|
|
||||||
|
|
||||||
try:
|
|
||||||
preview = await self.ap.skill_service.preview_install_from_zip_upload(
|
|
||||||
file_bytes=file.read(),
|
|
||||||
filename=file.filename or '',
|
|
||||||
)
|
|
||||||
return self.success(data={'skills': preview})
|
|
||||||
except (ValueError, BoxError) as exc:
|
|
||||||
return self.http_status(400, -1, str(exc))
|
|
||||||
except Exception as exc:
|
|
||||||
return self.http_status(500, -1, f'Failed to preview skill: {exc}')
|
|
||||||
|
|
||||||
@self.route('/scan', methods=['GET'], auth_type=group.AuthType.USER_TOKEN_OR_API_KEY)
|
|
||||||
async def scan_skill_directory() -> quart.Response:
|
|
||||||
path = quart.request.args.get('path', '').strip()
|
|
||||||
if not path:
|
|
||||||
return self.http_status(400, -1, 'Missing required parameter: path')
|
|
||||||
|
|
||||||
try:
|
|
||||||
result = await self.ap.skill_service.scan_directory_async(path)
|
|
||||||
return self.success(data=result)
|
|
||||||
except (ValueError, BoxError) as exc:
|
|
||||||
return self.http_status(400, -1, str(exc))
|
|
||||||
@@ -31,18 +31,6 @@ class SystemRouterGroup(group.RouterGroup):
|
|||||||
except Exception:
|
except Exception:
|
||||||
pass
|
pass
|
||||||
|
|
||||||
# ``system.outbound_ips`` may be a comma-separated string instead of
|
|
||||||
# a list when injected via the SYSTEM__OUTBOUND_IPS env var into a
|
|
||||||
# pre-existing data/config.yaml that lacks the key (env overrides
|
|
||||||
# only coerce to list when the key already holds one).
|
|
||||||
outbound_ips = self.ap.instance_config.data.get('system', {}).get('outbound_ips', [])
|
|
||||||
if isinstance(outbound_ips, str):
|
|
||||||
outbound_ips = [ip.strip() for ip in outbound_ips.split(',') if ip.strip()]
|
|
||||||
elif isinstance(outbound_ips, list):
|
|
||||||
outbound_ips = [str(ip).strip() for ip in outbound_ips if str(ip).strip()]
|
|
||||||
else:
|
|
||||||
outbound_ips = []
|
|
||||||
|
|
||||||
return self.success(
|
return self.success(
|
||||||
data={
|
data={
|
||||||
'version': constants.semantic_version,
|
'version': constants.semantic_version,
|
||||||
@@ -61,7 +49,6 @@ class SystemRouterGroup(group.RouterGroup):
|
|||||||
'disable_models_service', False
|
'disable_models_service', False
|
||||||
),
|
),
|
||||||
'limitation': self.ap.instance_config.data.get('system', {}).get('limitation', {}),
|
'limitation': self.ap.instance_config.data.get('system', {}).get('limitation', {}),
|
||||||
'outbound_ips': outbound_ips,
|
|
||||||
'wizard_status': wizard_status,
|
'wizard_status': wizard_status,
|
||||||
'wizard_progress': wizard_progress,
|
'wizard_progress': wizard_progress,
|
||||||
}
|
}
|
||||||
@@ -149,9 +136,16 @@ class SystemRouterGroup(group.RouterGroup):
|
|||||||
|
|
||||||
return self.success(data=task.to_dict())
|
return self.success(data=task.to_dict())
|
||||||
|
|
||||||
@self.route('/storage-analysis', methods=['GET'], auth_type=group.AuthType.USER_TOKEN)
|
@self.route('/debug/exec', methods=['POST'], auth_type=group.AuthType.USER_TOKEN)
|
||||||
async def _() -> str:
|
async def _() -> str:
|
||||||
return self.success(data=await self.ap.maintenance_service.get_storage_analysis())
|
if not constants.debug_mode:
|
||||||
|
return self.http_status(403, 403, 'Forbidden')
|
||||||
|
|
||||||
|
py_code = await quart.request.data
|
||||||
|
|
||||||
|
ap = self.ap
|
||||||
|
|
||||||
|
return self.success(data=exec(py_code, {'ap': ap}))
|
||||||
|
|
||||||
@self.route(
|
@self.route(
|
||||||
'/debug/plugin/action',
|
'/debug/plugin/action',
|
||||||
|
|||||||
@@ -146,7 +146,6 @@ class UserRouterGroup(group.RouterGroup):
|
|||||||
return self.fail(3, str(e))
|
return self.fail(3, str(e))
|
||||||
except ValueError as e:
|
except ValueError as e:
|
||||||
traceback.print_exc()
|
traceback.print_exc()
|
||||||
self.ap.logger.warning(f'Space OAuth callback failed: {e}')
|
|
||||||
return self.fail(1, str(e))
|
return self.fail(1, str(e))
|
||||||
except Exception as e:
|
except Exception as e:
|
||||||
traceback.print_exc()
|
traceback.print_exc()
|
||||||
|
|||||||
@@ -105,24 +105,23 @@ class HTTPController:
|
|||||||
):
|
):
|
||||||
if os.path.exists(os.path.join(frontend_path, path + '.html')):
|
if os.path.exists(os.path.join(frontend_path, path + '.html')):
|
||||||
path += '.html'
|
path += '.html'
|
||||||
elif not path.startswith('api/'):
|
elif path.startswith('home/'):
|
||||||
# SPA fallback: serve index.html for all non-API, non-static routes
|
# SPA fallback for /home/* sub-routes.
|
||||||
# so that React Router can handle client-side routing (Vite SPA).
|
# Entity detail views use query params (e.g. /home/bots?id=uuid),
|
||||||
# For /home/* sub-routes, first try parent .html files (pre-rendered pages).
|
# so the pre-rendered list page is served directly via path + '.html'.
|
||||||
if path.startswith('home/'):
|
# This fallback handles any remaining unmatched sub-paths.
|
||||||
segments = path.rstrip('/').split('/')
|
segments = path.rstrip('/').split('/')
|
||||||
|
|
||||||
|
# Walk up parent segments looking for matching .html files
|
||||||
for i in range(len(segments) - 1, 0, -1):
|
for i in range(len(segments) - 1, 0, -1):
|
||||||
parent_path = '/'.join(segments[:i]) + '.html'
|
parent_path = '/'.join(segments[:i]) + '.html'
|
||||||
if os.path.exists(os.path.join(frontend_path, parent_path)):
|
if os.path.exists(os.path.join(frontend_path, parent_path)):
|
||||||
response = await quart.send_from_directory(
|
response = await quart.send_from_directory(frontend_path, parent_path, mimetype='text/html')
|
||||||
frontend_path, parent_path, mimetype='text/html'
|
|
||||||
)
|
|
||||||
response.headers['Cache-Control'] = 'no-cache, no-store, must-revalidate'
|
response.headers['Cache-Control'] = 'no-cache, no-store, must-revalidate'
|
||||||
response.headers['Pragma'] = 'no-cache'
|
response.headers['Pragma'] = 'no-cache'
|
||||||
response.headers['Expires'] = '0'
|
response.headers['Expires'] = '0'
|
||||||
return response
|
return response
|
||||||
|
# Final fallback to index.html for /home/* routes
|
||||||
# Fallback to index.html for SPA client-side routing
|
|
||||||
response = await quart.send_from_directory(frontend_path, 'index.html', mimetype='text/html')
|
response = await quart.send_from_directory(frontend_path, 'index.html', mimetype='text/html')
|
||||||
response.headers['Cache-Control'] = 'no-cache, no-store, must-revalidate'
|
response.headers['Cache-Control'] = 'no-cache, no-store, must-revalidate'
|
||||||
response.headers['Pragma'] = 'no-cache'
|
response.headers['Pragma'] = 'no-cache'
|
||||||
|
|||||||
@@ -52,9 +52,6 @@ class ApiKeyService:
|
|||||||
|
|
||||||
async def verify_api_key(self, key: str) -> bool:
|
async def verify_api_key(self, key: str) -> bool:
|
||||||
"""Verify if an API key is valid"""
|
"""Verify if an API key is valid"""
|
||||||
if not isinstance(key, str) or not key.startswith('lbk_'):
|
|
||||||
return False
|
|
||||||
|
|
||||||
result = await self.ap.persistence_mgr.execute_async(
|
result = await self.ap.persistence_mgr.execute_async(
|
||||||
sqlalchemy.select(apikey.ApiKey).where(apikey.ApiKey.key == key)
|
sqlalchemy.select(apikey.ApiKey).where(apikey.ApiKey.key == key)
|
||||||
)
|
)
|
||||||
|
|||||||
@@ -5,7 +5,6 @@ import sqlalchemy
|
|||||||
import typing
|
import typing
|
||||||
|
|
||||||
from ....core import app
|
from ....core import app
|
||||||
from ....discover import engine
|
|
||||||
from ....entity.persistence import bot as persistence_bot
|
from ....entity.persistence import bot as persistence_bot
|
||||||
from ....entity.persistence import pipeline as persistence_pipeline
|
from ....entity.persistence import pipeline as persistence_pipeline
|
||||||
|
|
||||||
@@ -18,24 +17,6 @@ class BotService:
|
|||||||
def __init__(self, ap: app.Application) -> None:
|
def __init__(self, ap: app.Application) -> None:
|
||||||
self.ap = ap
|
self.ap = ap
|
||||||
|
|
||||||
def _get_adapter_component(self, adapter_name: str) -> engine.Component | None:
|
|
||||||
"""Return the discovered platform adapter component for an adapter name."""
|
|
||||||
for component in self.ap.discover.get_components_by_kind('MessagePlatformAdapter'):
|
|
||||||
if component.metadata.name == adapter_name:
|
|
||||||
return component
|
|
||||||
return None
|
|
||||||
|
|
||||||
def _adapter_declares_webhook_url(self, adapter_name: str) -> bool:
|
|
||||||
"""Whether the adapter manifest declares a generated webhook URL config item."""
|
|
||||||
component = self._get_adapter_component(adapter_name)
|
|
||||||
if component is None:
|
|
||||||
return False
|
|
||||||
|
|
||||||
for config_item in component.spec.get('config', []):
|
|
||||||
if config_item.get('type') == 'webhook-url':
|
|
||||||
return True
|
|
||||||
return False
|
|
||||||
|
|
||||||
async def get_bots(self, include_secret: bool = True) -> list[dict]:
|
async def get_bots(self, include_secret: bool = True) -> list[dict]:
|
||||||
"""获取所有机器人"""
|
"""获取所有机器人"""
|
||||||
result = await self.ap.persistence_mgr.execute_async(sqlalchemy.select(persistence_bot.Bot))
|
result = await self.ap.persistence_mgr.execute_async(sqlalchemy.select(persistence_bot.Bot))
|
||||||
@@ -77,10 +58,17 @@ class BotService:
|
|||||||
if runtime_bot is not None:
|
if runtime_bot is not None:
|
||||||
adapter_runtime_values['bot_account_id'] = runtime_bot.adapter.bot_account_id
|
adapter_runtime_values['bot_account_id'] = runtime_bot.adapter.bot_account_id
|
||||||
|
|
||||||
# Webhook URL for adapters that declare a generated webhook config item.
|
# Webhook URL for unified webhook adapters (independent of bot running state)
|
||||||
# This is manifest-driven so EBA adapters do not need to be mirrored in a
|
if persistence_bot['adapter'] in [
|
||||||
# second hard-coded list.
|
'wecom',
|
||||||
if self._adapter_declares_webhook_url(persistence_bot['adapter']):
|
'wecombot',
|
||||||
|
'officialaccount',
|
||||||
|
'qqofficial',
|
||||||
|
'slack',
|
||||||
|
'wecomcs',
|
||||||
|
'LINE',
|
||||||
|
'lark',
|
||||||
|
]:
|
||||||
webhook_prefix = self.ap.instance_config.data['api'].get('webhook_prefix', 'http://127.0.0.1:5300')
|
webhook_prefix = self.ap.instance_config.data['api'].get('webhook_prefix', 'http://127.0.0.1:5300')
|
||||||
extra_webhook_prefix = self.ap.instance_config.data['api'].get('extra_webhook_prefix', '')
|
extra_webhook_prefix = self.ap.instance_config.data['api'].get('extra_webhook_prefix', '')
|
||||||
webhook_url = f'/bots/{bot_uuid}'
|
webhook_url = f'/bots/{bot_uuid}'
|
||||||
@@ -111,11 +99,11 @@ class BotService:
|
|||||||
# TODO: 检查配置信息格式
|
# TODO: 检查配置信息格式
|
||||||
bot_data['uuid'] = str(uuid.uuid4())
|
bot_data['uuid'] = str(uuid.uuid4())
|
||||||
|
|
||||||
# bind the most recently updated pipeline if any exist
|
# checkout the default pipeline
|
||||||
result = await self.ap.persistence_mgr.execute_async(
|
result = await self.ap.persistence_mgr.execute_async(
|
||||||
sqlalchemy.select(persistence_pipeline.LegacyPipeline)
|
sqlalchemy.select(persistence_pipeline.LegacyPipeline).where(
|
||||||
.order_by(persistence_pipeline.LegacyPipeline.updated_at.desc())
|
persistence_pipeline.LegacyPipeline.is_default == True
|
||||||
.limit(1)
|
)
|
||||||
)
|
)
|
||||||
pipeline = result.first()
|
pipeline = result.first()
|
||||||
if pipeline is not None:
|
if pipeline is not None:
|
||||||
@@ -132,26 +120,24 @@ class BotService:
|
|||||||
|
|
||||||
async def update_bot(self, bot_uuid: str, bot_data: dict) -> None:
|
async def update_bot(self, bot_uuid: str, bot_data: dict) -> None:
|
||||||
"""Update bot"""
|
"""Update bot"""
|
||||||
update_data = bot_data.copy()
|
if 'uuid' in bot_data:
|
||||||
|
del bot_data['uuid']
|
||||||
if 'uuid' in update_data:
|
|
||||||
del update_data['uuid']
|
|
||||||
|
|
||||||
# set use_pipeline_name
|
# set use_pipeline_name
|
||||||
if 'use_pipeline_uuid' in update_data:
|
if 'use_pipeline_uuid' in bot_data:
|
||||||
result = await self.ap.persistence_mgr.execute_async(
|
result = await self.ap.persistence_mgr.execute_async(
|
||||||
sqlalchemy.select(persistence_pipeline.LegacyPipeline).where(
|
sqlalchemy.select(persistence_pipeline.LegacyPipeline).where(
|
||||||
persistence_pipeline.LegacyPipeline.uuid == update_data['use_pipeline_uuid']
|
persistence_pipeline.LegacyPipeline.uuid == bot_data['use_pipeline_uuid']
|
||||||
)
|
)
|
||||||
)
|
)
|
||||||
pipeline = result.first()
|
pipeline = result.first()
|
||||||
if pipeline is not None:
|
if pipeline is not None:
|
||||||
update_data['use_pipeline_name'] = pipeline.name
|
bot_data['use_pipeline_name'] = pipeline.name
|
||||||
else:
|
else:
|
||||||
raise Exception('Pipeline not found')
|
raise Exception('Pipeline not found')
|
||||||
|
|
||||||
await self.ap.persistence_mgr.execute_async(
|
await self.ap.persistence_mgr.execute_async(
|
||||||
sqlalchemy.update(persistence_bot.Bot).values(update_data).where(persistence_bot.Bot.uuid == bot_uuid)
|
sqlalchemy.update(persistence_bot.Bot).values(bot_data).where(persistence_bot.Bot.uuid == bot_uuid)
|
||||||
)
|
)
|
||||||
await self.ap.platform_mgr.remove_bot(bot_uuid)
|
await self.ap.platform_mgr.remove_bot(bot_uuid)
|
||||||
|
|
||||||
|
|||||||
314
src/langbot/pkg/api/http/service/human_takeover.py
Normal file
314
src/langbot/pkg/api/http/service/human_takeover.py
Normal file
@@ -0,0 +1,314 @@
|
|||||||
|
from __future__ import annotations
|
||||||
|
|
||||||
|
import uuid
|
||||||
|
import datetime
|
||||||
|
import json
|
||||||
|
import logging
|
||||||
|
|
||||||
|
import sqlalchemy
|
||||||
|
|
||||||
|
from ....core import app
|
||||||
|
from ....entity.persistence import human_takeover as persistence_human_takeover
|
||||||
|
|
||||||
|
import langbot_plugin.api.entities.builtin.platform.message as platform_message
|
||||||
|
|
||||||
|
|
||||||
|
class HumanTakeoverService:
|
||||||
|
"""Human takeover service.
|
||||||
|
|
||||||
|
Manages operator takeover of user conversation sessions, bypassing
|
||||||
|
the normal AI pipeline. Uses an in-memory cache for fast synchronous
|
||||||
|
lookups on the hot message path, backed by database persistence.
|
||||||
|
"""
|
||||||
|
|
||||||
|
ap: app.Application
|
||||||
|
|
||||||
|
# In-memory cache: session_id -> HumanTakeoverSession record id
|
||||||
|
# Only contains sessions with status='active'
|
||||||
|
_active_sessions: dict[str, str]
|
||||||
|
|
||||||
|
logger: logging.Logger
|
||||||
|
|
||||||
|
def __init__(self, ap: app.Application) -> None:
|
||||||
|
self.ap = ap
|
||||||
|
self._active_sessions = {}
|
||||||
|
self.logger = logging.getLogger('human-takeover')
|
||||||
|
|
||||||
|
async def initialize(self) -> None:
|
||||||
|
"""Load active takeover sessions from DB into memory cache."""
|
||||||
|
try:
|
||||||
|
result = await self.ap.persistence_mgr.execute_async(
|
||||||
|
sqlalchemy.select(persistence_human_takeover.HumanTakeoverSession).where(
|
||||||
|
persistence_human_takeover.HumanTakeoverSession.status == 'active'
|
||||||
|
)
|
||||||
|
)
|
||||||
|
rows = result.all()
|
||||||
|
for row in rows:
|
||||||
|
session = row[0] if isinstance(row, tuple) else row
|
||||||
|
self._active_sessions[session.session_id] = session.id
|
||||||
|
self.logger.info(f'Loaded {len(self._active_sessions)} active takeover sessions from DB')
|
||||||
|
except Exception as e:
|
||||||
|
self.logger.warning(f'Failed to load active takeover sessions: {e}')
|
||||||
|
|
||||||
|
def is_taken_over(self, session_id: str) -> bool:
|
||||||
|
"""Check if a session is currently under human takeover.
|
||||||
|
|
||||||
|
This is a synchronous in-memory lookup for performance, since it
|
||||||
|
is called on every incoming message (hot path).
|
||||||
|
"""
|
||||||
|
return session_id in self._active_sessions
|
||||||
|
|
||||||
|
async def takeover_session(
|
||||||
|
self,
|
||||||
|
session_id: str,
|
||||||
|
bot_uuid: str,
|
||||||
|
taken_by: str | None = None,
|
||||||
|
platform: str | None = None,
|
||||||
|
user_id: str | None = None,
|
||||||
|
user_name: str | None = None,
|
||||||
|
) -> dict:
|
||||||
|
"""Take over a conversation session.
|
||||||
|
|
||||||
|
Args:
|
||||||
|
session_id: The session to take over (e.g. 'person_123' or 'group_456').
|
||||||
|
bot_uuid: UUID of the bot whose session is being taken over.
|
||||||
|
taken_by: Email/username of the admin performing the takeover.
|
||||||
|
platform: Platform name.
|
||||||
|
user_id: The end-user's ID in the session.
|
||||||
|
user_name: The end-user's display name.
|
||||||
|
|
||||||
|
Returns:
|
||||||
|
Dict with the created takeover session record.
|
||||||
|
|
||||||
|
Raises:
|
||||||
|
ValueError: If the session is already taken over.
|
||||||
|
"""
|
||||||
|
if self.is_taken_over(session_id):
|
||||||
|
raise ValueError(f'Session {session_id} is already taken over')
|
||||||
|
|
||||||
|
record_id = str(uuid.uuid4())
|
||||||
|
now = datetime.datetime.now(datetime.timezone.utc).replace(tzinfo=None)
|
||||||
|
|
||||||
|
record_data = {
|
||||||
|
'id': record_id,
|
||||||
|
'session_id': session_id,
|
||||||
|
'bot_uuid': bot_uuid,
|
||||||
|
'status': 'active',
|
||||||
|
'taken_by': taken_by,
|
||||||
|
'taken_at': now,
|
||||||
|
'released_at': None,
|
||||||
|
'platform': platform,
|
||||||
|
'user_id': user_id,
|
||||||
|
'user_name': user_name,
|
||||||
|
}
|
||||||
|
|
||||||
|
await self.ap.persistence_mgr.execute_async(
|
||||||
|
sqlalchemy.insert(persistence_human_takeover.HumanTakeoverSession).values(record_data)
|
||||||
|
)
|
||||||
|
|
||||||
|
# Update in-memory cache
|
||||||
|
self._active_sessions[session_id] = record_id
|
||||||
|
|
||||||
|
self.logger.info(f'Session {session_id} taken over by {taken_by}')
|
||||||
|
|
||||||
|
return record_data
|
||||||
|
|
||||||
|
async def release_session(self, session_id: str) -> dict:
|
||||||
|
"""Release a taken-over session back to AI pipeline processing.
|
||||||
|
|
||||||
|
Args:
|
||||||
|
session_id: The session to release.
|
||||||
|
|
||||||
|
Returns:
|
||||||
|
Dict with the updated takeover session record.
|
||||||
|
|
||||||
|
Raises:
|
||||||
|
ValueError: If the session is not currently taken over.
|
||||||
|
"""
|
||||||
|
if not self.is_taken_over(session_id):
|
||||||
|
raise ValueError(f'Session {session_id} is not currently taken over')
|
||||||
|
|
||||||
|
now = datetime.datetime.now(datetime.timezone.utc).replace(tzinfo=None)
|
||||||
|
|
||||||
|
await self.ap.persistence_mgr.execute_async(
|
||||||
|
sqlalchemy.update(persistence_human_takeover.HumanTakeoverSession)
|
||||||
|
.where(
|
||||||
|
sqlalchemy.and_(
|
||||||
|
persistence_human_takeover.HumanTakeoverSession.session_id == session_id,
|
||||||
|
persistence_human_takeover.HumanTakeoverSession.status == 'active',
|
||||||
|
)
|
||||||
|
)
|
||||||
|
.values(status='released', released_at=now)
|
||||||
|
)
|
||||||
|
|
||||||
|
# Remove from in-memory cache
|
||||||
|
self._active_sessions.pop(session_id, None)
|
||||||
|
|
||||||
|
self.logger.info(f'Session {session_id} released back to AI pipeline')
|
||||||
|
|
||||||
|
return {
|
||||||
|
'session_id': session_id,
|
||||||
|
'status': 'released',
|
||||||
|
'released_at': now.isoformat(),
|
||||||
|
}
|
||||||
|
|
||||||
|
async def send_message(
|
||||||
|
self,
|
||||||
|
session_id: str,
|
||||||
|
message_text: str,
|
||||||
|
operator_name: str | None = None,
|
||||||
|
) -> dict:
|
||||||
|
"""Send a message from the operator to the user via the platform adapter.
|
||||||
|
|
||||||
|
Args:
|
||||||
|
session_id: The taken-over session ID (e.g. 'person_123' or 'group_456').
|
||||||
|
message_text: The text message to send.
|
||||||
|
operator_name: Name of the operator sending the message.
|
||||||
|
|
||||||
|
Returns:
|
||||||
|
Dict with send result info.
|
||||||
|
|
||||||
|
Raises:
|
||||||
|
ValueError: If the session is not currently taken over.
|
||||||
|
RuntimeError: If the bot or adapter cannot be found.
|
||||||
|
"""
|
||||||
|
if not self.is_taken_over(session_id):
|
||||||
|
raise ValueError(f'Session {session_id} is not currently taken over')
|
||||||
|
|
||||||
|
# Look up the takeover record to get bot_uuid
|
||||||
|
result = await self.ap.persistence_mgr.execute_async(
|
||||||
|
sqlalchemy.select(persistence_human_takeover.HumanTakeoverSession).where(
|
||||||
|
sqlalchemy.and_(
|
||||||
|
persistence_human_takeover.HumanTakeoverSession.session_id == session_id,
|
||||||
|
persistence_human_takeover.HumanTakeoverSession.status == 'active',
|
||||||
|
)
|
||||||
|
)
|
||||||
|
)
|
||||||
|
row = result.first()
|
||||||
|
if not row:
|
||||||
|
raise RuntimeError(f'Active takeover record not found for session {session_id}')
|
||||||
|
|
||||||
|
takeover_record = row[0] if isinstance(row, tuple) else row
|
||||||
|
bot_uuid = takeover_record.bot_uuid
|
||||||
|
|
||||||
|
# Get the runtime bot
|
||||||
|
runtime_bot = await self.ap.platform_mgr.get_bot_by_uuid(bot_uuid)
|
||||||
|
if not runtime_bot:
|
||||||
|
raise RuntimeError(f'Bot {bot_uuid} not found or not running')
|
||||||
|
|
||||||
|
# Parse session_id to determine target_type and target_id
|
||||||
|
# Format: 'person_{id}' or 'group_{id}'
|
||||||
|
if session_id.startswith('person_'):
|
||||||
|
target_type = 'person'
|
||||||
|
target_id = session_id[len('person_') :]
|
||||||
|
elif session_id.startswith('group_'):
|
||||||
|
target_type = 'group'
|
||||||
|
target_id = session_id[len('group_') :]
|
||||||
|
else:
|
||||||
|
raise ValueError(f'Invalid session_id format: {session_id}')
|
||||||
|
|
||||||
|
# Build message chain
|
||||||
|
message_chain = platform_message.MessageChain([platform_message.Plain(text=message_text)])
|
||||||
|
|
||||||
|
# Send via adapter
|
||||||
|
await runtime_bot.adapter.send_message(target_type, target_id, message_chain)
|
||||||
|
|
||||||
|
# Record the operator message in monitoring
|
||||||
|
bot_name = runtime_bot.bot_entity.name or bot_uuid
|
||||||
|
try:
|
||||||
|
message_content = json.dumps(message_chain.model_dump(), ensure_ascii=False)
|
||||||
|
except Exception:
|
||||||
|
message_content = message_text
|
||||||
|
|
||||||
|
await self.ap.monitoring_service.record_message(
|
||||||
|
bot_id=bot_uuid,
|
||||||
|
bot_name=bot_name,
|
||||||
|
pipeline_id='__human_takeover__',
|
||||||
|
pipeline_name='Human Takeover',
|
||||||
|
message_content=message_content,
|
||||||
|
session_id=session_id,
|
||||||
|
status='success',
|
||||||
|
level='info',
|
||||||
|
platform=takeover_record.platform,
|
||||||
|
user_id=operator_name or 'operator',
|
||||||
|
user_name=operator_name or 'Operator',
|
||||||
|
role='operator',
|
||||||
|
)
|
||||||
|
|
||||||
|
self.logger.info(f'Operator message sent to session {session_id}: {message_text[:50]}...')
|
||||||
|
|
||||||
|
return {
|
||||||
|
'session_id': session_id,
|
||||||
|
'message_sent': True,
|
||||||
|
}
|
||||||
|
|
||||||
|
async def get_active_sessions(
|
||||||
|
self,
|
||||||
|
bot_uuid: str | None = None,
|
||||||
|
limit: int = 100,
|
||||||
|
offset: int = 0,
|
||||||
|
) -> tuple[list[dict], int]:
|
||||||
|
"""Get list of active (or all) takeover sessions.
|
||||||
|
|
||||||
|
Args:
|
||||||
|
bot_uuid: Optional filter by bot UUID.
|
||||||
|
limit: Maximum number of results.
|
||||||
|
offset: Pagination offset.
|
||||||
|
|
||||||
|
Returns:
|
||||||
|
Tuple of (list of session dicts, total count).
|
||||||
|
"""
|
||||||
|
conditions = []
|
||||||
|
|
||||||
|
if bot_uuid:
|
||||||
|
conditions.append(persistence_human_takeover.HumanTakeoverSession.bot_uuid == bot_uuid)
|
||||||
|
|
||||||
|
# Count
|
||||||
|
count_query = sqlalchemy.select(sqlalchemy.func.count(persistence_human_takeover.HumanTakeoverSession.id))
|
||||||
|
if conditions:
|
||||||
|
count_query = count_query.where(sqlalchemy.and_(*conditions))
|
||||||
|
|
||||||
|
count_result = await self.ap.persistence_mgr.execute_async(count_query)
|
||||||
|
total = count_result.scalar() or 0
|
||||||
|
|
||||||
|
# Fetch records
|
||||||
|
query = sqlalchemy.select(persistence_human_takeover.HumanTakeoverSession).order_by(
|
||||||
|
persistence_human_takeover.HumanTakeoverSession.taken_at.desc()
|
||||||
|
)
|
||||||
|
if conditions:
|
||||||
|
query = query.where(sqlalchemy.and_(*conditions))
|
||||||
|
|
||||||
|
query = query.limit(limit).offset(offset)
|
||||||
|
|
||||||
|
result = await self.ap.persistence_mgr.execute_async(query)
|
||||||
|
rows = result.all()
|
||||||
|
|
||||||
|
sessions = []
|
||||||
|
for row in rows:
|
||||||
|
session = row[0] if isinstance(row, tuple) else row
|
||||||
|
sessions.append(
|
||||||
|
self.ap.persistence_mgr.serialize_model(persistence_human_takeover.HumanTakeoverSession, session)
|
||||||
|
)
|
||||||
|
|
||||||
|
return sessions, total
|
||||||
|
|
||||||
|
async def get_session_detail(self, session_id: str) -> dict | None:
|
||||||
|
"""Get detail for a specific takeover session.
|
||||||
|
|
||||||
|
Args:
|
||||||
|
session_id: The session ID to look up.
|
||||||
|
|
||||||
|
Returns:
|
||||||
|
Session dict or None if not found.
|
||||||
|
"""
|
||||||
|
result = await self.ap.persistence_mgr.execute_async(
|
||||||
|
sqlalchemy.select(persistence_human_takeover.HumanTakeoverSession)
|
||||||
|
.where(persistence_human_takeover.HumanTakeoverSession.session_id == session_id)
|
||||||
|
.order_by(persistence_human_takeover.HumanTakeoverSession.taken_at.desc())
|
||||||
|
)
|
||||||
|
row = result.first()
|
||||||
|
if not row:
|
||||||
|
return None
|
||||||
|
|
||||||
|
session = row[0] if isinstance(row, tuple) else row
|
||||||
|
return self.ap.persistence_mgr.serialize_model(persistence_human_takeover.HumanTakeoverSession, session)
|
||||||
@@ -31,126 +31,15 @@ class KnowledgeService:
|
|||||||
if not knowledge_engine_plugin_id:
|
if not knowledge_engine_plugin_id:
|
||||||
raise ValueError('knowledge_engine_plugin_id is required')
|
raise ValueError('knowledge_engine_plugin_id is required')
|
||||||
|
|
||||||
creation_settings = kb_data.get('creation_settings', {})
|
|
||||||
retrieval_settings = kb_data.get('retrieval_settings', {})
|
|
||||||
|
|
||||||
# Validate required fields based on plugin's creation_schema and retrieval_schema
|
|
||||||
await self._validate_schema_required_fields(
|
|
||||||
knowledge_engine_plugin_id,
|
|
||||||
creation_settings,
|
|
||||||
retrieval_settings,
|
|
||||||
)
|
|
||||||
|
|
||||||
kb = await self.ap.rag_mgr.create_knowledge_base(
|
kb = await self.ap.rag_mgr.create_knowledge_base(
|
||||||
name=kb_data.get('name', 'Untitled'),
|
name=kb_data.get('name', 'Untitled'),
|
||||||
knowledge_engine_plugin_id=knowledge_engine_plugin_id,
|
knowledge_engine_plugin_id=knowledge_engine_plugin_id,
|
||||||
creation_settings=creation_settings,
|
creation_settings=kb_data.get('creation_settings', {}),
|
||||||
retrieval_settings=retrieval_settings,
|
retrieval_settings=kb_data.get('retrieval_settings', {}),
|
||||||
description=kb_data.get('description', ''),
|
description=kb_data.get('description', ''),
|
||||||
)
|
)
|
||||||
return kb.uuid
|
return kb.uuid
|
||||||
|
|
||||||
async def _validate_schema_required_fields(
|
|
||||||
self,
|
|
||||||
plugin_id: str,
|
|
||||||
creation_settings: dict,
|
|
||||||
retrieval_settings: dict,
|
|
||||||
) -> None:
|
|
||||||
"""Validate required fields based on plugin's creation_schema and retrieval_schema.
|
|
||||||
|
|
||||||
This is a business-agnostic validation that checks all fields marked as
|
|
||||||
required in the plugin's schema, regardless of field type.
|
|
||||||
|
|
||||||
Args:
|
|
||||||
plugin_id: Knowledge Engine plugin ID.
|
|
||||||
creation_settings: User-provided creation settings.
|
|
||||||
retrieval_settings: User-provided retrieval settings.
|
|
||||||
|
|
||||||
Raises:
|
|
||||||
ValueError: If any required field is missing or empty.
|
|
||||||
"""
|
|
||||||
# Validate creation_schema
|
|
||||||
try:
|
|
||||||
creation_schema = await self.ap.plugin_connector.get_rag_creation_schema(plugin_id)
|
|
||||||
self._check_required_fields(creation_schema, creation_settings, 'creation_settings')
|
|
||||||
except ValueError:
|
|
||||||
raise
|
|
||||||
except Exception as e:
|
|
||||||
self.ap.logger.warning(f'Failed to get creation_schema for validation: {e}')
|
|
||||||
|
|
||||||
# Validate retrieval_schema
|
|
||||||
try:
|
|
||||||
retrieval_schema = await self.ap.plugin_connector.get_rag_retrieval_schema(plugin_id)
|
|
||||||
self._check_required_fields(retrieval_schema, retrieval_settings, 'retrieval_settings')
|
|
||||||
except ValueError:
|
|
||||||
raise
|
|
||||||
except Exception as e:
|
|
||||||
self.ap.logger.warning(f'Failed to get retrieval_schema for validation: {e}')
|
|
||||||
|
|
||||||
def _check_required_fields(
|
|
||||||
self,
|
|
||||||
schema: dict | list,
|
|
||||||
settings: dict,
|
|
||||||
context: str,
|
|
||||||
) -> None:
|
|
||||||
"""Check required fields in schema against provided settings.
|
|
||||||
|
|
||||||
Args:
|
|
||||||
schema: Plugin-defined schema (can be list or dict with 'schema' key).
|
|
||||||
settings: User-provided settings values.
|
|
||||||
context: Context name for error messages (e.g., 'creation_settings').
|
|
||||||
|
|
||||||
Raises:
|
|
||||||
ValueError: If a required field is missing or empty.
|
|
||||||
"""
|
|
||||||
if not schema:
|
|
||||||
return
|
|
||||||
|
|
||||||
# schema can be a list directly, or a dict with 'schema' key
|
|
||||||
items = schema if isinstance(schema, list) else schema.get('schema', [])
|
|
||||||
if not items:
|
|
||||||
return
|
|
||||||
|
|
||||||
for item in items:
|
|
||||||
field_name = item.get('name')
|
|
||||||
if not field_name:
|
|
||||||
continue
|
|
||||||
|
|
||||||
is_required = item.get('required', False)
|
|
||||||
if not is_required:
|
|
||||||
continue
|
|
||||||
|
|
||||||
# Check show_if condition - if field is conditionally shown, only validate when condition is met
|
|
||||||
show_if = item.get('show_if')
|
|
||||||
if show_if:
|
|
||||||
depend_field = show_if.get('field')
|
|
||||||
operator = show_if.get('operator')
|
|
||||||
expected_value = show_if.get('value')
|
|
||||||
|
|
||||||
if depend_field and operator:
|
|
||||||
depend_value = settings.get(depend_field)
|
|
||||||
# If show_if condition is not met, skip validation for this field
|
|
||||||
if operator == 'eq' and depend_value != expected_value:
|
|
||||||
continue
|
|
||||||
if operator == 'neq' and depend_value == expected_value:
|
|
||||||
continue
|
|
||||||
if operator == 'in' and isinstance(expected_value, list) and depend_value not in expected_value:
|
|
||||||
continue
|
|
||||||
|
|
||||||
value = settings.get(field_name)
|
|
||||||
|
|
||||||
# Validate required field has a non-empty value
|
|
||||||
if value is None or (isinstance(value, str) and value.strip() == ''):
|
|
||||||
# Get field label for friendly error message
|
|
||||||
label = item.get('label', {})
|
|
||||||
field_label = (
|
|
||||||
label.get('en_US', field_name)
|
|
||||||
or label.get('zh_Hans', field_name)
|
|
||||||
or label.get('zh_Hant', field_name)
|
|
||||||
or field_name
|
|
||||||
)
|
|
||||||
raise ValueError(f'{field_label} is required ({context}.{field_name})')
|
|
||||||
|
|
||||||
async def update_knowledge_base(self, kb_uuid: str, kb_data: dict) -> None:
|
async def update_knowledge_base(self, kb_uuid: str, kb_data: dict) -> None:
|
||||||
"""更新知识库"""
|
"""更新知识库"""
|
||||||
# Filter to only mutable fields
|
# Filter to only mutable fields
|
||||||
|
|||||||
@@ -1,309 +0,0 @@
|
|||||||
from __future__ import annotations
|
|
||||||
|
|
||||||
import datetime
|
|
||||||
import os
|
|
||||||
import re
|
|
||||||
from pathlib import Path
|
|
||||||
from typing import Any
|
|
||||||
|
|
||||||
import sqlalchemy
|
|
||||||
|
|
||||||
from ....core import app
|
|
||||||
from ....entity.persistence import bstorage as persistence_bstorage
|
|
||||||
from ....entity.persistence import monitoring as persistence_monitoring
|
|
||||||
|
|
||||||
|
|
||||||
LOG_FILE_PATTERN = re.compile(r'^langbot-(\d{4}-\d{2}-\d{2})\.log(?:\.\d+)?$')
|
|
||||||
DEFAULT_UPLOAD_FILE_RETENTION_DAYS = 7
|
|
||||||
DEFAULT_LOG_RETENTION_DAYS = 3
|
|
||||||
|
|
||||||
|
|
||||||
class MaintenanceService:
|
|
||||||
"""Storage maintenance and diagnostics."""
|
|
||||||
|
|
||||||
ap: app.Application
|
|
||||||
|
|
||||||
def __init__(self, ap: app.Application) -> None:
|
|
||||||
self.ap = ap
|
|
||||||
|
|
||||||
async def cleanup_expired_files(self) -> dict[str, int]:
|
|
||||||
cleanup_cfg = self.ap.instance_config.data.get('storage', {}).get('cleanup', {})
|
|
||||||
upload_retention_days = self._positive_int(
|
|
||||||
cleanup_cfg.get('uploaded_file_retention_days'),
|
|
||||||
DEFAULT_UPLOAD_FILE_RETENTION_DAYS,
|
|
||||||
'storage.cleanup.uploaded_file_retention_days',
|
|
||||||
)
|
|
||||||
log_retention_days = self._positive_int(
|
|
||||||
cleanup_cfg.get('log_retention_days'),
|
|
||||||
DEFAULT_LOG_RETENTION_DAYS,
|
|
||||||
'storage.cleanup.log_retention_days',
|
|
||||||
)
|
|
||||||
|
|
||||||
return {
|
|
||||||
'uploaded_files': await self._cleanup_expired_uploaded_files(upload_retention_days),
|
|
||||||
'log_files': self._cleanup_expired_log_files(log_retention_days),
|
|
||||||
}
|
|
||||||
|
|
||||||
async def get_storage_analysis(self) -> dict[str, Any]:
|
|
||||||
cleanup_cfg = self.ap.instance_config.data.get('storage', {}).get('cleanup', {})
|
|
||||||
upload_retention_days = self._positive_int(
|
|
||||||
cleanup_cfg.get('uploaded_file_retention_days'),
|
|
||||||
DEFAULT_UPLOAD_FILE_RETENTION_DAYS,
|
|
||||||
'storage.cleanup.uploaded_file_retention_days',
|
|
||||||
)
|
|
||||||
log_retention_days = self._positive_int(
|
|
||||||
cleanup_cfg.get('log_retention_days'),
|
|
||||||
DEFAULT_LOG_RETENTION_DAYS,
|
|
||||||
'storage.cleanup.log_retention_days',
|
|
||||||
)
|
|
||||||
|
|
||||||
database_cfg = self.ap.instance_config.data.get('database', {})
|
|
||||||
database_type = database_cfg.get('use', 'sqlite')
|
|
||||||
database_path = (
|
|
||||||
Path(database_cfg.get('sqlite', {}).get('path', 'data/langbot.db')) if database_type == 'sqlite' else None
|
|
||||||
)
|
|
||||||
roots: list[tuple[str, Path | None]] = [
|
|
||||||
('database', database_path),
|
|
||||||
('logs', Path('data/logs')),
|
|
||||||
('storage', Path('data/storage')),
|
|
||||||
('vector_store', Path('data/chroma')),
|
|
||||||
('plugins', Path('data/plugins')),
|
|
||||||
('mcp', Path('data/mcp')),
|
|
||||||
('temp', Path('data/temp')),
|
|
||||||
]
|
|
||||||
|
|
||||||
sections = []
|
|
||||||
for key, path in roots:
|
|
||||||
sections.append(
|
|
||||||
{
|
|
||||||
'key': key,
|
|
||||||
'path': str(path) if path else '',
|
|
||||||
'exists': path.exists() if path else False,
|
|
||||||
'size_bytes': self._path_size(path) if path else 0,
|
|
||||||
'file_count': self._file_count(path) if path else 0,
|
|
||||||
}
|
|
||||||
)
|
|
||||||
|
|
||||||
monitoring_counts = await self._monitoring_counts()
|
|
||||||
binary_storage = await self._binary_storage_stats()
|
|
||||||
upload_candidates = await self._expired_uploaded_candidates(upload_retention_days)
|
|
||||||
log_candidates = self._expired_log_candidates(log_retention_days)
|
|
||||||
|
|
||||||
return {
|
|
||||||
'generated_at': datetime.datetime.now(datetime.timezone.utc).isoformat(),
|
|
||||||
'cleanup_policy': {
|
|
||||||
'uploaded_file_retention_days': upload_retention_days,
|
|
||||||
'log_retention_days': log_retention_days,
|
|
||||||
},
|
|
||||||
'sections': sections,
|
|
||||||
'database': {
|
|
||||||
'type': database_type,
|
|
||||||
'monitoring_counts': monitoring_counts,
|
|
||||||
'binary_storage': binary_storage,
|
|
||||||
},
|
|
||||||
'cleanup_candidates': {
|
|
||||||
'uploaded_files': upload_candidates,
|
|
||||||
'log_files': log_candidates,
|
|
||||||
},
|
|
||||||
'tasks': self.ap.task_mgr.get_stats() if self.ap.task_mgr else {},
|
|
||||||
}
|
|
||||||
|
|
||||||
async def _cleanup_expired_uploaded_files(self, retention_days: int) -> int:
|
|
||||||
provider = self.ap.storage_mgr.storage_provider
|
|
||||||
provider_name = provider.__class__.__name__
|
|
||||||
if provider_name == 'LocalStorageProvider':
|
|
||||||
candidates = self._expired_local_upload_candidates(retention_days, include_paths=True)
|
|
||||||
deleted = 0
|
|
||||||
for item in candidates:
|
|
||||||
try:
|
|
||||||
os.remove(item['path'])
|
|
||||||
deleted += 1
|
|
||||||
except FileNotFoundError:
|
|
||||||
pass
|
|
||||||
except Exception as e:
|
|
||||||
self.ap.logger.warning(f'Failed to delete expired uploaded file {item["key"]}: {e}')
|
|
||||||
return deleted
|
|
||||||
|
|
||||||
if provider_name == 'S3StorageProvider':
|
|
||||||
return await self._cleanup_expired_s3_uploaded_files(retention_days)
|
|
||||||
|
|
||||||
return 0
|
|
||||||
|
|
||||||
async def _expired_uploaded_candidates(self, retention_days: int) -> list[dict[str, Any]]:
|
|
||||||
provider_name = self.ap.storage_mgr.storage_provider.__class__.__name__
|
|
||||||
if provider_name == 'LocalStorageProvider':
|
|
||||||
return self._expired_local_upload_candidates(retention_days)
|
|
||||||
if provider_name == 'S3StorageProvider':
|
|
||||||
return await self._expired_s3_upload_candidates(retention_days)
|
|
||||||
return []
|
|
||||||
|
|
||||||
async def _cleanup_expired_s3_uploaded_files(self, retention_days: int) -> int:
|
|
||||||
provider = self.ap.storage_mgr.storage_provider
|
|
||||||
candidates = await self._expired_s3_upload_candidates(retention_days)
|
|
||||||
deleted = 0
|
|
||||||
for item in candidates:
|
|
||||||
await provider.delete(item['key'])
|
|
||||||
deleted += 1
|
|
||||||
return deleted
|
|
||||||
|
|
||||||
async def _expired_s3_upload_candidates(self, retention_days: int) -> list[dict[str, Any]]:
|
|
||||||
provider = self.ap.storage_mgr.storage_provider
|
|
||||||
cutoff = datetime.datetime.now(datetime.timezone.utc) - datetime.timedelta(days=retention_days)
|
|
||||||
candidates = []
|
|
||||||
paginator = provider.s3_client.get_paginator('list_objects_v2')
|
|
||||||
|
|
||||||
for page in paginator.paginate(Bucket=provider.bucket_name):
|
|
||||||
for obj in page.get('Contents', []):
|
|
||||||
key = obj.get('Key', '')
|
|
||||||
last_modified = obj.get('LastModified')
|
|
||||||
if not self._is_uploaded_file_key(key):
|
|
||||||
continue
|
|
||||||
if last_modified and last_modified < cutoff:
|
|
||||||
candidates.append(
|
|
||||||
{
|
|
||||||
'key': key,
|
|
||||||
'size_bytes': obj.get('Size', 0),
|
|
||||||
'modified_at': last_modified.isoformat(),
|
|
||||||
}
|
|
||||||
)
|
|
||||||
|
|
||||||
return candidates
|
|
||||||
|
|
||||||
def _cleanup_expired_log_files(self, retention_days: int) -> int:
|
|
||||||
deleted = 0
|
|
||||||
for item in self._expired_log_candidates(retention_days, include_paths=True):
|
|
||||||
try:
|
|
||||||
os.remove(item['path'])
|
|
||||||
deleted += 1
|
|
||||||
except FileNotFoundError:
|
|
||||||
pass
|
|
||||||
except Exception as e:
|
|
||||||
self.ap.logger.warning(f'Failed to delete expired log file {item["name"]}: {e}')
|
|
||||||
return deleted
|
|
||||||
|
|
||||||
def _expired_local_upload_candidates(
|
|
||||||
self, retention_days: int, include_paths: bool = False
|
|
||||||
) -> list[dict[str, Any]]:
|
|
||||||
storage_root = Path('data/storage')
|
|
||||||
if not storage_root.exists():
|
|
||||||
return []
|
|
||||||
|
|
||||||
cutoff = datetime.datetime.now().timestamp() - retention_days * 86400
|
|
||||||
candidates = []
|
|
||||||
for entry in storage_root.iterdir():
|
|
||||||
if not entry.is_file() or not self._is_uploaded_file_key(entry.name):
|
|
||||||
continue
|
|
||||||
stat = entry.stat()
|
|
||||||
if stat.st_mtime >= cutoff:
|
|
||||||
continue
|
|
||||||
item = {
|
|
||||||
'key': entry.name,
|
|
||||||
'size_bytes': stat.st_size,
|
|
||||||
'modified_at': datetime.datetime.fromtimestamp(stat.st_mtime, datetime.timezone.utc).isoformat(),
|
|
||||||
}
|
|
||||||
if include_paths:
|
|
||||||
item['path'] = str(entry)
|
|
||||||
candidates.append(item)
|
|
||||||
return candidates
|
|
||||||
|
|
||||||
def _expired_log_candidates(self, retention_days: int, include_paths: bool = False) -> list[dict[str, Any]]:
|
|
||||||
log_root = Path('data/logs')
|
|
||||||
if not log_root.exists():
|
|
||||||
return []
|
|
||||||
|
|
||||||
cutoff_date = datetime.date.today() - datetime.timedelta(days=retention_days - 1)
|
|
||||||
candidates = []
|
|
||||||
for entry in log_root.iterdir():
|
|
||||||
if not entry.is_file():
|
|
||||||
continue
|
|
||||||
match = LOG_FILE_PATTERN.match(entry.name)
|
|
||||||
if not match:
|
|
||||||
continue
|
|
||||||
try:
|
|
||||||
file_date = datetime.date.fromisoformat(match.group(1))
|
|
||||||
except ValueError:
|
|
||||||
continue
|
|
||||||
if file_date >= cutoff_date:
|
|
||||||
continue
|
|
||||||
stat = entry.stat()
|
|
||||||
item = {
|
|
||||||
'name': entry.name,
|
|
||||||
'date': file_date.isoformat(),
|
|
||||||
'size_bytes': stat.st_size,
|
|
||||||
}
|
|
||||||
if include_paths:
|
|
||||||
item['path'] = str(entry)
|
|
||||||
candidates.append(item)
|
|
||||||
return candidates
|
|
||||||
|
|
||||||
def _is_uploaded_file_key(self, key: str) -> bool:
|
|
||||||
return '/' not in key and not key.startswith('plugin_config_')
|
|
||||||
|
|
||||||
async def _monitoring_counts(self) -> dict[str, int]:
|
|
||||||
tables = {
|
|
||||||
'messages': persistence_monitoring.MonitoringMessage.id,
|
|
||||||
'llm_calls': persistence_monitoring.MonitoringLLMCall.id,
|
|
||||||
'embedding_calls': persistence_monitoring.MonitoringEmbeddingCall.id,
|
|
||||||
'errors': persistence_monitoring.MonitoringError.id,
|
|
||||||
'sessions': persistence_monitoring.MonitoringSession.session_id,
|
|
||||||
'feedback': persistence_monitoring.MonitoringFeedback.id,
|
|
||||||
}
|
|
||||||
counts: dict[str, int] = {}
|
|
||||||
for key, column in tables.items():
|
|
||||||
result = await self.ap.persistence_mgr.execute_async(sqlalchemy.select(sqlalchemy.func.count(column)))
|
|
||||||
counts[key] = result.scalar() or 0
|
|
||||||
return counts
|
|
||||||
|
|
||||||
async def _binary_storage_stats(self) -> dict[str, Any]:
|
|
||||||
count_result = await self.ap.persistence_mgr.execute_async(
|
|
||||||
sqlalchemy.select(sqlalchemy.func.count(persistence_bstorage.BinaryStorage.unique_key))
|
|
||||||
)
|
|
||||||
size_bytes = None
|
|
||||||
try:
|
|
||||||
size_result = await self.ap.persistence_mgr.execute_async(
|
|
||||||
sqlalchemy.select(sqlalchemy.func.sum(sqlalchemy.func.length(persistence_bstorage.BinaryStorage.value)))
|
|
||||||
)
|
|
||||||
size_bytes = size_result.scalar() or 0
|
|
||||||
except Exception as e:
|
|
||||||
self.ap.logger.warning(f'Failed to estimate binary storage size: {e}')
|
|
||||||
|
|
||||||
return {
|
|
||||||
'count': count_result.scalar() or 0,
|
|
||||||
'size_bytes': size_bytes,
|
|
||||||
}
|
|
||||||
|
|
||||||
def _path_size(self, path: Path) -> int:
|
|
||||||
if not path.exists():
|
|
||||||
return 0
|
|
||||||
if path.is_file():
|
|
||||||
return path.stat().st_size
|
|
||||||
total = 0
|
|
||||||
for root, _, files in os.walk(path):
|
|
||||||
for file_name in files:
|
|
||||||
file_path = Path(root) / file_name
|
|
||||||
try:
|
|
||||||
total += file_path.stat().st_size
|
|
||||||
except FileNotFoundError:
|
|
||||||
pass
|
|
||||||
return total
|
|
||||||
|
|
||||||
def _file_count(self, path: Path) -> int:
|
|
||||||
if not path.exists():
|
|
||||||
return 0
|
|
||||||
if path.is_file():
|
|
||||||
return 1
|
|
||||||
count = 0
|
|
||||||
for _, _, files in os.walk(path):
|
|
||||||
count += len(files)
|
|
||||||
return count
|
|
||||||
|
|
||||||
def _positive_int(self, value: Any, default: int, name: str) -> int:
|
|
||||||
try:
|
|
||||||
parsed = int(value)
|
|
||||||
except (TypeError, ValueError):
|
|
||||||
self.ap.logger.warning(f'Invalid {name}: {value!r}, using {default}')
|
|
||||||
return default
|
|
||||||
if parsed < 1:
|
|
||||||
self.ap.logger.warning(f'Invalid {name}: {value!r}, using {default}')
|
|
||||||
return default
|
|
||||||
return parsed
|
|
||||||
@@ -152,24 +152,7 @@ class MCPService:
|
|||||||
coroutine = runtime_mcp_session.refresh()
|
coroutine = runtime_mcp_session.refresh()
|
||||||
else:
|
else:
|
||||||
runtime_mcp_session = await self.ap.tool_mgr.mcp_tool_loader.load_mcp_server(server_config=server_data)
|
runtime_mcp_session = await self.ap.tool_mgr.mcp_tool_loader.load_mcp_server(server_config=server_data)
|
||||||
|
coroutine = runtime_mcp_session.start()
|
||||||
# A transient test owns an isolated Box session. Always tear it down
|
|
||||||
# after the test completes (success or failure) so it does not leak.
|
|
||||||
test_session = runtime_mcp_session
|
|
||||||
|
|
||||||
async def _run_and_cleanup() -> None:
|
|
||||||
try:
|
|
||||||
await test_session.start()
|
|
||||||
finally:
|
|
||||||
try:
|
|
||||||
await test_session.shutdown()
|
|
||||||
except Exception as exc:
|
|
||||||
self.ap.logger.warning(
|
|
||||||
f'Failed to tear down transient MCP test session '
|
|
||||||
f'{test_session.server_name}: {type(exc).__name__}: {exc}'
|
|
||||||
)
|
|
||||||
|
|
||||||
coroutine = _run_and_cleanup()
|
|
||||||
|
|
||||||
ctx = taskmgr.TaskContext.new()
|
ctx = taskmgr.TaskContext.new()
|
||||||
wrapper = self.ap.task_mgr.create_user_task(
|
wrapper = self.ap.task_mgr.create_user_task(
|
||||||
|
|||||||
@@ -23,17 +23,6 @@ def _parse_provider_api_keys(provider_dict: dict) -> dict:
|
|||||||
return provider_dict
|
return provider_dict
|
||||||
|
|
||||||
|
|
||||||
def _runtime_model_data(model_uuid: str, model_data: dict) -> dict:
|
|
||||||
"""Return model data for rebuilding runtime models after an update.
|
|
||||||
|
|
||||||
Update payloads intentionally omit uuid before writing to the database.
|
|
||||||
Runtime model entities still need the stable uuid so pipeline configs can
|
|
||||||
resolve the in-memory model immediately after an edit, without requiring a
|
|
||||||
process restart.
|
|
||||||
"""
|
|
||||||
return {**model_data, 'uuid': model_uuid}
|
|
||||||
|
|
||||||
|
|
||||||
class LLMModelsService:
|
class LLMModelsService:
|
||||||
ap: app.Application
|
ap: app.Application
|
||||||
|
|
||||||
@@ -184,7 +173,7 @@ class LLMModelsService:
|
|||||||
raise Exception('provider not found')
|
raise Exception('provider not found')
|
||||||
|
|
||||||
runtime_llm_model = await self.ap.model_mgr.load_llm_model_with_provider(
|
runtime_llm_model = await self.ap.model_mgr.load_llm_model_with_provider(
|
||||||
persistence_model.LLMModel(**_runtime_model_data(model_uuid, model_data)),
|
persistence_model.LLMModel(**model_data),
|
||||||
runtime_provider,
|
runtime_provider,
|
||||||
)
|
)
|
||||||
self.ap.model_mgr.llm_models.append(runtime_llm_model)
|
self.ap.model_mgr.llm_models.append(runtime_llm_model)
|
||||||
@@ -345,7 +334,7 @@ class EmbeddingModelsService:
|
|||||||
raise Exception('provider not found')
|
raise Exception('provider not found')
|
||||||
|
|
||||||
runtime_embedding_model = await self.ap.model_mgr.load_embedding_model_with_provider(
|
runtime_embedding_model = await self.ap.model_mgr.load_embedding_model_with_provider(
|
||||||
persistence_model.EmbeddingModel(**_runtime_model_data(model_uuid, model_data)),
|
persistence_model.EmbeddingModel(**model_data),
|
||||||
runtime_provider,
|
runtime_provider,
|
||||||
)
|
)
|
||||||
self.ap.model_mgr.embedding_models.append(runtime_embedding_model)
|
self.ap.model_mgr.embedding_models.append(runtime_embedding_model)
|
||||||
@@ -378,162 +367,3 @@ class EmbeddingModelsService:
|
|||||||
input_text=['Hello, world!'],
|
input_text=['Hello, world!'],
|
||||||
extra_args={},
|
extra_args={},
|
||||||
)
|
)
|
||||||
|
|
||||||
|
|
||||||
class RerankModelsService:
|
|
||||||
ap: app.Application
|
|
||||||
|
|
||||||
def __init__(self, ap: app.Application) -> None:
|
|
||||||
self.ap = ap
|
|
||||||
|
|
||||||
async def get_rerank_models(self) -> list[dict]:
|
|
||||||
"""Get all rerank models with provider info"""
|
|
||||||
result = await self.ap.persistence_mgr.execute_async(sqlalchemy.select(persistence_model.RerankModel))
|
|
||||||
models = result.all()
|
|
||||||
|
|
||||||
providers_result = await self.ap.persistence_mgr.execute_async(
|
|
||||||
sqlalchemy.select(persistence_model.ModelProvider)
|
|
||||||
)
|
|
||||||
providers = {p.uuid: p for p in providers_result.all()}
|
|
||||||
|
|
||||||
models_list = []
|
|
||||||
for model in models:
|
|
||||||
model_dict = self.ap.persistence_mgr.serialize_model(persistence_model.RerankModel, model)
|
|
||||||
provider = providers.get(model.provider_uuid)
|
|
||||||
if provider:
|
|
||||||
provider_dict = self.ap.persistence_mgr.serialize_model(persistence_model.ModelProvider, provider)
|
|
||||||
model_dict['provider'] = _parse_provider_api_keys(provider_dict)
|
|
||||||
models_list.append(model_dict)
|
|
||||||
|
|
||||||
return models_list
|
|
||||||
|
|
||||||
async def get_rerank_models_by_provider(self, provider_uuid: str) -> list[dict]:
|
|
||||||
"""Get rerank models by provider UUID"""
|
|
||||||
result = await self.ap.persistence_mgr.execute_async(
|
|
||||||
sqlalchemy.select(persistence_model.RerankModel).where(
|
|
||||||
persistence_model.RerankModel.provider_uuid == provider_uuid
|
|
||||||
)
|
|
||||||
)
|
|
||||||
models = result.all()
|
|
||||||
return [self.ap.persistence_mgr.serialize_model(persistence_model.RerankModel, m) for m in models]
|
|
||||||
|
|
||||||
async def create_rerank_model(self, model_data: dict, preserve_uuid: bool = False) -> str:
|
|
||||||
"""Create a new rerank model"""
|
|
||||||
if not preserve_uuid:
|
|
||||||
model_data['uuid'] = str(uuid.uuid4())
|
|
||||||
|
|
||||||
if 'provider' in model_data:
|
|
||||||
provider_data = model_data.pop('provider')
|
|
||||||
if provider_data.get('uuid'):
|
|
||||||
model_data['provider_uuid'] = provider_data['uuid']
|
|
||||||
else:
|
|
||||||
provider_uuid = await self.ap.provider_service.find_or_create_provider(
|
|
||||||
requester=provider_data.get('requester', ''),
|
|
||||||
base_url=provider_data.get('base_url', ''),
|
|
||||||
api_keys=provider_data.get('api_keys', []),
|
|
||||||
)
|
|
||||||
model_data['provider_uuid'] = provider_uuid
|
|
||||||
|
|
||||||
await self.ap.persistence_mgr.execute_async(
|
|
||||||
sqlalchemy.insert(persistence_model.RerankModel).values(**model_data)
|
|
||||||
)
|
|
||||||
|
|
||||||
runtime_provider = self.ap.model_mgr.provider_dict.get(model_data['provider_uuid'])
|
|
||||||
if runtime_provider is None:
|
|
||||||
raise Exception('provider not found')
|
|
||||||
|
|
||||||
runtime_rerank_model = await self.ap.model_mgr.load_rerank_model_with_provider(
|
|
||||||
persistence_model.RerankModel(**model_data),
|
|
||||||
runtime_provider,
|
|
||||||
)
|
|
||||||
self.ap.model_mgr.rerank_models.append(runtime_rerank_model)
|
|
||||||
|
|
||||||
return model_data['uuid']
|
|
||||||
|
|
||||||
async def get_rerank_model(self, model_uuid: str) -> dict | None:
|
|
||||||
"""Get a single rerank model with provider info"""
|
|
||||||
result = await self.ap.persistence_mgr.execute_async(
|
|
||||||
sqlalchemy.select(persistence_model.RerankModel).where(persistence_model.RerankModel.uuid == model_uuid)
|
|
||||||
)
|
|
||||||
model = result.first()
|
|
||||||
if model is None:
|
|
||||||
return None
|
|
||||||
|
|
||||||
model_dict = self.ap.persistence_mgr.serialize_model(persistence_model.RerankModel, model)
|
|
||||||
|
|
||||||
provider_result = await self.ap.persistence_mgr.execute_async(
|
|
||||||
sqlalchemy.select(persistence_model.ModelProvider).where(
|
|
||||||
persistence_model.ModelProvider.uuid == model.provider_uuid
|
|
||||||
)
|
|
||||||
)
|
|
||||||
provider = provider_result.first()
|
|
||||||
if provider:
|
|
||||||
provider_dict = self.ap.persistence_mgr.serialize_model(persistence_model.ModelProvider, provider)
|
|
||||||
model_dict['provider'] = _parse_provider_api_keys(provider_dict)
|
|
||||||
|
|
||||||
return model_dict
|
|
||||||
|
|
||||||
async def update_rerank_model(self, model_uuid: str, model_data: dict) -> None:
|
|
||||||
"""Update an existing rerank model"""
|
|
||||||
if 'uuid' in model_data:
|
|
||||||
del model_data['uuid']
|
|
||||||
|
|
||||||
if 'provider' in model_data:
|
|
||||||
provider_data = model_data.pop('provider')
|
|
||||||
if provider_data.get('uuid'):
|
|
||||||
model_data['provider_uuid'] = provider_data['uuid']
|
|
||||||
else:
|
|
||||||
provider_uuid = await self.ap.provider_service.find_or_create_provider(
|
|
||||||
requester=provider_data.get('requester', ''),
|
|
||||||
base_url=provider_data.get('base_url', ''),
|
|
||||||
api_keys=provider_data.get('api_keys', []),
|
|
||||||
)
|
|
||||||
model_data['provider_uuid'] = provider_uuid
|
|
||||||
|
|
||||||
await self.ap.persistence_mgr.execute_async(
|
|
||||||
sqlalchemy.update(persistence_model.RerankModel)
|
|
||||||
.where(persistence_model.RerankModel.uuid == model_uuid)
|
|
||||||
.values(**model_data)
|
|
||||||
)
|
|
||||||
|
|
||||||
await self.ap.model_mgr.remove_rerank_model(model_uuid)
|
|
||||||
|
|
||||||
runtime_provider = self.ap.model_mgr.provider_dict.get(model_data['provider_uuid'])
|
|
||||||
if runtime_provider is None:
|
|
||||||
raise Exception('provider not found')
|
|
||||||
|
|
||||||
runtime_rerank_model = await self.ap.model_mgr.load_rerank_model_with_provider(
|
|
||||||
persistence_model.RerankModel(**_runtime_model_data(model_uuid, model_data)),
|
|
||||||
runtime_provider,
|
|
||||||
)
|
|
||||||
self.ap.model_mgr.rerank_models.append(runtime_rerank_model)
|
|
||||||
|
|
||||||
async def delete_rerank_model(self, model_uuid: str) -> None:
|
|
||||||
"""Delete a rerank model"""
|
|
||||||
await self.ap.persistence_mgr.execute_async(
|
|
||||||
sqlalchemy.delete(persistence_model.RerankModel).where(persistence_model.RerankModel.uuid == model_uuid)
|
|
||||||
)
|
|
||||||
await self.ap.model_mgr.remove_rerank_model(model_uuid)
|
|
||||||
|
|
||||||
async def test_rerank_model(self, model_uuid: str, model_data: dict) -> None:
|
|
||||||
"""Test a rerank model"""
|
|
||||||
runtime_rerank_model: model_requester.RuntimeRerankModel | None = None
|
|
||||||
|
|
||||||
if model_uuid != '_':
|
|
||||||
for model in self.ap.model_mgr.rerank_models:
|
|
||||||
if model.model_entity.uuid == model_uuid:
|
|
||||||
runtime_rerank_model = model
|
|
||||||
break
|
|
||||||
if runtime_rerank_model is None:
|
|
||||||
raise Exception('model not found')
|
|
||||||
else:
|
|
||||||
runtime_rerank_model = await self.ap.model_mgr.init_temporary_runtime_rerank_model(model_data)
|
|
||||||
|
|
||||||
await runtime_rerank_model.provider.invoke_rerank(
|
|
||||||
model=runtime_rerank_model,
|
|
||||||
query='What is artificial intelligence?',
|
|
||||||
documents=[
|
|
||||||
'Artificial intelligence is a branch of computer science.',
|
|
||||||
'The weather is nice today.',
|
|
||||||
],
|
|
||||||
)
|
|
||||||
|
|||||||
@@ -18,119 +18,55 @@ class MonitoringService:
|
|||||||
|
|
||||||
# ========== Cleanup Methods ==========
|
# ========== Cleanup Methods ==========
|
||||||
|
|
||||||
async def cleanup_expired_records(self, retention_days: int, batch_size: int = 1000) -> dict[str, int]:
|
async def cleanup_expired_records(self, retention_days: int) -> dict[str, int]:
|
||||||
"""Delete monitoring records older than the specified retention period.
|
"""Delete monitoring records older than the specified retention period.
|
||||||
|
|
||||||
Args:
|
Args:
|
||||||
retention_days: Number of days to retain records.
|
retention_days: Number of days to retain records.
|
||||||
batch_size: Maximum rows to delete per table batch.
|
|
||||||
|
|
||||||
Returns:
|
Returns:
|
||||||
A dict mapping table name to the number of deleted rows.
|
A dict mapping table name to the number of deleted rows.
|
||||||
"""
|
"""
|
||||||
if retention_days < 1:
|
|
||||||
raise ValueError('retention_days must be >= 1')
|
|
||||||
if batch_size < 1:
|
|
||||||
raise ValueError('batch_size must be >= 1')
|
|
||||||
|
|
||||||
cutoff = datetime.datetime.now(datetime.timezone.utc).replace(tzinfo=None) - datetime.timedelta(
|
cutoff = datetime.datetime.now(datetime.timezone.utc).replace(tzinfo=None) - datetime.timedelta(
|
||||||
days=retention_days
|
days=retention_days
|
||||||
)
|
)
|
||||||
|
|
||||||
tables_and_columns: list[tuple[str, type, sqlalchemy.Column, sqlalchemy.Column]] = [
|
tables_and_columns: list[tuple[str, type, sqlalchemy.Column]] = [
|
||||||
(
|
(
|
||||||
'monitoring_messages',
|
'monitoring_messages',
|
||||||
persistence_monitoring.MonitoringMessage,
|
persistence_monitoring.MonitoringMessage,
|
||||||
persistence_monitoring.MonitoringMessage.timestamp,
|
persistence_monitoring.MonitoringMessage.timestamp,
|
||||||
persistence_monitoring.MonitoringMessage.id,
|
|
||||||
),
|
),
|
||||||
(
|
(
|
||||||
'monitoring_llm_calls',
|
'monitoring_llm_calls',
|
||||||
persistence_monitoring.MonitoringLLMCall,
|
persistence_monitoring.MonitoringLLMCall,
|
||||||
persistence_monitoring.MonitoringLLMCall.timestamp,
|
persistence_monitoring.MonitoringLLMCall.timestamp,
|
||||||
persistence_monitoring.MonitoringLLMCall.id,
|
|
||||||
),
|
),
|
||||||
(
|
(
|
||||||
'monitoring_embedding_calls',
|
'monitoring_embedding_calls',
|
||||||
persistence_monitoring.MonitoringEmbeddingCall,
|
persistence_monitoring.MonitoringEmbeddingCall,
|
||||||
persistence_monitoring.MonitoringEmbeddingCall.timestamp,
|
persistence_monitoring.MonitoringEmbeddingCall.timestamp,
|
||||||
persistence_monitoring.MonitoringEmbeddingCall.id,
|
|
||||||
),
|
),
|
||||||
(
|
(
|
||||||
'monitoring_errors',
|
'monitoring_errors',
|
||||||
persistence_monitoring.MonitoringError,
|
persistence_monitoring.MonitoringError,
|
||||||
persistence_monitoring.MonitoringError.timestamp,
|
persistence_monitoring.MonitoringError.timestamp,
|
||||||
persistence_monitoring.MonitoringError.id,
|
|
||||||
),
|
),
|
||||||
(
|
(
|
||||||
'monitoring_sessions',
|
'monitoring_sessions',
|
||||||
persistence_monitoring.MonitoringSession,
|
persistence_monitoring.MonitoringSession,
|
||||||
persistence_monitoring.MonitoringSession.last_activity,
|
persistence_monitoring.MonitoringSession.last_activity,
|
||||||
persistence_monitoring.MonitoringSession.session_id,
|
|
||||||
),
|
|
||||||
(
|
|
||||||
'monitoring_feedback',
|
|
||||||
persistence_monitoring.MonitoringFeedback,
|
|
||||||
persistence_monitoring.MonitoringFeedback.timestamp,
|
|
||||||
persistence_monitoring.MonitoringFeedback.id,
|
|
||||||
),
|
),
|
||||||
]
|
]
|
||||||
|
|
||||||
deleted_counts: dict[str, int] = {}
|
deleted_counts: dict[str, int] = {}
|
||||||
|
|
||||||
for table_name, model_cls, ts_column, pk_column in tables_and_columns:
|
for table_name, model_cls, ts_column in tables_and_columns:
|
||||||
deleted_counts[table_name] = await self._delete_expired_in_batches(
|
result = await self.ap.persistence_mgr.execute_async(sqlalchemy.delete(model_cls).where(ts_column < cutoff))
|
||||||
model_cls=model_cls,
|
deleted_counts[table_name] = result.rowcount
|
||||||
ts_column=ts_column,
|
|
||||||
pk_column=pk_column,
|
|
||||||
cutoff=cutoff,
|
|
||||||
batch_size=batch_size,
|
|
||||||
)
|
|
||||||
|
|
||||||
if sum(deleted_counts.values()) > 0:
|
|
||||||
await self._release_sqlite_space()
|
|
||||||
|
|
||||||
return deleted_counts
|
return deleted_counts
|
||||||
|
|
||||||
async def _delete_expired_in_batches(
|
|
||||||
self,
|
|
||||||
model_cls: type,
|
|
||||||
ts_column: sqlalchemy.Column,
|
|
||||||
pk_column: sqlalchemy.Column,
|
|
||||||
cutoff: datetime.datetime,
|
|
||||||
batch_size: int,
|
|
||||||
) -> int:
|
|
||||||
deleted_total = 0
|
|
||||||
|
|
||||||
while True:
|
|
||||||
select_result = await self.ap.persistence_mgr.execute_async(
|
|
||||||
sqlalchemy.select(pk_column).where(ts_column < cutoff).limit(batch_size)
|
|
||||||
)
|
|
||||||
pk_values = list(select_result.scalars().all())
|
|
||||||
if not pk_values:
|
|
||||||
break
|
|
||||||
|
|
||||||
delete_result = await self.ap.persistence_mgr.execute_async(
|
|
||||||
sqlalchemy.delete(model_cls).where(pk_column.in_(pk_values))
|
|
||||||
)
|
|
||||||
deleted = delete_result.rowcount or 0
|
|
||||||
deleted_total += deleted
|
|
||||||
|
|
||||||
if len(pk_values) < batch_size:
|
|
||||||
break
|
|
||||||
|
|
||||||
return deleted_total
|
|
||||||
|
|
||||||
async def _release_sqlite_space(self) -> None:
|
|
||||||
database_type = self.ap.instance_config.data.get('database', {}).get('use', 'sqlite')
|
|
||||||
if database_type != 'sqlite':
|
|
||||||
return
|
|
||||||
|
|
||||||
async with self.ap.persistence_mgr.get_db_engine().connect() as conn:
|
|
||||||
autocommit_conn = await conn.execution_options(isolation_level='AUTOCOMMIT')
|
|
||||||
await autocommit_conn.execute(sqlalchemy.text('PRAGMA wal_checkpoint(TRUNCATE)'))
|
|
||||||
await autocommit_conn.execute(sqlalchemy.text('VACUUM'))
|
|
||||||
|
|
||||||
# ========== Recording Methods ==========
|
# ========== Recording Methods ==========
|
||||||
|
|
||||||
async def record_message(
|
async def record_message(
|
||||||
@@ -1288,57 +1224,14 @@ class MonitoringService:
|
|||||||
"""
|
"""
|
||||||
import json
|
import json
|
||||||
|
|
||||||
now = datetime.datetime.now(datetime.timezone.utc).replace(tzinfo=None)
|
|
||||||
reasons_json = json.dumps(inaccurate_reasons, ensure_ascii=False) if inaccurate_reasons else None
|
|
||||||
|
|
||||||
MonitoringFeedback = persistence_monitoring.MonitoringFeedback
|
|
||||||
|
|
||||||
# Handle cancel feedback (type=3): delete existing record
|
|
||||||
if feedback_type == 3:
|
|
||||||
await self.ap.persistence_mgr.execute_async(
|
|
||||||
sqlalchemy.delete(MonitoringFeedback).where(MonitoringFeedback.feedback_id == feedback_id)
|
|
||||||
)
|
|
||||||
return None
|
|
||||||
|
|
||||||
# Check if record with this feedback_id already exists
|
|
||||||
existing_result = await self.ap.persistence_mgr.execute_async(
|
|
||||||
sqlalchemy.select(MonitoringFeedback).where(MonitoringFeedback.feedback_id == feedback_id)
|
|
||||||
)
|
|
||||||
existing_row = existing_result.first()
|
|
||||||
|
|
||||||
if existing_row:
|
|
||||||
# UPDATE existing record
|
|
||||||
existing = existing_row[0] if isinstance(existing_row, tuple) else existing_row
|
|
||||||
await self.ap.persistence_mgr.execute_async(
|
|
||||||
sqlalchemy.update(MonitoringFeedback)
|
|
||||||
.where(MonitoringFeedback.feedback_id == feedback_id)
|
|
||||||
.values(
|
|
||||||
timestamp=now,
|
|
||||||
feedback_type=feedback_type,
|
|
||||||
feedback_content=feedback_content,
|
|
||||||
inaccurate_reasons=reasons_json,
|
|
||||||
bot_id=bot_id or existing.bot_id,
|
|
||||||
bot_name=bot_name or existing.bot_name,
|
|
||||||
pipeline_id=pipeline_id or existing.pipeline_id,
|
|
||||||
pipeline_name=pipeline_name or existing.pipeline_name,
|
|
||||||
session_id=session_id or existing.session_id,
|
|
||||||
message_id=message_id or existing.message_id,
|
|
||||||
stream_id=stream_id or existing.stream_id,
|
|
||||||
user_id=user_id or existing.user_id,
|
|
||||||
platform=platform or existing.platform,
|
|
||||||
)
|
|
||||||
)
|
|
||||||
return existing.id
|
|
||||||
else:
|
|
||||||
# INSERT new record with IntegrityError defense
|
|
||||||
record_id = str(uuid.uuid4())
|
record_id = str(uuid.uuid4())
|
||||||
record_data = {
|
record_data = {
|
||||||
'id': record_id,
|
'id': record_id,
|
||||||
'timestamp': now,
|
'timestamp': datetime.datetime.now(datetime.timezone.utc).replace(tzinfo=None),
|
||||||
'feedback_id': feedback_id,
|
'feedback_id': feedback_id,
|
||||||
'feedback_type': feedback_type,
|
'feedback_type': feedback_type,
|
||||||
'feedback_content': feedback_content,
|
'feedback_content': feedback_content,
|
||||||
'inaccurate_reasons': reasons_json,
|
'inaccurate_reasons': json.dumps(inaccurate_reasons, ensure_ascii=False) if inaccurate_reasons else None,
|
||||||
'bot_id': bot_id,
|
'bot_id': bot_id,
|
||||||
'bot_name': bot_name,
|
'bot_name': bot_name,
|
||||||
'pipeline_id': pipeline_id,
|
'pipeline_id': pipeline_id,
|
||||||
@@ -1349,22 +1242,12 @@ class MonitoringService:
|
|||||||
'user_id': user_id,
|
'user_id': user_id,
|
||||||
'platform': platform,
|
'platform': platform,
|
||||||
}
|
}
|
||||||
try:
|
|
||||||
await self.ap.persistence_mgr.execute_async(sqlalchemy.insert(MonitoringFeedback).values(record_data))
|
|
||||||
return record_id
|
|
||||||
except Exception:
|
|
||||||
# UNIQUE constraint conflict (concurrent feedback for same feedback_id)
|
|
||||||
await self.ap.persistence_mgr.execute_async(
|
await self.ap.persistence_mgr.execute_async(
|
||||||
sqlalchemy.update(MonitoringFeedback)
|
sqlalchemy.insert(persistence_monitoring.MonitoringFeedback).values(record_data)
|
||||||
.where(MonitoringFeedback.feedback_id == feedback_id)
|
|
||||||
.values(
|
|
||||||
timestamp=now,
|
|
||||||
feedback_type=feedback_type,
|
|
||||||
feedback_content=feedback_content,
|
|
||||||
inaccurate_reasons=reasons_json,
|
|
||||||
)
|
)
|
||||||
)
|
|
||||||
return feedback_id
|
return record_id
|
||||||
|
|
||||||
async def get_feedback_stats(
|
async def get_feedback_stats(
|
||||||
self,
|
self,
|
||||||
|
|||||||
@@ -113,9 +113,14 @@ class PipelineService:
|
|||||||
return pipeline_data['uuid']
|
return pipeline_data['uuid']
|
||||||
|
|
||||||
async def update_pipeline(self, pipeline_uuid: str, pipeline_data: dict) -> None:
|
async def update_pipeline(self, pipeline_uuid: str, pipeline_data: dict) -> None:
|
||||||
pipeline_data = pipeline_data.copy()
|
if 'uuid' in pipeline_data:
|
||||||
for protected_field in ('uuid', 'for_version', 'stages', 'is_default'):
|
del pipeline_data['uuid']
|
||||||
pipeline_data.pop(protected_field, None)
|
if 'for_version' in pipeline_data:
|
||||||
|
del pipeline_data['for_version']
|
||||||
|
if 'stages' in pipeline_data:
|
||||||
|
del pipeline_data['stages']
|
||||||
|
if 'is_default' in pipeline_data:
|
||||||
|
del pipeline_data['is_default']
|
||||||
|
|
||||||
await self.ap.persistence_mgr.execute_async(
|
await self.ap.persistence_mgr.execute_async(
|
||||||
sqlalchemy.update(persistence_pipeline.LegacyPipeline)
|
sqlalchemy.update(persistence_pipeline.LegacyPipeline)
|
||||||
@@ -215,8 +220,6 @@ class PipelineService:
|
|||||||
bound_mcp_servers: list[str] = None,
|
bound_mcp_servers: list[str] = None,
|
||||||
enable_all_plugins: bool = True,
|
enable_all_plugins: bool = True,
|
||||||
enable_all_mcp_servers: bool = True,
|
enable_all_mcp_servers: bool = True,
|
||||||
bound_skills: list[str] = None,
|
|
||||||
enable_all_skills: bool = True,
|
|
||||||
) -> None:
|
) -> None:
|
||||||
"""Update the bound plugins and MCP servers for a pipeline"""
|
"""Update the bound plugins and MCP servers for a pipeline"""
|
||||||
# Get current pipeline
|
# Get current pipeline
|
||||||
@@ -234,12 +237,9 @@ class PipelineService:
|
|||||||
extensions_preferences = pipeline.extensions_preferences or {}
|
extensions_preferences = pipeline.extensions_preferences or {}
|
||||||
extensions_preferences['enable_all_plugins'] = enable_all_plugins
|
extensions_preferences['enable_all_plugins'] = enable_all_plugins
|
||||||
extensions_preferences['enable_all_mcp_servers'] = enable_all_mcp_servers
|
extensions_preferences['enable_all_mcp_servers'] = enable_all_mcp_servers
|
||||||
extensions_preferences['enable_all_skills'] = enable_all_skills
|
|
||||||
extensions_preferences['plugins'] = bound_plugins
|
extensions_preferences['plugins'] = bound_plugins
|
||||||
if bound_mcp_servers is not None:
|
if bound_mcp_servers is not None:
|
||||||
extensions_preferences['mcp_servers'] = bound_mcp_servers
|
extensions_preferences['mcp_servers'] = bound_mcp_servers
|
||||||
if bound_skills is not None:
|
|
||||||
extensions_preferences['skills'] = bound_skills
|
|
||||||
|
|
||||||
await self.ap.persistence_mgr.execute_async(
|
await self.ap.persistence_mgr.execute_async(
|
||||||
sqlalchemy.update(persistence_pipeline.LegacyPipeline)
|
sqlalchemy.update(persistence_pipeline.LegacyPipeline)
|
||||||
|
|||||||
Some files were not shown because too many files have changed in this diff Show More
Reference in New Issue
Block a user