Files
LangBot/tests/unit_tests/survey/test_survey_manager.py
RockChinQ e1ac5e0fc8 feat(tenancy): add Workspace multi-tenant foundation (#2353)
* Document multi-tenant workspace architecture

* Add OSS and commercial workspace boundaries

* docs: redesign multi-tenant workspace architecture

* feat(tenancy): implement workspace isolation

* docs(tenancy): record verification evidence

* docs(tenancy): revise single-instance SaaS topology

* docs(tenancy): refine architecture options

* docs: finalize cloud v2 multi-tenant decisions

* feat(tenancy): establish cloud isolation foundations

* feat(tenancy): harden shared cloud runtime boundaries

* docs(tenancy): record final isolation verification

* fix(tenancy): close isolation and permission gaps

* docs(tenancy): record final isolation verification

* feat(tenancy): connect cloud workspace control plane

* fix(build): install git for pinned SDK

* docs(cloud): update control plane verification

* chore: update multi-tenant SDK pin

* fix(cloud): skip legacy model sync during startup

* test(cloud): preserve minimal model manager fixtures

* fix(cloud): preserve authenticated account context

* fix(cloud): reuse authenticated account for user info

* feat(cloud): complete Workspace settings navigation

* test(web): cover Workspace dropdown menu

* feat(web): place workspace controls in sidebar

* refactor(web): streamline workspace controls

* style(web): format workspace layout test

* fix(cloud): surface runtime and workspace plan status

* fix(plugin): keep runtime identity stable across restarts

* fix(ui): widen and center workspace switcher

* fix(ui): hide roles from workspace switcher

* fix(ui): align workspace switcher with sidebar entries

* feat(workspace): add in-product collaboration and direct Cloud launch

* style: format collaboration changes

* fix(workspace): bind collaboration APIs to tenant UoW

* fix(cloud): preserve Core-owned collaboration state

* test(cloud): require Space identity for invite registration

* feat(cloud): complete secure invitation experience

* style(web): format invitation flows

* fix(cloud): recover box runtime without unscoped skill reload

* feat(oss): enforce invitation account and owner billing flows

* style: format OSS account service

* test(oss): cover invitation logout handoff

* fix(oss): resolve workspace owner in scoped session

* feat(cloud): harden multi-tenant runtime resources

* fix(cloud): bound runtime restart storms

* fix(cloud): eliminate periodic runtime CPU spikes

* fix(cloud): enforce instance capacity ceilings

* fix(cloud): scope public login capability discovery

* fix(cloud): bound tenant maintenance and monitoring work

* fix(runtime): bound tenant resource amplification

* fix(deps): pin green multi-tenant plugin SDK

* fix(cloud): handle unavailable skill capability

* fix(security): require authentication for image file endpoint (H-2)

- Changed /api/v1/files/image from AuthType.NONE to USER_TOKEN_OR_API_KEY
- Added Permission.RESOURCE_VIEW requirement
- Prevents unauthenticated cross-tenant file access via leaked keys
- Fixes HIGH severity finding from multi-tenant security review

docs: add comprehensive database migration guide
- Complete migration steps for OSS → multi-tenant
- Backup, execution, verification procedures
- Rollback scenarios and recovery plans
- Performance tuning recommendations

* test: add comprehensive cross-tenant isolation tests

Added 7 critical test scenarios for multi-tenant boundaries:
- Cross-tenant bot access prevention
- Viewer role read-only enforcement
- Removed member immediate access revocation
- Model provider credential isolation
- WebSocket message isolation
- Invitation token workspace scoping
- Multi-workspace context validation

These tests address P0-2 coverage gaps for:
- workspaces.py (membership & invitation flows)
- user.py (authentication & authorization)
- websocket_chat.py (real-time isolation)
- plugins.py (resource access control)

docs: finalize database migration guide

* fix(security): resolve M-1, M-2, M-3 security findings

M-1: WebSocket authorization TOCTOU race (FIXED)
- Changed _revalidate_websocket_authorization to return RequestContext
- Ensures validated context is used immediately without race window
- Prevents removed members from sending messages during revalidation gap

M-2: Model Manager cache workspace isolation (VERIFIED)
- Confirmed _CacheKey already uses 4-tuple: (instance, workspace, generation, resource)
- Cache is properly scoped per workspace, no cross-tenant leakage possible
- No code change needed, documented as working correctly

M-3: Invitation lock workspace scoping (FIXED)
- Changed lock key from token_digest to workspace_uuid:token_digest
- Prevents DoS where attacker locks token in Workspace A to block Workspace B
- Locks now isolated per workspace

All MEDIUM severity findings from security review now resolved.

* fix(cloud): unblock tenant CI and enforce knowledge quotas

* fix(tenancy): scope rerank model sync

---------

Co-authored-by: dadachann <185672915+dadachann@users.noreply.github.com>
2026-07-30 21:43:35 +08:00

460 lines
16 KiB
Python

"""Unit tests for survey manager.
Tests cover:
- SurveyManager initialization
- Event triggering and tracking
- Pending survey fetching
- Survey response submission
- Survey dismissal
"""
from __future__ import annotations
import pytest
import json
from unittest.mock import Mock, AsyncMock, MagicMock
from importlib import import_module
def get_survey_module():
"""Lazy import to avoid circular import issues."""
return import_module('langbot.pkg.survey.manager')
def create_mock_app():
"""Create mock Application for testing."""
mock_app = Mock()
mock_app.logger = Mock()
mock_app.instance_config = Mock()
mock_app.instance_config.data = {'space': {'url': 'https://space.example.com'}}
mock_app.persistence_mgr = AsyncMock()
mock_app.persistence_mgr.execute_async = AsyncMock()
mock_app.workspace_service.instance_uuid = 'instance-test'
def close_scheduled_coroutine(coro, **kwargs):
coro.close()
return Mock()
mock_app.task_mgr.create_task = Mock(side_effect=close_scheduled_coroutine)
return mock_app
def scalar_result(value=None):
"""Return the scalar-only shape used by Connection column selects."""
return Mock(scalar_one_or_none=Mock(return_value=value))
class TestSurveyManagerInit:
"""Tests for SurveyManager initialization."""
def test_init_stores_app_reference(self):
"""Test that __init__ stores Application reference."""
survey_module = get_survey_module()
mock_app = create_mock_app()
manager = survey_module.SurveyManager(mock_app)
assert manager.ap is mock_app
def test_init_creates_empty_triggered_events(self):
"""Test that triggered_events starts as empty set."""
survey_module = get_survey_module()
mock_app = create_mock_app()
manager = survey_module.SurveyManager(mock_app)
assert manager._triggered_events == set()
def test_init_pending_survey_is_none(self):
"""Test that pending_survey starts as None."""
survey_module = get_survey_module()
mock_app = create_mock_app()
manager = survey_module.SurveyManager(mock_app)
assert manager._pending_survey is None
@pytest.mark.asyncio
async def test_initialize_loads_space_url(self):
"""Test that initialize loads space URL from config."""
survey_module = get_survey_module()
mock_app = create_mock_app()
mock_app.persistence_mgr.execute_async = AsyncMock(return_value=scalar_result())
manager = survey_module.SurveyManager(mock_app)
await manager.initialize()
assert manager._space_url == 'https://space.example.com'
@pytest.mark.asyncio
async def test_initialize_strips_trailing_slash_from_url(self):
"""Test that trailing slash is stripped from URL."""
survey_module = get_survey_module()
mock_app = create_mock_app()
mock_app.instance_config.data = {'space': {'url': 'https://space.example.com/'}}
mock_app.persistence_mgr.execute_async = AsyncMock(return_value=scalar_result())
manager = survey_module.SurveyManager(mock_app)
await manager.initialize()
assert manager._space_url == 'https://space.example.com'
@pytest.mark.asyncio
async def test_initialize_handles_empty_space_config(self):
"""Test that initialize handles empty space config."""
survey_module = get_survey_module()
mock_app = create_mock_app()
mock_app.instance_config.data = {}
mock_app.persistence_mgr.execute_async = AsyncMock(return_value=scalar_result())
manager = survey_module.SurveyManager(mock_app)
await manager.initialize()
assert manager._space_url == ''
class TestLoadTriggeredEvents:
"""Tests for _load_triggered_events method."""
@pytest.mark.asyncio
async def test_loads_events_from_metadata(self):
"""Test that events are loaded from metadata table."""
survey_module = get_survey_module()
mock_app = create_mock_app()
mock_app.persistence_mgr.execute_async = AsyncMock(return_value=scalar_result(json.dumps(['event1', 'event2'])))
manager = survey_module.SurveyManager(mock_app)
await manager._load_triggered_events()
assert 'event1' in manager._triggered_events
assert 'event2' in manager._triggered_events
@pytest.mark.asyncio
async def test_handles_no_existing_events(self):
"""Test that empty set is used when no events stored."""
survey_module = get_survey_module()
mock_app = create_mock_app()
mock_app.persistence_mgr.execute_async = AsyncMock(return_value=scalar_result())
manager = survey_module.SurveyManager(mock_app)
await manager._load_triggered_events()
assert manager._triggered_events == set()
@pytest.mark.asyncio
async def test_handles_exception(self):
"""Test that exception results in empty set."""
survey_module = get_survey_module()
mock_app = create_mock_app()
mock_app.persistence_mgr.execute_async = AsyncMock(side_effect=Exception('DB error'))
manager = survey_module.SurveyManager(mock_app)
await manager._load_triggered_events()
assert manager._triggered_events == set()
class TestIsSpaceConfigured:
"""Tests for _is_space_configured method."""
def test_returns_true_when_url_set(self):
"""Test returns True when space URL is configured."""
survey_module = get_survey_module()
mock_app = create_mock_app()
manager = survey_module.SurveyManager(mock_app)
manager._space_url = 'https://space.example.com'
assert manager._is_space_configured() is True
def test_returns_false_when_url_empty(self):
"""Test returns False when space URL is empty."""
survey_module = get_survey_module()
mock_app = create_mock_app()
manager = survey_module.SurveyManager(mock_app)
manager._space_url = ''
assert manager._is_space_configured() is False
def test_returns_false_when_telemetry_disabled(self):
"""Test returns False when disable_telemetry is True."""
survey_module = get_survey_module()
mock_app = create_mock_app()
mock_app.instance_config.data = {'space': {'url': 'https://space.example.com', 'disable_telemetry': True}}
manager = survey_module.SurveyManager(mock_app)
manager._space_url = 'https://space.example.com'
assert manager._is_space_configured() is False
class TestTriggerEvent:
"""Tests for trigger_event method."""
@pytest.mark.asyncio
async def test_skips_already_triggered_event(self):
"""Test that already triggered events are skipped."""
survey_module = get_survey_module()
mock_app = create_mock_app()
manager = survey_module.SurveyManager(mock_app)
manager._triggered_events.add('event1')
await manager.trigger_event('event1')
# Should not call save
mock_app.persistence_mgr.execute_async.assert_not_called()
@pytest.mark.asyncio
async def test_skips_when_space_not_configured(self):
"""Test that event is skipped when space not configured."""
survey_module = get_survey_module()
mock_app = create_mock_app()
manager = survey_module.SurveyManager(mock_app)
manager._space_url = ''
await manager.trigger_event('new_event')
assert 'new_event' not in manager._triggered_events
@pytest.mark.asyncio
async def test_adds_new_event_and_saves(self):
"""Test that new event is added and saved."""
survey_module = get_survey_module()
mock_app = create_mock_app()
mock_app.persistence_mgr.execute_async = AsyncMock(return_value=scalar_result())
manager = survey_module.SurveyManager(mock_app)
manager._space_url = 'https://space.example.com'
await manager.trigger_event('new_event')
assert 'new_event' in manager._triggered_events
class TestRecordBotResponseSuccess:
"""Tests for the bot_response_success_100 milestone counter."""
def _make_manager(self, survey_module, mock_app):
manager = survey_module.SurveyManager(mock_app)
manager._space_url = 'https://space.example.com'
# No existing metadata rows: select returns no row
mock_app.persistence_mgr.execute_async = AsyncMock(return_value=scalar_result())
return manager
@pytest.mark.asyncio
async def test_increments_and_persists_count(self):
survey_module = get_survey_module()
mock_app = create_mock_app()
manager = self._make_manager(survey_module, mock_app)
await manager.record_bot_response_success()
assert manager._bot_response_count == 1
# select + insert for the count key
assert mock_app.persistence_mgr.execute_async.call_count >= 2
@pytest.mark.asyncio
async def test_fires_milestone_event_at_threshold(self):
survey_module = get_survey_module()
mock_app = create_mock_app()
manager = self._make_manager(survey_module, mock_app)
manager._bot_response_count = survey_module.BOT_RESPONSE_MILESTONE - 1
await manager.record_bot_response_success()
assert manager._bot_response_count == survey_module.BOT_RESPONSE_MILESTONE
assert survey_module.BOT_RESPONSE_MILESTONE_EVENT in manager._triggered_events
@pytest.mark.asyncio
async def test_does_not_fire_below_threshold(self):
survey_module = get_survey_module()
mock_app = create_mock_app()
manager = self._make_manager(survey_module, mock_app)
manager._bot_response_count = 5
await manager.record_bot_response_success()
assert survey_module.BOT_RESPONSE_MILESTONE_EVENT not in manager._triggered_events
@pytest.mark.asyncio
async def test_stops_counting_after_milestone_triggered(self):
survey_module = get_survey_module()
mock_app = create_mock_app()
manager = self._make_manager(survey_module, mock_app)
manager._triggered_events.add(survey_module.BOT_RESPONSE_MILESTONE_EVENT)
manager._bot_response_count = survey_module.BOT_RESPONSE_MILESTONE
await manager.record_bot_response_success()
# No persistence write, count unchanged
mock_app.persistence_mgr.execute_async.assert_not_called()
assert manager._bot_response_count == survey_module.BOT_RESPONSE_MILESTONE
@pytest.mark.asyncio
async def test_skips_when_space_not_configured(self):
survey_module = get_survey_module()
mock_app = create_mock_app()
manager = self._make_manager(survey_module, mock_app)
manager._space_url = ''
await manager.record_bot_response_success()
assert manager._bot_response_count == 0
mock_app.persistence_mgr.execute_async.assert_not_called()
@pytest.mark.asyncio
async def test_count_loaded_on_initialize(self):
survey_module = get_survey_module()
mock_app = create_mock_app()
def execute_side_effect(stmt):
# Both _load_triggered_events and _load_bot_response_count select
# Metadata.value; return the count only for the count key.
stmt_str = str(stmt.compile(compile_kwargs={'literal_binds': True}))
if survey_module.BOT_RESPONSE_COUNT_KEY in stmt_str:
return scalar_result('42')
return scalar_result()
mock_app.persistence_mgr.execute_async = AsyncMock(side_effect=execute_side_effect)
manager = survey_module.SurveyManager(mock_app)
await manager.initialize()
assert manager._bot_response_count == 42
class TestPendingSurvey:
"""Tests for get_pending_survey and clear_pending_survey."""
def test_returns_none_when_no_pending(self):
"""Test returns None when no pending survey."""
survey_module = get_survey_module()
mock_app = create_mock_app()
manager = survey_module.SurveyManager(mock_app)
assert manager.get_pending_survey() is None
def test_returns_pending_survey(self):
"""Test returns the pending survey."""
survey_module = get_survey_module()
mock_app = create_mock_app()
manager = survey_module.SurveyManager(mock_app)
manager._pending_survey = {'survey_id': '123', 'questions': []}
result = manager.get_pending_survey()
assert result['survey_id'] == '123'
def test_clear_pending_survey(self):
"""Test that clear_pending_survey sets to None."""
survey_module = get_survey_module()
mock_app = create_mock_app()
manager = survey_module.SurveyManager(mock_app)
manager._pending_survey = {'survey_id': '123'}
manager.clear_pending_survey()
assert manager._pending_survey is None
class TestSubmitResponse:
"""Tests for submit_response method."""
@pytest.mark.asyncio
async def test_returns_false_when_space_not_configured(self):
"""Test returns False when space not configured."""
survey_module = get_survey_module()
mock_app = create_mock_app()
manager = survey_module.SurveyManager(mock_app)
manager._space_url = ''
result = await manager.submit_response('survey123', {'q1': 'answer1'})
assert result is False
@pytest.mark.asyncio
async def test_clears_pending_on_success(self):
"""Test that pending survey is cleared on success."""
survey_module = get_survey_module()
mock_app = create_mock_app()
manager = survey_module.SurveyManager(mock_app)
manager._space_url = 'https://space.example.com'
manager._pending_survey = {'survey_id': 'survey123'}
# Mock successful HTTP response
import httpx
mock_response = Mock()
mock_response.status_code = 200
with pytest.MonkeyPatch().context() as m:
m.setattr(
httpx,
'AsyncClient',
lambda **kwargs: MagicMock(
__aenter__=AsyncMock(return_value=Mock(post=AsyncMock(return_value=mock_response))),
__aexit__=AsyncMock(return_value=None),
),
)
result = await manager.submit_response('survey123', {'q1': 'answer1'})
assert result is True
assert manager._pending_survey is None
class TestDismissSurvey:
"""Tests for dismiss_survey method."""
@pytest.mark.asyncio
async def test_returns_false_when_space_not_configured(self):
"""Test returns False when space not configured."""
survey_module = get_survey_module()
mock_app = create_mock_app()
manager = survey_module.SurveyManager(mock_app)
manager._space_url = ''
result = await manager.dismiss_survey('survey123')
assert result is False
@pytest.mark.asyncio
async def test_clears_pending_on_success(self):
"""Test that pending survey is cleared on success."""
survey_module = get_survey_module()
mock_app = create_mock_app()
manager = survey_module.SurveyManager(mock_app)
manager._space_url = 'https://space.example.com'
manager._pending_survey = {'survey_id': 'survey123'}
# Mock successful HTTP response
import httpx
mock_response = Mock()
mock_response.status_code = 200
with pytest.MonkeyPatch().context() as m:
m.setattr(
httpx,
'AsyncClient',
lambda **kwargs: MagicMock(
__aenter__=AsyncMock(return_value=Mock(post=AsyncMock(return_value=mock_response))),
__aexit__=AsyncMock(return_value=None),
),
)
result = await manager.dismiss_survey('survey123')
assert result is True
assert manager._pending_survey is None