Files
claude-mem/tests/integration/chroma-vector-sync.test.ts
T
Alex Newman c6f932988a Fix 30+ root-cause bugs across 10 triage phases (#1214)
* MAESTRO: fix ChromaDB core issues — Python pinning, Windows paths, disable toggle, metadata sanitization, transport errors

- Add --python version pinning to uvx args in both local and remote mode (fixes #1196, #1206, #1208)
- Convert backslash paths to forward slashes for --data-dir on Windows (fixes #1199)
- Add CLAUDE_MEM_CHROMA_ENABLED setting for SQLite-only fallback mode (fixes #707)
- Sanitize metadata in addDocuments() to filter null/undefined/empty values (fixes #1183, #1188)
- Wrap callTool() in try/catch for transport errors with auto-reconnect (fixes #1162)

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* MAESTRO: fix data integrity — content-hash deduplication, project name collision, empty project guard, stuck isProcessing

- Add SHA-256 content-hash deduplication to observations INSERT (store.ts, transactions.ts, SessionStore.ts)
- Add content_hash column via migration 22 with backfill and index
- Fix project name collision: getCurrentProjectName() now returns parent/basename
- Guard against empty project string with cwd-derived fallback
- Fix stuck isProcessing: hasAnyPendingWork() resets processing messages older than 5 minutes
- Add 12 new tests covering all four fixes

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* MAESTRO: fix hook lifecycle — stderr suppression, output isolation, conversation pollution prevention

- Suppress process.stderr.write in hookCommand() to prevent Claude Code showing diagnostic
  output as error UI (#1181). Restores stderr in finally block for worker-continues case.
- Convert console.error() to logger.warn()/error() in hook-command.ts and handlers/index.ts
  so all diagnostics route to log file instead of stderr.
- Verified all 7 handlers return suppressOutput: true (prevents conversation pollution #598, #784).
- Verified session-complete is a recognized event type (fixes #984).
- Verified unknown event types return no-op handler with exit 0 (graceful degradation).
- Added 10 new tests in tests/hook-lifecycle.test.ts covering event dispatch, adapter defaults,
  stderr suppression, and standard response constants.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* MAESTRO: fix worker lifecycle — restart loop coordination, stale transport retry, ENOENT shutdown race

- Add PID file mtime guard to prevent concurrent restart storms (#1145):
  isPidFileRecent() + touchPidFile() coordinate across sessions
- Add transparent retry in ChromaMcpManager.callTool() on transport
  error — reconnects and retries once instead of failing (#1131)
- Wrap getInstalledPluginVersion() with ENOENT/EBUSY handling (#1042)
- Verified ChromaMcpManager.stop() already called on all shutdown paths

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* MAESTRO: fix Windows platform support — uvx.cmd spawn, PowerShell $_ elimination, windowsHide, FTS5 fallback

- Route uvx spawn through cmd.exe /c on Windows since MCP SDK lacks shell:true (#1190, #1192, #1199)
- Replace all PowerShell Where-Object {$_} pipelines with WQL -Filter server-side filtering (#1024, #1062)
- Add windowsHide: true to all exec/spawn calls missing it to prevent console popups (#1048)
- Add FTS5 runtime probe with graceful fallback when unavailable on Windows (#791)
- Guard FTS5 table creation in migrations, SessionSearch, and SessionStore with try/catch

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* MAESTRO: fix skills/ distribution — build-time verification and regression tests (#1187)

Add post-build verification in build-hooks.js that fails if critical
distribution files (skills, hooks, plugin manifest) are missing. Add
10 regression tests covering skill file presence, YAML frontmatter,
hooks.json integrity, and package.json files field.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* MAESTRO: fix MigrationRunner schema initialization (#979) — version conflict between parallel migration systems

Root cause: old DatabaseManager migrations 1-7 shared schema_versions table with
MigrationRunner's 4-22, causing version number collisions (5=drop tables vs add column,
6=FTS5 vs prompt tracking, 7=discovery_tokens vs remove UNIQUE).  initializeSchema()
was gated behind maxApplied===0, so core tables were never created when old versions
were present.

Fixes:
- initializeSchema() always creates core tables via CREATE TABLE IF NOT EXISTS
- Migrations 5-7 check actual DB state (columns/constraints) not just version tracking
- Crash-safe temp table rebuilds (DROP IF EXISTS _new before CREATE)
- Added missing migration 21 (ON UPDATE CASCADE) to MigrationRunner
- Added ON UPDATE CASCADE to FK definitions in initializeSchema()
- All changes applied to both runner.ts and SessionStore.ts

Tests: 13 new tests in migration-runner.test.ts covering fresh DB, idempotency,
version conflicts, crash recovery, FK constraints, and data integrity.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* MAESTRO: fix 21 test failures — stale mocks, outdated assertions, missing OpenClaw guards

Server tests (12): Added missing workerPath and getAiStatus to ServerOptions
mocks after interface expansion. ChromaSync tests (3): Updated to verify
transport cleanup in ChromaMcpManager after architecture refactor. OpenClaw (2):
Added memory_ tool skipping and response truncation to prevent recursive loops
and oversized payloads. MarkdownFormatter (2): Updated assertions to match
current output. SettingsDefaultsManager (1): Used correct default key for
getBool test. Logger standards (1): Excluded CLI transcript command from
background service check.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* MAESTRO: fix Codex CLI compatibility (#744) — session_id fallbacks, unknown platform tolerance, undefined guard

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* MAESTRO: fix Cursor IDE integration (#838, #1049) — adapter field fallbacks, tolerant session-init validation

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* MAESTRO: fix /api/logs OOM (#1203) — tail-read replaces full-file readFileSync

Replace readFileSync (loads entire file into memory) with readLastLines()
that reads only from the end of the file in expanding chunks (64KB → 10MB cap).
Prevents OOM on large log files while preserving the same API response shape.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* MAESTRO: fix Settings CORS error (#1029) — explicit methods and allowedHeaders in CORS config

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* MAESTRO: add session custom_title for agent attribution (#1213) — migration 23, endpoint + store support

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* MAESTRO: prevent CLAUDE.md/AGENTS.md writes inside .git/ directories (#1165)

Add .git path guard to all 4 write sites to prevent ref corruption when
paths resolve inside .git internals.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* MAESTRO: fix plugin disabled state not respected (#781) — early exit check in all hook entry points

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* MAESTRO: fix UserPromptSubmit context re-injection on every turn (#1079) — contextInjected session flag

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

* MAESTRO: fix stale AbortController queue stall (#1099) — lastGeneratorActivity tracking + 30s timeout

Three-layer fix:
1. Added lastGeneratorActivity timestamp to ActiveSession, updated by
   processAgentResponse (all agents), getMessageIterator (queue yields),
   and startGeneratorWithProvider (generator launch)
2. Added stale generator detection in ensureGeneratorRunning — if no
   activity for >30s, aborts stale controller, resets state, restarts
3. Added AbortSignal.timeout(30000) in deleteSession to prevent
   indefinite hang when awaiting a stuck generator promise

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>

---------

Co-authored-by: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-23 19:34:35 -05:00

368 lines
13 KiB
TypeScript

/**
* Chroma Vector Sync Integration Tests
*
* Tests ChromaSync vector embedding and semantic search.
* Skips tests if uvx/chroma not installed (CI-safe).
*
* Sources:
* - ChromaSync implementation from src/services/sync/ChromaSync.ts
* - MCP patterns from the Chroma MCP server
*/
import { describe, it, expect, beforeEach, afterEach, beforeAll, afterAll, spyOn } from 'bun:test';
import { logger } from '../../src/utils/logger.js';
import path from 'path';
import os from 'os';
import fs from 'fs';
// Check if uvx/chroma is available
let chromaAvailable = false;
let skipReason = '';
async function checkChromaAvailability(): Promise<{ available: boolean; reason: string }> {
try {
// Check if uvx is available
const uvxCheck = Bun.spawn(['uvx', '--version'], {
stdout: 'pipe',
stderr: 'pipe',
});
await uvxCheck.exited;
if (uvxCheck.exitCode !== 0) {
return { available: false, reason: 'uvx not installed' };
}
return { available: true, reason: '' };
} catch (error) {
return { available: false, reason: `uvx check failed: ${error}` };
}
}
// Suppress logger output during tests
let loggerSpies: ReturnType<typeof spyOn>[] = [];
describe('ChromaSync Vector Sync Integration', () => {
const testProject = `test-project-${Date.now()}`;
const testVectorDbDir = path.join(os.tmpdir(), `chroma-test-${Date.now()}`);
beforeAll(async () => {
const check = await checkChromaAvailability();
chromaAvailable = check.available;
skipReason = check.reason;
// Create temp directory for vector db
if (chromaAvailable) {
fs.mkdirSync(testVectorDbDir, { recursive: true });
}
});
afterAll(async () => {
// Cleanup temp directory
try {
if (fs.existsSync(testVectorDbDir)) {
fs.rmSync(testVectorDbDir, { recursive: true, force: true });
}
} catch {
// Ignore cleanup errors
}
});
beforeEach(() => {
loggerSpies = [
spyOn(logger, 'info').mockImplementation(() => {}),
spyOn(logger, 'debug').mockImplementation(() => {}),
spyOn(logger, 'warn').mockImplementation(() => {}),
spyOn(logger, 'error').mockImplementation(() => {}),
];
});
afterEach(() => {
loggerSpies.forEach(spy => spy.mockRestore());
});
describe('ChromaSync availability check', () => {
it('should detect uvx availability status', async () => {
const check = await checkChromaAvailability();
// This test always passes - it just logs the status
expect(typeof check.available).toBe('boolean');
if (!check.available) {
console.log(`Chroma tests will be skipped: ${check.reason}`);
}
});
});
describe('ChromaSync class structure', () => {
it('should be importable', async () => {
const { ChromaSync } = await import('../../src/services/sync/ChromaSync.js');
expect(ChromaSync).toBeDefined();
expect(typeof ChromaSync).toBe('function');
});
it('should instantiate with project name', async () => {
const { ChromaSync } = await import('../../src/services/sync/ChromaSync.js');
const sync = new ChromaSync('test-project');
expect(sync).toBeDefined();
});
});
describe('Document formatting', () => {
it('should format observation documents correctly', async () => {
if (!chromaAvailable) {
console.log(`Skipping: ${skipReason}`);
return;
}
const { ChromaSync } = await import('../../src/services/sync/ChromaSync.js');
const sync = new ChromaSync(testProject);
// Test the document formatting logic by examining the class
// The formatObservationDocs method is private, but we can verify
// the sync method signature exists
expect(typeof sync.syncObservation).toBe('function');
expect(typeof sync.syncSummary).toBe('function');
expect(typeof sync.syncUserPrompt).toBe('function');
});
it('should have query method', async () => {
const { ChromaSync } = await import('../../src/services/sync/ChromaSync.js');
const sync = new ChromaSync(testProject);
expect(typeof sync.queryChroma).toBe('function');
});
it('should have close method for cleanup', async () => {
const { ChromaSync } = await import('../../src/services/sync/ChromaSync.js');
const sync = new ChromaSync(testProject);
expect(typeof sync.close).toBe('function');
});
it('should have ensureBackfilled method', async () => {
const { ChromaSync } = await import('../../src/services/sync/ChromaSync.js');
const sync = new ChromaSync(testProject);
expect(typeof sync.ensureBackfilled).toBe('function');
});
});
describe('Observation sync interface', () => {
it('should accept ParsedObservation format', async () => {
const { ChromaSync } = await import('../../src/services/sync/ChromaSync.js');
const sync = new ChromaSync(testProject);
// The syncObservation method should accept these parameters
const observationId = 1;
const memorySessionId = 'session-123';
const project = 'test-project';
const observation = {
type: 'discovery',
title: 'Test Title',
subtitle: 'Test Subtitle',
facts: ['fact1', 'fact2'],
narrative: 'Test narrative',
concepts: ['concept1'],
files_read: ['/path/to/file.ts'],
files_modified: []
};
const promptNumber = 1;
const createdAtEpoch = Date.now();
// Verify method signature accepts these parameters
// We don't actually call it to avoid needing a running Chroma server
expect(sync.syncObservation.length).toBeGreaterThanOrEqual(0);
});
});
describe('Summary sync interface', () => {
it('should accept ParsedSummary format', async () => {
const { ChromaSync } = await import('../../src/services/sync/ChromaSync.js');
const sync = new ChromaSync(testProject);
// The syncSummary method should accept these parameters
const summaryId = 1;
const memorySessionId = 'session-123';
const project = 'test-project';
const summary = {
request: 'Test request',
investigated: 'Test investigated',
learned: 'Test learned',
completed: 'Test completed',
next_steps: 'Test next steps',
notes: 'Test notes'
};
const promptNumber = 1;
const createdAtEpoch = Date.now();
// Verify method exists
expect(typeof sync.syncSummary).toBe('function');
});
});
describe('User prompt sync interface', () => {
it('should accept prompt text format', async () => {
const { ChromaSync } = await import('../../src/services/sync/ChromaSync.js');
const sync = new ChromaSync(testProject);
// The syncUserPrompt method should accept these parameters
const promptId = 1;
const memorySessionId = 'session-123';
const project = 'test-project';
const promptText = 'Help me write a function';
const promptNumber = 1;
const createdAtEpoch = Date.now();
// Verify method exists
expect(typeof sync.syncUserPrompt).toBe('function');
});
});
describe('Query interface', () => {
it('should accept query string and options', async () => {
const { ChromaSync } = await import('../../src/services/sync/ChromaSync.js');
const sync = new ChromaSync(testProject);
// Verify method signature
expect(typeof sync.queryChroma).toBe('function');
// The method should return a promise
// (without calling it since no server is running)
});
});
describe('Collection naming', () => {
it('should use project-based collection name', async () => {
const { ChromaSync } = await import('../../src/services/sync/ChromaSync.js');
// Collection name format is cm__{project}
const projectName = 'my-project';
const sync = new ChromaSync(projectName);
// The collection name is private, but we can verify the class
// was constructed successfully with the project name
expect(sync).toBeDefined();
});
it('should handle special characters in project names', async () => {
const { ChromaSync } = await import('../../src/services/sync/ChromaSync.js');
// Projects with special characters should work
const projectName = 'my-project_v2.0';
const sync = new ChromaSync(projectName);
expect(sync).toBeDefined();
});
});
describe('Error handling', () => {
it('should handle connection failures gracefully', async () => {
if (!chromaAvailable) {
console.log(`Skipping: ${skipReason}`);
return;
}
const { ChromaSync } = await import('../../src/services/sync/ChromaSync.js');
const sync = new ChromaSync(testProject);
// Calling syncObservation without a running server should throw
// but not crash the process
const observation = {
type: 'discovery' as const,
title: 'Test',
subtitle: null,
facts: [],
narrative: null,
concepts: [],
files_read: [],
files_modified: []
};
// This should either throw or fail gracefully
try {
await sync.syncObservation(
1,
'session-123',
'test',
observation,
1,
Date.now()
);
// If it didn't throw, the connection might have succeeded
} catch (error) {
// Expected - server not running
expect(error).toBeDefined();
}
// Clean up
await sync.close();
});
});
describe('Cleanup', () => {
it('should handle close on unconnected instance', async () => {
const { ChromaSync } = await import('../../src/services/sync/ChromaSync.js');
const sync = new ChromaSync(testProject);
// Close without ever connecting should not throw
await expect(sync.close()).resolves.toBeUndefined();
});
it('should be safe to call close multiple times', async () => {
const { ChromaSync } = await import('../../src/services/sync/ChromaSync.js');
const sync = new ChromaSync(testProject);
// Multiple close calls should be safe
await expect(sync.close()).resolves.toBeUndefined();
await expect(sync.close()).resolves.toBeUndefined();
});
});
describe('Process leak prevention (Issue #761)', () => {
/**
* Regression test for GitHub Issue #761:
* "Feature Request: Option to disable Chroma (RAM usage / zombie processes)"
*
* Root cause: When connection errors occur (MCP error -32000, Connection closed),
* the code was resetting `connected` and `client` but NOT closing the transport,
* leaving the chroma-mcp subprocess alive. Each reconnection attempt spawned
* a NEW process while old ones accumulated as zombies.
*
* Fix: Transport lifecycle is now managed by ChromaMcpManager (singleton),
* which handles connect/disconnect/cleanup. ChromaSync delegates to it.
*/
it('should have transport cleanup in ChromaMcpManager error handlers', async () => {
// ChromaSync now delegates connection management to ChromaMcpManager.
// Verify that ChromaMcpManager source includes transport cleanup.
const sourceFile = await Bun.file(
new URL('../../src/services/sync/ChromaMcpManager.ts', import.meta.url)
).text();
// Verify that error handlers include transport cleanup
expect(sourceFile).toContain('this.transport.close()');
// Verify transport is set to null after close
expect(sourceFile).toContain('this.transport = null');
// Verify connected is set to false after close
expect(sourceFile).toContain('this.connected = false');
});
it('should reset state after close regardless of connection status', async () => {
// ChromaSync.close() is now a lightweight method that logs and returns.
// Connection state is managed by ChromaMcpManager singleton.
const { ChromaSync } = await import('../../src/services/sync/ChromaSync.js');
const sync = new ChromaSync(testProject);
// close() should complete without error regardless of state
await expect(sync.close()).resolves.toBeUndefined();
});
it('should clean up transport in ChromaMcpManager close() method', async () => {
// Read the ChromaMcpManager source to verify transport.close() is in the close path
const sourceFile = await Bun.file(
new URL('../../src/services/sync/ChromaMcpManager.ts', import.meta.url)
).text();
// Verify the close/disconnect method properly cleans up transport
expect(sourceFile).toContain('await this.transport.close()');
expect(sourceFile).toContain('this.transport = null');
expect(sourceFile).toContain('this.connected = false');
});
});
});