Test Coverage Goals — posttrainllm

Test Coverage Goals — posttrainllm

Tier: EXEMPLARY

posttrainllm targets EXEMPLARY test coverage across all three runtimes: Swift (native Mac), Python (reference impl), and TypeScript (browser).

Coverage Targets

CI Integration

Swift coverage

• CLANG_ENABLE_CODE_COVERAGE=YES passed to xcodebuild test
• xcrun xccov view --report --json extracts per-target coverage
• Coverage JSON uploaded as artifact (swift-coverage-report)

Python coverage

• coverage run --source=python_ref runs test_phase1.py + test_lora.py
• coverage report -m prints per-file summary
• Coverage XML uploaded as artifact (python-coverage-report)

TypeScript coverage

• vitest run --coverage in the browser CI job
• v8 coverage provider, thresholds in browser/vitest.config.ts
• Coverage targets: tokenizer.ts, datasets.ts, gallery-schema.ts, runtime_detect.ts, storage.ts

Running Coverage Locally

Swift

cd native-mac
xcodebuild test \
  -scheme posttrainllm-Package \
  -destination 'platform=macOS' \
  -resultBundlePath /tmp/test-result.xcresult \
  CLANG_ENABLE_CODE_COVERAGE=YES
xcrun xccov view --report /tmp/test-result.xcresult

Python

pip install coverage
coverage run --source=python_ref tests/test_phase1.py
coverage run --source=python_ref --append tests/test_lora.py
coverage report -m

TypeScript (browser)

cd browser
npm test:coverage

Test Inventory

Swift (181+ tests across 28 files)

• TinyGPTModelTests: 25 files, 181+ test functions (model config, LoRA, optimizers, eval gates, etc.)
• TinyGPTIOTests: 1 file, 12+ tests (file format I/O)
• TinyGPTServeTests: 2 files (HTTP parser + server)

Python (14+ tests across 2 files)

• test_phase1.py: 14 tests (tokenizer, layer shapes, loss, overfit, gradient check, checkpoint reload)
• test_lora.py: LoRA injection, frozen-base gradients, save/load roundtrip

TypeScript (54 tests across 4 files)

• tokenizer.test.ts: 13 tests (encode/decode/roundtrip for ASCII + Unicode)
• datasets.test.ts: 18 tests (catalog validation, fetchHfText with mocked HTTP, error handling)
• runtime_detect.test.ts: 16 tests (browser detection, hardware tiers, model recommendation)
• storage.test.ts: 7 tests (OPFS save/load, gallery cache, durable storage)

Eval smoke tests (24 bash scripts)

• eval-gate-smoke.sh, common-smoke.sh run in CI
• Remaining 22 scripts run locally (some need GPU/model access)