Skip to content

test(sleep): document preference-scope evidence loss during deduplication - #331

Draft
Baixin Guo (GBX-Max1220) wants to merge 2 commits into
microsoft:mainfrom
GBX-Max1220:test/154-preference-scope-contracts
Draft

Baixin Guo (GBX-Max1220) wants to merge 2 commits into
microsoft:mainfrom
GBX-Max1220:test/154-preference-scope-contracts

Conversation

@GBX-Max1220

Copy link
Copy Markdown

Refs #154.

Adds a CPU-only, synthetic paired-session matrix covering durable preferences, one-off corrections, later reversals, and ambiguous feedback through the existing SessionDigest → mining → dedup path.

Individual records retain the scope statements. Same-intent dedup merges source session IDs but retains only the first record's context. Four strict expected-failure tests document the proposed retention contract; unrelated exceptions still fail normally.

The accompanying matrix separates evidence retention from proposed persistence policies. No production code is changed, and no model calls are made.

Validation

Command:
PYTHONPATH=. python -m pytest tests/test_preference_scope_contracts.py tests/test_sleep_skill_hint.py tests/test_env_section_survives_dedup.py -q --tb=short

Result: 31 passed, 4 xfailed, 130 subtests passed.
The new file contributes 8 passing cases and 4 strict expected failures. The full suite was not run.

Review scope

This draft demonstrates an evidence-retention gap, not an incorrect persistent update or reliable preference inference. Persistence policies remain proposals for discussion; clean-context replay and learning gains are outside this patch.

Feedback on overlap and the proposed retention contract would be appreciated before expanding the work.

AI-assisted preparation and execution; submitted by Baixin Guo (Max).

@GBX-Max1220

Copy link
Copy Markdown
Author

@microsoft-github-policy-service agree

This branch has not been deployed

No deployments
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant