Skip to content

Sync with current source: product capabilities doc, on-demand model evaluation - #4

Merged
PradipNichite merged 1 commit into
mainfrom
sync/product-capabilities
Oct 26, 2026
Merged

PradipNichite merged 1 commit into
mainfrom
sync/product-capabilities

Conversation

@PradipNichite

Copy link
Copy Markdown
Contributor

Brings this repository up to date with the current source and adds a product capabilities map.

  • New: docs/product-capabilities.md. It covers:

    • what the product supports today;
    • hosted vs standalone;
    • the REST API (Document Intelligence has no MCP server yet);
    • per-operation model configuration and fallbacks;
    • sample data and suggested workflows;
    • cost, latency and evaluation;
    • current limitations.

    It is linked from README.md and docs/README.md.

  • Model evaluation (.github/workflows/model-evaluation.yml) runs on demand only, through Actions → Model evaluation → Run workflow. It needs the MODEL_EVAL_OPENAI_API_KEY and MODEL_EVAL_LANGSMITH_API_KEY secrets.

  • Product work since the initial release:

    • chat usage and document processing_telemetry;
    • synthetic resume and invoice samples with ground truth;
    • chart and follow-up fixes;
    • the model evaluation harness and its results;
    • collection-scoped API keys.

The tree is the output of deploy/export_source.py on the private development repository at b3d09a5: 1,269 files, and the private-identifier scan found nothing. The README changes from PRs 1–3 are kept. Line endings are now LF, as in the source. The initial snapshot had been archived with CRLF conversion.

🤖 Generated with Claude Code

…el evaluation

Tree = deploy/export_source.py output of the private development repository at
b3d09a5 (1,269 files, private-identifier scan 0). Adds docs/product-capabilities.md
(linked from README.md and docs/README.md), makes the model evaluation workflow
on demand only, and brings the product work since the initial release: usage and
processing telemetry, sample data, chart and follow-up fixes, the model evaluation
harness and results, collection-scoped API keys.

Line endings are now LF as in the source repository; the initial snapshot had been
archived with CRLF conversion on Windows.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@PradipNichite
PradipNichite merged commit 2c5d1fd into main Oct 26, 2026
5 checks passed
@PradipNichite
PradipNichite deleted the sync/product-capabilities branch October 26, 2026 13:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant