Tracking: end-to-end use case support for ASAPPlanner (inputs, missing components, adding summaries) #685

Activity

1. zzylol

   added a commit that references this issue on Oct 13, 2026

   docs: link the e2e use-case tracking issue #685

   ...

   5aa28e6
2. zzylol commented on Oct 14, 2026

   

   zzylol

   on Oct 14, 2026

   Last edited by zzylol

   ContributorAuthor

   More actions

   Work items → PRs/issues (moved out of the design doc)

   The design doc docs/design_docs/proposals/asapplanner-e2e-use-case.md no longer names PRs or issues. This is the mapping it carried (as of origin/main at 6665fcc3), so status stays tracked here.

   Design docs cited

   Doc	Number
   planner-layering.md (stages, Assumptions 1–8, Examples, Scenarios)	#509
   asap-primitive-schema.md (summary coverage, maintained populations)	#573
   decoupling_op_and_expr.md (operators vs scalar expressions)	#511

   Inputs not read by the pipeline on main

   Input	PRs / issues
   Time selection, window segments, panes (G10)	#628, #632, #634
   Recurrence, predictability; Stage 2 materialization (MatAtIngestion/MatAtQuery, media) (G8)	#604, #606
   Evaluation rate in pricing (G4)	#594
   Arrival, raw-data retention, deployment capabilities (G9)	#604, #609, #610
   Latency requirement / latency bounds, reasons for losing candidates	#526, #660
   One bundle for all deployment inputs; capabilities	#525
   Memory / disk budgets	#660
   Executor support for scalar operator references	#668
   Distinct-count / population bounds, HLL confidence in sizing and selection	#678

   Cost model

   Item	PRs / issues
   Remove unread PlanningModels.cost with the legacy search	open PR #635
   Deployment prices, per-second cost, memory pricing, calibration (G4)	#594
   Exact-state and KLL δ pricing	#682
   Cost models 1/2/3 (usage over time, peak capacity, own-cluster trade-offs)	#683, #660
   Measured costs (sketch-bench)	#679
   Validation of measured vs analytical cost	#347

   Accuracy model

   Item	PRs / issues
   Guarantee composition through arithmetic and comparisons; top-k band	#669
   Observed error fed back (runtime feedback)	#250
   DDSketch domain gaps	#527

   Tracked missing components

   Component	PRs / issues
   Early search-space pruning without discarding a possibly-best plan	#673
   Plan search strategies (DP over nesting, MILP over shared DAGs)	#671
   DataFusion optimizer rules in SQL lowering; rule-list API	#670
   Filter / HAVING push-down across levels	#664
   Pass 2 reuse rules: rollup, top-k reuse, nested sum merge	#680
   Pass 2 ASAP-aware CSE	G4 (#588, #589, #593, #594, #640), G5 (#595–#599, #621, #627), G6 (#591, #592, #601), G10 (#628, #632, #634)
   Stage 2 materialization (G8)	#604, #606
   Maintained-population top-k in Pass 1	#681
   Top-k output schema keeps item columns	#672
   Grouped approximate counts via Hydra in Pass 1 (G7)	#605
   Docs after consolidation	#677
   Viewer redesign for stage_pipeline (G11)	#574
   Per-operator timing in validate	#656

   Proposed components (no issue yet when the doc was written)

   Component	Related
   Plan handoff envelope (guarantees, costs, revision, input digest)	—
   Validation that the deployment can execute the plan (dry bind)	partly #609, #656
   Re-planning and state transitions	—
   Runtime feedback into models	#250 (error), #347 (cost validation)
   Latency estimation	partly #526, #660
   User-facing explanations	—
   Declared value domains and counter semantics	—
   End-to-end acceptance on a real deployment	backend restack
3. zzylol

   added a commit that references this issue on Oct 14, 2026

   docs: link the e2e use-case tracking issue #685

   1e72fb0
4. zzylol commented on Oct 18, 2026

   

   zzylol

   on Oct 18, 2026

   Last edited by zzylol

   ContributorAuthor

   More actions

   Status update (2026-10-18, origin/main at 58999df2)

   The consolidation groups landed as new PRs; the draft PRs the earlier table cites were closed as superseded. Where each item went:

   Earlier reference	Now
   #604, #606 (Stage 2 materialization, Example 4)	#717
   #609, #610, #625 (deployment inputs, MatAtQuery kept)	#730
   #594 (Stage 3 per-second cost, prices)	#692, then #723 (ResourceUsage, ResourceUnitCost, cost models 1–3)
   #683, #660 (cost models 1/2/3)	#723
   #679 (measured costs)	#734
   #678 (HLL confidence)	#693, #715
   #669 (accuracy composition)	#687 (part a), #712 (part b)
   #680 (Pass 2 reuse rules)	#716
   G4: #588, #589, #593, #640	#692
   G5: #595–#599, #621, #627	#702, #707, #708
   G6: #591, #592, #601	#696, #713
   G7: #603, #605, #608, #620	on main (SQL COUNT(*), HydraCms in Pass 1, measure filters); executor #695
   G10: #628, #632, #634	not done; tracked in #731 (drafts kept open)
   #635 (remove PlanningModels.cost, legacy search)	#734, #736
   #677 (docs)	#732
   #574 (viewer)	#686, #698
   Time selection input	removed (#722); window segments are #731

   New issues opened since: #703, #725–#727, #731, #733, #735, #738, #739. They are added to the checklist above.
5. zzylol

   added

   documentationImprovements or additions to documentationImprovements or additions to documentation

   enhancementNew feature or requestNew feature or request

   tracking issue

   on Oct 18, 2026