How-to

Select a portfolio under budget

Choose the asset combination worth keeping, ranked by delta-per-cost, every decision at a Bonferroni-corrected interval, with a rejection log.

Valuation answers “which assets improve the agent?” Selection answers “which combination should I keep?”

kno select --value-run-id <value run id> --pool pool.jsonl

What you get

Selected 2, greedy on delta-per-cost
  RANK  ASSET          DESTINATION    DELTA (95% CI)
  1     refund-policy  context        +0.4000 [-0.1000, 0.9000]
  2     pricing-tier   context        +0.3000 [-0.0500, 0.6500]

Rejected 1
  old-faq       redundant   duplicates refund-policy
  • Budget, selection fits a context budget (tokens) and a cost budget (dollars) simultaneously.
  • Bonferroni-corrected intervals, the error budget is the family of decisions, not any one of them.
  • Rejection log, every reject carries a reason: no-effect, regression, redundant, cost-dominated, wrong-mechanism, irrelevant, budget-exhausted, measurement-failed.
  • Honest caveat, the selection-time gain is inflated by the winner’s curse; the honest number is the validate report’s holdout gain.

“Include nothing new” is a legal, first-class answer.

Details: Select a portfolio recipe.

← All docs