The refusal threshold was a guess. Twenty probes calibrated it.
labor-ph answers Philippine labor law questions from an indexed corpus, and refuses when retrieval support is too weak. The refusal line started as a hand-picked distance of 0.4. A 20-probe calibration sweep scored 61 candidate thresholds and moved it to 0.58. Every number on this page is computed from the committed artifacts: calibration-results.json and runs/2026-05-22-final.json.
the sweep · precision, recall, f1 against threshold
precisionrecallf1
Past 0.56 every probe that deserved an answer got one. Past the low 0.60s the sweep shows the other cliff: refusals stop firing at all and the out-of-corpus probes get missed, which is why precision and recall fall to zero at the far right rather than staying flat.
0.40 against 0.58, exact sweep rows
hand-picked · threshold 0.40
7 false refusals
precision0.364
recall1.000
f10.533
calibrated · threshold 0.58
0 false refusals
precision1.000
recall1.000
f11.000
final run: 10/12 pass · 83.3%latency p50 8.5s · p95 10.0s$0.0096 per queryq-019 · tagalog_code_switchedq-020 · adversarial
The two failures are known misses on RA 11210: both queries expect it as a citation and retrieval returns other sections instead, because the source PDF for that law is scanned and its text has not been OCRed yet. The run notes say exactly that.
one real answer, citations inline
Based on the retrieved sections, here is what the law states regarding paternity-related provisions:
---
## Paternity Leave in Relation to Maternity Leave
### Allocation of Maternity Leave Credits to the Father
Under Republic Act No. 11210 (the "105-Day Expanded Maternity Leave Law"), a female worker may, **at her option**, allocate **up to seven (7) days** of her maternity leave benefits to the **child's father**, whether or not they are married to each other [Section 6, Republic Act No. 11210].
The closest section in the indexed laws is an unlabeled section from Republic Act No. 11210, but it does not directly answer this question. This topic may be outside what PD 442 and the indexed Republic Acts cover. For legal advice, consult a licensed labor lawyer.
reason: out_of_corpusclosest chunk distance 0.581threshold 0.58over the line by 0.001
The nearest chunk is the preamble of Republic Act No. 11210, 0.001 past the support line. Below that line the system returns nothing rather than the nearest section: the probe gets a named refusal with the closest chunk attached as evidence, and zero synthesis cost.
Honest caveats. Faithfulness here is a must_contain substring proxy (the run reports must_contain_mean 1), which checks that required phrases appear rather than grading groundedness. No recall@k metric exists in these artifacts. And the end-to-end ask path needs OpenAI embedding credit the account no longer has, so the live query loop is currently offline while the stored index and all committed evals remain inspectable; the README says this out loud. Repository: labor-ph.