A good detector can still produce many false alerts
Suppose an invoice-warning rule identifies 80% of payments that eventually arrive late. It would be incorrect to conclude that every flagged invoice has an 80% chance of being late. The first number starts with late invoices; the second starts with flagged invoices. Those groups have different denominators.
Bayes' theorem provides the conversion using the prior event probability and the signal's behavior for both event and nonevent cases. OpenStax explains this probability update. A count table often makes the same logic easier to inspect before it enters a cash model.
Define late precisely, such as unpaid thirty days after the contractual due date, and define when the warning is observed. A signal available only after the payment deadline cannot support a forecast supposedly made before that deadline.
References: OpenStax: Probability theory and Bayes' theorem
Build the table from a hypothetical invoice population
Assume an invented population of 1,000 comparable invoices, of which 100 are late under the chosen definition. The warning rule flags 80% of the late invoices and 20% of the invoices that pay on time. These percentages are assumptions for the illustration, not collection benchmarks.
Of the 100 late invoices, 80 are flagged and 20 are not. Of the 900 on-time invoices, 180 are flagged and 720 are not. The rule therefore produces 260 warnings in total.
Among those 260 flagged invoices, 80 are late. The probability of lateness conditional on a warning is 80 divided by 260, or approximately 30.77%. The warning meaningfully increases risk from the 10% base rate, while most flagged invoices still pay on time.
| Illustrative payment outcome | Flagged | Not flagged | Total |
|---|---|---|---|
| Late | 80 | 20 | 100 |
| On time | 180 | 720 | 900 |
| Total | 260 | 740 | 1,000 |
Use both sides of the signal
The unflagged group also has an updated probability. Twenty of its 740 invoices are late, giving approximately 2.70%. Absence of a warning reduces the modeled probability but does not eliminate late payments.
The two group probabilities reconcile to the original population. Multiplying 260 by 80/260 and 740 by 20/740 gives 80 plus 20 expected late invoices, or 100. That reconciliation is a useful check against accidentally applying the 80% detection rate to the flagged group.
A dashboard can show the warning rate, the share of late invoices detected, and the share of warnings that turn out late. Label each measure clearly. They describe workload, detection and alert precision respectively, and none can be substituted for another without changing the question.
The prior rate changes the meaning of the same warning
Consider another hypothetical population where half the invoices are late. Keep the same 80% detection rate and 20% false-alert rate. In a population of 1,000, the rule flags 400 late invoices and 100 on-time invoices.
Now 400 of 500 warnings correspond to lateness, so the conditional probability is 80%. The signal's assumed detection characteristics have not changed; the underlying prevalence has. Applying the first population's 30.77% estimate to this second population would miss that difference.
Use a base rate relevant to the customer group, terms and forecast horizon. A warning developed on disputed invoices may not have the same interpretation for newly issued, undisputed invoices. Population changes deserve a separate check rather than a silent reuse of an old probability.
Translate probability into the particular cash event
If every invoice in the first example is $1,000 and lateness means no payment by the forecast deadline, expected receipts by that deadline are $180,000 from flagged invoices and $720,000 from unflagged invoices. The expected delayed amount totals $100,000.
Real invoices differ in size. A count-based warning probability should not automatically be applied to the entire dollar balance if large invoices have different payment behavior. Forecast invoice-level or appropriately grouped amounts, with evidence that the conditional probability fits those amounts.
Delayed payment is also different from permanent loss. This example updates the chance of receiving cash by a date; it does not estimate an accounting allowance or establish that the delayed amount is uncollectible. Model later collection dates separately if they matter to the funding decision.
Check how the historical labels were assembled
Include invoices whose outcomes are fully observable for the chosen deadline. A newly issued invoice cannot yet be labeled on time merely because it has not become late. Mixing immature cases into the historical table can understate the event rate.
Reconstruct the signal using information that existed at the forecast date. A later dispute code, revised due date or collection note can leak the eventual outcome into an apparently predictive rule. Retain dated snapshots when evaluating whether the warning worked prospectively.
Keep credit notes, cancellations and corrected invoices separate from ordinary payment outcomes where they change the amount owed. Otherwise the table may label a valid noncash resolution as a failed collection and teach the model the wrong relationship.
A warning probability does not measure the benefit of chasing
A higher probability can help prioritize a review, but it does not show how much a reminder or collection call will improve payment. Some flagged invoices may pay late regardless of outreach; others may be easily resolved once a missing purchase-order reference is supplied.
Assess the cost and incremental effect of the proposed intervention separately. If the team begins acting on warnings, later payment outcomes may reflect both the original risk and the action taken. A successful intervention can make a useful warning appear less predictive when that treatment history is ignored.
Use the alert to ask a specific question of the account owner, such as whether an acceptance document is missing. The probability summarizes evidence about a class of invoices; it does not explain the individual cause without further information.
Monitor the updated probability against later outcomes
As complete new invoice cohorts mature, compare the predicted late shares with the observed results for flagged and unflagged groups. Investigate changes in terms, customer mix, warning coverage and collection actions before changing the forecast.
The practical output is a probability attached to a defined event and population, together with the expected dated cash effect. That is more useful than carrying a detector's 80% headline into a cash forecast where it answers the wrong conditional question.
Sources
Requirements and product details can change. Check the linked guidance for the facts that apply to your situation.
Related reading
Need help with this work?
General information, not personalized accounting, tax, legal, or investment advice. Have the appropriate qualified professional review decisions that depend on your circumstances.