Measure the service your company agreed to buy
Start with the important deliverables and controls in the engagement. A scorecard should show whether the provider produces usable work, explains uncertainty, and keeps commitments. It should also make the company's own dependencies visible so the review can lead to a fair remedy.
The Journal of Accountancy's CAS guidance describes vendor evaluation using defined criteria that include quality, delivery, cost, and stakeholder feedback. Apply that general idea to your accounting service, while designing measures around its actual scope. A provider's internal revenue or utilization target is not necessarily a useful measure of client value.
Keep the first version small. Choose measures that answer an actionable question and can be supported by evidence. An elaborate dashboard with uncertain definitions can create more debate than insight.
References: Journal of Accountancy: CAS service design and vendor evaluation
Define the denominator before calculating a percentage
For on-time delivery, specify what counts as a deliverable, the agreed due time, the acceptance criteria, and the treatment of approved changes. A draft with missing reconciliations should not count as a completed final report simply because it arrived before the deadline.
Use both end-to-end performance and documented dependency information. If client delay is relevant, record when usable information was due and received. Do not remove a late item from the denominator merely because somebody labels it client-caused after the event.
For an illustrative month, suppose 10 deliverables were due and eight met the agreed completion date. End-to-end on-time delivery is 80%. If one of the two late items is excluded under a documented, pre-agreed client-dependency rule, the adjusted result is eight out of nine, or about 88.9%. Show both figures and the exclusion, rather than replacing the less flattering result.
Balance speed with the quality of the finished work
Track whether required review occurred, whether outputs were accepted without substantive correction, and whether important exceptions were explained. Classify correction severity so a formatting change and a material accounting error do not contribute equally to a misleading average.
The following is an illustrative scorecard design, not an industry benchmark. Set targets after understanding the service and baseline. A critical unresolved issue should remain visible even when the overall score looks good.
| Measure | Evidence | Question it should prompt |
|---|---|---|
| Accepted delivery on time | Dated output and acceptance criteria | Which dependency or capacity caused delay? |
| Required review completed | Named review record | Was judgment checked before release? |
| Substantive corrections | Correction log by cause and severity | Is a recurring preparation or control issue present? |
| Aged unresolved questions | Original age and affected output | Who can remove the remaining blocker? |
| Avoidable client rework | Repeated requests or rejected inputs by cause | Which handoff needs improvement? |
| Service changes and fees | Approved scope changes and invoices | Does the cost match the accepted commitment? |
Keep a serious exception outside the average
Suppose, hypothetically, nine of 10 reports were accepted without correction, but the tenth contained a significant error that affected an external submission. A 90% first-pass acceptance rate is arithmetically accurate and operationally incomplete. The serious issue needs its own assessment, recovery, and prevention action.
GAO's Green Book treats monitoring and timely remediation as parts of an internal-control system. It is a federal framework; the applicable requirements for your company may differ. The useful principle for this scorecard is that observing a problem should lead to an accountable response, not merely a lower color on a chart.
Avoid a single weighted total unless its purpose is clear. A provider could improve a composite score by answering messages faster while leaving a significant reconciliation problem unresolved. Show the few measures and serious exceptions that management needs to judge directly.
References: GAO: Standards for Internal Control in the Federal Government, 2025
Review causes with evidence from both sides
Discuss a small number of actual examples behind the measures. Compare the agreed input date, the request quality, the provider's start and review dates, and the final outcome. This helps distinguish insufficient capacity from poor source quality or an unexpectedly complex issue.
Measure the company's contribution too. Late approvals, missing contracts, and changing instructions can make a well-staffed service ineffective. Record those dependencies without using them to excuse a provider's failure to identify or escalate a problem.
For subjective feedback, ask a concrete question: could the recipient understand the report's limitations, obtain a useful answer, or locate the evidence? Keep the number and role of respondents visible. One executive's preference about presentation should not be mistaken for broad evidence of accounting quality.
Turn the review into a limited improvement plan
Select the most consequential gap and agree the action, owner, date, and evidence of improvement. That might involve a revised request format, a different reviewer, or a clearer input cutoff. Avoid creating a long list that nobody has the capacity to complete.
Keep definitions stable long enough to observe a trend, and mark changes when the scope or business changes. More transactions or a new entity can make periods less comparable. Explain the difference instead of attributing every movement to provider performance.
Use the scorecard to decide whether the service needs a process fix, more capacity, a scope adjustment, or a different provider. The numbers should help that decision by making the underlying work easier to inspect.
Sources
Requirements and product details can change. Check the linked guidance for the facts that apply to your situation.
Related reading
Need help with this work?
General information, not personalized accounting, tax, legal, or investment advice. Have the appropriate qualified professional review decisions that depend on your circumstances.