How grades work
The whole method, published. Every firm is measured on the same three things.
No firm has a grade yet. The cut-offs between letters are still provisional.
First letter A
Typical project
The middle of its last 10 projects.
Shown from 3 projects.
Second letter B
Average
All of its last 10 projects, averaged.
Shown from 3 projects.
Third letter A
Most common
The letter it gets most often.
Shown from 5 projects. A tie shows a dash.
The colour follows the first letter.
- Excellent every time.
- A typical firm.
- Below a typical firm.
- Most of the list left unfixed.
- 3 or 4 projects: no most common yet.
- Fewer than 3 projects: no grade yet.
Three letters, last 10 projects
Each finished project gets a letter from A to E.
Projects at the same address count one at a time. A firm's second project there counts only if it started after the first ended.
Each project scores from 0 to 1. Its letter:
- A0.85 and aboveAlmost everything resolved, quickly, and the fixes held
- B0.75 and aboveAbout what most firms manage
- C0.62 and aboveNoticeably below most firms
- D0.45 and aboveWell below
- Ebelow 0.45Most defects left unresolved, or left for a long time
When a project ends
A project ends when the client signs it off.
It also ends after 60 days with nothing from the client. The client can ask for more time.
The project's score is fixed when the project ends.
Some projects end because the client went quiet. A fix the client had seen before the end keeps its 30 days. It still counts as accepted after 30 days unanswered.
A fix sent after the project has ended is kept on the record. It does not change the score.
If a firm disagrees
The grade is computed from the record and nothing else.
We never adjust a grade by hand.
While a project is live, a correction to the record recomputes the grade overnight.
A firm can report a defect it believes isn't real. We read every report.
Reporting a defect never pauses or holds a grade.
The method in full
What we measure
We do not judge whether a defect was fixed to a reasonable standard, and we do not decide how many defects a job of a given size ought to produce. Both are guesses, and the second one is worse than a guess: a client who inspects every week logs many more defects than one who visits twice, on identical work.
So we measure three things that are entirely about the firm: what it did with the list it was given.
1. How much got resolved
The share of a client's defects the firm actually resolved by the end of the project, weighted so that serious defects count for more than cosmetic ones.
A defect's weight is set by the kind of work it is:
- Painting / touch-up ×0.5
- Tiling ×1
- Glass & aluminium ×1
- Plumbing ×1.2
- Electrical ×1.2
- Wet works ×1.2
- Hacking / masonry ×1
- Carpentry ×1.5
- Waterproofing ×2
- Structural ×1.8
- Other ×1
Then by how serious it is: see How serious a defect is.
A firm that fixes every paint mark and leaves a leak has resolved most of the items and very little of the weight, and its figure reflects that.
A defect settled by agreement with the client counts as resolved. There is no limit on how many can be settled and no penalty for settling.
A fix the client doesn't answer within 30 days of seeing it counts as accepted. Its speed is timed from the day the firm sent its photo. A fix the client has not opened is not accepted. We remind the client before then.
2. How long it took
Anything put right within 4 days is prompt and scores full marks. From there the score falls away, reaching zero at 30 days. A defect never resolved counts as the full 30.
Not every defect needs doing straight away, and a client and firm often agree that something can wait until later in the works. So each defect carries a “needs attention now” switch, on by default, which only the client can change.
- On. The defect is measured against 30 days.
- Off. It is measured against the length of the job instead.
Switching it off does not remove a defect from the measurement. It gives it a longer clock, which is what was actually agreed. A deferred defect still sitting unresolved at the end uses its whole allowance, exactly like any other.
Every time the switch is flipped, it is logged with who and when, and the firm sees it.
3. Whether the fix held
Of every repair the firm claimed to have made, the share the client accepted on the first attempt. A fix that was claimed, rejected, and then abandoned counts here as a failure.
Because it is measured against what the firm attempted, we always publish it with that wording (“of attempted fixes held first time”) so it is never mistaken for a statement about the whole list.
How serious a defect is
How serious a defect is also sets its weight. The client, or the checker they appointed, chooses when adding it:
- Minor ×1.
- Major ×2.
- Critical ×10, once our team confirms it or the firm has not acknowledged it within 48 hours of it being sent. Until then it weighs as Major.
A Major or Critical defect can involve up to 3 trades, and weighs all of them.
A defect a firm raises is always Minor. Once a defect is sent, the client's choice stands. Our team reviews how serious a defect is only when it is marked Critical, and either confirms it or counts it as Major.
The project score
The three combine, weighted:
55%
for how much of the list got resolved
30%
for how long it took
15%
for whether the fix held first time
The result runs from 0 to 1, and higher is better. A project where everything was resolved within 4 days and every fix held scores exactly 1.000.
Defects raised in the last 14 days before sign-off are left out of all three measurements. A firm cannot be marked down for a defect it was given no real chance to see.
The numbers we chose
Everything above is measured except three numbers, which we picked:
- 4 days counts as prompt, to become the speed of the quickest quarter of firms on the platform.
- 30 days scores nothing on speed, to become the speed of the slowest tenth.
- 14 days before sign-off is too late to count, to be reviewed once enough projects have finished.
The cut-offs between letters are provisional. We will say here when they are set from the real spread of firms, and on how many projects.
Who can add a defect
Three people can add a defect to a project: the client, the defect checker the client appointed, and the firm itself. Only the client can send the list, accept a fix, settle a defect or sign off. A fix left unanswered for 30 days after the client has seen it counts as accepted. A firm can take back a defect it raised itself, and the client is emailed and notified the moment it does. Nobody can delete a client's defect but the client.
A defect a firm raises about its own work is scored against the firm, never for it. Left unresolved it counts against the firm exactly like one the client found. Resolved, it is taken out of both halves of the published figures, so self-reporting cannot lift a firm's numbers. It still gets the item written down and fixed.
We show the split on every firm page: how many defects clients raised, and how many the firm raised about itself. A defect your appointed checker raises counts as one you raised, because they are checking on your behalf. Who raised a defect is recorded once, when it is added, and nobody can change it afterwards, including the firm and us.
What we never do
The grade is not for sale at any price. Firms and renovators cannot buy a position, a badge or a place in search.
There is no browsable list of firms and no star rating. Firms can never edit or delete a client's defect.
One placement here is paid for, outside the registry. A defect checker can buy a labelled seat on the checker list. Checkers carry no grade.