Every procurement decision starts with the same question: which vendor is the best choice? But "best" means different things to different stakeholders. Finance cares about price. Operations cares about delivery reliability. Quality cares about defect rates. Without a structured evaluation framework, you are not making a decision — you are managing competing opinions.
A weighted vendor evaluation scorecard solves this problem by making your criteria explicit, assigning importance before you see any vendor scores, and producing a clear, objective ranking that everyone can see and challenge on the same terms. Here is how to build one, step by step.
Step 1: Define your evaluation criteria
Start by listing what actually matters for this procurement decision. The most common mistake is copying a generic template without tailoring it to the specific purchase. Criteria that matter when buying raw materials do not overlap with criteria for selecting a SaaS vendor. Ask your stakeholders directly: "If we had to reject a vendor for one reason, what would that reason be?" Their answers become your criteria.
Typical categories include:
- Price / total cost of ownership — unit cost, volume discounts, payment terms, shipping, maintenance
- Quality — defect rates, certifications (ISO), quality management systems, sample evaluation
- Delivery reliability — on-time delivery percentage, lead time, capacity, geographic proximity
- Technical capability — expertise, innovation track record, equipment, R&D investment
- Financial stability — credit rating, years in business, revenue trends, dependency on single customers
- Service and responsiveness — communication speed, issue resolution time, account management quality
- Compliance and risk — regulatory compliance, data security, ESG practices, geopolitical exposure
Aim for 5–8 criteria. Fewer than 5 means you are missing important dimensions. More than 8 creates diminishing returns — criteria with weights under 5% rarely change the final ranking.
If your criteria list is longer than a sticky note, you are measuring too many things. Focus on what changes the decision.
Step 2: Assign criteria weights
Weights determine how much each criterion contributes to the final score. This is where procurement teams most often go wrong: assigning equal weights for political convenience rather than reflecting actual business priorities.
Follow this process to assign defensible weights:
- Force-rank all criteria.Ask stakeholders: "If you could only keep one criterion, which would it be?" Rank from most to least important. No ties allowed — forced ranking surfaces real priorities.
- Assign initial weights. Give your top-ranked criterion a starting weight of 25–35%. Distribute the remaining percentage points across lower-ranked criteria. Total must equal 100%.
- Validate with scenario testing. Test edge cases: if two vendors are tied on every criterion except your highest-weighted one, does the model pick the right winner? If not, your weights are off.
- Document the rationale. Write one sentence per criterion explaining why it received its weight. This protects the scorecard from later second-guessing.
A sample weight distribution for an indirect materials procurement might be: Quality 30%, Price 25%, Delivery 20%, Technical Capability 10%, Service 10%, Financial Stability 5%.
Step 3: Create a scoring rubric
A rubric is the difference between subjective opinion and objective evaluation. For each criterion, define what a score of 1, 2, 3, 4, and 5 actually means with observable evidence — not vague adjectives.
Use this standard 1–5 scale as your foundation:
- 1 — Does not meet: The vendor cannot satisfy this requirement. Significant gaps exist. Would require major investment or change to become acceptable.
- 2 — Partially meets: The vendor has relevant capability but with notable weaknesses. Would require some accommodation or oversight.
- 3 — Meets: The vendor satisfies the requirement at an acceptable level. Comparable to industry standard. No significant concerns.
- 4 — Exceeds: The vendor goes beyond the baseline. Demonstrated strengths that create measurable advantage over typical suppliers.
- 5 — Significantly exceeds: Best-in-class. The vendor sets the standard in this area. Clear differentiator that meaningfully impacts business outcomes.
Then tailor behavioral anchors to each criterion. For example, under Delivery Reliability, a rubric might specify: 1 = "less than 85% on-time delivery over last 12 months," 3 = "92–96% on-time delivery," 5 = "98%+ on-time delivery with documented contingency plans for disruptions."
Step 4: Calculate weighted scores
With your criteria defined, weights set, and rubric built, calculation is straightforward. For each vendor, multiply each criterion score by its weight percentage (expressed as a decimal), then sum the results:
Weighted Score = Σ (Score × Weight)
Step 5: A worked example
Let us walk through a real scenario. A manufacturing company is evaluating three suppliers for a critical component. The procurement team has defined six criteria with weights, and three evaluators have scored each vendor using the rubric.
The criteria and weights:
- Quality — 30%
- Price — 25%
- Delivery — 20%
- Technical capability — 10%
- Service — 10%
- Financial stability — 5%
Vendor A scores: Quality 4, Price 3, Delivery 4, Technical 5, Service 3, Financial 4. Weighted score = (4×0.30) + (3×0.25) + (4×0.20) + (5×0.10) + (3×0.10) + (4×0.05) = 1.20 + 0.75 + 0.80 + 0.50 + 0.30 + 0.20 = 3.75
Vendor B scores: Quality 3, Price 5, Delivery 3, Technical 3, Service 4, Financial 5. Weighted score = (3×0.30) + (5×0.25) + (3×0.20) + (3×0.10) + (4×0.10) + (5×0.05) = 0.90 + 1.25 + 0.60 + 0.30 + 0.40 + 0.25 = 3.70
Vendor C scores: Quality 5, Price 2, Delivery 5, Technical 4, Service 5, Financial 3. Weighted score = (5×0.30) + (2×0.25) + (5×0.20) + (4×0.10) + (5×0.10) + (3×0.05) = 1.50 + 0.50 + 1.00 + 0.40 + 0.50 + 0.15 = 4.05
Final ranking: Vendor C (4.05), Vendor A (3.75), Vendor B (3.70). Notice what the scorecard reveals: Vendor B had the best price but lost on quality and delivery — the two highest-weighted criteria. Without explicit weights, the team might have defaulted to the cheapest option. The scorecard makes the tradeoffs visible and defensible.