Consistency issues in the best worst method: Measurements and thresholds

Fuqi Liang*, Matteo Brunelli, Jafar Rezaei

*Corresponding author for this work

Research output: Contribution to journalArticleScientificpeer-review

52 Citations (Scopus)
29 Downloads (Pure)


The Best-Worst Method (BWM) uses ratios of the relative importance of criteria in pairs based on the assessment done by decision-makers. When a decision-maker provides the pairwise comparisons in BWM, checking the acceptable inconsistency, to ensure the rationality of the assessments, is an important step. Although both the original and the extended versions of BWM have proposed several consistency measurements, there are some deficiencies, including: (i) the lack of a mechanism to provide immediate feedback to the decision-maker regarding the consistency of the pairwise comparisons being provided, (ii) the inability to consider the ordinal consistency into account, and (iii) the lack of consistency thresholds to determine the reliability of the results. To deal with these problems, this study starts by proposing a cardinal consistency measurement to provide immediate feedback, called the input-based consistency measurement, after which an ordinal consistency measurement is proposed to check the coherence of the order of the results (weights) against the order of the pairwise comparisons provided by the decision-maker. Finally, a method is proposed to balance cardinal consistency ratio under ordinal-consistent and ordinal-inconsistent conditions, to determine the thresholds for the proposed and the original consistency ratios.

Original languageEnglish
Article number102175
JournalOmega (United Kingdom)
Publication statusPublished - 2020


  • Best worst method
  • Consistency measurement
  • Consistency threshold


Dive into the research topics of 'Consistency issues in the best worst method: Measurements and thresholds'. Together they form a unique fingerprint.

Cite this