The evaluation of Agricultural Biomass Conversion Technologies (ABCTs) requires the consideration of multiple sustainability dimensions, including environmental, economic, technical, social, and political–regulatory factors. This study assessed the relevance and relative importance of sustainability criteria for evaluating ABCTs in the Visayas region of the Philippines. A structured expert survey involving 117 respondents from government, the private sector, academe, and other relevant sectors was conducted to validate twenty sustainability criteria and determine the relative priority of five sustainability dimensions. Respondents assessed criterion relevance using a five-point rating scale, while dimension rankings and comparative importance assessments were used to derive weights through the Stepwise Weight Assessment Ratio Analysis (SWARA) method. All twenty criteria obtained mean relevance ratings above 3.80, with Waste Utilization Efficiency receiving the highest mean rating (4.6154) and Political Stability the lowest (3.8205). The Environmental dimension obtained the highest SWARA weight (0.2872), followed by Economic (0.2480), Technical (0.1977), Social (0.1545), and Political–Regulatory (0.1126). Although the Social and Political–Regulatory dimensions received lower relative weights, their constituent criteria were generally considered relevant by respondents. The findings establish a distinction between criterion relevance and relative sustainability priority and provide the dimension-level weighting structure subsequently applied in the extended SWARA–ARAS framework for evaluating ABCTs.