Price discovery algorithm for free-form PHILGEPS dataset
Abstract
PHILGEPS is the official online platform used in government procurement of products and services. In this work, we aim to perform price discovery on the products listed in the free-form PHILGEPS 2016 procurement report. The text listings were first lemmatized to determine product keywords. Afterwards, product price distributions were generated by kernel density estimation in conjunction with two-sample Kolmogorov-Smirnov test. Lastly, keywords were clustered into three groups based on their threshold bandwidth hth. It was found that general product terms cluster together, with the specific product identifiers having bandwidths between 0.25 and 1.50.