"Look Ma, No Hands!" A Parameter-Free Topic Model
  It has always been a burden to the users of statistical topic models to
predetermine the right number of topics, which is a key parameter of most topic
models. Conventionally, automatic selection of this parameter is done through
either statistical model selection (e.g., cross-validation, AIC, or BIC) or
Bayesian nonparametric models (e.g., hierarchical Dirichlet process). These
methods either rely on repeated runs of the inference algorithm to search
through a large range of parameter values which does not suit the mining of big
data, or replace this parameter with alternative parameters that are less
intuitive and still hard to be determined. In this paper, we explore to
"eliminate" this parameter from a new perspective. We first present a
nonparametric treatment of the PLSA model named nonparametric probabilistic
latent semantic analysis (nPLSA). The inference procedure of nPLSA allows for
the exploration and comparison of different numbers of topics within a single
execution, yet remains as simple as that of PLSA. This is achieved by
substituting the parameter of the number of topics with an alternative
parameter that is the minimal goodness of fit of a document. We show that the
new parameter can be further eliminated by two parameter-free treatments:
either by monitoring the diversity among the discovered topics or by a weak
supervision from users in the form of an exemplar topic. The parameter-free
topic model finds the appropriate number of topics when the diversity among the
discovered topics is maximized, or when the granularity of the discovered
topics matches the exemplar topic. Experiments on both synthetic and real data
prove that the parameter-free topic model extracts topics with a comparable
quality comparing to classical topic models with "manual transmission". The
quality of the topics outperforms those extracted through classical Bayesian
nonparametric models.
