GriTS: Grid table similarity metric for table structure recognition
  In this paper, we propose a new class of evaluation metric for table
structure recognition, grid table similarity (GriTS). Unlike prior metrics,
GriTS evaluates the correctness of a predicted table directly in its natural
form as a matrix. To create a similarity measure between matrices, we
generalize the two-dimensional largest common substructure (2D-LCS) problem,
which is NP-hard, to the 2D most similar substructures (2D-MSS) problem and
propose a polynomial-time heuristic for solving it. We validate empirically
using the PubTables-1M dataset that comparison between matrices exhibits more
desirable behavior than alternatives for table structure recognition
evaluation. GriTS also unifies all three subtasks of cell topology recognition,
cell location recognition, and cell content recognition within the same
framework, which simplifies the evaluation and enables more meaningful
comparisons across different types of structure recognition approaches. Code
will be released at https://github.com/microsoft/table-transformer.
