Besides, even if something of the sort did recur in all cases, it would still depend on the circumstances that is, on what happened before and after the pointing whether we should say He pointed to the shape and not to the colour.