Why not instead say that, in general, knowing does not imply that no future evidence would lead me to lose my knowledge, but in some cases, where I do know, it just is in fact the case (and not because of some special sense of 'know')