Updating Formulas and Algorithms for Computing Entropy and Gini Index
  from Time-Changing Data Streams
  Despite growing interest in data stream mining the most successful
incremental learners, such as VFDT, still use periodic recomputation to update
attribute information gains and Gini indices. This note provides simple
incremental formulas and algorithms for computing entropy and Gini index from
time-changing data streams.
