Learning continuous models for continuous physics
  Dynamical systems that evolve continuously over time are ubiquitous
throughout science and engineering. Machine learning (ML) provides data-driven
approaches to model and predict the dynamics of such systems. A core issue with
this approach is that ML models are typically trained on discrete data, using
ML methodologies that are not aware of underlying continuity properties, which
results in models that often do not capture the underlying continuous dynamics
of a system of interest. As a result, these ML models are of limited use for
for many scientific and engineering applications. To address this challenge, we
develop a convergence test based on numerical analysis theory. Our test
verifies whether a model has learned a function that accurately approximates a
system's underlying continuous dynamics. Models that fail this test fail to
capture relevant dynamics, rendering them of limited utility for many
scientific prediction tasks; while models that pass this test enable both
better interpolation and better extrapolation in multiple ways. Our results
illustrate how principled numerical analysis methods can be coupled with
existing ML training/testing methodologies to validate models for science and
engineering applications.
