{"push_id":1872755351,"size":2,"distinct_size":1,"ref":"refs/heads/textio-read-watch-new-files","head":"6e2a6f538520390cf66e2af1c3bae2ee84ff8fb8","before":"a8e180c8a7de05ca10d2484a51282993af6bd6f8","commits":[{"sha":"a2d7520a49eda13abf3ef8f50a72eba0821f688f","author":{"name":"Eugene Kirpichov","email":"894747bb4c3458838d5b868e800da2320dcadb48@google.com"},"message":"[BEAM-2623] Introduces Watch transform\n\nThe transform watches for new elements in a family of growing sets.\nSee design at http://s.apache.org/beam-watch-transform\n\nAs part of the implementation, I found and fixed a bug in tracking the\nwatermark in OutputAndTimeBoundedSplittableProcessElementInvoker.\nThe watermark must be captured at the moment checkpoint is taken,\nbecause it describes timestamps of elements output from the checkpoint.\n\nI also made direct runner by default checkpoint SDF's every 100 elements\nrather than every 10000, to make it more aggressive - that's what\nuncovered the bug above.","distinct":false,"url":"https://api.github.com/repos/jkff/incubator-beam/commits/a2d7520a49eda13abf3ef8f50a72eba0821f688f"},{"sha":"6e2a6f538520390cf66e2af1c3bae2ee84ff8fb8","author":{"name":"Eugene Kirpichov","email":"894747bb4c3458838d5b868e800da2320dcadb48@google.com"},"message":"[BEAM-2512] Introduces TextIO.read/readAll().watchForNewFiles()\n\nPart of http://s.apache.org/textio-sdf, based on\nhttp://s.apache.org/beam-watch-transform.","distinct":true,"url":"https://api.github.com/repos/jkff/incubator-beam/commits/6e2a6f538520390cf66e2af1c3bae2ee84ff8fb8"}]}
{"actor":{"display_login":"jkff"}}