{"action":"created","issue":{"url":"https://api.github.com/repos/idaholab/moose/issues/9834","repository_url":"https://api.github.com/repos/idaholab/moose","labels_url":"https://api.github.com/repos/idaholab/moose/issues/9834/labels{/name}","comments_url":"https://api.github.com/repos/idaholab/moose/issues/9834/comments","events_url":"https://api.github.com/repos/idaholab/moose/issues/9834/events","html_url":"https://github.com/idaholab/moose/pull/9834","id":257155141,"number":9834,"title":"benchmarking capability","user":{"login":"rwcarlsen","id":1351242,"avatar_url":"https://avatars2.githubusercontent.com/u/1351242?v=4","gravatar_id":"","url":"https://api.github.com/users/rwcarlsen","html_url":"https://github.com/rwcarlsen","followers_url":"https://api.github.com/users/rwcarlsen/followers","following_url":"https://api.github.com/users/rwcarlsen/following{/other_user}","gists_url":"https://api.github.com/users/rwcarlsen/gists{/gist_id}","starred_url":"https://api.github.com/users/rwcarlsen/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rwcarlsen/subscriptions","organizations_url":"https://api.github.com/users/rwcarlsen/orgs","repos_url":"https://api.github.com/users/rwcarlsen/repos","events_url":"https://api.github.com/users/rwcarlsen/events{/privacy}","received_events_url":"https://api.github.com/users/rwcarlsen/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2017-09-12T19:29:50Z","updated_at":"2017-09-14T19:57:23Z","closed_at":null,"author_association":"CONTRIBUTOR","pull_request":{"url":"https://api.github.com/repos/idaholab/moose/pulls/9834","html_url":"https://github.com/idaholab/moose/pull/9834","diff_url":"https://github.com/idaholab/moose/pull/9834.diff","patch_url":"https://github.com/idaholab/moose/pull/9834.patch"},"body":"Rework of #9407.  I left the benchmark.py script in and it basically does the same stuff it did in #9407.  But the benchmark running code has been refactored and a new Benchmark tester for the test harness has been created.  The simple diffusion tests file has an example benchmark added.  To run benchmarks with the test harness you ```./run_tests --run benchmarks```.\r\n\r\nI implemented it through a \"tagging\" functionality - I don't have any particular strong feelings about the details flag names, etc.  Feel free to make suggestions.  I figured it would be useful to be able to tag tests in ``tests`` files and the have ``--run`` and ``--skip`` flags on the harness that are lists of tags to include/exclude.  I'm also open to building a tagging sort of functionality out in another PR before we put this in.  ``checkRunnableBase`` could benefit from some refactoring I think.\r\n\r\nYou can still use the benchmark list file like the previous PR, but it is bonus functionality you can ignore; this PR allows you to specify benchmarks in the tests files.  To create a benchmark, you add this sort of thing to a ``tests`` file:\r\n\r\n```\r\n...\r\n[my-bench-name]\r\n  type = Benchmark\r\n  input = \"foo.i\"\r\n  cli_args = \"...\"\r\n[../]\r\n...\r\n```\r\n\r\nAll the benchmarking data is stored in a ``benchmarks.sqlite`` file."},"comment":{"url":"https://api.github.com/repos/idaholab/moose/issues/comments/329591726","html_url":"https://github.com/idaholab/moose/pull/9834#issuecomment-329591726","issue_url":"https://api.github.com/repos/idaholab/moose/issues/9834","id":329591726,"user":{"login":"rwcarlsen","id":1351242,"avatar_url":"https://avatars2.githubusercontent.com/u/1351242?v=4","gravatar_id":"","url":"https://api.github.com/users/rwcarlsen","html_url":"https://github.com/rwcarlsen","followers_url":"https://api.github.com/users/rwcarlsen/followers","following_url":"https://api.github.com/users/rwcarlsen/following{/other_user}","gists_url":"https://api.github.com/users/rwcarlsen/gists{/gist_id}","starred_url":"https://api.github.com/users/rwcarlsen/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rwcarlsen/subscriptions","organizations_url":"https://api.github.com/users/rwcarlsen/orgs","repos_url":"https://api.github.com/users/rwcarlsen/repos","events_url":"https://api.github.com/users/rwcarlsen/events{/privacy}","received_events_url":"https://api.github.com/users/rwcarlsen/received_events","type":"User","site_admin":false},"created_at":"2017-09-14T19:57:23Z","updated_at":"2017-09-14T19:57:23Z","author_association":"CONTRIBUTOR","body":"I guess I should remove the sample ``bench.list`` and update the script readme to reflect all this."}}
{"actor":{"display_login":"rwcarlsen"}}