{"action":"closed","number":8861,"pull_request":{"url":"https://api.github.com/repos/elastic/logstash/pulls/8861","id":159277822,"html_url":"https://github.com/elastic/logstash/pull/8861","diff_url":"https://github.com/elastic/logstash/pull/8861.diff","patch_url":"https://github.com/elastic/logstash/pull/8861.patch","issue_url":"https://api.github.com/repos/elastic/logstash/issues/8861","number":8861,"state":"closed","locked":false,"title":"added new PQ checking tool bin/pqcheck","user":{"login":"colinsurprenant","id":2010,"avatar_url":"https://avatars1.githubusercontent.com/u/2010?v=4","gravatar_id":"","url":"https://api.github.com/users/colinsurprenant","html_url":"https://github.com/colinsurprenant","followers_url":"https://api.github.com/users/colinsurprenant/followers","following_url":"https://api.github.com/users/colinsurprenant/following{/other_user}","gists_url":"https://api.github.com/users/colinsurprenant/gists{/gist_id}","starred_url":"https://api.github.com/users/colinsurprenant/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/colinsurprenant/subscriptions","organizations_url":"https://api.github.com/users/colinsurprenant/orgs","repos_url":"https://api.github.com/users/colinsurprenant/repos","events_url":"https://api.github.com/users/colinsurprenant/events{/privacy}","received_events_url":"https://api.github.com/users/colinsurprenant/received_events","type":"User","site_admin":false},"body":"`bin/pqcheck` new tool to verify a PQ dir files structure. \r\n\r\nThis is based on the original one-liner script @jordansissel produced as part of a diagnostic thread.\r\n\r\nThis tool can take dir path as parameter or use the default `data/queue/main` and will look into each checkpoint files and print it content. Il also prints the corresponding page file size and prints if it is fully acked or not. \r\n\r\nexample output:\r\n```\r\n$ bin/pqcheck\r\nchecking queue dir: data/queue/main\r\ncheckpoint.head, FA, 67108864, {:version=>1, :page=>141, :firstUnackedPage=>141, :firstUnackedSeq=>17075891, :minSeq=>16974637, :elementCount=>101254, :crc32=>3485132876}\r\ncheckpoint.1, FA, NA, {:version=>0, :page=>0, :firstUnackedPage=>0, :firstUnackedSeq=>0, :minSeq=>0, :elementCount=>0, :crc32=>0}\r\n```\r\n\r\n","created_at":"2017-12-19T21:37:10Z","updated_at":"2017-12-22T21:45:54Z","closed_at":"2017-12-22T21:45:54Z","merged_at":"2017-12-22T21:45:54Z","merge_commit_sha":"c0916128770e3ef2152d130578317c4f1cbde400","assignee":{"login":"yaauie","id":210924,"avatar_url":"https://avatars1.githubusercontent.com/u/210924?v=4","gravatar_id":"","url":"https://api.github.com/users/yaauie","html_url":"https://github.com/yaauie","followers_url":"https://api.github.com/users/yaauie/followers","following_url":"https://api.github.com/users/yaauie/following{/other_user}","gists_url":"https://api.github.com/users/yaauie/gists{/gist_id}","starred_url":"https://api.github.com/users/yaauie/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/yaauie/subscriptions","organizations_url":"https://api.github.com/users/yaauie/orgs","repos_url":"https://api.github.com/users/yaauie/repos","events_url":"https://api.github.com/users/yaauie/events{/privacy}","received_events_url":"https://api.github.com/users/yaauie/received_events","type":"User","site_admin":false},"assignees":[{"login":"yaauie","id":210924,"avatar_url":"https://avatars1.githubusercontent.com/u/210924?v=4","gravatar_id":"","url":"https://api.github.com/users/yaauie","html_url":"https://github.com/yaauie","followers_url":"https://api.github.com/users/yaauie/followers","following_url":"https://api.github.com/users/yaauie/following{/other_user}","gists_url":"https://api.github.com/users/yaauie/gists{/gist_id}","starred_url":"https://api.github.com/users/yaauie/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/yaauie/subscriptions","organizations_url":"https://api.github.com/users/yaauie/orgs","repos_url":"https://api.github.com/users/yaauie/repos","events_url":"https://api.github.com/users/yaauie/events{/privacy}","received_events_url":"https://api.github.com/users/yaauie/received_events","type":"User","site_admin":false}],"requested_reviewers":[],"milestone":null,"commits_url":"https://api.github.com/repos/elastic/logstash/pulls/8861/commits","review_comments_url":"https://api.github.com/repos/elastic/logstash/pulls/8861/comments","review_comment_url":"https://api.github.com/repos/elastic/logstash/pulls/comments{/number}","comments_url":"https://api.github.com/repos/elastic/logstash/issues/8861/comments","statuses_url":"https://api.github.com/repos/elastic/logstash/statuses/c0916128770e3ef2152d130578317c4f1cbde400","head":{"label":"colinsurprenant:pqcheck","ref":"pqcheck","sha":"c0916128770e3ef2152d130578317c4f1cbde400","user":{"login":"colinsurprenant","id":2010,"avatar_url":"https://avatars1.githubusercontent.com/u/2010?v=4","gravatar_id":"","url":"https://api.github.com/users/colinsurprenant","html_url":"https://github.com/colinsurprenant","followers_url":"https://api.github.com/users/colinsurprenant/followers","following_url":"https://api.github.com/users/colinsurprenant/following{/other_user}","gists_url":"https://api.github.com/users/colinsurprenant/gists{/gist_id}","starred_url":"https://api.github.com/users/colinsurprenant/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/colinsurprenant/subscriptions","organizations_url":"https://api.github.com/users/colinsurprenant/orgs","repos_url":"https://api.github.com/users/colinsurprenant/repos","events_url":"https://api.github.com/users/colinsurprenant/events{/privacy}","received_events_url":"https://api.github.com/users/colinsurprenant/received_events","type":"User","site_admin":false},"repo":{"id":17155108,"name":"logstash","full_name":"colinsurprenant/logstash","owner":{"login":"colinsurprenant","id":2010,"avatar_url":"https://avatars1.githubusercontent.com/u/2010?v=4","gravatar_id":"","url":"https://api.github.com/users/colinsurprenant","html_url":"https://github.com/colinsurprenant","followers_url":"https://api.github.com/users/colinsurprenant/followers","following_url":"https://api.github.com/users/colinsurprenant/following{/other_user}","gists_url":"https://api.github.com/users/colinsurprenant/gists{/gist_id}","starred_url":"https://api.github.com/users/colinsurprenant/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/colinsurprenant/subscriptions","organizations_url":"https://api.github.com/users/colinsurprenant/orgs","repos_url":"https://api.github.com/users/colinsurprenant/repos","events_url":"https://api.github.com/users/colinsurprenant/events{/privacy}","received_events_url":"https://api.github.com/users/colinsurprenant/received_events","type":"User","site_admin":false},"private":false,"html_url":"https://github.com/colinsurprenant/logstash","description":"logstash - logs/event transport, processing, management, search.","fork":true,"url":"https://api.github.com/repos/colinsurprenant/logstash","forks_url":"https://api.github.com/repos/colinsurprenant/logstash/forks","keys_url":"https://api.github.com/repos/colinsurprenant/logstash/keys{/key_id}","collaborators_url":"https://api.github.com/repos/colinsurprenant/logstash/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/colinsurprenant/logstash/teams","hooks_url":"https://api.github.com/repos/colinsurprenant/logstash/hooks","issue_events_url":"https://api.github.com/repos/colinsurprenant/logstash/issues/events{/number}","events_url":"https://api.github.com/repos/colinsurprenant/logstash/events","assignees_url":"https://api.github.com/repos/colinsurprenant/logstash/assignees{/user}","branches_url":"https://api.github.com/repos/colinsurprenant/logstash/branches{/branch}","tags_url":"https://api.github.com/repos/colinsurprenant/logstash/tags","blobs_url":"https://api.github.com/repos/colinsurprenant/logstash/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/colinsurprenant/logstash/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/colinsurprenant/logstash/git/refs{/sha}","trees_url":"https://api.github.com/repos/colinsurprenant/logstash/git/trees{/sha}","statuses_url":"https://api.github.com/repos/colinsurprenant/logstash/statuses/{sha}","languages_url":"https://api.github.com/repos/colinsurprenant/logstash/languages","stargazers_url":"https://api.github.com/repos/colinsurprenant/logstash/stargazers","contributors_url":"https://api.github.com/repos/colinsurprenant/logstash/contributors","subscribers_url":"https://api.github.com/repos/colinsurprenant/logstash/subscribers","subscription_url":"https://api.github.com/repos/colinsurprenant/logstash/subscription","commits_url":"https://api.github.com/repos/colinsurprenant/logstash/commits{/sha}","git_commits_url":"https://api.github.com/repos/colinsurprenant/logstash/git/commits{/sha}","comments_url":"https://api.github.com/repos/colinsurprenant/logstash/comments{/number}","issue_comment_url":"https://api.github.com/repos/colinsurprenant/logstash/issues/comments{/number}","contents_url":"https://api.github.com/repos/colinsurprenant/logstash/contents/{+path}","compare_url":"https://api.github.com/repos/colinsurprenant/logstash/compare/{base}...{head}","merges_url":"https://api.github.com/repos/colinsurprenant/logstash/merges","archive_url":"https://api.github.com/repos/colinsurprenant/logstash/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/colinsurprenant/logstash/downloads","issues_url":"https://api.github.com/repos/colinsurprenant/logstash/issues{/number}","pulls_url":"https://api.github.com/repos/colinsurprenant/logstash/pulls{/number}","milestones_url":"https://api.github.com/repos/colinsurprenant/logstash/milestones{/number}","notifications_url":"https://api.github.com/repos/colinsurprenant/logstash/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/colinsurprenant/logstash/labels{/name}","releases_url":"https://api.github.com/repos/colinsurprenant/logstash/releases{/id}","deployments_url":"https://api.github.com/repos/colinsurprenant/logstash/deployments","created_at":"2014-02-24T23:52:15Z","updated_at":"2015-04-13T10:39:50Z","pushed_at":"2017-12-22T21:45:08Z","git_url":"git://github.com/colinsurprenant/logstash.git","ssh_url":"git@github.com:colinsurprenant/logstash.git","clone_url":"https://github.com/colinsurprenant/logstash.git","svn_url":"https://github.com/colinsurprenant/logstash","homepage":"http://logstash.net/","size":98398,"stargazers_count":0,"watchers_count":0,"language":"Ruby","has_issues":false,"has_projects":true,"has_downloads":true,"has_wiki":false,"has_pages":false,"forks_count":1,"mirror_url":null,"archived":false,"open_issues_count":0,"license":{"key":"other","name":"Other","spdx_id":null,"url":null},"forks":1,"open_issues":0,"watchers":0,"default_branch":"master"}},"base":{"label":"elastic:master","ref":"master","sha":"e5f359367f5997d1893a9aa1baa75d7e1c9de8e9","user":{"login":"elastic","id":6764390,"avatar_url":"https://avatars0.githubusercontent.com/u/6764390?v=4","gravatar_id":"","url":"https://api.github.com/users/elastic","html_url":"https://github.com/elastic","followers_url":"https://api.github.com/users/elastic/followers","following_url":"https://api.github.com/users/elastic/following{/other_user}","gists_url":"https://api.github.com/users/elastic/gists{/gist_id}","starred_url":"https://api.github.com/users/elastic/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/elastic/subscriptions","organizations_url":"https://api.github.com/users/elastic/orgs","repos_url":"https://api.github.com/users/elastic/repos","events_url":"https://api.github.com/users/elastic/events{/privacy}","received_events_url":"https://api.github.com/users/elastic/received_events","type":"Organization","site_admin":false},"repo":{"id":1090311,"name":"logstash","full_name":"elastic/logstash","owner":{"login":"elastic","id":6764390,"avatar_url":"https://avatars0.githubusercontent.com/u/6764390?v=4","gravatar_id":"","url":"https://api.github.com/users/elastic","html_url":"https://github.com/elastic","followers_url":"https://api.github.com/users/elastic/followers","following_url":"https://api.github.com/users/elastic/following{/other_user}","gists_url":"https://api.github.com/users/elastic/gists{/gist_id}","starred_url":"https://api.github.com/users/elastic/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/elastic/subscriptions","organizations_url":"https://api.github.com/users/elastic/orgs","repos_url":"https://api.github.com/users/elastic/repos","events_url":"https://api.github.com/users/elastic/events{/privacy}","received_events_url":"https://api.github.com/users/elastic/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/elastic/logstash","description":"Logstash - transport and process your logs, events, or other data","fork":false,"url":"https://api.github.com/repos/elastic/logstash","forks_url":"https://api.github.com/repos/elastic/logstash/forks","keys_url":"https://api.github.com/repos/elastic/logstash/keys{/key_id}","collaborators_url":"https://api.github.com/repos/elastic/logstash/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/elastic/logstash/teams","hooks_url":"https://api.github.com/repos/elastic/logstash/hooks","issue_events_url":"https://api.github.com/repos/elastic/logstash/issues/events{/number}","events_url":"https://api.github.com/repos/elastic/logstash/events","assignees_url":"https://api.github.com/repos/elastic/logstash/assignees{/user}","branches_url":"https://api.github.com/repos/elastic/logstash/branches{/branch}","tags_url":"https://api.github.com/repos/elastic/logstash/tags","blobs_url":"https://api.github.com/repos/elastic/logstash/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/elastic/logstash/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/elastic/logstash/git/refs{/sha}","trees_url":"https://api.github.com/repos/elastic/logstash/git/trees{/sha}","statuses_url":"https://api.github.com/repos/elastic/logstash/statuses/{sha}","languages_url":"https://api.github.com/repos/elastic/logstash/languages","stargazers_url":"https://api.github.com/repos/elastic/logstash/stargazers","contributors_url":"https://api.github.com/repos/elastic/logstash/contributors","subscribers_url":"https://api.github.com/repos/elastic/logstash/subscribers","subscription_url":"https://api.github.com/repos/elastic/logstash/subscription","commits_url":"https://api.github.com/repos/elastic/logstash/commits{/sha}","git_commits_url":"https://api.github.com/repos/elastic/logstash/git/commits{/sha}","comments_url":"https://api.github.com/repos/elastic/logstash/comments{/number}","issue_comment_url":"https://api.github.com/repos/elastic/logstash/issues/comments{/number}","contents_url":"https://api.github.com/repos/elastic/logstash/contents/{+path}","compare_url":"https://api.github.com/repos/elastic/logstash/compare/{base}...{head}","merges_url":"https://api.github.com/repos/elastic/logstash/merges","archive_url":"https://api.github.com/repos/elastic/logstash/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/elastic/logstash/downloads","issues_url":"https://api.github.com/repos/elastic/logstash/issues{/number}","pulls_url":"https://api.github.com/repos/elastic/logstash/pulls{/number}","milestones_url":"https://api.github.com/repos/elastic/logstash/milestones{/number}","notifications_url":"https://api.github.com/repos/elastic/logstash/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/elastic/logstash/labels{/name}","releases_url":"https://api.github.com/repos/elastic/logstash/releases{/id}","deployments_url":"https://api.github.com/repos/elastic/logstash/deployments","created_at":"2010-11-18T01:31:50Z","updated_at":"2017-12-22T19:37:35Z","pushed_at":"2017-12-22T21:45:48Z","git_url":"git://github.com/elastic/logstash.git","ssh_url":"git@github.com:elastic/logstash.git","clone_url":"https://github.com/elastic/logstash.git","svn_url":"https://github.com/elastic/logstash","homepage":"https://www.elastic.co/products/logstash","size":99919,"stargazers_count":8404,"watchers_count":8404,"language":"Ruby","has_issues":true,"has_projects":true,"has_downloads":true,"has_wiki":false,"has_pages":false,"forks_count":2347,"mirror_url":null,"archived":false,"open_issues_count":1074,"license":null,"forks":2347,"open_issues":1074,"watchers":8404,"default_branch":"master"}},"_links":{"self":{"href":"https://api.github.com/repos/elastic/logstash/pulls/8861"},"html":{"href":"https://github.com/elastic/logstash/pull/8861"},"issue":{"href":"https://api.github.com/repos/elastic/logstash/issues/8861"},"comments":{"href":"https://api.github.com/repos/elastic/logstash/issues/8861/comments"},"review_comments":{"href":"https://api.github.com/repos/elastic/logstash/pulls/8861/comments"},"review_comment":{"href":"https://api.github.com/repos/elastic/logstash/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/elastic/logstash/pulls/8861/commits"},"statuses":{"href":"https://api.github.com/repos/elastic/logstash/statuses/c0916128770e3ef2152d130578317c4f1cbde400"}},"author_association":"CONTRIBUTOR","merged":true,"mergeable":null,"rebaseable":null,"mergeable_state":"unknown","merged_by":{"login":"colinsurprenant","id":2010,"avatar_url":"https://avatars1.githubusercontent.com/u/2010?v=4","gravatar_id":"","url":"https://api.github.com/users/colinsurprenant","html_url":"https://github.com/colinsurprenant","followers_url":"https://api.github.com/users/colinsurprenant/followers","following_url":"https://api.github.com/users/colinsurprenant/following{/other_user}","gists_url":"https://api.github.com/users/colinsurprenant/gists{/gist_id}","starred_url":"https://api.github.com/users/colinsurprenant/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/colinsurprenant/subscriptions","organizations_url":"https://api.github.com/users/colinsurprenant/orgs","repos_url":"https://api.github.com/users/colinsurprenant/repos","events_url":"https://api.github.com/users/colinsurprenant/events{/privacy}","received_events_url":"https://api.github.com/users/colinsurprenant/received_events","type":"User","site_admin":false},"comments":2,"review_comments":19,"maintainer_can_modify":false,"commits":1,"additions":31,"deletions":0,"changed_files":1}}
{"actor":{"display_login":"colinsurprenant"}}