{"action":"closed","issue":{"url":"https://api.github.com/repos/Azure/azure-diagnostics-tools/issues/53","repository_url":"https://api.github.com/repos/Azure/azure-diagnostics-tools","labels_url":"https://api.github.com/repos/Azure/azure-diagnostics-tools/issues/53/labels{/name}","comments_url":"https://api.github.com/repos/Azure/azure-diagnostics-tools/issues/53/comments","events_url":"https://api.github.com/repos/Azure/azure-diagnostics-tools/issues/53/events","html_url":"https://github.com/Azure/azure-diagnostics-tools/issues/53","id":194601292,"number":53,"title":"Continuation Token incorrectly reset","user":{"login":"blane-directscale","id":18354676,"avatar_url":"https://avatars.githubusercontent.com/u/18354676?v=3","gravatar_id":"","url":"https://api.github.com/users/blane-directscale","html_url":"https://github.com/blane-directscale","followers_url":"https://api.github.com/users/blane-directscale/followers","following_url":"https://api.github.com/users/blane-directscale/following{/other_user}","gists_url":"https://api.github.com/users/blane-directscale/gists{/gist_id}","starred_url":"https://api.github.com/users/blane-directscale/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/blane-directscale/subscriptions","organizations_url":"https://api.github.com/users/blane-directscale/orgs","repos_url":"https://api.github.com/users/blane-directscale/repos","events_url":"https://api.github.com/users/blane-directscale/events{/privacy}","received_events_url":"https://api.github.com/users/blane-directscale/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":2,"created_at":"2016-12-09T13:51:04Z","updated_at":"2017-02-13T17:57:18Z","closed_at":"2017-02-13T17:57:18Z","body":"Hello,  Looks like you don't support public pull requests, so I'll report this here.  \r\n\r\nI found a issue with the logstash blob plugin.  If the number of items in the container exceeds the paging value (default is 5000) then the list_blob_names method will get stuck in an infant loop.\r\n\r\nCode in /Logstash/logstash-input-azureblob/lib/logstash/inputs/azureblob.rb\r\n\r\n```\r\n    loop do\r\n      continuation_token = NIL\r\n      entries = @azure_blob.list_blobs(@container, { :timeout => 10, :marker => continuation_token})\r\n\r\n```\r\nThe continuation_token is cleared each time thought the loop so it will always fetch the first page.  An easy way to dup this is to setup a container with 10 blobs and then set the max_results option of the list_blobs call to 2 or something smaller that the number in the container.\r\n\r\nThe code should initialize the value only once before entering the loop.  \r\n\r\n```\r\n    continuation_token = NIL\r\n    loop do\r\n      entries = @azure_blob.list_blobs(@container, { :timeout => 10, :marker => continuation_token})\r\n\r\n```\r\n-Thanks"}}
{"actor":{"display_login":"brahmnes"}}