{"action":"created","issue":{"url":"https://api.github.com/repos/edenhill/librdkafka/issues/1566","repository_url":"https://api.github.com/repos/edenhill/librdkafka","labels_url":"https://api.github.com/repos/edenhill/librdkafka/issues/1566/labels{/name}","comments_url":"https://api.github.com/repos/edenhill/librdkafka/issues/1566/comments","events_url":"https://api.github.com/repos/edenhill/librdkafka/issues/1566/events","html_url":"https://github.com/edenhill/librdkafka/issues/1566","id":277766265,"number":1566,"title":"Question: batch.num.messages & queue.buffering.max.ms","user":{"login":"michallevin","id":5261246,"avatar_url":"https://avatars3.githubusercontent.com/u/5261246?v=4","gravatar_id":"","url":"https://api.github.com/users/michallevin","html_url":"https://github.com/michallevin","followers_url":"https://api.github.com/users/michallevin/followers","following_url":"https://api.github.com/users/michallevin/following{/other_user}","gists_url":"https://api.github.com/users/michallevin/gists{/gist_id}","starred_url":"https://api.github.com/users/michallevin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/michallevin/subscriptions","organizations_url":"https://api.github.com/users/michallevin/orgs","repos_url":"https://api.github.com/users/michallevin/repos","events_url":"https://api.github.com/users/michallevin/events{/privacy}","received_events_url":"https://api.github.com/users/michallevin/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2017-11-29T14:05:29Z","updated_at":"2017-11-29T14:20:23Z","closed_at":null,"author_association":"NONE","body":"batch.num.messages default is 10000\r\nqueue.buffering.max.ms default is 0\r\n\r\nDoes this mean that by default no batching is done? "},"comment":{"url":"https://api.github.com/repos/edenhill/librdkafka/issues/comments/347873898","html_url":"https://github.com/edenhill/librdkafka/issues/1566#issuecomment-347873898","issue_url":"https://api.github.com/repos/edenhill/librdkafka/issues/1566","id":347873898,"user":{"login":"edenhill","id":524990,"avatar_url":"https://avatars0.githubusercontent.com/u/524990?v=4","gravatar_id":"","url":"https://api.github.com/users/edenhill","html_url":"https://github.com/edenhill","followers_url":"https://api.github.com/users/edenhill/followers","following_url":"https://api.github.com/users/edenhill/following{/other_user}","gists_url":"https://api.github.com/users/edenhill/gists{/gist_id}","starred_url":"https://api.github.com/users/edenhill/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/edenhill/subscriptions","organizations_url":"https://api.github.com/users/edenhill/orgs","repos_url":"https://api.github.com/users/edenhill/repos","events_url":"https://api.github.com/users/edenhill/events{/privacy}","received_events_url":"https://api.github.com/users/edenhill/received_events","type":"User","site_admin":false},"created_at":"2017-11-29T14:20:23Z","updated_at":"2017-11-29T14:20:23Z","author_association":"OWNER","body":"Almost, it means it will wait 0 ms for messages to accumulate before serializing a batch and enqueueing it for transmission.\r\nIf the time it takes to do the serialization (and other broker-thread tasks) is higher than the time it takes the application to produce() a message, then it is likely that more than one message will be accumulated for the next wait-less serializing batch run.\r\nSo it depends, but most likely you will see 1 or only a few messages per batch with this setting, which also means that you will not get optimal performance due to the increased overhead ratio of sending single or few messages at the time.\r\n\r\nI suggest you find a reasonable trade-off value for latency/thruput somewhere between 0-100ms.\r\nEven inreasing the timeout by a few milliseconds will do much (depending on your produce pattern)."}}
{"actor":{"display_login":"edenhill"}}