{"action":"opened","issue":{"url":"https://api.github.com/repos/DataDog/integrations-core/issues/284","repository_url":"https://api.github.com/repos/DataDog/integrations-core","labels_url":"https://api.github.com/repos/DataDog/integrations-core/issues/284/labels{/name}","comments_url":"https://api.github.com/repos/DataDog/integrations-core/issues/284/comments","events_url":"https://api.github.com/repos/DataDog/integrations-core/issues/284/events","html_url":"https://github.com/DataDog/integrations-core/issues/284","id":215745520,"number":284,"title":"[docker] Check 'docker_daemon' instance #0 failed","user":{"login":"pahaz","id":1394025,"avatar_url":"https://avatars1.githubusercontent.com/u/1394025?v=3","gravatar_id":"","url":"https://api.github.com/users/pahaz","html_url":"https://github.com/pahaz","followers_url":"https://api.github.com/users/pahaz/followers","following_url":"https://api.github.com/users/pahaz/following{/other_user}","gists_url":"https://api.github.com/users/pahaz/gists{/gist_id}","starred_url":"https://api.github.com/users/pahaz/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/pahaz/subscriptions","organizations_url":"https://api.github.com/users/pahaz/orgs","repos_url":"https://api.github.com/users/pahaz/repos","events_url":"https://api.github.com/users/pahaz/events{/privacy}","received_events_url":"https://api.github.com/users/pahaz/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2017-03-21T13:49:50Z","updated_at":"2017-03-21T13:49:50Z","closed_at":null,"body":"<!--\r\n\r\nThis issue queue is primarily intended for tracking features, bugs and work items associated with\r\nthe Datadog Agent open-source project.\r\n\r\nPrior to submitting an issue please review the following:\r\n\r\n- [ ] [Troubleshooting](https://datadog.zendesk.com/hc/en-us/sections/200766955-Troubleshooting) section of our [Knowledge base](https://datadog.zendesk.com/hc/en-us).\r\n- [ ] Contact our [support](http://docs.datadoghq.com/help/) and [send them your logs](https://github.com/DataDog/dd-agent/wiki/Send-logs-to-support).\r\n- [ ] Finally, you can open a Github issue respecting this [title convention](https://github.com/DataDog/dd-agent/blob/master/CONTRIBUTING.md#commits-titles) (it helps us triage).\r\n\r\nIf you are reporting a new issue, make sure that we do not have any duplicates\r\nalready open. You can ensure this by searching the issue list for this\r\nrepository. If there is a duplicate, please close your issue and add a comment\r\nto the existing issue instead.\r\n\r\nIf you suspect your issue is a bug, please edit your issue description to\r\ninclude the BUG REPORT INFORMATION shown below.\r\n\r\n---------------------------------------------------\r\nBUG REPORT INFORMATION\r\n---------------------------------------------------\r\nUse the commands below to provide key information from your environment:\r\nYou do NOT have to include this information if this is a FEATURE REQUEST\r\n-->\r\n\r\n**Output of the [info page](https://help.datadoghq.com/hc/en-us/articles/203764635-Agent-Status-and-Information) **\r\n\r\n```\r\n====================\r\nCollector (v 5.11.2)\r\n====================\r\n\r\n  Status date: 2017-03-21 13:45:44 (18s ago)\r\n  Pid: 21732\r\n  Platform: Linux-4.4.0-66-generic-x86_64-with-Ubuntu-16.04-xenial\r\n  Python Version: 2.7.12, 64bit\r\n  Logs: <stderr>, /var/log/datadog/collector.log, syslog:/dev/log\r\n\r\n  Clocks\r\n  ======\r\n\r\n    NTP offset: 0.0177 s\r\n    System UTC time: 2017-03-21 13:46:03.049974\r\n\r\n  Paths\r\n  =====\r\n\r\n    conf.d: /etc/dd-agent/conf.d\r\n    checks.d: /opt/datadog-agent/agent/checks.d\r\n\r\n  Hostnames\r\n  =========\r\n\r\n    socket-hostname: tpahaz\r\n    hostname: tpahaz\r\n    socket-fqdn: tpahaz\r\n\r\n  Checks\r\n  ======\r\n\r\n    process\r\n    -------\r\n      - instance #0 [OK]\r\n      - instance #1 [OK]\r\n      - instance #2 [OK]\r\n      - instance #3 [OK]\r\n      - instance #4 [OK]\r\n      - instance #5 [OK]\r\n      - instance #6 [OK]\r\n      - instance #7 [OK]\r\n      - instance #8 [OK]\r\n      - instance #9 [OK]\r\n      - instance #10 [OK]\r\n      - instance #11 [OK]\r\n      - instance #12 [OK]\r\n      - instance #13 [OK]\r\n      - instance #14 [OK]\r\n      - instance #15 [OK]\r\n      - instance #16 [OK]\r\n      - Collected 137 metrics, 0 events & 17 service checks\r\n\r\n    network\r\n    -------\r\n      - instance #0 [OK]\r\n      - Collected 39 metrics, 0 events & 0 service checks\r\n\r\n    nginx\r\n    -----\r\n      - instance #0 [OK]\r\n      - Collected 7 metrics, 0 events & 1 service check\r\n\r\n    ntp\r\n    ---\r\n      - Collected 0 metrics, 0 events & 0 service checks\r\n\r\n    consul\r\n    ------\r\n      - instance #0 [OK]\r\n      - Collected 21 metrics, 0 events & 2 service checks\r\n\r\n    disk\r\n    ----\r\n      - instance #0 [OK]\r\n      - Collected 24 metrics, 0 events & 0 service checks\r\n\r\n    docker_daemon\r\n    -------------\r\n      - instance #0 [OK]\r\n      - Collected 184 metrics, 0 events & 1 service check\r\n\r\n\r\n  Emitters\r\n  ========\r\n\r\n    - http_emitter [OK]\r\n\r\n====================\r\nDogstatsd (v 5.11.2)\r\n====================\r\n\r\n  Status date: 2017-03-21 13:45:58 (4s ago)\r\n  Pid: 21726\r\n  Platform: Linux-4.4.0-66-generic-x86_64-with-Ubuntu-16.04-xenial\r\n  Python Version: 2.7.12, 64bit\r\n  Logs: <stderr>, /var/log/datadog/dogstatsd.log, syslog:/dev/log\r\n\r\n  Flush count: 30\r\n  Packet Count: 0\r\n  Packets per second: 0.0\r\n  Metric count: 1\r\n  Event count: 0\r\n  Service check count: 0\r\n\r\n====================\r\nForwarder (v 5.11.2)\r\n====================\r\n\r\n  Status date: 2017-03-21 13:46:03 (0s ago)\r\n  Pid: 21725\r\n  Platform: Linux-4.4.0-66-generic-x86_64-with-Ubuntu-16.04-xenial\r\n  Python Version: 2.7.12, 64bit\r\n  Logs: <stderr>, /var/log/datadog/forwarder.log, syslog:/dev/log\r\n\r\n  Queue Size: 12472 bytes\r\n  Queue Length: 1\r\n  Flush Count: 101\r\n  Transactions received: 45\r\n  Transactions flushed: 44\r\n  Transactions rejected: 0\r\n  API Key Status: API Key is valid\r\n\r\n\r\n======================\r\nTrace Agent (v 5.11.2)\r\n======================\r\n\r\n  Not running (port 8126)\r\n```\r\n\r\n**Additional environment details (Operating System, Cloud provider, etc):**\r\n - ubuntu server 16.04.2 LTS\r\n\r\n**Steps to reproduce the issue:**\r\n1. restart some container\r\n\r\nSometimes it product the trace:\r\n```\r\nERROR (__init__.py:784): Check 'docker_daemon' instance #0 failed\r\n                                           Traceback (most recent call last):\r\n                                             File \"/opt/datadog-agent/agent/checks/__init__.py\", line 767, in run\r\n                                               self.check(copy.deepcopy(instance))\r\n                                             File \"/opt/datadog-agent/agent/checks.d/docker_daemon.py\", line 230, in check\r\n                                               self._report_performance_metrics(containers_by_id)\r\n                                             File \"/opt/datadog-agent/agent/checks.d/docker_daemon.py\", line 489, in _report_performance_metrics\r\n                                               self._report_cgroup_metrics(container, tags)\r\n                                             File \"/opt/datadog-agent/agent/checks.d/docker_daemon.py\", line 507, in _report_cgroup_metrics\r\n                                               stat_file = self._get_cgroup_from_proc(cgroup[\"cgroup\"], container['_pid'], cgroup['file'])\r\n                                             File \"/opt/datadog-agent/agent/checks.d/docker_daemon.py\", line 770, in _get_cgroup_from_proc\r\n                                               return DockerUtil.find_cgroup_from_proc(self._mountpoints, pid, cgroup, self.docker_util._docker_root) % (params)\r\n                                             File \"/opt/datadog-agent/agent/utils/dockerutil.py\", line 311, in find_cgroup_from_proc\r\n                                               with open(proc_path, 'r') as fp:\r\n                                           IOError: [Errno 2] No such file or directory: '/proc/21292/cgroup'\r\n```\r\n\r\n**Additional information you deem important (e.g. issue happens only occasionally):**\r\nI think it may be related with container state.\r\n"}}
{"actor":{"display_login":"pahaz"}}