{"action":"created","issue":{"url":"https://api.github.com/repos/git-lfs/git-lfs/issues/2439","repository_url":"https://api.github.com/repos/git-lfs/git-lfs","labels_url":"https://api.github.com/repos/git-lfs/git-lfs/issues/2439/labels{/name}","comments_url":"https://api.github.com/repos/git-lfs/git-lfs/issues/2439/comments","events_url":"https://api.github.com/repos/git-lfs/git-lfs/issues/2439/events","html_url":"https://github.com/git-lfs/git-lfs/issues/2439","id":245367310,"number":2439,"title":"git-lfs died of signal 9","user":{"login":"larsxschneider","id":477434,"avatar_url":"https://avatars0.githubusercontent.com/u/477434?v=4","gravatar_id":"","url":"https://api.github.com/users/larsxschneider","html_url":"https://github.com/larsxschneider","followers_url":"https://api.github.com/users/larsxschneider/followers","following_url":"https://api.github.com/users/larsxschneider/following{/other_user}","gists_url":"https://api.github.com/users/larsxschneider/gists{/gist_id}","starred_url":"https://api.github.com/users/larsxschneider/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/larsxschneider/subscriptions","organizations_url":"https://api.github.com/users/larsxschneider/orgs","repos_url":"https://api.github.com/users/larsxschneider/repos","events_url":"https://api.github.com/users/larsxschneider/events{/privacy}","received_events_url":"https://api.github.com/users/larsxschneider/received_events","type":"User","site_admin":false},"labels":[{"id":57558054,"url":"https://api.github.com/repos/git-lfs/git-lfs/labels/bug","name":"bug","color":"fc2929","default":true}],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":9,"created_at":"2017-07-25T11:13:27Z","updated_at":"2017-08-01T18:22:52Z","closed_at":null,"body":"If I clone a large Git LFS repo (~1GB native Git objects + ~30GB LFS objects) like this:\r\n```\r\ngit lfs clone https://server/org/repo.git\r\n```\r\n\r\nThen I can reliably reproduce the following error:\r\n```\r\n...\r\nGit LFS: (6802 of 7093 files) 5.08 GB / 5.17 GB                                \r\ntrace git-lfs: HTTP: GET https://server/lfs/2188/objects/2f36b022c374238616fe05181082d0fa6d0000cbefff04d2219df2ad5bcc0f7c\r\nGit LFS: (6803 of 7093 files) 5.08 GB / 5.17 GB                                \r\nerror: git-lfs died of signal 9\r\n```\r\n\r\n## Setup\r\n\r\n```\r\n$ git --version\r\ngit version 2.13.2\r\n$ git lfs version\r\ngit-lfs/2.2.1 (GitHub; darwin amd64; go 1.8.3)\r\n$ git config -l | grep lfs\r\nlfs.batch=true\r\nlfs.concurrenttransfers=10\r\nlfs.transfer.maxretries=10\r\nfilter.lfs.clean=git-lfs clean -- %f\r\nfilter.lfs.smudge=git-lfs smudge -- %f\r\nfilter.lfs.process=git-lfs filter-process\r\nfilter.lfs.required=true\r\n```\r\n\r\n## Observations\r\n\r\n* the error seems to happen only on macOS (I was not able to reproduce it on Windows so far)\r\n* the error happens somewhat randomly (not for the same LFS files) but always after ~5GB\r\n* `git lfs clone` calls internally `git` which in turn calls internally `git lfs`. I think `git` [prints the error message here](https://github.com/git/git/blob/0339965c70d68fd3831c9a5306443c869de3f6a8/run-command.c#L539). This is the output in the process view:\r\n```\r\n-+= 60783 lars git lfs clone https://server/org/repo.git\r\n \\-+- 60784 lars /usr/local/bin/git-lfs clone https://server/org/repo.git\r\n   |--- 61066 lars git ls-tree -r -l -z --full-tree cbea3229a0999e5da8777cf69605785745150100\r\n   |--- 61067 lars git cat-file --batch\r\n   \\-+- 61080 lars git update-index -q --refresh --stdin\r\n     \\--- 61081 lars git-lfs filter-process\r\n```\r\n* shortly before the process dies my machine completely freezes. My guess is that `git-lfs` excessively allocates system resources. I monitored the resource consumption with `ps aux` and recorded the high CPU usage right before the process died:\r\n```\r\nUSER            PID   %CPU  %MEM VSZ       RSS     TT    STAT STARTED  TIME     COMMAND\r\nlars            13556 110.1 13.1 556753000 2194964 s007  R+   11:32AM  12:04.69 /usr/local/bin/git-lfs clone https://server/org/repo.git\r\nlars            13556 119.3 11.1 556753000 1869576 s007  R+   11:32AM  12:06.00 /usr/local/bin/git-lfs clone https://server/org/repo.git\r\nlars            13556 119.3 13.1 556753000 2198776 s007  R+   11:32AM  12:07.28 /usr/local/bin/git-lfs clone https://server/org/repo.git\r\nlars            13556 123.9 15.2 556753000 2556848 s007  R+   11:32AM  12:08.60 /usr/local/bin/git-lfs clone https://server/org/repo.git\r\nlars            13556 133.9 16.3 556753000 2726700 s007  R+   11:32AM  12:09.97 /usr/local/bin/git-lfs clone https://server/org/repo.git\r\n```\r\n* if I set `lfs.concurrenttransfers=1` and `lfs.transfer.maxretries=0` then I can still reliably reproduce the error\r\n* I was not able to reproduce the error with a fake repository so far\r\n\r\n---\r\n\r\nDo you have a clue what that error might be? How would you continue with the debugging? I think it would make sense to add additional debug output (I am already running it with `GIT_TRACE=1 GIT_CURL_VERBOSE=1 GIT_TRACE_PACKET=1`). Can you recommend good places for debug output?\r\n\r\nThanks,\r\nLars "},"comment":{"url":"https://api.github.com/repos/git-lfs/git-lfs/issues/comments/319454776","html_url":"https://github.com/git-lfs/git-lfs/issues/2439#issuecomment-319454776","issue_url":"https://api.github.com/repos/git-lfs/git-lfs/issues/2439","id":319454776,"user":{"login":"pluehne","id":3244280,"avatar_url":"https://avatars1.githubusercontent.com/u/3244280?v=4","gravatar_id":"","url":"https://api.github.com/users/pluehne","html_url":"https://github.com/pluehne","followers_url":"https://api.github.com/users/pluehne/followers","following_url":"https://api.github.com/users/pluehne/following{/other_user}","gists_url":"https://api.github.com/users/pluehne/gists{/gist_id}","starred_url":"https://api.github.com/users/pluehne/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/pluehne/subscriptions","organizations_url":"https://api.github.com/users/pluehne/orgs","repos_url":"https://api.github.com/users/pluehne/repos","events_url":"https://api.github.com/users/pluehne/events{/privacy}","received_events_url":"https://api.github.com/users/pluehne/received_events","type":"User","site_admin":false},"created_at":"2017-08-01T18:22:52Z","updated_at":"2017-08-01T18:22:52Z","body":"@ttaylorr Thanks, I will apply the patch tomorrow and post the `stderr` here :)."}}
{"actor":{"display_login":"pluehne"}}