{"action":"created","issue":{"url":"https://api.github.com/repos/ianstormtaylor/metascraper/issues/25","repository_url":"https://api.github.com/repos/ianstormtaylor/metascraper","labels_url":"https://api.github.com/repos/ianstormtaylor/metascraper/issues/25/labels{/name}","comments_url":"https://api.github.com/repos/ianstormtaylor/metascraper/issues/25/comments","events_url":"https://api.github.com/repos/ianstormtaylor/metascraper/issues/25/events","html_url":"https://github.com/ianstormtaylor/metascraper/issues/25","id":223509490,"number":25,"title":"Error: unknown compression method","user":{"login":"jsappme","id":13439477,"avatar_url":"https://avatars2.githubusercontent.com/u/13439477?v=3","gravatar_id":"","url":"https://api.github.com/users/jsappme","html_url":"https://github.com/jsappme","followers_url":"https://api.github.com/users/jsappme/followers","following_url":"https://api.github.com/users/jsappme/following{/other_user}","gists_url":"https://api.github.com/users/jsappme/gists{/gist_id}","starred_url":"https://api.github.com/users/jsappme/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jsappme/subscriptions","organizations_url":"https://api.github.com/users/jsappme/orgs","repos_url":"https://api.github.com/users/jsappme/repos","events_url":"https://api.github.com/users/jsappme/events{/privacy}","received_events_url":"https://api.github.com/users/jsappme/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":0,"created_at":"2017-04-21T22:06:11Z","updated_at":"2017-04-21T22:47:39Z","closed_at":null,"body":"any idea why some url like this one http://www.concordmonitor.com/on-new-hampshire-s-antique-alley-it-s-out-with-the-old-in-with-the-new-9234789 gives this error while calling:\r\n\r\nMetascraper.scrapeUrl(results[j].url)"},"comment":{"url":"https://api.github.com/repos/ianstormtaylor/metascraper/issues/comments/296322474","html_url":"https://github.com/ianstormtaylor/metascraper/issues/25#issuecomment-296322474","issue_url":"https://api.github.com/repos/ianstormtaylor/metascraper/issues/25","id":296322474,"user":{"login":"blakeembrey","id":1088987,"avatar_url":"https://avatars3.githubusercontent.com/u/1088987?v=3","gravatar_id":"","url":"https://api.github.com/users/blakeembrey","html_url":"https://github.com/blakeembrey","followers_url":"https://api.github.com/users/blakeembrey/followers","following_url":"https://api.github.com/users/blakeembrey/following{/other_user}","gists_url":"https://api.github.com/users/blakeembrey/gists{/gist_id}","starred_url":"https://api.github.com/users/blakeembrey/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/blakeembrey/subscriptions","organizations_url":"https://api.github.com/users/blakeembrey/orgs","repos_url":"https://api.github.com/users/blakeembrey/repos","events_url":"https://api.github.com/users/blakeembrey/events{/privacy}","received_events_url":"https://api.github.com/users/blakeembrey/received_events","type":"User","site_admin":false},"created_at":"2017-04-21T22:47:39Z","updated_at":"2017-04-21T22:47:39Z","body":"Seems like whatever the page is responding with isn't compressed properly. I'd love to know what exactly it is, I can very other pages with the same headers work using `zlib`. I can replicate the same behaviour using `curl` and `gunzip` on the CLI. E.g. \r\n\r\n```sh\r\ncurl -H 'Accept-Encoding: gzip,deflate' https://github.com | gunzip -dc # works\r\ncurl -H 'Accept-Encoding: gzip, deflate' http://www.concordmonitor.com/on-new-hampshire-s-antique-alley-it-s-out-with-the-old-in-with-the-new-9234789 | gunzip -dc # errors with \"unknown compression format\"\r\n```\r\n\r\nAccording to https://nodejs.org/api/zlib.html#zlib_compressing_http_requests_and_responses both types of responses should be handled by node.js properly and I haven't seen it before. Anyone else have ideas to fix it? I can try splitting out to the specific methods zlib methods used instead of the combined method. Someone else want to test that fixes it first though? I might not get around to it for a while."}}
{"actor":{"display_login":"blakeembrey"}}