{"action":"created","issue":{"url":"https://api.github.com/repos/4pr0n/ripme/issues/606","repository_url":"https://api.github.com/repos/4pr0n/ripme","labels_url":"https://api.github.com/repos/4pr0n/ripme/issues/606/labels{/name}","comments_url":"https://api.github.com/repos/4pr0n/ripme/issues/606/comments","events_url":"https://api.github.com/repos/4pr0n/ripme/issues/606/events","html_url":"https://github.com/4pr0n/ripme/issues/606","id":275088794,"number":606,"title":"RIPME very often java.net.SocketTimeoutException: Read timed out","user":{"login":"m4ntic0r","id":24922164,"avatar_url":"https://avatars1.githubusercontent.com/u/24922164?v=4","gravatar_id":"","url":"https://api.github.com/users/m4ntic0r","html_url":"https://github.com/m4ntic0r","followers_url":"https://api.github.com/users/m4ntic0r/followers","following_url":"https://api.github.com/users/m4ntic0r/following{/other_user}","gists_url":"https://api.github.com/users/m4ntic0r/gists{/gist_id}","starred_url":"https://api.github.com/users/m4ntic0r/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/m4ntic0r/subscriptions","organizations_url":"https://api.github.com/users/m4ntic0r/orgs","repos_url":"https://api.github.com/users/m4ntic0r/repos","events_url":"https://api.github.com/users/m4ntic0r/events{/privacy}","received_events_url":"https://api.github.com/users/m4ntic0r/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2017-11-18T15:59:06Z","updated_at":"2017-11-18T16:58:33Z","closed_at":null,"author_association":"NONE","body":"I dont know what i should do anymore.. i am ripping some reddit picture threads, and it is very often that the whole process is freezing and i have to kill the java process.\r\n\r\ni am using latest ripme version, and java 1.8.0_131-b11 on a debian 9 stable system\r\n\r\nmy command is:\r\n\r\njava -jar /path/ripme.jar -l /path/ripme/rips -u https://www.reddit.com/r/astrophotography/new/ >> path/logfile.log\r\n\r\nin my logs i always see:\r\n\r\n`[!] Skipping https://apod.nasa.gov/apod/image/1711/HubblesVariableNebula_HubbleSchmidt_1507.jpg -- file already exists: /hdd/collector/ripme/rips/reddit_sub_spaceporn/7bjvva-HubblesVariableNebula_HubbleSchmidt_1507.jpg\r\n[!] Skipping https://i.redd.it/2xakxvhezkwz.png -- file already exists: /hdd/collector/ripme/rips/reddit_sub_spaceporn/7becjy-2xakxvhezkwz.png\r\n[!] Skipping https://i.imgur.com/F3lu5vq.png -- file already exists: /hdd/collector/ripme/rips/reddit_sub_spaceporn/7bebsf-F3lu5vq.png\r\n[!] Skipping https://www.nasa.gov/sites/default/files/thumbnails/image/potw1742a.jpg -- file already exists: /hdd/collector/ripme/rips/reddit_sub_spaceporn/7be245-potw1742a.jpg\r\n[!] Skipping https://i.imgur.com/mkaA6u3.jpg -- file already exists: /hdd/collector/ripme/rips/reddit_sub_spaceporn/7bdtos-mkaA6u3.jpg\r\n\r\n\r\n**Error while loading https://www.reddit.com/r/spaceporn/new/.json?after=t3_7bdtos\r\njava.net.SocketTimeoutException: Read timed out\r\n\tat java.net.SocketInputStream.socketRead0(Native Method)\r\n\tat java.net.SocketInputStream.socketRead(SocketInputStream.java:116)\r\n\tat java.net.SocketInputStream.read(SocketInputStream.java:171)\r\n\tat java.net.SocketInputStream.read(SocketInputStream.java:141)\r\n\tat sun.security.ssl.InputRecord.readFully(InputRecord.java:465)\r\n\tat sun.security.ssl.InputRecord.readV3Record(InputRecord.java:593)\r\n\tat sun.security.ssl.InputRecord.read(InputRecord.java:532)\r\n\tat sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)\r\n\tat sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:930)\r\n\tat sun.security.ssl.AppInputStream.read(AppInputStream.java:105)\r\n\tat java.io.BufferedInputStream.fill(BufferedInputStream.java:246)\r\n\tat java.io.BufferedInputStream.read1(BufferedInputStream.java:286)\r\n\tat java.io.BufferedInputStream.read(BufferedInputStream.java:345)\r\n\tat sun.net.www.MeteredStream.read(MeteredStream.java:134)\r\n\tat java.io.FilterInputStream.read(FilterInputStream.java:133)\r\n\tat sun.net.www.protocol.http.HttpURLConnection$HttpInputStream.read(HttpURLConnection.java:3375)\r\n\tat sun.net.www.protocol.http.HttpURLConnection$HttpInputStream.read(HttpURLConnection.java:3368)\r\n\tat sun.net.www.protocol.http.HttpURLConnection$HttpInputStream.read(HttpURLConnection.java:3356)\r\n\tat java.util.zip.CheckedInputStream.read(CheckedInputStream.java:59)\r\n\tat java.util.zip.GZIPInputStream.readUByte(GZIPInputStream.java:266)\r\n\tat java.util.zip.GZIPInputStream.readUShort(GZIPInputStream.java:258)\r\n\tat java.util.zip.GZIPInputStream.readHeader(GZIPInputStream.java:164)\r\n\tat java.util.zip.GZIPInputStream.<init>(GZIPInputStream.java:79)\r\n\tat java.util.zip.GZIPInputStream.<init>(GZIPInputStream.java:91)\r\n\tat org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:494)\r\n\tat org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:434)\r\n\tat org.jsoup.helper.HttpConnection.execute(HttpConnection.java:181)\r\n\tat com.rarchives.ripme.utils.Http.response(Http.java:130)\r\n\tat com.rarchives.ripme.ripper.rippers.RedditRipper.getJsonArrayFromURL(RedditRipper.java:128)\r\n\tat com.rarchives.ripme.ripper.rippers.RedditRipper.getAndParseAndReturnNext(RedditRipper.java:75)\r\n\tat com.rarchives.ripme.ripper.rippers.RedditRipper.rip(RedditRipper.java:64)\r\n\tat com.rarchives.ripme.App.rip(App.java:67)\r\n\tat com.rarchives.ripme.App.ripURL(App.java:177)\r\n\tat com.rarchives.ripme.App.handleArguments(App.java:169)\r\n\tat com.rarchives.ripme.App.main(App.java:56)\r\n[!] Error while ripping URL https://www.reddit.com/r/spaceporn/new/\r\njava.io.IOException: Failed to load https://www.reddit.com/r/spaceporn/new/.json?after=t3_7bdtos after 1 attempts\r\n\tat com.rarchives.ripme.utils.Http.response(Http.java:137)\r\n\tat com.rarchives.ripme.ripper.rippers.RedditRipper.getJsonArrayFromURL(RedditRipper.java:128)\r\n\tat com.rarchives.ripme.ripper.rippers.RedditRipper.getAndParseAndReturnNext(RedditRipper.java:75)\r\n\tat com.rarchives.ripme.ripper.rippers.RedditRipper.rip(RedditRipper.java:64)\r\n\tat com.rarchives.ripme.App.rip(App.java:67)\r\n\tat com.rarchives.ripme.App.ripURL(App.java:177)\r\n\tat com.rarchives.ripme.App.handleArguments(App.java:169)\r\n\tat com.rarchives.ripme.App.main(App.java:56)\r\nCaused by: java.net.SocketTimeoutException: Read timed out\r\n\tat java.net.SocketInputStream.socketRead0(Native Method)\r\n\tat java.net.SocketInputStream.socketRead(SocketInputStream.java:116)\r\n\tat java.net.SocketInputStream.read(SocketInputStream.java:171)\r\n\tat java.net.SocketInputStream.read(SocketInputStream.java:141)\r\n\tat sun.security.ssl.InputRecord.readFully(InputRecord.java:465)\r\n\tat sun.security.ssl.InputRecord.readV3Record(InputRecord.java:593)\r\n\tat sun.security.ssl.InputRecord.read(InputRecord.java:532)\r\n\tat sun.security.ssl.SSLSocketImpl.readRecord(SSLSocketImpl.java:973)\r\n\tat sun.security.ssl.SSLSocketImpl.readDataRecord(SSLSocketImpl.java:930)\r\n\tat sun.security.ssl.AppInputStream.read(AppInputStream.java:105)\r\n\tat java.io.BufferedInputStream.fill(BufferedInputStream.java:246)\r\n\tat java.io.BufferedInputStream.read1(BufferedInputStream.java:286)\r\n\tat java.io.BufferedInputStream.read(BufferedInputStream.java:345)\r\n\tat sun.net.www.MeteredStream.read(MeteredStream.java:134)\r\n\tat java.io.FilterInputStream.read(FilterInputStream.java:133)\r\n\tat sun.net.www.protocol.http.HttpURLConnection$HttpInputStream.read(HttpURLConnection.java:3375)\r\n\tat sun.net.www.protocol.http.HttpURLConnection$HttpInputStream.read(HttpURLConnection.java:3368)\r\n\tat sun.net.www.protocol.http.HttpURLConnection$HttpInputStream.read(HttpURLConnection.java:3356)\r\n\tat java.util.zip.CheckedInputStream.read(CheckedInputStream.java:59)\r\n\tat java.util.zip.GZIPInputStream.readUByte(GZIPInputStream.java:266)\r\n\tat java.util.zip.GZIPInputStream.readUShort(GZIPInputStream.java:258)\r\n\tat java.util.zip.GZIPInputStream.readHeader(GZIPInputStream.java:164)\r\n\tat java.util.zip.GZIPInputStream.<init>(GZIPInputStream.java:79)\r\n\tat java.util.zip.GZIPInputStream.<init>(GZIPInputStream.java:91)\r\n\tat org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:494)\r\n\tat org.jsoup.helper.HttpConnection$Response.execute(HttpConnection.java:434)\r\n\tat org.jsoup.helper.HttpConnection.execute(HttpConnection.java:181)\r\n\tat com.rarchives.ripme.utils.Http.response(Http.java:130)\r\n\t... 7 more`**"},"comment":{"url":"https://api.github.com/repos/4pr0n/ripme/issues/comments/345455227","html_url":"https://github.com/4pr0n/ripme/issues/606#issuecomment-345455227","issue_url":"https://api.github.com/repos/4pr0n/ripme/issues/606","id":345455227,"user":{"login":"m4ntic0r","id":24922164,"avatar_url":"https://avatars1.githubusercontent.com/u/24922164?v=4","gravatar_id":"","url":"https://api.github.com/users/m4ntic0r","html_url":"https://github.com/m4ntic0r","followers_url":"https://api.github.com/users/m4ntic0r/followers","following_url":"https://api.github.com/users/m4ntic0r/following{/other_user}","gists_url":"https://api.github.com/users/m4ntic0r/gists{/gist_id}","starred_url":"https://api.github.com/users/m4ntic0r/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/m4ntic0r/subscriptions","organizations_url":"https://api.github.com/users/m4ntic0r/orgs","repos_url":"https://api.github.com/users/m4ntic0r/repos","events_url":"https://api.github.com/users/m4ntic0r/events{/privacy}","received_events_url":"https://api.github.com/users/m4ntic0r/received_events","type":"User","site_admin":false},"created_at":"2017-11-18T16:58:33Z","updated_at":"2017-11-18T16:58:33Z","author_association":"NONE","body":"hm but there is no problem for me.. i use this connection for everything, on this machine there runs e.g. an irc connection without any issues."}}
{"actor":{"display_login":"m4ntic0r"}}