{"action":"created","issue":{"url":"https://api.github.com/repos/BBC-News/wraith/issues/445","repository_url":"https://api.github.com/repos/BBC-News/wraith","labels_url":"https://api.github.com/repos/BBC-News/wraith/issues/445/labels{/name}","comments_url":"https://api.github.com/repos/BBC-News/wraith/issues/445/comments","events_url":"https://api.github.com/repos/BBC-News/wraith/issues/445/events","html_url":"https://github.com/BBC-News/wraith/issues/445","id":163415543,"number":445,"title":"Loading over 500 urls within paths section from a text file","user":{"login":"rayferns","id":6547963,"avatar_url":"https://avatars.githubusercontent.com/u/6547963?v=3","gravatar_id":"","url":"https://api.github.com/users/rayferns","html_url":"https://github.com/rayferns","followers_url":"https://api.github.com/users/rayferns/followers","following_url":"https://api.github.com/users/rayferns/following{/other_user}","gists_url":"https://api.github.com/users/rayferns/gists{/gist_id}","starred_url":"https://api.github.com/users/rayferns/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rayferns/subscriptions","organizations_url":"https://api.github.com/users/rayferns/orgs","repos_url":"https://api.github.com/users/rayferns/repos","events_url":"https://api.github.com/users/rayferns/events{/privacy}","received_events_url":"https://api.github.com/users/rayferns/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":5,"created_at":"2016-07-01T15:08:13Z","updated_at":"2017-01-26T21:58:56Z","closed_at":null,"body":"I have a config file to test a website with javascript and cookies disabled.\nThe config file has 565 paths to do a screengrab.\nHere are teh challenges I'm facing:\n1. Rather than hardcoding all the urls path to compare screenshots, I prefer to have the urls read from a csv or text file\n2. Secondly, Screencapturing of over 565 urls screens takes over 5 hours, is there a way to speed this up? PhantomJS freezs after screengrabs, the compare process does not start.\n\nWould appreciate your answers to the above questions.\n\n---\n\nReporting a problem? Please describe the issue above, and complete the following checklist so that we can help you more quickly.\n#### Issue checklist:\n- [Y ] I have validated my config file against [YAML Validator](http://codebeautify.org/yaml-validator) to make sure it is valid YAML.\n  Valid YAML\n- [ Y] I have run the command in verbose mode (by adding `verbose: true` to my config) and pasted the output below:\n\n```\nC:\\VisualRegression>wraith capture configs\\vw08_test_0107.yaml\nDEBUG: #################################################\nDEBUG:   Command run:        capture configs\\vw08_test_0107.yaml\nDEBUG:   Wraith version:     3.2.0\nDEBUG:   Ruby version:       ruby 2.3.0p0 (2015-12-25 revision 53290) [x64-mingw\n32]\n\nDEBUG:   ImageMagick:        Version: ImageMagick 7.0.2-1 Q16 x64 2016-06-23 htt\np://www.imagemagick.org\n\nDEBUG:   PhantomJS version:  1.9.6\n\nDEBUG:   CasperJS version:   1.1.1\n\nDEBUG: #################################################\nDEBUG:\nConfig validated. No serious issues found.\nno paths defined in config, crawling from site root\nC:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/wraith-3.2.0/lib/wraith/spider.rb:64:in `\nspider': undefined local variable or method `wraith' for #<Wraith::Crawler:0x000\n00003e48df8> (NameError)\nDid you mean?  @wraith\n        from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/wraith-3.2.0/lib/wraith/spid\ner.rb:36:in `determine_paths'\n        from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/wraith-3.2.0/lib/wraith/spid\ner.rb:24:in `check_for_paths'\n        from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/wraith-3.2.0/lib/wraith/cli.\nrb:36:in `check_for_paths'\n        from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/wraith-3.2.0/lib/wraith/cli.\nrb:134:in `block in capture'\n        from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/wraith-3.2.0/lib/wraith/cli.\nrb:28:in `within_acceptable_limits'\n        from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/wraith-3.2.0/lib/wraith/cli.\nrb:131:in `capture'\n        from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/thor-0.19.1/lib/thor/command\n.rb:27:in `run'\n        from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/thor-0.19.1/lib/thor/invocat\nion.rb:126:in `invoke_command'\n        from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/thor-0.19.1/lib/thor.rb:359:\nin `dispatch'\n        from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/thor-0.19.1/lib/thor/base.rb\n:440:in `start'\n        from C:/Ruby23-x64/lib/ruby/gems/2.3.0/gems/wraith-3.2.0/bin/wraith:5:in\n `<top (required)>'\n        from C:/Ruby23-x64/bin/wraith:23:in `load'\n        from C:/Ruby23-x64/bin/wraith:23:in `<main>'\npaste results here\n```\n- [Y ] I have pasted the contents of my config file below:\n\n```\npaste config here\n#debug mode\nverbose: true\n#Headless browser option\nbrowser:\n  phantomjs: \"phantomjs\"\n  # slimerjs: \"slimerjs\"\n\nbefore_capture: 'javascript/disable_cookies.js'\n\n#If you want to have multiple snapping files, set the file name here\n#snap_file: \"javascript/snap.js\"\n\n# Type the name of the directory that shots will be stored in\ndirectory: 'shots'\n\n#As per https://github.com/BBC-News/wraith/issues/308 - to read in https urls\nphantomjs_options: --ssl-protocol=tlsv1 --ignore-ssl-errors=yes\n\n# Add only 2 domains, key will act as a label\ndomains:\n  Live: \"http://www.volkswagen.co.uk\"\n  VW08: \"http://origin-vw08.vwcloud.co.uk\"\n\n#Type screen widths below, here are a couple of examples\nscreen_widths:\n    - 600x800\n    - 1024x600\n    - 1280x960\n    - 2560x1600\n    - 768x1024\n    - 1280x800\n    - 1080x1920\n    - 320x533\n    - 750x1334\n\n#Type page URL paths below, here are a couple of examples\npaths:\n    # Home: /\n    # Owners-My: /owners/my\nimports: 'Files/test1.txt'\n\n#Amount of fuzz ImageMagick will use\nfuzz: '20%'\n\n#Set the number of days to keep the site spider file\nspider_days:\n  - 10\n\n#Choose how results are displayed, by default alphanumeric. Different screen widths are always grouped.\n#alphanumeric - all paths (with, and without, a difference) are shown, sorted by path\n#diffs_first - all paths (with, and without, a difference) are shown, sorted by difference size (largest first)\n#diffs_only - only paths with a difference are shown, sorted by difference size (largest first)\nmode: diffs_first\n\nthreshold: 5\n\n# Examples: 'basic_template' (default), 'slideshow_template'\n# gallery:\n  # template: 'slideshow_template'\n    # thumb_width:  200\n    # thumb_height: 200\n----------------------------\nText file has following input:\n Home: /\n Owners-My: /owners/my\n```\n"},"comment":{"url":"https://api.github.com/repos/BBC-News/wraith/issues/comments/275527270","html_url":"https://github.com/BBC-News/wraith/issues/445#issuecomment-275527270","issue_url":"https://api.github.com/repos/BBC-News/wraith/issues/445","id":275527270,"user":{"login":"mramitanand","id":11560714,"avatar_url":"https://avatars.githubusercontent.com/u/11560714?v=3","gravatar_id":"","url":"https://api.github.com/users/mramitanand","html_url":"https://github.com/mramitanand","followers_url":"https://api.github.com/users/mramitanand/followers","following_url":"https://api.github.com/users/mramitanand/following{/other_user}","gists_url":"https://api.github.com/users/mramitanand/gists{/gist_id}","starred_url":"https://api.github.com/users/mramitanand/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mramitanand/subscriptions","organizations_url":"https://api.github.com/users/mramitanand/orgs","repos_url":"https://api.github.com/users/mramitanand/repos","events_url":"https://api.github.com/users/mramitanand/events{/privacy}","received_events_url":"https://api.github.com/users/mramitanand/received_events","type":"User","site_admin":false},"created_at":"2017-01-26T21:58:56Z","updated_at":"2017-01-26T21:58:56Z","body":"Actually I discovered what is wrong - it looks like EVERY page has an error because there is a white space at top. Wraith obv cannot generate a gallery.html file that big. Sorry"}}
{"actor":{"display_login":"mramitanand"}}