{"action":"closed","issue":{"url":"https://api.github.com/repos/manashmndl/NewsCrawler/issues/14","repository_url":"https://api.github.com/repos/manashmndl/NewsCrawler","labels_url":"https://api.github.com/repos/manashmndl/NewsCrawler/issues/14/labels{/name}","comments_url":"https://api.github.com/repos/manashmndl/NewsCrawler/issues/14/comments","events_url":"https://api.github.com/repos/manashmndl/NewsCrawler/issues/14/events","html_url":"https://github.com/manashmndl/NewsCrawler/issues/14","id":197106582,"number":14,"title":"Assorted issues before first run","user":{"login":"arefindk","id":2077385,"avatar_url":"https://avatars.githubusercontent.com/u/2077385?v=3","gravatar_id":"","url":"https://api.github.com/users/arefindk","html_url":"https://github.com/arefindk","followers_url":"https://api.github.com/users/arefindk/followers","following_url":"https://api.github.com/users/arefindk/following{/other_user}","gists_url":"https://api.github.com/users/arefindk/gists{/gist_id}","starred_url":"https://api.github.com/users/arefindk/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/arefindk/subscriptions","organizations_url":"https://api.github.com/users/arefindk/orgs","repos_url":"https://api.github.com/users/arefindk/repos","events_url":"https://api.github.com/users/arefindk/events{/privacy}","received_events_url":"https://api.github.com/users/arefindk/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":4,"created_at":"2016-12-22T06:50:02Z","updated_at":"2017-01-26T23:44:28Z","closed_at":"2017-01-26T23:44:28Z","body":"## 1. Update the description in readme.md after you verify them:\r\nYou might need to update the nltk corpuses to properly run the newspaper library\r\n`python -m nltk.downloader all`\r\n\r\n## 2. Update the description in readme.md after you verify it:\r\nTo encounter the lxml error while installing newspaper using pip in ubuntu:\r\n`sudo apt-get install python-dev libxml2-dev libxslt1-dev zlib1g-dev`\r\nhttp://stackoverflow.com/questions/5178416/pip-install-lxml-error\r\n\r\n## 3. Update the description in readme.md after you verify it:\r\n\r\nTo encounter jpeg is required error while installing  indicoio\r\n\r\n```\r\nsudo apt-get install libtiff5-dev libjpeg8-dev zlib1g-dev libfreetype6-dev liblcms2-dev libwebp-dev tcl8.6-dev tk8.6-dev python-tk\r\n```\r\n\r\n## 4. Update the description in readme.md after you verify it:\r\nYou need to update the default nltk 2.x to 3.x so that nltk.tag works\r\n```\r\npip install -U nltk\r\n```\r\n\r\n## 5. Update the description in readme.md after you verify it:\r\nYou forgot to add this in the requirements\r\n```\r\npip install wget\r\n```\r\n\r\n## 6. Update the description in readme.md after you verify it:\r\nmake sure adding a single path name would suffice\r\n\r\nhere is another place Newcrawler/newscralwer/credentials where you need the pathname\r\n\r\n## 7. Update the description in readme.md after you verify it:\r\nAdding the path and api key in the root folder does not make any difference, it seems that the actual configurations files are. the files in ` NewsCrawler/NewsCrawler/credentials_and_configs` directory \r\n\r\n\r\nThere is problem with indentation, in all the crawler files, it was resolved when I used sublime to convert all indentation to tabs then it is resolved\r\n\r\n## 8. You forgot to  `import re`,\r\n\r\nbut used re somewhere in the middle of the codes in the dailystar and prothomalo file, but it was imported in the dtribune crawler.\r\n\r\n## 9. where are you saving the jpeg files?\r\n\r\n## 10. DhakaTribune crawler not working\r\n\r\n## 11. Most importantly you saved the published date as a string, it should be a date, not a string, and rename date variable to `date_crawled` and `published  date to date_published`**\r\n\r\n\r\n## 12. Change ner_list_location to ner_locations and change ner_location to ner_unique_locations.**\r\n\r\n## 13. what does shoulder keyword stand for inside the data inserted in elasticsearch?"}}
{"actor":{"display_login":"arefindk"}}