{"action":"created","issue":{"url":"https://api.github.com/repos/facebookresearch/DrQA/issues/30","repository_url":"https://api.github.com/repos/facebookresearch/DrQA","labels_url":"https://api.github.com/repos/facebookresearch/DrQA/issues/30/labels{/name}","comments_url":"https://api.github.com/repos/facebookresearch/DrQA/issues/30/comments","events_url":"https://api.github.com/repos/facebookresearch/DrQA/issues/30/events","html_url":"https://github.com/facebookresearch/DrQA/issues/30","id":251584931,"number":30,"title":"Numpu memory error","user":{"login":"Deepakchawla","id":10181936,"avatar_url":"https://avatars2.githubusercontent.com/u/10181936?v=4","gravatar_id":"","url":"https://api.github.com/users/Deepakchawla","html_url":"https://github.com/Deepakchawla","followers_url":"https://api.github.com/users/Deepakchawla/followers","following_url":"https://api.github.com/users/Deepakchawla/following{/other_user}","gists_url":"https://api.github.com/users/Deepakchawla/gists{/gist_id}","starred_url":"https://api.github.com/users/Deepakchawla/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Deepakchawla/subscriptions","organizations_url":"https://api.github.com/users/Deepakchawla/orgs","repos_url":"https://api.github.com/users/Deepakchawla/repos","events_url":"https://api.github.com/users/Deepakchawla/events{/privacy}","received_events_url":"https://api.github.com/users/Deepakchawla/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":7,"created_at":"2017-08-21T08:28:26Z","updated_at":"2017-08-22T03:28:59Z","closed_at":null,"body":"When I am running **python scripts/retriever/interactive.py** command then it shows me below error.\r\nroot@ubuntu-2gb-nyc3-01:~/DrQA# python scripts/retriever/interactive.py\r\n08/21/2017 08:13:28 AM: [ Initializing ranker... ]\r\n08/21/2017 08:13:28 AM: [ Loading /root/DrQA/data/wikipedia/docs-tfidf-ngram=2-hash=16777216-tokenizer=simple.npz ]\r\nTraceback (most recent call last):\r\n  File \"scripts/retriever/interactive.py\", line 27, in <module>\r\n    ranker = retriever.get_class('tfidf')(tfidf_path=args.model)\r\n  File \"/root/DrQA/drqa/retriever/tfidf_doc_ranker.py\", line 37, in __init__\r\n    matrix, metadata = utils.load_sparse_csr(tfidf_path)\r\n  File \"/root/DrQA/drqa/retriever/utils.py\", line 34, in load_sparse_csr\r\n    matrix = sp.csr_matrix((loader['data'], loader['indices'],\r\n  File \"/root/anaconda3/lib/python3.6/site-packages/numpy/lib/npyio.py\", line 233, in __getitem__\r\n    pickle_kwargs=self.pickle_kwargs)\r\n  File \"/root/anaconda3/lib/python3.6/site-packages/numpy/lib/format.py\", line 664, in read_array\r\n    array = numpy.ndarray(count, dtype=dtype)\r\nMemoryError\r\n\r\nI am using it without GPU and below is my system information.\r\nArchitecture:          x86_64\r\nCPU op-mode(s):        32-bit, 64-bit\r\nByte Order:            Little Endian\r\nCPU(s):                4\r\nOn-line CPU(s) list:   0-3\r\nThread(s) per core:    1\r\nCore(s) per socket:    1\r\nSocket(s):             4\r\nNUMA node(s):          1\r\nVendor ID:             GenuineIntel\r\nCPU family:            6\r\nModel:                 79\r\nModel name:            Intel(R) Xeon(R) CPU E5-2650 v4 @ 2.20GHz\r\nStepping:              1\r\nCPU MHz:               2199.998\r\nBogoMIPS:              4399.99\r\nHypervisor vendor:     KVM\r\nVirtualization type:   full\r\nL1d cache:             32K\r\nL1i cache:             32K\r\nL2 cache:              256K\r\nL3 cache:              30720K\r\nNUMA node0 CPU(s):     0-3\r\nCan some one help me to resolve that problem..??\r\n\r\nThank You"},"comment":{"url":"https://api.github.com/repos/facebookresearch/DrQA/issues/comments/323909269","html_url":"https://github.com/facebookresearch/DrQA/issues/30#issuecomment-323909269","issue_url":"https://api.github.com/repos/facebookresearch/DrQA/issues/30","id":323909269,"user":{"login":"ajfisch","id":11946777,"avatar_url":"https://avatars0.githubusercontent.com/u/11946777?v=4","gravatar_id":"","url":"https://api.github.com/users/ajfisch","html_url":"https://github.com/ajfisch","followers_url":"https://api.github.com/users/ajfisch/followers","following_url":"https://api.github.com/users/ajfisch/following{/other_user}","gists_url":"https://api.github.com/users/ajfisch/gists{/gist_id}","starred_url":"https://api.github.com/users/ajfisch/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ajfisch/subscriptions","organizations_url":"https://api.github.com/users/ajfisch/orgs","repos_url":"https://api.github.com/users/ajfisch/repos","events_url":"https://api.github.com/users/ajfisch/events{/privacy}","received_events_url":"https://api.github.com/users/ajfisch/received_events","type":"User","site_admin":false},"created_at":"2017-08-22T03:28:59Z","updated_at":"2017-08-22T03:28:59Z","body":"Do you still have overcommit enabled? You might need that to run with the tokenizers, as it allocates (but doesn't use all) memory for the JVM for each tokenizer process.\r\n\r\nYou can also see if running with `--tokenizer spacy` works."}}
{"actor":{"display_login":"ajfisch"}}