{"action":"created","issue":{"url":"https://api.github.com/repos/oppia/oppia/issues/4188","repository_url":"https://api.github.com/repos/oppia/oppia","labels_url":"https://api.github.com/repos/oppia/oppia/issues/4188/labels{/name}","comments_url":"https://api.github.com/repos/oppia/oppia/issues/4188/comments","events_url":"https://api.github.com/repos/oppia/oppia/issues/4188/events","html_url":"https://github.com/oppia/oppia/issues/4188","id":280907160,"number":4188,"title":"Errors when running GenerateV1StatisticsJob and ExplorationStateIdMappingJob in production","user":{"login":"seanlip","id":10575562,"avatar_url":"https://avatars0.githubusercontent.com/u/10575562?v=4","gravatar_id":"","url":"https://api.github.com/users/seanlip","html_url":"https://github.com/seanlip","followers_url":"https://api.github.com/users/seanlip/followers","following_url":"https://api.github.com/users/seanlip/following{/other_user}","gists_url":"https://api.github.com/users/seanlip/gists{/gist_id}","starred_url":"https://api.github.com/users/seanlip/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/seanlip/subscriptions","organizations_url":"https://api.github.com/users/seanlip/orgs","repos_url":"https://api.github.com/users/seanlip/repos","events_url":"https://api.github.com/users/seanlip/events{/privacy}","received_events_url":"https://api.github.com/users/seanlip/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":{"login":"prasanna08","id":8678373,"avatar_url":"https://avatars0.githubusercontent.com/u/8678373?v=4","gravatar_id":"","url":"https://api.github.com/users/prasanna08","html_url":"https://github.com/prasanna08","followers_url":"https://api.github.com/users/prasanna08/followers","following_url":"https://api.github.com/users/prasanna08/following{/other_user}","gists_url":"https://api.github.com/users/prasanna08/gists{/gist_id}","starred_url":"https://api.github.com/users/prasanna08/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/prasanna08/subscriptions","organizations_url":"https://api.github.com/users/prasanna08/orgs","repos_url":"https://api.github.com/users/prasanna08/repos","events_url":"https://api.github.com/users/prasanna08/events{/privacy}","received_events_url":"https://api.github.com/users/prasanna08/received_events","type":"User","site_admin":false},"assignees":[{"login":"prasanna08","id":8678373,"avatar_url":"https://avatars0.githubusercontent.com/u/8678373?v=4","gravatar_id":"","url":"https://api.github.com/users/prasanna08","html_url":"https://github.com/prasanna08","followers_url":"https://api.github.com/users/prasanna08/followers","following_url":"https://api.github.com/users/prasanna08/following{/other_user}","gists_url":"https://api.github.com/users/prasanna08/gists{/gist_id}","starred_url":"https://api.github.com/users/prasanna08/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/prasanna08/subscriptions","organizations_url":"https://api.github.com/users/prasanna08/orgs","repos_url":"https://api.github.com/users/prasanna08/repos","events_url":"https://api.github.com/users/prasanna08/events{/privacy}","received_events_url":"https://api.github.com/users/prasanna08/received_events","type":"User","site_admin":false},{"login":"pranavsid98","id":15828797,"avatar_url":"https://avatars0.githubusercontent.com/u/15828797?v=4","gravatar_id":"","url":"https://api.github.com/users/pranavsid98","html_url":"https://github.com/pranavsid98","followers_url":"https://api.github.com/users/pranavsid98/followers","following_url":"https://api.github.com/users/pranavsid98/following{/other_user}","gists_url":"https://api.github.com/users/pranavsid98/gists{/gist_id}","starred_url":"https://api.github.com/users/pranavsid98/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/pranavsid98/subscriptions","organizations_url":"https://api.github.com/users/pranavsid98/orgs","repos_url":"https://api.github.com/users/pranavsid98/repos","events_url":"https://api.github.com/users/pranavsid98/events{/privacy}","received_events_url":"https://api.github.com/users/pranavsid98/received_events","type":"User","site_admin":false}],"milestone":null,"comments":0,"created_at":"2017-12-11T06:30:02Z","updated_at":"2017-12-11T09:23:54Z","closed_at":"2017-12-11T09:23:54Z","author_association":"OWNER","body":"Two errors show up when running the GenerateV1StatisticsJob in production:\r\n\r\n```\r\nTraceback (most recent call last): (/third_party/gae-mapreduce-1.9.17.0/mapreduce/handlers.py:508)\r\n  File \"/third_party/gae-mapreduce-1.9.17.0/mapreduce/handlers.py\", line 494, in handle\r\n    tstate.input_reader, shard_state, tstate, ctx)\r\n  File \"/third_party/gae-mapreduce-1.9.17.0/mapreduce/handlers.py\", line 583, in _process_inputs\r\n    entity, input_reader, ctx, tstate):\r\n  File \"/third_party/gae-mapreduce-1.9.17.0/mapreduce/handlers.py\", line 625, in _process_datum\r\n    for output in result:\r\n  File \"/core/domain/stats_jobs_one_off.py\", line 345, in reduce\r\n    change_dict['state_name'])\r\nKeyError: u'END'\r\n```\r\n\r\n```\r\nTraceback (most recent call last): (/third_party/gae-mapreduce-1.9.17.0/mapreduce/handlers.py:508)\r\n  File \"/third_party/gae-mapreduce-1.9.17.0/mapreduce/handlers.py\", line 494, in handle\r\n    tstate.input_reader, shard_state, tstate, ctx)\r\n  File \"/third_party/gae-mapreduce-1.9.17.0/mapreduce/handlers.py\", line 583, in _process_inputs\r\n    entity, input_reader, ctx, tstate):\r\n  File \"/third_party/gae-mapreduce-1.9.17.0/mapreduce/handlers.py\", line 625, in _process_datum\r\n    for output in result:\r\n  File \"/core/domain/stats_jobs_one_off.py\", line 432, in reduce\r\n    dest_states.append(init_state.interaction.default_outcome.dest)\r\nAttributeError: 'NoneType' object has no attribute 'dest'\r\n```\r\n\r\nThe ExplorationStateIdMappingJob also continues to exhibit this error in production:\r\n\r\n```\r\nTraceback (most recent call last): (/third_party/gae-mapreduce-1.9.17.0/mapreduce/handlers.py:508)\r\n  File \"/third_party/gae-mapreduce-1.9.17.0/mapreduce/handlers.py\", line 494, in handle\r\n    tstate.input_reader, shard_state, tstate, ctx)\r\n  File \"/third_party/gae-mapreduce-1.9.17.0/mapreduce/handlers.py\", line 583, in _process_inputs\r\n    entity, input_reader, ctx, tstate):\r\n  File \"/third_party/gae-mapreduce-1.9.17.0/mapreduce/handlers.py\", line 634, in _process_datum\r\n    output_writer.write(output)\r\n  File \"/third_party/gae-mapreduce-1.9.17.0/mapreduce/output_writers.py\", line 1145, in write\r\n    if len(data) != 2:\r\nTypeError: object of type 'exceptions.Exception' has no len()\r\n```"},"comment":{"url":"https://api.github.com/repos/oppia/oppia/issues/comments/350667217","html_url":"https://github.com/oppia/oppia/issues/4188#issuecomment-350667217","issue_url":"https://api.github.com/repos/oppia/oppia/issues/4188","id":350667217,"user":{"login":"seanlip","id":10575562,"avatar_url":"https://avatars0.githubusercontent.com/u/10575562?v=4","gravatar_id":"","url":"https://api.github.com/users/seanlip","html_url":"https://github.com/seanlip","followers_url":"https://api.github.com/users/seanlip/followers","following_url":"https://api.github.com/users/seanlip/following{/other_user}","gists_url":"https://api.github.com/users/seanlip/gists{/gist_id}","starred_url":"https://api.github.com/users/seanlip/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/seanlip/subscriptions","organizations_url":"https://api.github.com/users/seanlip/orgs","repos_url":"https://api.github.com/users/seanlip/repos","events_url":"https://api.github.com/users/seanlip/events{/privacy}","received_events_url":"https://api.github.com/users/seanlip/received_events","type":"User","site_admin":false},"created_at":"2017-12-11T09:23:54Z","updated_at":"2017-12-11T09:23:54Z","author_association":"OWNER","body":"The first two errors have been fixed in #4189 and the job now runs fully in production. I will close this and file a separate issue for ExplorationStateIdMappingJob, since the latter is a separate job."}}
{"actor":{"display_login":"seanlip"}}