{"action":"created","issue":{"url":"https://api.github.com/repos/RasaHQ/rasa_nlu/issues/481","repository_url":"https://api.github.com/repos/RasaHQ/rasa_nlu","labels_url":"https://api.github.com/repos/RasaHQ/rasa_nlu/issues/481/labels{/name}","comments_url":"https://api.github.com/repos/RasaHQ/rasa_nlu/issues/481/comments","events_url":"https://api.github.com/repos/RasaHQ/rasa_nlu/issues/481/events","html_url":"https://github.com/RasaHQ/rasa_nlu/issues/481","id":243280326,"number":481,"title":"Synonyms seem broken in 0.9.1","user":{"login":"znat","id":3694634,"avatar_url":"https://avatars0.githubusercontent.com/u/3694634?v=4","gravatar_id":"","url":"https://api.github.com/users/znat","html_url":"https://github.com/znat","followers_url":"https://api.github.com/users/znat/followers","following_url":"https://api.github.com/users/znat/following{/other_user}","gists_url":"https://api.github.com/users/znat/gists{/gist_id}","starred_url":"https://api.github.com/users/znat/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/znat/subscriptions","organizations_url":"https://api.github.com/users/znat/orgs","repos_url":"https://api.github.com/users/znat/repos","events_url":"https://api.github.com/users/znat/events{/privacy}","received_events_url":"https://api.github.com/users/znat/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2017-07-17T01:18:35Z","updated_at":"2017-07-17T19:21:59Z","closed_at":"2017-07-17T19:16:16Z","body":"<!-- If you don't know your rasa NLU version, here is some help: https://goo.gl/g9QQg2. If you are creating a feature request, feel free to remove all the system information stuff. --> \r\n\r\n**rasa NLU version**: 0.9.1\r\n\r\n**Used backend / pipeline** (`mitie`, `spacy_sklearn`, ...):\r\n`[\"nlp_spacy\", \"tokenizer_spacy\", \"intent_entity_featurizer_regex\", \"intent_featurizer_spacy\", \"ner_crf\", \"ner_synonyms\", \"intent_classifier_sklearn\"]`\r\n\r\n**Issue**:\r\nEntity synonyms are not recognized. In the training file below, \"looking for a restaurant in new-york\" will be parsed as expected but no city entity will be found for  \"looking for a restaurant in NYC\".\r\n\r\n`models/current/entity_synonyms.json` content: `{\"nyc\": \"new-york\", \"the big apple\": \"new-york\"}`\r\n\r\nThis is just a toy file to reproduce the issue found on a larger set \r\n\r\n```json\r\n{\r\n    \"rasa_nlu_data\": {\r\n        \"common_examples\": [\r\n            {\r\n                \"text\": \"looking for a restaurant in new-york\", \r\n                \"intent\": \"inform\", \r\n                \"entities\": [\r\n                    {\r\n                        \"start\": 28, \r\n                        \"end\": 36, \r\n                        \"value\": \"new-york\", \r\n                        \"entity\": \"city\"\r\n                    }\r\n                ]\r\n            }, \r\n            {\r\n                \"text\": \"looking for a restaurant in the big apple\", \r\n                \"intent\": \"inform\", \r\n                \"entities\": [\r\n                    {\r\n                        \"start\": 28, \r\n                        \"end\": 41, \r\n                        \"value\": \"new-york\", \r\n                        \"entity\": \"city\"\r\n                    }\r\n                ]\r\n            }, \r\n            {\r\n                \"text\": \"good food in new-york\", \r\n                \"intent\": \"inform\", \r\n                \"entities\": [\r\n                    {\r\n                        \"start\": 13, \r\n                        \"end\": 21, \r\n                        \"value\": \"new-york\", \r\n                        \"entity\": \"city\"\r\n                    }\r\n                ]\r\n            }, \r\n            {\r\n                \"text\": \"good food in NYC\", \r\n                \"intent\": \"inform\", \r\n                \"entities\": [\r\n                    {\r\n                        \"start\": 13, \r\n                        \"end\": 16, \r\n                        \"value\": \"new-york\", \r\n                        \"entity\": \"city\"\r\n                    }\r\n                ]\r\n            }, \r\n            {\r\n                \"text\": \"hey\", \r\n                \"intent\": \"greet\"\r\n            }, \r\n            {\r\n                \"text\": \"hello\", \r\n                \"intent\": \"greet\"\r\n            }\r\n        ], \r\n        \"entity_synonyms\": []\r\n    }\r\n}\r\n```\r\n"},"comment":{"url":"https://api.github.com/repos/RasaHQ/rasa_nlu/issues/comments/315855244","html_url":"https://github.com/RasaHQ/rasa_nlu/issues/481#issuecomment-315855244","issue_url":"https://api.github.com/repos/RasaHQ/rasa_nlu/issues/481","id":315855244,"user":{"login":"tmbo","id":1098412,"avatar_url":"https://avatars3.githubusercontent.com/u/1098412?v=4","gravatar_id":"","url":"https://api.github.com/users/tmbo","html_url":"https://github.com/tmbo","followers_url":"https://api.github.com/users/tmbo/followers","following_url":"https://api.github.com/users/tmbo/following{/other_user}","gists_url":"https://api.github.com/users/tmbo/gists{/gist_id}","starred_url":"https://api.github.com/users/tmbo/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tmbo/subscriptions","organizations_url":"https://api.github.com/users/tmbo/orgs","repos_url":"https://api.github.com/users/tmbo/repos","events_url":"https://api.github.com/users/tmbo/events{/privacy}","received_events_url":"https://api.github.com/users/tmbo/received_events","type":"User","site_admin":false},"created_at":"2017-07-17T19:21:59Z","updated_at":"2017-07-17T19:21:59Z","body":"I also don't think this is related to the synonyms. It might be that the entity recognition doesn't always recognize the entity (which might be to the small number of training examples - depending on the initialization of the model we might sometimes get lucky and sometimes the training might not be enough). That being said, if you think there might be an issue, that is definitely something we need to have a look at."}}
{"actor":{"display_login":"tmbo"}}