{"action":"closed","issue":{"url":"https://api.github.com/repos/mongodb-labs/mongo-connector/issues/634","repository_url":"https://api.github.com/repos/mongodb-labs/mongo-connector","labels_url":"https://api.github.com/repos/mongodb-labs/mongo-connector/issues/634/labels{/name}","comments_url":"https://api.github.com/repos/mongodb-labs/mongo-connector/issues/634/comments","events_url":"https://api.github.com/repos/mongodb-labs/mongo-connector/issues/634/events","html_url":"https://github.com/mongodb-labs/mongo-connector/issues/634","id":203346695,"number":634,"title":"Mongo-connector shutting down after collections dump ","user":{"login":"Webgardener","id":3612401,"avatar_url":"https://avatars.githubusercontent.com/u/3612401?v=3","gravatar_id":"","url":"https://api.github.com/users/Webgardener","html_url":"https://github.com/Webgardener","followers_url":"https://api.github.com/users/Webgardener/followers","following_url":"https://api.github.com/users/Webgardener/following{/other_user}","gists_url":"https://api.github.com/users/Webgardener/gists{/gist_id}","starred_url":"https://api.github.com/users/Webgardener/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Webgardener/subscriptions","organizations_url":"https://api.github.com/users/Webgardener/orgs","repos_url":"https://api.github.com/users/Webgardener/repos","events_url":"https://api.github.com/users/Webgardener/events{/privacy}","received_events_url":"https://api.github.com/users/Webgardener/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":1,"created_at":"2017-01-26T11:16:37Z","updated_at":"2017-01-26T19:02:49Z","closed_at":"2017-01-26T19:02:49Z","body":"Hi. \r\n\r\nI use mongo-connector to perform a synchronization between 2 mongo db and I get the following behavior : Mongo-connector stops after performing the init dump collection synchronization.\r\n  \r\nHere the stack :\r\n\r\n- python 2.7\r\n- mongo-connector==2.4\r\n- pymongo==3.4.0\r\n- urllib3==1.20\r\n- Mongodb 3.4 \r\n- OS : ubuntu 16.04 \r\n\r\nthe mongo-connector instanciation:\r\n`mongo-connector -m mongosrouce:27017 -t mongocible:37017 -d mongo_doc_manager\r\n`\r\nand the associated log :\r\n\r\n`2017-01-26 10:05:29,263 [ERROR] mongo_connector.util:92 - Fatal Exception\r\nTraceback (most recent call last):\r\n  File \"/usr/local/lib/python2.7/dist-packages/mongo_connector/util.py\", line 90, in wrapped\r\n    func(*args, **kwargs)\r\n  File \"/usr/local/lib/python2.7/dist-packages/mongo_connector/oplog_manager.py\", line 199, in run\r\n    cursor, cursor_empty = self.init_cursor()\r\n  File \"/usr/local/lib/python2.7/dist-packages/mongo_connector/oplog_manager.py\", line 702, in init_cursor\r\n    self.checkpoint = self.rollback()\r\n  File \"/usr/local/lib/python2.7/dist-packages/mongo_connector/oplog_manager.py\", line 843, in rollback\r\n    bson_obj_id_list = [obj_id(doc['_id']) for doc in doc_list]\r\n  File \"/usr/local/lib/python2.7/dist-packages/bson/objectid.py\", line 110, in __init__\r\n    self.__validate(oid)\r\n  File \"/usr/local/lib/python2.7/dist-packages/bson/objectid.py\", line 209, in __validate\r\n    \"not %s\" % (text_type.__name__, type(oid)))\r\nTypeError: id must be an instance of (bytes, unicode, ObjectId), not <type 'int'>\r\n2017-01-26 10:05:29,635 [ERROR] mongo_connector.connector:304 - MongoConnector: OplogThread <OplogThread(Thread-2, stopped 139845225649920)> unexpectedly stopped! Shutting down\r\n`\r\nStatistics on database shows that almost everything was synchronized:\r\n\r\nSource : \r\n`Source\r\n\r\n{\r\n\t\"db\" : \"mydb\",\r\n\t\"collections\" : 8,\r\n\t\"views\" : 0,\r\n\t\"objects\" : 877791,\r\n\t\"avgObjSize\" : 1386.7995274501561,\r\n\t\"dataSize\" : 1188789.203125,\r\n\t\"storageSize\" : 1502156,\r\n\t\"numExtents\" : 63,\r\n\t\"indexes\" : 18,\r\n\t\"indexSize\" : 68426.09375,\r\n\t\"fileSize\" : 2031616,\r\n\t\"nsSizeMB\" : 16,\r\n\t\"extentFreeList\" : {\r\n\t\t\"num\" : 0,\r\n\t\t\"totalSize\" : 0\r\n\t},\r\n\t\"dataFileVersion\" : {\r\n\t\t\"major\" : 4,\r\n\t\t\"minor\" : 22\r\n\t},\r\n\t\"ok\" : 1\r\n}\r\n\r\n\r\nCible\r\n\r\n{\r\n\t\"db\" : \"mydb\",\r\n\t\"collections\" : 8,\r\n\t\"views\" : 0,\r\n\t\"objects\" : **877767**,\r\n\t\r\n}\r\n`\r\nTarget:\r\n\r\n`{\r\n\t\"db\" : \"myDB\",\r\n\t\"collections\" : 8,\r\n\t\"views\" : 0,\r\n\t\"objects\" : **877767**,\r\n}` \r\n\r\nI wonder what happened. Could the problem come from a specific document ?"}}
{"actor":{"display_login":"ShaneHarvey"}}