{"action":"created","issue":{"url":"https://api.github.com/repos/confluentinc/ksql/issues/515","repository_url":"https://api.github.com/repos/confluentinc/ksql","labels_url":"https://api.github.com/repos/confluentinc/ksql/issues/515/labels{/name}","comments_url":"https://api.github.com/repos/confluentinc/ksql/issues/515/comments","events_url":"https://api.github.com/repos/confluentinc/ksql/issues/515/events","html_url":"https://github.com/confluentinc/ksql/issues/515","id":281214152,"number":515,"title":"Describe message format","user":{"login":"tomlinsonr","id":34462182,"avatar_url":"https://avatars2.githubusercontent.com/u/34462182?v=4","gravatar_id":"","url":"https://api.github.com/users/tomlinsonr","html_url":"https://github.com/tomlinsonr","followers_url":"https://api.github.com/users/tomlinsonr/followers","following_url":"https://api.github.com/users/tomlinsonr/following{/other_user}","gists_url":"https://api.github.com/users/tomlinsonr/gists{/gist_id}","starred_url":"https://api.github.com/users/tomlinsonr/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tomlinsonr/subscriptions","organizations_url":"https://api.github.com/users/tomlinsonr/orgs","repos_url":"https://api.github.com/users/tomlinsonr/repos","events_url":"https://api.github.com/users/tomlinsonr/events{/privacy}","received_events_url":"https://api.github.com/users/tomlinsonr/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":{"login":"hjafarpour","id":16784742,"avatar_url":"https://avatars3.githubusercontent.com/u/16784742?v=4","gravatar_id":"","url":"https://api.github.com/users/hjafarpour","html_url":"https://github.com/hjafarpour","followers_url":"https://api.github.com/users/hjafarpour/followers","following_url":"https://api.github.com/users/hjafarpour/following{/other_user}","gists_url":"https://api.github.com/users/hjafarpour/gists{/gist_id}","starred_url":"https://api.github.com/users/hjafarpour/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hjafarpour/subscriptions","organizations_url":"https://api.github.com/users/hjafarpour/orgs","repos_url":"https://api.github.com/users/hjafarpour/repos","events_url":"https://api.github.com/users/hjafarpour/events{/privacy}","received_events_url":"https://api.github.com/users/hjafarpour/received_events","type":"User","site_admin":false},"assignees":[{"login":"hjafarpour","id":16784742,"avatar_url":"https://avatars3.githubusercontent.com/u/16784742?v=4","gravatar_id":"","url":"https://api.github.com/users/hjafarpour","html_url":"https://github.com/hjafarpour","followers_url":"https://api.github.com/users/hjafarpour/followers","following_url":"https://api.github.com/users/hjafarpour/following{/other_user}","gists_url":"https://api.github.com/users/hjafarpour/gists{/gist_id}","starred_url":"https://api.github.com/users/hjafarpour/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hjafarpour/subscriptions","organizations_url":"https://api.github.com/users/hjafarpour/orgs","repos_url":"https://api.github.com/users/hjafarpour/repos","events_url":"https://api.github.com/users/hjafarpour/events{/privacy}","received_events_url":"https://api.github.com/users/hjafarpour/received_events","type":"User","site_admin":false}],"milestone":null,"comments":5,"created_at":"2017-12-12T00:23:46Z","updated_at":"2017-12-15T14:21:15Z","closed_at":null,"author_association":"NONE","body":"For Arcadia Data:\r\n\r\nNeed a way to discover the format of messages in a topic:\r\n```sql\r\nDESCRIBE TOPIC <topic_name> WITH (VALUE_FORMAT = 'JSON')\r\n```"},"comment":{"url":"https://api.github.com/repos/confluentinc/ksql/issues/comments/352017141","html_url":"https://github.com/confluentinc/ksql/issues/515#issuecomment-352017141","issue_url":"https://api.github.com/repos/confluentinc/ksql/issues/515","id":352017141,"user":{"login":"tomlinsonr","id":34462182,"avatar_url":"https://avatars2.githubusercontent.com/u/34462182?v=4","gravatar_id":"","url":"https://api.github.com/users/tomlinsonr","html_url":"https://github.com/tomlinsonr","followers_url":"https://api.github.com/users/tomlinsonr/followers","following_url":"https://api.github.com/users/tomlinsonr/following{/other_user}","gists_url":"https://api.github.com/users/tomlinsonr/gists{/gist_id}","starred_url":"https://api.github.com/users/tomlinsonr/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/tomlinsonr/subscriptions","organizations_url":"https://api.github.com/users/tomlinsonr/orgs","repos_url":"https://api.github.com/users/tomlinsonr/repos","events_url":"https://api.github.com/users/tomlinsonr/events{/privacy}","received_events_url":"https://api.github.com/users/tomlinsonr/received_events","type":"User","site_admin":false},"created_at":"2017-12-15T14:21:15Z","updated_at":"2017-12-15T14:21:15Z","author_association":"NONE","body":"@miguno is correct. We were focusing on (2) because it seemed like auto-guessing would be the bigger effort and we think (2) may be necessary anyway with (as an example) non-standard delimiters in DELIMITED files. We can also work to auto-guess on the client side by guessing multiple formats serially and seeing which one does not error out.\r\n\r\nIn show-me-some-data (1 above), auto-guessing would be great, along with an option to see the absolute raw data in the auto-guess in incorrect. Of course, specification of the format should be permitted in the case where the user knows. Showing the raw data would help the user specify that the DELIMITED format has a delimiter of \"|\", and not a delimiter of \",\"\r\n\r\nThe goal of the show-me-the-data is typically to understand what data is available, so that you can eventually build a model for the data and then build applications on that model. So show-me-some-data and describe-the-structure-of-the-topic are two parts of the same workflow. With both of these questions, the eventual motivation is to build a standard model of the data that can be queried."}}
{"actor":{"display_login":"tomlinsonr"}}