{"action":"reopened","issue":{"url":"https://api.github.com/repos/ngrunwald/datasplash/issues/12","repository_url":"https://api.github.com/repos/ngrunwald/datasplash","labels_url":"https://api.github.com/repos/ngrunwald/datasplash/issues/12/labels{/name}","comments_url":"https://api.github.com/repos/ngrunwald/datasplash/issues/12/comments","events_url":"https://api.github.com/repos/ngrunwald/datasplash/issues/12/events","html_url":"https://github.com/ngrunwald/datasplash/issues/12","id":208402761,"number":12,"title":"unable to deserialize datasplash.core.proxy$com.google.cloud.dataflow.sdk.transforms.DoFn","user":{"login":"domparry","id":19376765,"avatar_url":"https://avatars.githubusercontent.com/u/19376765?v=3","gravatar_id":"","url":"https://api.github.com/users/domparry","html_url":"https://github.com/domparry","followers_url":"https://api.github.com/users/domparry/followers","following_url":"https://api.github.com/users/domparry/following{/other_user}","gists_url":"https://api.github.com/users/domparry/gists{/gist_id}","starred_url":"https://api.github.com/users/domparry/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/domparry/subscriptions","organizations_url":"https://api.github.com/users/domparry/orgs","repos_url":"https://api.github.com/users/domparry/repos","events_url":"https://api.github.com/users/domparry/events{/privacy}","received_events_url":"https://api.github.com/users/domparry/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"assignees":[],"milestone":null,"comments":12,"created_at":"2017-02-17T10:41:36Z","updated_at":"2017-02-21T06:08:28Z","closed_at":null,"body":"Hi there. I'm getting an exception trying to run the following:\r\n\r\nIf I remove the block below  ;; log the message, then it submits successfully and runs. I can see it processing pubsub messages. I was trying to write these to a BigQuery table, but getting errors. I then thought I'd try to see what the structure of the messages was, and used this bit of code from your example to try to log the messages. Am I doing something wrong or is there an issue here?\r\n\r\n``` \r\n(defn apply-transformations-to-pipeline\r\n [read-subscription outputTable pipeline]\r\n\r\n(->> pipeline\r\n\r\n      ;; Read the messages from PubSub\r\n      (ps/read-from-pubsub read-subscription {:name \"read-interactions-from-pubsub\"})\r\n\r\n      ;; log the message\r\n\r\n      (ds/map (fn [message]\r\n                (do\r\n                 (log/info (str \"Got message:\\n\" message))))\r\n              {:name \"log-message\"})))\r\n```\r\nStacktrace below:\r\n\r\n```\r\nSLF4J: Failed to load class \"org.slf4j.impl.StaticLoggerBinder\".\r\nSLF4J: Defaulting to no-operation (NOP) logger implementation\r\nSLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details.\r\nException in thread \"main\" java.lang.IllegalArgumentException: unable to deserialize datasplash.core.proxy$com.google.cloud.dataflow.sdk.transforms.DoFn$ff19274a@730bea0, compiling:(/private/var/folders/mc/6vrbpxbs60q4hwdrp8wm89380000gn/T/form-init1605582858210262277.clj:1:125)\r\n\tat clojure.lang.Compiler.load(Compiler.java:7391)\r\n\tat clojure.lang.Compiler.loadFile(Compiler.java:7317)\r\n\tat clojure.main$load_script.invokeStatic(main.clj:275)\r\n\tat clojure.main$init_opt.invokeStatic(main.clj:277)\r\n\tat clojure.main$init_opt.invoke(main.clj:277)\r\n\tat clojure.main$initialize.invokeStatic(main.clj:308)\r\n\tat clojure.main$null_opt.invokeStatic(main.clj:342)\r\n\tat clojure.main$null_opt.invoke(main.clj:339)\r\n\tat clojure.main$main.invokeStatic(main.clj:421)\r\n\tat clojure.main$main.doInvoke(main.clj:384)\r\n\tat clojure.lang.RestFn.invoke(RestFn.java:421)\r\n\tat clojure.lang.Var.invoke(Var.java:383)\r\n\tat clojure.lang.AFn.applyToHelper(AFn.java:156)\r\n\tat clojure.lang.Var.applyTo(Var.java:700)\r\n\tat clojure.main.main(main.java:37)\r\nCaused by: java.lang.IllegalArgumentException: unable to deserialize datasplash.core.proxy$com.google.cloud.dataflow.sdk.transforms.DoFn$ff19274a@730bea0\r\n\tat com.google.cloud.dataflow.sdk.util.SerializableUtils.deserializeFromByteArray(SerializableUtils.java:76)\r\n\tat com.google.cloud.dataflow.sdk.util.SerializableUtils.clone(SerializableUtils.java:91)\r\n\tat com.google.cloud.dataflow.sdk.transforms.ParDo$Bound.<init>(ParDo.java:720)\r\n\tat com.google.cloud.dataflow.sdk.transforms.ParDo$Unbound.of(ParDo.java:678)\r\n\tat com.google.cloud.dataflow.sdk.transforms.ParDo$Unbound.access$000(ParDo.java:596)\r\n\tat com.google.cloud.dataflow.sdk.transforms.ParDo.of(ParDo.java:563)\r\n\tat com.google.cloud.dataflow.sdk.transforms.ParDo.of(ParDo.java:558)\r\n\tat datasplash.core$map_op$make_map_op__5352.invoke(core.clj:500)\r\n\tat fulliautomatix.core$apply_transformations_to_pipeline.invokeStatic(core.clj:33)\r\n\tat fulliautomatix.core$apply_transformations_to_pipeline.invoke(core.clj:24)\r\n\tat fulliautomatix.core$_main.invokeStatic(core.clj:89)\r\n\tat fulliautomatix.core$_main.doInvoke(core.clj:79)\r\n\tat clojure.lang.RestFn.invoke(RestFn.java:397)\r\n\tat clojure.lang.Var.invoke(Var.java:375)\r\n\tat user$eval5.invokeStatic(form-init1605582858210262277.clj:1)\r\n\tat user$eval5.invoke(form-init1605582858210262277.clj:1)\r\n\tat clojure.lang.Compiler.eval(Compiler.java:6927)\r\n\tat clojure.lang.Compiler.eval(Compiler.java:6917)\r\n\tat clojure.lang.Compiler.load(Compiler.java:7379)\r\n\t... 14 more\r\nCaused by: java.lang.ClassNotFoundException: fulliautomatix.core$apply_transformations_to_pipeline$fn__45\r\n\tat java.net.URLClassLoader.findClass(URLClassLoader.java:381)\r\n\tat java.lang.ClassLoader.loadClass(ClassLoader.java:424)\r\n\tat sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)\r\n\tat java.lang.ClassLoader.loadClass(ClassLoader.java:357)\r\n\tat java.lang.Class.forName0(Native Method)\r\n\tat java.lang.Class.forName(Class.java:348)\r\n\tat java.io.ObjectInputStream.resolveClass(ObjectInputStream.java:628)\r\n\tat java.io.ObjectInputStream.readNonProxyDesc(ObjectInputStream.java:1620)\r\n\tat java.io.ObjectInputStream.readClassDesc(ObjectInputStream.java:1521)\r\n\tat java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1781)\r\n\tat java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1353)\r\n\tat java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2018)\r\n\tat java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1942)\r\n\tat java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1808)\r\n\tat java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1353)\r\n\tat java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2018)\r\n\tat java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1942)\r\n\tat java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1808)\r\n\tat java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1353)\r\n\tat java.io.ObjectInputStream.readArray(ObjectInputStream.java:1714)\r\n\tat java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1347)\r\n\tat java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2018)\r\n\tat java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1942)\r\n\tat java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1808)\r\n\tat java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1353)\r\n\tat java.io.ObjectInputStream.defaultReadFields(ObjectInputStream.java:2018)\r\n\tat java.io.ObjectInputStream.readSerialData(ObjectInputStream.java:1942)\r\n\tat java.io.ObjectInputStream.readOrdinaryObject(ObjectInputStream.java:1808)\r\n\tat java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1353)\r\n\tat java.io.ObjectInputStream.readObject(ObjectInputStream.java:373)\r\n\tat com.google.cloud.dataflow.sdk.util.SerializableUtils.deserializeFromByteArray(SerializableUtils.java:73)\r\n\t... 32 more\r\n```"}}
{"actor":{"display_login":"domparry"}}