{"action":"created","issue":{"url":"https://api.github.com/repos/juju-solutions/bigtop/issues/47","repository_url":"https://api.github.com/repos/juju-solutions/bigtop","labels_url":"https://api.github.com/repos/juju-solutions/bigtop/issues/47/labels{/name}","comments_url":"https://api.github.com/repos/juju-solutions/bigtop/issues/47/comments","events_url":"https://api.github.com/repos/juju-solutions/bigtop/issues/47/events","html_url":"https://github.com/juju-solutions/bigtop/issues/47","id":198681392,"number":47,"title":"Spark environment variables not set","user":{"login":"galgalesh","id":1492981,"avatar_url":"https://avatars2.githubusercontent.com/u/1492981?v=3","gravatar_id":"","url":"https://api.github.com/users/galgalesh","html_url":"https://github.com/galgalesh","followers_url":"https://api.github.com/users/galgalesh/followers","following_url":"https://api.github.com/users/galgalesh/following{/other_user}","gists_url":"https://api.github.com/users/galgalesh/gists{/gist_id}","starred_url":"https://api.github.com/users/galgalesh/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/galgalesh/subscriptions","organizations_url":"https://api.github.com/users/galgalesh/orgs","repos_url":"https://api.github.com/users/galgalesh/repos","events_url":"https://api.github.com/users/galgalesh/events{/privacy}","received_events_url":"https://api.github.com/users/galgalesh/received_events","type":"User","site_admin":false},"labels":[{"id":373481433,"url":"https://api.github.com/repos/juju-solutions/bigtop/labels/enhancement","name":"enhancement","color":"84b6eb","default":true}],"state":"open","locked":false,"assignee":{"login":"kwmonroe","id":4576822,"avatar_url":"https://avatars0.githubusercontent.com/u/4576822?v=3","gravatar_id":"","url":"https://api.github.com/users/kwmonroe","html_url":"https://github.com/kwmonroe","followers_url":"https://api.github.com/users/kwmonroe/followers","following_url":"https://api.github.com/users/kwmonroe/following{/other_user}","gists_url":"https://api.github.com/users/kwmonroe/gists{/gist_id}","starred_url":"https://api.github.com/users/kwmonroe/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kwmonroe/subscriptions","organizations_url":"https://api.github.com/users/kwmonroe/orgs","repos_url":"https://api.github.com/users/kwmonroe/repos","events_url":"https://api.github.com/users/kwmonroe/events{/privacy}","received_events_url":"https://api.github.com/users/kwmonroe/received_events","type":"User","site_admin":false},"assignees":[{"login":"kwmonroe","id":4576822,"avatar_url":"https://avatars0.githubusercontent.com/u/4576822?v=3","gravatar_id":"","url":"https://api.github.com/users/kwmonroe","html_url":"https://github.com/kwmonroe","followers_url":"https://api.github.com/users/kwmonroe/followers","following_url":"https://api.github.com/users/kwmonroe/following{/other_user}","gists_url":"https://api.github.com/users/kwmonroe/gists{/gist_id}","starred_url":"https://api.github.com/users/kwmonroe/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kwmonroe/subscriptions","organizations_url":"https://api.github.com/users/kwmonroe/orgs","repos_url":"https://api.github.com/users/kwmonroe/repos","events_url":"https://api.github.com/users/kwmonroe/events{/privacy}","received_events_url":"https://api.github.com/users/kwmonroe/received_events","type":"User","site_admin":false}],"milestone":null,"comments":3,"created_at":"2017-01-04T10:58:43Z","updated_at":"2017-07-03T17:23:39Z","closed_at":null,"body":"the apache-spark sets a number of useful spark environment variables:\r\n\r\n```\r\n cat /etc/environment | grep -i spark\r\nPATH=\"/usr/lib/jvm/java-8-openjdk-amd64/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/usr/lib/spark/bin:/usr/lib/hadoop/bin:/usr/lib/hadoop/sbin\"\r\nSPARK_JAR=\"hdfs:///user/ubuntu/share/lib/spark-assembly.jar\"\r\nSPARK_DRIVER_MEMORY=\"1g\"\r\nSPARK_EXECUTOR_MEMORY=\"1g\"\r\nSPARK_CONF_DIR=\"/etc/spark/conf\"\r\nPYSPARK_DRIVER_PYTHON=\"ipython\"\r\nSPARK_HOME=\"/usr/lib/spark\"\r\n```\r\n\r\nThis is not the case for the bigtop spark charm\r\n\r\n```\r\ncat /etc/environment | grep -i spark\r\nMASTER=\"spark://172.28.0.15:7077\"\r\n```\r\n\r\nIs this a bug or is this intentional? This causes installation of Apache Toree to fail, because it uses these env vars to find spark, even though stuff like pyspark is in the PATH."},"comment":{"url":"https://api.github.com/repos/juju-solutions/bigtop/issues/comments/312698624","html_url":"https://github.com/juju-solutions/bigtop/issues/47#issuecomment-312698624","issue_url":"https://api.github.com/repos/juju-solutions/bigtop/issues/47","id":312698624,"user":{"login":"kwmonroe","id":4576822,"avatar_url":"https://avatars0.githubusercontent.com/u/4576822?v=3","gravatar_id":"","url":"https://api.github.com/users/kwmonroe","html_url":"https://github.com/kwmonroe","followers_url":"https://api.github.com/users/kwmonroe/followers","following_url":"https://api.github.com/users/kwmonroe/following{/other_user}","gists_url":"https://api.github.com/users/kwmonroe/gists{/gist_id}","starred_url":"https://api.github.com/users/kwmonroe/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kwmonroe/subscriptions","organizations_url":"https://api.github.com/users/kwmonroe/orgs","repos_url":"https://api.github.com/users/kwmonroe/repos","events_url":"https://api.github.com/users/kwmonroe/events{/privacy}","received_events_url":"https://api.github.com/users/kwmonroe/received_events","type":"User","site_admin":false},"created_at":"2017-07-03T17:23:39Z","updated_at":"2017-07-03T17:23:39Z","body":"Ack @galgalesh - thx for the feedback.  I'll wire this into the spark charm."}}
{"actor":{"display_login":"kwmonroe"}}