Running Spark Standalone mode..an error ...Failed to connect to master localhost:8081 akka.actor.ActorNotFound: Actor not found for: ActorSelection
Spark Refresher
[pts/0][16:01:21:hadoop@localhost ] ~>cd spark-1.5.0-bin-hadoop2.4
[pts/0][16:01:27:hadoop@localhost ] ~/spark-1.5.0-bin-hadoop2.4>ls
bin data examples logs python RELEASE work
CHANGES.txt derby.log lib metastore_db R sbin
conf ec2 LICENSE NOTICE README.md scala
[pts/0][16:01:28:hadoop@localhost ] ~/spark-1.5.0-bin-hadoop2.4>jps
29286 Jps
[pts/0][16:01:41:hadoop@localhost ] ~/spark-1.5.0-bin-hadoop2.4>cd sbin/
===========optional if you need UI view and connecting via windows to a lunix box==========
[pts/0][16:03:11:hadoop@localhost ] ~/spark-1.5.0-bin-hadoop2.4/sbin>vncserver
xauth: timeout in locking authority file /u01/hadoop/.Xauthority
New 'localhost:1 (hadoop)' desktop is localhost:1
Starting applications specified in /u01/hadoop/.vnc/xstartup
Log file is /u01/hadoop/.vnc/localhost:1.log
=======================================STARTING MASTER==========================================================================
[pts/0][16:49:38:hadoop@localhost ] ~/spark-1.5.0-bin-hadoop2.4/sbin>./start-master.sh
starting org.apache.spark.deploy.master.Master, logging to /u01/hadoop/spark-1.5.0-bin-hadoop2.4/sbin/../logs/spark-hadoop-org.apache.spark.deploy.master.Master-1-localhost.out
[pts/0][16:49:55:hadoop@localhost ] ~/spark-1.5.0-bin-hadoop2.4/sbin>tail -f ../logs/spark-hadoop-org.apache.spark.deploy.master.Master-1-localhost.out
16/05/03 16:49:57 WARN util.Utils: Service 'MasterUI' could not bind on port 8080. Attempting port 8081.
16/05/03 16:49:57 INFO server.Server: jetty-8.y.z-SNAPSHOT
16/05/03 16:49:57 INFO server.AbstractConnector: Started SelectChannelConnector@0.0.0.0:8081
16/05/03 16:49:57 INFO util.Utils: Successfully started service 'MasterUI' on port 8081.
16/05/03 16:49:57 INFO ui.MasterWebUI: Started MasterWebUI at http://localhost:8081
16/05/03 16:49:57 INFO server.Server: jetty-8.y.z-SNAPSHOT
16/05/03 16:49:57 INFO server.AbstractConnector: Started SelectChannelConnector@localhost:6066
16/05/03 16:49:57 INFO util.Utils: Successfully started service on port 6066.
16/05/03 16:49:57 INFO rest.StandaloneRestServer: Started REST server for submitting applications on port 6066
16/05/03 16:49:57 INFO master.Master: I have been elected leader! New state: ALIVE
^C
====================STARTING SLAVE================================================================
[pts/0][16:50:36:hadoop@localhost ] ~/spark-1.5.0-bin-hadoop2.4/sbin>./start-slave.sh spark://localhost:8081
starting org.apache.spark.deploy.worker.Worker, logging to /u01/hadoop/spark-1.5.0-bin-hadoop2.4/sbin/../logs/spark-hadoop-org.apache.spark.deploy.worker.Worker-1-localhost.out
[pts/0][16:50:53:hadoop@localhost ] ~/spark-1.5.0-bin-hadoop2.4/sbin>cat ../logs/spark-hadoop-org.apache.spark.deploy.worker.Worker-1-localhost.out
Spark Command: /u01/hadoop/jdk1.8.0_60//bin/java -cp /u01/hadoop/spark-1.5.0-bin-hadoop2.4/sbin/../conf/:/u01/hadoop/spark-1.5.0-bin-hadoop2.4/lib/spark-assembly-1.5.0-hadoop2.4.0.jar:/u01/hadoop/spark-1.5.0-bin-hadoop2.4/lib/datanucleus-api-jdo-3.2.6.jar:/u01/hadoop/spark-1.5.0-bin-hadoop2.4/lib/datanucleus-core-3.2.10.jar:/u01/hadoop/spark-1.5.0-bin-hadoop2.4/lib/datanucleus-rdbms-3.2.9.jar:/u01/hadoop/hadoop-2.5.0/etc/hadoop/ -Xms1g -Xmx1g org.apache.spark.deploy.worker.Worker --webui-port 8081 spark://localhost:8081
========================================
16/05/03 16:50:52 INFO worker.Worker: Registered signal handlers for [TERM, HUP, INT]
16/05/03 16:50:53 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
16/05/03 16:50:53 INFO spark.SecurityManager: Changing view acls to: hadoop
16/05/03 16:50:53 INFO spark.SecurityManager: Changing modify acls to: hadoop
16/05/03 16:50:53 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(hadoop); users with modify permissions: Set(hadoop)
16/05/03 16:50:54 INFO slf4j.Slf4jLogger: Slf4jLogger started
16/05/03 16:50:54 INFO Remoting: Starting remoting
16/05/03 16:50:54 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkWorker@localhost:41411]
16/05/03 16:50:54 INFO util.Utils: Successfully started service 'sparkWorker' on port 41411.
16/05/03 16:50:54 INFO worker.Worker: Starting Spark worker localhost:41411 with 8 cores, 14.6 GB RAM
16/05/03 16:50:54 INFO worker.Worker: Running Spark version 1.5.0
16/05/03 16:50:54 INFO worker.Worker: Spark home: /u01/hadoop/spark-1.5.0-bin-hadoop2.4
16/05/03 16:50:54 INFO server.Server: jetty-8.y.z-SNAPSHOT
16/05/03 16:50:54 WARN component.AbstractLifeCycle: FAILED SelectChannelConnector@0.0.0.0:8081: java.net.BindException: Address already in use
java.net.BindException: Address already in use
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:433)
at sun.nio.ch.Net.bind(Net.java:425)
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
at org.spark-project.jetty.server.nio.SelectChannelConnector.open(SelectChannelConnector.java:187)
at org.spark-project.jetty.server.AbstractConnector.doStart(AbstractConnector.java:316)
at org.spark-project.jetty.server.nio.SelectChannelConnector.doStart(SelectChannelConnector.java:265)
at org.spark-project.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
at org.spark-project.jetty.server.Server.doStart(Server.java:293)
at org.spark-project.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
at org.apache.spark.ui.JettyUtils$.org$apache$spark$ui$JettyUtils$$connect$1(JettyUtils.scala:236)
at org.apache.spark.ui.JettyUtils$$anonfun$3.apply(JettyUtils.scala:246)
at org.apache.spark.ui.JettyUtils$$anonfun$3.apply(JettyUtils.scala:246)
at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:1913)
at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)
at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1904)
at org.apache.spark.ui.JettyUtils$.startJettyServer(JettyUtils.scala:246)
at org.apache.spark.ui.WebUI.bind(WebUI.scala:136)
at org.apache.spark.deploy.worker.Worker.onStart(Worker.scala:190)
at org.apache.spark.rpc.akka.AkkaRpcEnv$$anonfun$actorRef$lzycompute$1$1$$anon$1$$anonfun$preStart$1.apply$mcV$sp(AkkaRpcEnv.scala:100)
at org.apache.spark.rpc.akka.AkkaRpcEnv.org$apache$spark$rpc$akka$AkkaRpcEnv$$safelyCall(AkkaRpcEnv.scala:197)
at org.apache.spark.rpc.akka.AkkaRpcEnv$$anonfun$actorRef$lzycompute$1$1$$anon$1.preStart(AkkaRpcEnv.scala:99)
at akka.actor.Actor$class.aroundPreStart(Actor.scala:472)
at org.apache.spark.rpc.akka.AkkaRpcEnv$$anonfun$actorRef$lzycompute$1$1$$anon$1.aroundPreStart(AkkaRpcEnv.scala:92)
at akka.actor.ActorCell.create(ActorCell.scala:580)
at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:456)
at akka.actor.ActorCell.systemInvoke(ActorCell.scala:478)
at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:263)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
16/05/03 16:50:54 WARN component.AbstractLifeCycle: FAILED org.spark-project.jetty.server.Server@1c60fe53: java.net.BindException: Address already in use
java.net.BindException: Address already in use
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:433)
at sun.nio.ch.Net.bind(Net.java:425)
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
at org.spark-project.jetty.server.nio.SelectChannelConnector.open(SelectChannelConnector.java:187)
at org.spark-project.jetty.server.AbstractConnector.doStart(AbstractConnector.java:316)
at org.spark-project.jetty.server.nio.SelectChannelConnector.doStart(SelectChannelConnector.java:265)
at org.spark-project.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
at org.spark-project.jetty.server.Server.doStart(Server.java:293)
at org.spark-project.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
at org.apache.spark.ui.JettyUtils$.org$apache$spark$ui$JettyUtils$$connect$1(JettyUtils.scala:236)
at org.apache.spark.ui.JettyUtils$$anonfun$3.apply(JettyUtils.scala:246)
at org.apache.spark.ui.JettyUtils$$anonfun$3.apply(JettyUtils.scala:246)
at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:1913)
at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)
at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1904)
at org.apache.spark.ui.JettyUtils$.startJettyServer(JettyUtils.scala:246)
at org.apache.spark.ui.WebUI.bind(WebUI.scala:136)
at org.apache.spark.deploy.worker.Worker.onStart(Worker.scala:190)
at org.apache.spark.rpc.akka.AkkaRpcEnv$$anonfun$actorRef$lzycompute$1$1$$anon$1$$anonfun$preStart$1.apply$mcV$sp(AkkaRpcEnv.scala:100)
at org.apache.spark.rpc.akka.AkkaRpcEnv.org$apache$spark$rpc$akka$AkkaRpcEnv$$safelyCall(AkkaRpcEnv.scala:197)
at org.apache.spark.rpc.akka.AkkaRpcEnv$$anonfun$actorRef$lzycompute$1$1$$anon$1.preStart(AkkaRpcEnv.scala:99)
at akka.actor.Actor$class.aroundPreStart(Actor.scala:472)
at org.apache.spark.rpc.akka.AkkaRpcEnv$$anonfun$actorRef$lzycompute$1$1$$anon$1.aroundPreStart(AkkaRpcEnv.scala:92)
at akka.actor.ActorCell.create(ActorCell.scala:580)
at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:456)
at akka.actor.ActorCell.systemInvoke(ActorCell.scala:478)
at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:263)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
16/05/03 16:50:54 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/log,null}
16/05/03 16:50:54 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/static,null}
16/05/03 16:50:54 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/json,null}
16/05/03 16:50:54 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/,null}
16/05/03 16:50:54 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/logPage/json,null}
16/05/03 16:50:54 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/logPage,null}
16/05/03 16:50:55 WARN util.Utils: Service 'WorkerUI' could not bind on port 8081. Attempting port 8082.
16/05/03 16:50:55 INFO server.Server: jetty-8.y.z-SNAPSHOT
16/05/03 16:50:55 INFO server.AbstractConnector: Started SelectChannelConnector@0.0.0.0:8082
16/05/03 16:50:55 INFO util.Utils: Successfully started service 'WorkerUI' on port 8082.
16/05/03 16:50:55 INFO ui.WorkerWebUI: Started WorkerWebUI at http://localhost:8082
16/05/03 16:50:55 INFO worker.Worker: Connecting to master localhost:8081...
16/05/03 16:50:55 WARN remote.ReliableDeliverySupervisor: Association with remote system [akka.tcp://sparkMaster@localhost:8081] has failed, address is now gated for [5000] ms. Reason: [Association failed with [akka.tcp://sparkMaster@localhost:8081]] Caused by: [The remote system explicitly disassociated (reason unknown).]
16/05/03 16:50:55 WARN worker.Worker: Failed to connect to master localhost:8081
akka.actor.ActorNotFound: Actor not found for: ActorSelection[Anchor(akka.tcp://sparkMaster@localhost:8081/), Path(/user/Master)]
at akka.actor.ActorSelection$$anonfun$resolveOne$1.apply(ActorSelection.scala:65)
at akka.actor.ActorSelection$$anonfun$resolveOne$1.apply(ActorSelection.scala:63)
at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)
at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:55)
at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:73)
at akka.dispatch.ExecutionContexts$sameThreadExecutionContext$.unbatchedExecute(Future.scala:74)
at akka.dispatch.BatchingExecutor$class.execute(BatchingExecutor.scala:120)
at akka.dispatch.ExecutionContexts$sameThreadExecutionContext$.execute(Future.scala:73)
at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:40)
at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:248)
at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:266)
at akka.actor.EmptyLocalActorRef.specialHandle(ActorRef.scala:533)
at akka.actor.DeadLetterActorRef.specialHandle(ActorRef.scala:569)
at akka.actor.DeadLetterActorRef.$bang(ActorRef.scala:559)
at akka.remote.RemoteActorRefProvider$RemoteDeadLetterActorRef.$bang(RemoteActorRefProvider.scala:87)
at akka.remote.EndpointWriter.postStop(Endpoint.scala:557)
at akka.actor.Actor$class.aroundPostStop(Actor.scala:477)
at akka.remote.EndpointActor.aroundPostStop(Endpoint.scala:411)
at akka.actor.dungeon.FaultHandling$class.akka$actor$dungeon$FaultHandling$$finishTerminate(FaultHandling.scala:210)
at akka.actor.dungeon.FaultHandling$class.terminate(FaultHandling.scala:172)
at akka.actor.ActorCell.terminate(ActorCell.scala:369)
at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:462)
at akka.actor.ActorCell.systemInvoke(ActorCell.scala:478)
at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:263)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
16/05/03 16:51:02 INFO worker.Worker: Retrying connection to master (attempt # 1)
16/05/03 16:51:02 INFO worker.Worker: Connecting to master localhost:8081...
16/05/03 16:51:02 WARN remote.ReliableDeliverySupervisor: Association with remote system [akka.tcp://sparkMaster@localhost:8081] has failed, address is now gated for [5000] ms. Reason: [Association failed with [akka.tcp://sparkMaster@localhost:8081]] Caused by: [The remote system explicitly disassociated (reason unknown).]
16/05/03 16:51:02 WARN worker.Worker: Failed to connect to master localhost:8081
akka.actor.ActorNotFound: Actor not found for: ActorSelection[Anchor(akka.tcp://sparkMaster@localhost:8081/), Path(/user/Master)]
at akka.actor.ActorSelection$$anonfun$resolveOne$1.apply(ActorSelection.scala:65)
at akka.actor.ActorSelection$$anonfun$resolveOne$1.apply(ActorSelection.scala:63)
at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)
at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:55)
at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:73)
at akka.dispatch.ExecutionContexts$sameThreadExecutionContext$.unbatchedExecute(Future.scala:74)
at akka.dispatch.BatchingExecutor$class.execute(BatchingExecutor.scala:120)
at akka.dispatch.ExecutionContexts$sameThreadExecutionContext$.execute(Future.scala:73)
at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:40)
at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:248)
at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:266)
at akka.actor.EmptyLocalActorRef.specialHandle(ActorRef.scala:533)
at akka.actor.DeadLetterActorRef.specialHandle(ActorRef.scala:569)
at akka.actor.DeadLetterActorRef.$bang(ActorRef.scala:559)
at akka.remote.RemoteActorRefProvider$RemoteDeadLetterActorRef.$bang(RemoteActorRefProvider.scala:87)
at akka.remote.EndpointWriter.postStop(Endpoint.scala:557)
at akka.actor.Actor$class.aroundPostStop(Actor.scala:477)
at akka.remote.EndpointActor.aroundPostStop(Endpoint.scala:411)
at akka.actor.dungeon.FaultHandling$class.akka$actor$dungeon$FaultHandling$$finishTerminate(FaultHandling.scala:210)
at akka.actor.dungeon.FaultHandling$class.terminate(FaultHandling.scala:172)
at akka.actor.ActorCell.terminate(ActorCell.scala:369)
at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:462)
at akka.actor.ActorCell.systemInvoke(ActorCell.scala:478)
at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:263)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
16/05/03 16:51:09 INFO worker.Worker: Retrying connection to master (attempt # 2)
16/05/03 16:51:09 INFO worker.Worker: Connecting to master localhost:8081...
16/05/03 16:51:09 WARN remote.ReliableDeliverySupervisor: Association with remote system [akka.tcp://sparkMaster@localhost:8081] has failed, address is now gated for [5000] ms. Reason: [Association failed with [akka.tcp://sparkMaster@localhost:8081]] Caused by: [The remote system explicitly disassociated (reason unknown).]
16/05/03 16:51:09 WARN worker.Worker: Failed to connect to master localhost:8081
akka.actor.ActorNotFound: Actor not found for: ActorSelection[Anchor(akka.tcp://sparkMaster@localhost:8081/), Path(/user/Master)]
at akka.actor.ActorSelection$$anonfun$resolveOne$1.apply(ActorSelection.scala:65)
at akka.actor.ActorSelection$$anonfun$resolveOne$1.apply(ActorSelection.scala:63)
at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)
at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:55)
at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:73)
at akka.dispatch.ExecutionContexts$sameThreadExecutionContext$.unbatchedExecute(Future.scala:74)
at akka.dispatch.BatchingExecutor$class.execute(BatchingExecutor.scala:120)
at akka.dispatch.ExecutionContexts$sameThreadExecutionContext$.execute(Future.scala:73)
at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:40)
at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:248)
at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:266)
at akka.actor.EmptyLocalActorRef.specialHandle(ActorRef.scala:533)
at akka.actor.DeadLetterActorRef.specialHandle(ActorRef.scala:569)
at akka.actor.DeadLetterActorRef.$bang(ActorRef.scala:559)
at akka.remote.RemoteActorRefProvider$RemoteDeadLetterActorRef.$bang(RemoteActorRefProvider.scala:87)
at akka.remote.EndpointWriter.postStop(Endpoint.scala:557)
at akka.actor.Actor$class.aroundPostStop(Actor.scala:477)
at akka.remote.EndpointActor.aroundPostStop(Endpoint.scala:411)
at akka.actor.dungeon.FaultHandling$class.akka$actor$dungeon$FaultHandling$$finishTerminate(FaultHandling.scala:210)
at akka.actor.dungeon.FaultHandling$class.terminate(FaultHandling.scala:172)
at akka.actor.ActorCell.terminate(ActorCell.scala:369)
at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:462)
at akka.actor.ActorCell.systemInvoke(ActorCell.scala:478)
at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:263)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
16/05/03 16:51:16 INFO worker.Worker: Retrying connection to master (attempt # 3)
16/05/03 16:51:16 INFO worker.Worker: Connecting to master localhost:8081...
16/05/03 16:51:16 WARN remote.ReliableDeliverySupervisor: Association with remote system [akka.tcp://sparkMaster@localhost:8081] has failed, address is now gated for [5000] ms. Reason: [Association failed with [akka.tcp://sparkMaster@localhost:8081]] Caused by: [The remote system explicitly disassociated (reason unknown).]
16/05/03 16:51:16 WARN worker.Worker: Failed to connect to master localhost:8081
akka.actor.ActorNotFound: Actor not found for: ActorSelection[Anchor(akka.tcp://sparkMaster@localhost:8081/), Path(/user/Master)]
at akka.actor.ActorSelection$$anonfun$resolveOne$1.apply(ActorSelection.scala:65)
at akka.actor.ActorSelection$$anonfun$resolveOne$1.apply(ActorSelection.scala:63)
at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)
at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:55)
at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:73)
at akka.dispatch.ExecutionContexts$sameThreadExecutionContext$.unbatchedExecute(Future.scala:74)
at akka.dispatch.BatchingExecutor$class.execute(BatchingExecutor.scala:120)
at akka.dispatch.ExecutionContexts$sameThreadExecutionContext$.execute(Future.scala:73)
at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:40)
at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:248)
at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:266)
at akka.actor.EmptyLocalActorRef.specialHandle(ActorRef.scala:533)
at akka.actor.DeadLetterActorRef.specialHandle(ActorRef.scala:569)
at akka.actor.DeadLetterActorRef.$bang(ActorRef.scala:559)
at akka.remote.RemoteActorRefProvider$RemoteDeadLetterActorRef.$bang(RemoteActorRefProvider.scala:87)
at akka.remote.EndpointWriter.postStop(Endpoint.scala:557)
at akka.actor.Actor$class.aroundPostStop(Actor.scala:477)
at akka.remote.EndpointActor.aroundPostStop(Endpoint.scala:411)
at akka.actor.dungeon.FaultHandling$class.akka$actor$dungeon$FaultHandling$$finishTerminate(FaultHandling.scala:210)
at akka.actor.dungeon.FaultHandling$class.terminate(FaultHandling.scala:172)
at akka.actor.ActorCell.terminate(ActorCell.scala:369)
at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:462)
at akka.actor.ActorCell.systemInvoke(ActorCell.scala:478)
at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:263)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
16/05/03 16:51:23 INFO worker.Worker: Retrying connection to master (attempt # 4)
16/05/03 16:51:23 INFO worker.Worker: Connecting to master localhost:8081...
16/05/03 16:51:23 WARN remote.ReliableDeliverySupervisor: Association with remote system [akka.tcp://sparkMaster@localhost:8081] has failed, address is now gated for [5000] ms. Reason: [Association failed with [akka.tcp://sparkMaster@localhost:8081]] Caused by: [The remote system explicitly disassociated (reason unknown).]
16/05/03 16:51:23 WARN worker.Worker: Failed to connect to master localhost:8081
akka.actor.ActorNotFound: Actor not found for: ActorSelection[Anchor(akka.tcp://sparkMaster@localhost:8081/), Path(/user/Master)]
at akka.actor.ActorSelection$$anonfun$resolveOne$1.apply(ActorSelection.scala:65)
at akka.actor.ActorSelection$$anonfun$resolveOne$1.apply(ActorSelection.scala:63)
at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)
at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:55)
at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:73)
at akka.dispatch.ExecutionContexts$sameThreadExecutionContext$.unbatchedExecute(Future.scala:74)
at akka.dispatch.BatchingExecutor$class.execute(BatchingExecutor.scala:120)
at akka.dispatch.ExecutionContexts$sameThreadExecutionContext$.execute(Future.scala:73)
at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:40)
at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:248)
at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:266)
at akka.actor.EmptyLocalActorRef.specialHandle(ActorRef.scala:533)
at akka.actor.DeadLetterActorRef.specialHandle(ActorRef.scala:569)
at akka.actor.DeadLetterActorRef.$bang(ActorRef.scala:559)
at akka.remote.RemoteActorRefProvider$RemoteDeadLetterActorRef.$bang(RemoteActorRefProvider.scala:87)
at akka.remote.EndpointWriter.postStop(Endpoint.scala:557)
at akka.actor.Actor$class.aroundPostStop(Actor.scala:477)
at akka.remote.EndpointActor.aroundPostStop(Endpoint.scala:411)
at akka.actor.dungeon.FaultHandling$class.akka$actor$dungeon$FaultHandling$$finishTerminate(FaultHandling.scala:210)
at akka.actor.dungeon.FaultHandling$class.terminate(FaultHandling.scala:172)
at akka.actor.ActorCell.terminate(ActorCell.scala:369)
at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:462)
at akka.actor.ActorCell.systemInvoke(ActorCell.scala:478)
at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:263)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
[pts/0][16:55:53:hadoop@localhost ] ~/spark-1.5.0-bin-hadoop2.4/sbin>
----------------Error was due to incorect spark://url passed to start-slave.sh....check localhost:8081 where master is running, from its webui get the
exact url and pass it to slave.
---------------Fixed............
[pts/0][16:55:54:hadoop@localhost ] ~/spark-1.5.0-bin-hadoop2.4/sbin>./stop-slave.sh spark://localhost:8081
stopping org.apache.spark.deploy.worker.Worker
[pts/0][16:56:19:hadoop@localhost ] ~/spark-1.5.0-bin-hadoop2.4/sbin>./start-slave.sh spark://localhost:7077
starting org.apache.spark.deploy.worker.Worker, logging to /u01/hadoop/spark-1.5.0-bin-hadoop2.4/sbin/../logs/spark-hadoop-org.apache.spark.deploy.worker.Worker-1-localhost.out
[pts/0][16:56:55:hadoop@localhost ] ~/spark-1.5.0-bin-hadoop2.4/sbin>
----------
Access the master web-ui localhost:8080 or localhost:8081 wherver ur master is running..
now the web ui shows the master info and also under workers associated..u have the worker.
[pts/0][16:01:21:hadoop@localhost ] ~>cd spark-1.5.0-bin-hadoop2.4
[pts/0][16:01:27:hadoop@localhost ] ~/spark-1.5.0-bin-hadoop2.4>ls
bin data examples logs python RELEASE work
CHANGES.txt derby.log lib metastore_db R sbin
conf ec2 LICENSE NOTICE README.md scala
[pts/0][16:01:28:hadoop@localhost ] ~/spark-1.5.0-bin-hadoop2.4>jps
29286 Jps
[pts/0][16:01:41:hadoop@localhost ] ~/spark-1.5.0-bin-hadoop2.4>cd sbin/
===========optional if you need UI view and connecting via windows to a lunix box==========
[pts/0][16:03:11:hadoop@localhost ] ~/spark-1.5.0-bin-hadoop2.4/sbin>vncserver
xauth: timeout in locking authority file /u01/hadoop/.Xauthority
New 'localhost:1 (hadoop)' desktop is localhost:1
Starting applications specified in /u01/hadoop/.vnc/xstartup
Log file is /u01/hadoop/.vnc/localhost:1.log
=======================================STARTING MASTER==========================================================================
[pts/0][16:49:38:hadoop@localhost ] ~/spark-1.5.0-bin-hadoop2.4/sbin>./start-master.sh
starting org.apache.spark.deploy.master.Master, logging to /u01/hadoop/spark-1.5.0-bin-hadoop2.4/sbin/../logs/spark-hadoop-org.apache.spark.deploy.master.Master-1-localhost.out
[pts/0][16:49:55:hadoop@localhost ] ~/spark-1.5.0-bin-hadoop2.4/sbin>tail -f ../logs/spark-hadoop-org.apache.spark.deploy.master.Master-1-localhost.out
16/05/03 16:49:57 WARN util.Utils: Service 'MasterUI' could not bind on port 8080. Attempting port 8081.
16/05/03 16:49:57 INFO server.Server: jetty-8.y.z-SNAPSHOT
16/05/03 16:49:57 INFO server.AbstractConnector: Started SelectChannelConnector@0.0.0.0:8081
16/05/03 16:49:57 INFO util.Utils: Successfully started service 'MasterUI' on port 8081.
16/05/03 16:49:57 INFO ui.MasterWebUI: Started MasterWebUI at http://localhost:8081
16/05/03 16:49:57 INFO server.Server: jetty-8.y.z-SNAPSHOT
16/05/03 16:49:57 INFO server.AbstractConnector: Started SelectChannelConnector@localhost:6066
16/05/03 16:49:57 INFO util.Utils: Successfully started service on port 6066.
16/05/03 16:49:57 INFO rest.StandaloneRestServer: Started REST server for submitting applications on port 6066
16/05/03 16:49:57 INFO master.Master: I have been elected leader! New state: ALIVE
^C
====================STARTING SLAVE================================================================
[pts/0][16:50:36:hadoop@localhost ] ~/spark-1.5.0-bin-hadoop2.4/sbin>./start-slave.sh spark://localhost:8081
starting org.apache.spark.deploy.worker.Worker, logging to /u01/hadoop/spark-1.5.0-bin-hadoop2.4/sbin/../logs/spark-hadoop-org.apache.spark.deploy.worker.Worker-1-localhost.out
[pts/0][16:50:53:hadoop@localhost ] ~/spark-1.5.0-bin-hadoop2.4/sbin>cat ../logs/spark-hadoop-org.apache.spark.deploy.worker.Worker-1-localhost.out
Spark Command: /u01/hadoop/jdk1.8.0_60//bin/java -cp /u01/hadoop/spark-1.5.0-bin-hadoop2.4/sbin/../conf/:/u01/hadoop/spark-1.5.0-bin-hadoop2.4/lib/spark-assembly-1.5.0-hadoop2.4.0.jar:/u01/hadoop/spark-1.5.0-bin-hadoop2.4/lib/datanucleus-api-jdo-3.2.6.jar:/u01/hadoop/spark-1.5.0-bin-hadoop2.4/lib/datanucleus-core-3.2.10.jar:/u01/hadoop/spark-1.5.0-bin-hadoop2.4/lib/datanucleus-rdbms-3.2.9.jar:/u01/hadoop/hadoop-2.5.0/etc/hadoop/ -Xms1g -Xmx1g org.apache.spark.deploy.worker.Worker --webui-port 8081 spark://localhost:8081
========================================
16/05/03 16:50:52 INFO worker.Worker: Registered signal handlers for [TERM, HUP, INT]
16/05/03 16:50:53 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
16/05/03 16:50:53 INFO spark.SecurityManager: Changing view acls to: hadoop
16/05/03 16:50:53 INFO spark.SecurityManager: Changing modify acls to: hadoop
16/05/03 16:50:53 INFO spark.SecurityManager: SecurityManager: authentication disabled; ui acls disabled; users with view permissions: Set(hadoop); users with modify permissions: Set(hadoop)
16/05/03 16:50:54 INFO slf4j.Slf4jLogger: Slf4jLogger started
16/05/03 16:50:54 INFO Remoting: Starting remoting
16/05/03 16:50:54 INFO Remoting: Remoting started; listening on addresses :[akka.tcp://sparkWorker@localhost:41411]
16/05/03 16:50:54 INFO util.Utils: Successfully started service 'sparkWorker' on port 41411.
16/05/03 16:50:54 INFO worker.Worker: Starting Spark worker localhost:41411 with 8 cores, 14.6 GB RAM
16/05/03 16:50:54 INFO worker.Worker: Running Spark version 1.5.0
16/05/03 16:50:54 INFO worker.Worker: Spark home: /u01/hadoop/spark-1.5.0-bin-hadoop2.4
16/05/03 16:50:54 INFO server.Server: jetty-8.y.z-SNAPSHOT
16/05/03 16:50:54 WARN component.AbstractLifeCycle: FAILED SelectChannelConnector@0.0.0.0:8081: java.net.BindException: Address already in use
java.net.BindException: Address already in use
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:433)
at sun.nio.ch.Net.bind(Net.java:425)
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
at org.spark-project.jetty.server.nio.SelectChannelConnector.open(SelectChannelConnector.java:187)
at org.spark-project.jetty.server.AbstractConnector.doStart(AbstractConnector.java:316)
at org.spark-project.jetty.server.nio.SelectChannelConnector.doStart(SelectChannelConnector.java:265)
at org.spark-project.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
at org.spark-project.jetty.server.Server.doStart(Server.java:293)
at org.spark-project.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
at org.apache.spark.ui.JettyUtils$.org$apache$spark$ui$JettyUtils$$connect$1(JettyUtils.scala:236)
at org.apache.spark.ui.JettyUtils$$anonfun$3.apply(JettyUtils.scala:246)
at org.apache.spark.ui.JettyUtils$$anonfun$3.apply(JettyUtils.scala:246)
at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:1913)
at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)
at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1904)
at org.apache.spark.ui.JettyUtils$.startJettyServer(JettyUtils.scala:246)
at org.apache.spark.ui.WebUI.bind(WebUI.scala:136)
at org.apache.spark.deploy.worker.Worker.onStart(Worker.scala:190)
at org.apache.spark.rpc.akka.AkkaRpcEnv$$anonfun$actorRef$lzycompute$1$1$$anon$1$$anonfun$preStart$1.apply$mcV$sp(AkkaRpcEnv.scala:100)
at org.apache.spark.rpc.akka.AkkaRpcEnv.org$apache$spark$rpc$akka$AkkaRpcEnv$$safelyCall(AkkaRpcEnv.scala:197)
at org.apache.spark.rpc.akka.AkkaRpcEnv$$anonfun$actorRef$lzycompute$1$1$$anon$1.preStart(AkkaRpcEnv.scala:99)
at akka.actor.Actor$class.aroundPreStart(Actor.scala:472)
at org.apache.spark.rpc.akka.AkkaRpcEnv$$anonfun$actorRef$lzycompute$1$1$$anon$1.aroundPreStart(AkkaRpcEnv.scala:92)
at akka.actor.ActorCell.create(ActorCell.scala:580)
at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:456)
at akka.actor.ActorCell.systemInvoke(ActorCell.scala:478)
at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:263)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
16/05/03 16:50:54 WARN component.AbstractLifeCycle: FAILED org.spark-project.jetty.server.Server@1c60fe53: java.net.BindException: Address already in use
java.net.BindException: Address already in use
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:433)
at sun.nio.ch.Net.bind(Net.java:425)
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
at org.spark-project.jetty.server.nio.SelectChannelConnector.open(SelectChannelConnector.java:187)
at org.spark-project.jetty.server.AbstractConnector.doStart(AbstractConnector.java:316)
at org.spark-project.jetty.server.nio.SelectChannelConnector.doStart(SelectChannelConnector.java:265)
at org.spark-project.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
at org.spark-project.jetty.server.Server.doStart(Server.java:293)
at org.spark-project.jetty.util.component.AbstractLifeCycle.start(AbstractLifeCycle.java:64)
at org.apache.spark.ui.JettyUtils$.org$apache$spark$ui$JettyUtils$$connect$1(JettyUtils.scala:236)
at org.apache.spark.ui.JettyUtils$$anonfun$3.apply(JettyUtils.scala:246)
at org.apache.spark.ui.JettyUtils$$anonfun$3.apply(JettyUtils.scala:246)
at org.apache.spark.util.Utils$$anonfun$startServiceOnPort$1.apply$mcVI$sp(Utils.scala:1913)
at scala.collection.immutable.Range.foreach$mVc$sp(Range.scala:141)
at org.apache.spark.util.Utils$.startServiceOnPort(Utils.scala:1904)
at org.apache.spark.ui.JettyUtils$.startJettyServer(JettyUtils.scala:246)
at org.apache.spark.ui.WebUI.bind(WebUI.scala:136)
at org.apache.spark.deploy.worker.Worker.onStart(Worker.scala:190)
at org.apache.spark.rpc.akka.AkkaRpcEnv$$anonfun$actorRef$lzycompute$1$1$$anon$1$$anonfun$preStart$1.apply$mcV$sp(AkkaRpcEnv.scala:100)
at org.apache.spark.rpc.akka.AkkaRpcEnv.org$apache$spark$rpc$akka$AkkaRpcEnv$$safelyCall(AkkaRpcEnv.scala:197)
at org.apache.spark.rpc.akka.AkkaRpcEnv$$anonfun$actorRef$lzycompute$1$1$$anon$1.preStart(AkkaRpcEnv.scala:99)
at akka.actor.Actor$class.aroundPreStart(Actor.scala:472)
at org.apache.spark.rpc.akka.AkkaRpcEnv$$anonfun$actorRef$lzycompute$1$1$$anon$1.aroundPreStart(AkkaRpcEnv.scala:92)
at akka.actor.ActorCell.create(ActorCell.scala:580)
at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:456)
at akka.actor.ActorCell.systemInvoke(ActorCell.scala:478)
at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:263)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
16/05/03 16:50:54 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/log,null}
16/05/03 16:50:54 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/static,null}
16/05/03 16:50:54 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/json,null}
16/05/03 16:50:54 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/,null}
16/05/03 16:50:54 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/logPage/json,null}
16/05/03 16:50:54 INFO handler.ContextHandler: stopped o.s.j.s.ServletContextHandler{/logPage,null}
16/05/03 16:50:55 WARN util.Utils: Service 'WorkerUI' could not bind on port 8081. Attempting port 8082.
16/05/03 16:50:55 INFO server.Server: jetty-8.y.z-SNAPSHOT
16/05/03 16:50:55 INFO server.AbstractConnector: Started SelectChannelConnector@0.0.0.0:8082
16/05/03 16:50:55 INFO util.Utils: Successfully started service 'WorkerUI' on port 8082.
16/05/03 16:50:55 INFO ui.WorkerWebUI: Started WorkerWebUI at http://localhost:8082
16/05/03 16:50:55 INFO worker.Worker: Connecting to master localhost:8081...
16/05/03 16:50:55 WARN remote.ReliableDeliverySupervisor: Association with remote system [akka.tcp://sparkMaster@localhost:8081] has failed, address is now gated for [5000] ms. Reason: [Association failed with [akka.tcp://sparkMaster@localhost:8081]] Caused by: [The remote system explicitly disassociated (reason unknown).]
16/05/03 16:50:55 WARN worker.Worker: Failed to connect to master localhost:8081
akka.actor.ActorNotFound: Actor not found for: ActorSelection[Anchor(akka.tcp://sparkMaster@localhost:8081/), Path(/user/Master)]
at akka.actor.ActorSelection$$anonfun$resolveOne$1.apply(ActorSelection.scala:65)
at akka.actor.ActorSelection$$anonfun$resolveOne$1.apply(ActorSelection.scala:63)
at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)
at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:55)
at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:73)
at akka.dispatch.ExecutionContexts$sameThreadExecutionContext$.unbatchedExecute(Future.scala:74)
at akka.dispatch.BatchingExecutor$class.execute(BatchingExecutor.scala:120)
at akka.dispatch.ExecutionContexts$sameThreadExecutionContext$.execute(Future.scala:73)
at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:40)
at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:248)
at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:266)
at akka.actor.EmptyLocalActorRef.specialHandle(ActorRef.scala:533)
at akka.actor.DeadLetterActorRef.specialHandle(ActorRef.scala:569)
at akka.actor.DeadLetterActorRef.$bang(ActorRef.scala:559)
at akka.remote.RemoteActorRefProvider$RemoteDeadLetterActorRef.$bang(RemoteActorRefProvider.scala:87)
at akka.remote.EndpointWriter.postStop(Endpoint.scala:557)
at akka.actor.Actor$class.aroundPostStop(Actor.scala:477)
at akka.remote.EndpointActor.aroundPostStop(Endpoint.scala:411)
at akka.actor.dungeon.FaultHandling$class.akka$actor$dungeon$FaultHandling$$finishTerminate(FaultHandling.scala:210)
at akka.actor.dungeon.FaultHandling$class.terminate(FaultHandling.scala:172)
at akka.actor.ActorCell.terminate(ActorCell.scala:369)
at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:462)
at akka.actor.ActorCell.systemInvoke(ActorCell.scala:478)
at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:263)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
16/05/03 16:51:02 INFO worker.Worker: Retrying connection to master (attempt # 1)
16/05/03 16:51:02 INFO worker.Worker: Connecting to master localhost:8081...
16/05/03 16:51:02 WARN remote.ReliableDeliverySupervisor: Association with remote system [akka.tcp://sparkMaster@localhost:8081] has failed, address is now gated for [5000] ms. Reason: [Association failed with [akka.tcp://sparkMaster@localhost:8081]] Caused by: [The remote system explicitly disassociated (reason unknown).]
16/05/03 16:51:02 WARN worker.Worker: Failed to connect to master localhost:8081
akka.actor.ActorNotFound: Actor not found for: ActorSelection[Anchor(akka.tcp://sparkMaster@localhost:8081/), Path(/user/Master)]
at akka.actor.ActorSelection$$anonfun$resolveOne$1.apply(ActorSelection.scala:65)
at akka.actor.ActorSelection$$anonfun$resolveOne$1.apply(ActorSelection.scala:63)
at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)
at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:55)
at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:73)
at akka.dispatch.ExecutionContexts$sameThreadExecutionContext$.unbatchedExecute(Future.scala:74)
at akka.dispatch.BatchingExecutor$class.execute(BatchingExecutor.scala:120)
at akka.dispatch.ExecutionContexts$sameThreadExecutionContext$.execute(Future.scala:73)
at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:40)
at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:248)
at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:266)
at akka.actor.EmptyLocalActorRef.specialHandle(ActorRef.scala:533)
at akka.actor.DeadLetterActorRef.specialHandle(ActorRef.scala:569)
at akka.actor.DeadLetterActorRef.$bang(ActorRef.scala:559)
at akka.remote.RemoteActorRefProvider$RemoteDeadLetterActorRef.$bang(RemoteActorRefProvider.scala:87)
at akka.remote.EndpointWriter.postStop(Endpoint.scala:557)
at akka.actor.Actor$class.aroundPostStop(Actor.scala:477)
at akka.remote.EndpointActor.aroundPostStop(Endpoint.scala:411)
at akka.actor.dungeon.FaultHandling$class.akka$actor$dungeon$FaultHandling$$finishTerminate(FaultHandling.scala:210)
at akka.actor.dungeon.FaultHandling$class.terminate(FaultHandling.scala:172)
at akka.actor.ActorCell.terminate(ActorCell.scala:369)
at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:462)
at akka.actor.ActorCell.systemInvoke(ActorCell.scala:478)
at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:263)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
16/05/03 16:51:09 INFO worker.Worker: Retrying connection to master (attempt # 2)
16/05/03 16:51:09 INFO worker.Worker: Connecting to master localhost:8081...
16/05/03 16:51:09 WARN remote.ReliableDeliverySupervisor: Association with remote system [akka.tcp://sparkMaster@localhost:8081] has failed, address is now gated for [5000] ms. Reason: [Association failed with [akka.tcp://sparkMaster@localhost:8081]] Caused by: [The remote system explicitly disassociated (reason unknown).]
16/05/03 16:51:09 WARN worker.Worker: Failed to connect to master localhost:8081
akka.actor.ActorNotFound: Actor not found for: ActorSelection[Anchor(akka.tcp://sparkMaster@localhost:8081/), Path(/user/Master)]
at akka.actor.ActorSelection$$anonfun$resolveOne$1.apply(ActorSelection.scala:65)
at akka.actor.ActorSelection$$anonfun$resolveOne$1.apply(ActorSelection.scala:63)
at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)
at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:55)
at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:73)
at akka.dispatch.ExecutionContexts$sameThreadExecutionContext$.unbatchedExecute(Future.scala:74)
at akka.dispatch.BatchingExecutor$class.execute(BatchingExecutor.scala:120)
at akka.dispatch.ExecutionContexts$sameThreadExecutionContext$.execute(Future.scala:73)
at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:40)
at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:248)
at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:266)
at akka.actor.EmptyLocalActorRef.specialHandle(ActorRef.scala:533)
at akka.actor.DeadLetterActorRef.specialHandle(ActorRef.scala:569)
at akka.actor.DeadLetterActorRef.$bang(ActorRef.scala:559)
at akka.remote.RemoteActorRefProvider$RemoteDeadLetterActorRef.$bang(RemoteActorRefProvider.scala:87)
at akka.remote.EndpointWriter.postStop(Endpoint.scala:557)
at akka.actor.Actor$class.aroundPostStop(Actor.scala:477)
at akka.remote.EndpointActor.aroundPostStop(Endpoint.scala:411)
at akka.actor.dungeon.FaultHandling$class.akka$actor$dungeon$FaultHandling$$finishTerminate(FaultHandling.scala:210)
at akka.actor.dungeon.FaultHandling$class.terminate(FaultHandling.scala:172)
at akka.actor.ActorCell.terminate(ActorCell.scala:369)
at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:462)
at akka.actor.ActorCell.systemInvoke(ActorCell.scala:478)
at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:263)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
16/05/03 16:51:16 INFO worker.Worker: Retrying connection to master (attempt # 3)
16/05/03 16:51:16 INFO worker.Worker: Connecting to master localhost:8081...
16/05/03 16:51:16 WARN remote.ReliableDeliverySupervisor: Association with remote system [akka.tcp://sparkMaster@localhost:8081] has failed, address is now gated for [5000] ms. Reason: [Association failed with [akka.tcp://sparkMaster@localhost:8081]] Caused by: [The remote system explicitly disassociated (reason unknown).]
16/05/03 16:51:16 WARN worker.Worker: Failed to connect to master localhost:8081
akka.actor.ActorNotFound: Actor not found for: ActorSelection[Anchor(akka.tcp://sparkMaster@localhost:8081/), Path(/user/Master)]
at akka.actor.ActorSelection$$anonfun$resolveOne$1.apply(ActorSelection.scala:65)
at akka.actor.ActorSelection$$anonfun$resolveOne$1.apply(ActorSelection.scala:63)
at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)
at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:55)
at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:73)
at akka.dispatch.ExecutionContexts$sameThreadExecutionContext$.unbatchedExecute(Future.scala:74)
at akka.dispatch.BatchingExecutor$class.execute(BatchingExecutor.scala:120)
at akka.dispatch.ExecutionContexts$sameThreadExecutionContext$.execute(Future.scala:73)
at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:40)
at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:248)
at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:266)
at akka.actor.EmptyLocalActorRef.specialHandle(ActorRef.scala:533)
at akka.actor.DeadLetterActorRef.specialHandle(ActorRef.scala:569)
at akka.actor.DeadLetterActorRef.$bang(ActorRef.scala:559)
at akka.remote.RemoteActorRefProvider$RemoteDeadLetterActorRef.$bang(RemoteActorRefProvider.scala:87)
at akka.remote.EndpointWriter.postStop(Endpoint.scala:557)
at akka.actor.Actor$class.aroundPostStop(Actor.scala:477)
at akka.remote.EndpointActor.aroundPostStop(Endpoint.scala:411)
at akka.actor.dungeon.FaultHandling$class.akka$actor$dungeon$FaultHandling$$finishTerminate(FaultHandling.scala:210)
at akka.actor.dungeon.FaultHandling$class.terminate(FaultHandling.scala:172)
at akka.actor.ActorCell.terminate(ActorCell.scala:369)
at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:462)
at akka.actor.ActorCell.systemInvoke(ActorCell.scala:478)
at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:263)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
16/05/03 16:51:23 INFO worker.Worker: Retrying connection to master (attempt # 4)
16/05/03 16:51:23 INFO worker.Worker: Connecting to master localhost:8081...
16/05/03 16:51:23 WARN remote.ReliableDeliverySupervisor: Association with remote system [akka.tcp://sparkMaster@localhost:8081] has failed, address is now gated for [5000] ms. Reason: [Association failed with [akka.tcp://sparkMaster@localhost:8081]] Caused by: [The remote system explicitly disassociated (reason unknown).]
16/05/03 16:51:23 WARN worker.Worker: Failed to connect to master localhost:8081
akka.actor.ActorNotFound: Actor not found for: ActorSelection[Anchor(akka.tcp://sparkMaster@localhost:8081/), Path(/user/Master)]
at akka.actor.ActorSelection$$anonfun$resolveOne$1.apply(ActorSelection.scala:65)
at akka.actor.ActorSelection$$anonfun$resolveOne$1.apply(ActorSelection.scala:63)
at scala.concurrent.impl.CallbackRunnable.run(Promise.scala:32)
at akka.dispatch.BatchingExecutor$AbstractBatch.processBatch(BatchingExecutor.scala:55)
at akka.dispatch.BatchingExecutor$Batch.run(BatchingExecutor.scala:73)
at akka.dispatch.ExecutionContexts$sameThreadExecutionContext$.unbatchedExecute(Future.scala:74)
at akka.dispatch.BatchingExecutor$class.execute(BatchingExecutor.scala:120)
at akka.dispatch.ExecutionContexts$sameThreadExecutionContext$.execute(Future.scala:73)
at scala.concurrent.impl.CallbackRunnable.executeWithValue(Promise.scala:40)
at scala.concurrent.impl.Promise$DefaultPromise.tryComplete(Promise.scala:248)
at akka.pattern.PromiseActorRef.$bang(AskSupport.scala:266)
at akka.actor.EmptyLocalActorRef.specialHandle(ActorRef.scala:533)
at akka.actor.DeadLetterActorRef.specialHandle(ActorRef.scala:569)
at akka.actor.DeadLetterActorRef.$bang(ActorRef.scala:559)
at akka.remote.RemoteActorRefProvider$RemoteDeadLetterActorRef.$bang(RemoteActorRefProvider.scala:87)
at akka.remote.EndpointWriter.postStop(Endpoint.scala:557)
at akka.actor.Actor$class.aroundPostStop(Actor.scala:477)
at akka.remote.EndpointActor.aroundPostStop(Endpoint.scala:411)
at akka.actor.dungeon.FaultHandling$class.akka$actor$dungeon$FaultHandling$$finishTerminate(FaultHandling.scala:210)
at akka.actor.dungeon.FaultHandling$class.terminate(FaultHandling.scala:172)
at akka.actor.ActorCell.terminate(ActorCell.scala:369)
at akka.actor.ActorCell.invokeAll$1(ActorCell.scala:462)
at akka.actor.ActorCell.systemInvoke(ActorCell.scala:478)
at akka.dispatch.Mailbox.processAllSystemMessages(Mailbox.scala:263)
at akka.dispatch.Mailbox.run(Mailbox.scala:219)
at akka.dispatch.ForkJoinExecutorConfigurator$AkkaForkJoinTask.exec(AbstractDispatcher.scala:397)
at scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
at scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
at scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)
at scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
[pts/0][16:55:53:hadoop@localhost ] ~/spark-1.5.0-bin-hadoop2.4/sbin>
----------------Error was due to incorect spark://url passed to start-slave.sh....check localhost:8081 where master is running, from its webui get the
exact url and pass it to slave.
---------------Fixed............
[pts/0][16:55:54:hadoop@localhost ] ~/spark-1.5.0-bin-hadoop2.4/sbin>./stop-slave.sh spark://localhost:8081
stopping org.apache.spark.deploy.worker.Worker
[pts/0][16:56:19:hadoop@localhost ] ~/spark-1.5.0-bin-hadoop2.4/sbin>./start-slave.sh spark://localhost:7077
starting org.apache.spark.deploy.worker.Worker, logging to /u01/hadoop/spark-1.5.0-bin-hadoop2.4/sbin/../logs/spark-hadoop-org.apache.spark.deploy.worker.Worker-1-localhost.out
[pts/0][16:56:55:hadoop@localhost ] ~/spark-1.5.0-bin-hadoop2.4/sbin>
----------
Access the master web-ui localhost:8080 or localhost:8081 wherver ur master is running..
now the web ui shows the master info and also under workers associated..u have the worker.
Comments
Post a Comment