title: ConnectException: connect error: No such file or directory when trying to connect to '50010' using importtsv on hbase
body: <p>I configured short-circuit settings on both hdfs-site.xml and hbase-site.xml. And I run importtsv on hbase to import data from HDFS to HBase on Hbase cluster. I look over the log on each datanode and all datanode have ConnectException i said to the title.</p>
  
  <pre><code>2017-03-31 21:59:01,273 WARN [main] org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory: error creating DomainSocket
  java.net.ConnectException: connect(2) error: No such file or directory when trying to connect to '50010'
      at org.apache.hadoop.net.unix.DomainSocket.connect0(Native Method)
      at org.apache.hadoop.net.unix.DomainSocket.connect(DomainSocket.java:250)
      at org.apache.hadoop.hdfs.shortcircuit.DomainSocketFactory.createSocket(DomainSocketFactory.java:164)
      at org.apache.hadoop.hdfs.BlockReaderFactory.nextDomainPeer(BlockReaderFactory.java:753)
      at org.apache.hadoop.hdfs.BlockReaderFactory.createShortCircuitReplicaInfo(BlockReaderFactory.java:469)
      at org.apache.hadoop.hdfs.shortcircuit.ShortCircuitCache.create(ShortCircuitCache.java:783)
      at org.apache.hadoop.hdfs.shortcircuit.ShortCircuitCache.fetchOrCreate(ShortCircuitCache.java:717)
      at org.apache.hadoop.hdfs.BlockReaderFactory.getBlockReaderLocal(BlockReaderFactory.java:421)
      at org.apache.hadoop.hdfs.BlockReaderFactory.build(BlockReaderFactory.java:332)
      at org.apache.hadoop.hdfs.DFSInputStream.blockSeekTo(DFSInputStream.java:617)
      at org.apache.hadoop.hdfs.DFSInputStream.readWithStrategy(DFSInputStream.java:841)
      at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:889)
      at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:696)
      at java.io.DataInputStream.readByte(DataInputStream.java:265)
      at org.apache.hadoop.io.WritableUtils.readVLong(WritableUtils.java:308)
      at org.apache.hadoop.io.WritableUtils.readVIntInRange(WritableUtils.java:348)
      at org.apache.hadoop.io.Text.readString(Text.java:471)
      at org.apache.hadoop.io.Text.readString(Text.java:464)
      at org.apache.hadoop.mapred.MapTask.getSplitDetails(MapTask.java:358)
      at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:751)
      at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
      at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:163)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:422)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1656)
      at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
  2017-03-31 21:59:01,277 WARN [main] org.apache.hadoop.hdfs.shortcircuit.ShortCircuitCache: ShortCircuitCache(0x34f7234e): failed to load 1073750370_BP-642933002-"IP_ADDRESS"-1490774107737
  </code></pre>
  
  <p>EDIT</p>
  
  <p>hadoop 2.6.4
  hbase 1.2.3</p>
  
  <p>hdfs-site.xml</p>
  
  <pre><code>&lt;property&gt;
      &lt;name&gt;dfs.namenode.dir&lt;/name&gt;
      &lt;value&gt;/home/hadoop/hdfs/nn&lt;/value&gt;
  &lt;/property&gt;
  &lt;property&gt;
      &lt;name&gt;dfs.namenode.checkpoint.dir&lt;/name&gt;
      &lt;value&gt;/home/hadoop/hdfs/snn&lt;/value&gt;
  &lt;/property&gt;
  &lt;property&gt;
      &lt;name&gt;dfs.datanode.data.dir&lt;/name&gt;
      &lt;value&gt;file:///home/hadoop/hdfs/dn&lt;/value&gt;
  &lt;/property&gt;
  &lt;property&gt;
      &lt;name&gt;dfs.namenode.http-address&lt;/name&gt;
      &lt;value&gt;hadoop1:50070&lt;/value&gt;
  &lt;/property&gt;
  &lt;property&gt;
      &lt;name&gt;dfs.namenode.secondary.http-address&lt;/name&gt;
      &lt;value&gt;hadoop1:50090&lt;/value&gt;
  &lt;/property&gt;
  &lt;property&gt;
      &lt;name&gt;dfs.namenode.rpc-address&lt;/name&gt;
      &lt;value&gt;hadoop1:8020&lt;/value&gt;
  &lt;/property&gt;
  &lt;property&gt;
      &lt;name&gt;dfs.namenode.handler.count&lt;/name&gt;
      &lt;value&gt;50&lt;/value&gt;
  &lt;/property&gt;
  &lt;property&gt;
      &lt;name&gt;dfs.datanode.handler.count&lt;/name&gt;
      &lt;value&gt;50&lt;/value&gt;
  &lt;/property&gt;
  &lt;property&gt;
      &lt;name&gt;dfs.client.read.shortcircuit&lt;/name&gt;
      &lt;value&gt;true&lt;/value&gt;
  &lt;/property&gt;
  &lt;property&gt;
      &lt;name&gt;dfs.block.local-path-access.user&lt;/name&gt;
      &lt;value&gt;hbase&lt;/value&gt;
  &lt;/property&gt;
  &lt;property&gt;
      &lt;name&gt;dfs.datanode.data.dir.perm&lt;/name&gt;
      &lt;value&gt;775&lt;/value&gt;
  &lt;/property&gt;
  &lt;property&gt;
      &lt;name&gt;dfs.domain.socket.path&lt;/name&gt;
      &lt;value&gt;_PORT&lt;/value&gt;
  &lt;/property&gt;
  &lt;property&gt;
      &lt;name&gt;dfs.client.domain.socket.traffic&lt;/name&gt;
      &lt;value&gt;true&lt;/value&gt;
  &lt;/property&gt;
  </code></pre>
  
  <p>hbase-site.xml</p>
  
  <pre><code>&lt;property&gt;
      &lt;name&gt;hbase.rootdir&lt;/name&gt;
      &lt;value&gt;hdfs://hadoop1/hbase&lt;/value&gt;
  &lt;/property&gt;
  &lt;property&gt;
      &lt;name&gt;hbase.zookeeper.quorum&lt;/name&gt;
          &lt;value&gt;hadoop1,hadoop2,hadoop3,hadoop4,hadoop5,hadoop6,hadoop7,hadoop8&lt;/value&gt;
  &lt;/property&gt;
  &lt;property&gt;
      &lt;name&gt;hbase.cluster.distributed&lt;/name&gt;
      &lt;value&gt;true&lt;/value&gt;
  &lt;/property&gt;
  &lt;property&gt;
      &lt;name&gt;dfs.client.read.shortcircuit&lt;/name&gt;
      &lt;value&gt;true&lt;/value&gt;
  &lt;/property&gt;
  &lt;property&gt;
      &lt;name&gt;hbase.regionserver.handler.count&lt;/name&gt;
      &lt;value&gt;50&lt;/value&gt;
  &lt;/property&gt;
  &lt;property&gt;
      &lt;name&gt;hfile.block.cache.size&lt;/name&gt;
      &lt;value&gt;0.5&lt;/value&gt;
  &lt;/property&gt;
  &lt;property&gt;
      &lt;name&gt;hbase.regionserver.global.memstore.size&lt;/name&gt;
      &lt;value&gt;0.3&lt;/value&gt;
  &lt;/property&gt;
  &lt;property&gt;
      &lt;name&gt;hbase.regionserver.global.memstore.size.lower.limit&lt;/name&gt;
      &lt;value&gt;0.65&lt;/value&gt;
  &lt;/property&gt;
  &lt;property&gt;
      &lt;name&gt;dfs.domain.socket.path&lt;/name&gt;
      &lt;value&gt;_PORT&lt;/value&gt;
  &lt;/property&gt;
  </code></pre>