Error:

DataXceiver error processing WRITE_BLOCK operation src: /x.x.x.x:50373 dest: /x.x.x.x:50010

Solution:

1.修改進程最大文件打開數

sudo vim /etc/security/limits.conf

End of file

*           -      nofile          1000000
*           -      nproc           1000000

2.修改數據傳輸線程個數

hdfs-site.xml

in hadoop-1.x

dfs.datanode.max.xcievers

8192

 

Specifies the maximum number of threads to use for transferring data

  in and out of the DN.

in hadoop-2.x

dfs.datanode.max.transfer.threads

 8192



Specifies the maximum number of threads to use for transferring data

 in and out of the DN.

參考：https://huangkx.blog.csdn.net/article/details/21240247