{"id":1420,"date":"2017-09-21T17:07:23","date_gmt":"2017-09-21T09:07:23","guid":{"rendered":"https:\/\/www.strongd.net\/?p=1420"},"modified":"2017-09-21T17:07:23","modified_gmt":"2017-09-21T09:07:23","slug":"%e6%90%ad%e5%bb%ba-hadoop-%e4%bc%aa%e5%88%86%e5%b8%83%e5%bc%8f%e7%8e%af%e5%a2%83","status":"publish","type":"post","link":"https:\/\/www.strongd.net\/?p=1420","title":{"rendered":"\u642d\u5efa Hadoop \u4f2a\u5206\u5e03\u5f0f\u73af\u5883"},"content":{"rendered":"<h3 id=\"-\">\u8f6f\u786c\u4ef6\u73af\u5883<\/h3>\n<ul>\n<li>CentOS 7.2 64\u4f4d<\/li>\n<li>OpenJDK-1.7<\/li>\n<li>Hadoop-2.7<\/li>\n<\/ul>\n<h3 id=\"-\">\u5173\u4e8e\u672c\u6559\u7a0b\u7684\u8bf4\u660e<\/h3>\n<p>\u4e91\u5b9e\u9a8c\u5ba4\u4e91\u4e3b\u673a\u81ea\u52a8\u4f7f\u7528<code>root<\/code>\u8d26\u6237\u767b\u5f55\u7cfb\u7edf\uff0c\u56e0\u6b64\u672c\u6559\u7a0b\u4e2d\u6240\u6709\u7684\u64cd\u4f5c\u90fd\u662f\u4ee5<code>root<\/code>\u7528\u6237\u6765\u6267\u884c\u7684\u3002\u82e5\u8981\u5728\u81ea\u5df1\u7684\u4e91\u4e3b\u673a\u4e0a\u8fdb\u884c\u672c\u6559\u7a0b\u7684\u5b9e\u9a8c\uff0c\u4e3a\u4e86\u7cfb\u7edf\u5b89\u5168\uff0c\u5efa\u8bae\u65b0\u5efa\u4e00\u4e2a\u8d26\u6237\u767b\u5f55\u540e\u518d\u8fdb\u884c\u540e\u7eed\u64cd\u4f5c\u3002<\/p>\n<h2 id=\"-ssh-\">\u5b89\u88c5 SSH \u5ba2\u6237\u7aef<\/h2>\n<blockquote><p>\u4efb\u52a1\u65f6\u95f4\uff1a1min ~ 5min<\/p><\/blockquote>\n<h3 id=\"-ssh\">\u5b89\u88c5SSH<\/h3>\n<p>\u5b89\u88c5SSH\uff1a<\/p>\n<pre><code>sudo yum install openssh-clients openssh-server\r\n<\/code><\/pre>\n<p>\u5b89\u88c5\u5b8c\u6210\u540e\uff0c\u53ef\u4ee5\u4f7f\u7528\u4e0b\u9762\u547d\u4ee4\u8fdb\u884c\u6d4b\u8bd5\uff1a<\/p>\n<pre><code>ssh localhost\r\n<\/code><\/pre>\n<p>\u8f93\u5165root\u8d26\u6237\u7684\u5bc6\u7801\uff0c\u5982\u679c\u53ef\u4ee5\u6b63\u5e38\u767b\u5f55\uff0c\u5219\u8bf4\u660eSSH\u5b89\u88c5\u6ca1\u6709\u95ee\u9898\u3002\u6d4b\u8bd5\u6b63\u5e38\u540e\u4f7f\u7528<code>exit<\/code>\u547d\u4ee4\u9000\u51fassh\u3002<\/p>\n<h2 id=\"-java-\">\u5b89\u88c5 JAVA \u73af\u5883<\/h2>\n<blockquote><p>\u4efb\u52a1\u65f6\u95f4\uff1a5min ~ 10min<\/p><\/blockquote>\n<h3 id=\"-jdk\">\u5b89\u88c5 JDK<\/h3>\n<p>\u4f7f\u7528yum\u6765\u5b89\u88c51.7\u7248\u672cOpenJDK\uff1a<\/p>\n<pre><code>sudo yum install java-1.7.0-openjdk java-1.7.0-openjdk-devel\r\n<\/code><\/pre>\n<p>\u5b89\u88c5\u5b8c\u6210\u540e\uff0c\u8f93\u5165<code>java<\/code>\u548c<code>javac<\/code>\u547d\u4ee4\uff0c\u5982\u679c\u80fd\u8f93\u51fa\u5bf9\u5e94\u7684\u547d\u4ee4\u5e2e\u52a9\uff0c\u5219\u8868\u660ejdk\u5df2\u6b63\u786e\u5b89\u88c5\u3002<\/p>\n<h3 id=\"-java-\">\u914d\u7f6e JAVA \u73af\u5883\u53d8\u91cf<\/h3>\n<p>\u6267\u884c\u547d\u4ee4:<\/p>\n<p><em>\u7f16\u8f91 ~\/.bashrc<\/em>\uff0c\u5728\u7ed3\u5c3e\u8ffd\u52a0\uff1a<\/p>\n<pre><code>export JAVA_HOME=\/usr\/lib\/jvm\/java-1.7.0-openjdk\r\n<\/code><\/pre>\n<p>\u4fdd\u5b58\u6587\u4ef6\u540e\u6267\u884c\u4e0b\u9762\u547d\u4ee4\u4f7fJAVA_HOME\u73af\u5883\u53d8\u91cf\u751f\u6548:<\/p>\n<pre><code>source ~\/.bashrc\r\n<\/code><\/pre>\n<p>\u4e3a\u4e86\u68c0\u6d4b\u7cfb\u7edf\u4e2dJAVA\u73af\u5883\u662f\u5426\u5df2\u7ecf\u6b63\u786e\u914d\u7f6e\u5e76\u751f\u6548\uff0c\u53ef\u4ee5\u5206\u522b\u6267\u884c\u4e0b\u9762\u547d\u4ee4:<\/p>\n<pre><code>java -version\r\n$JAVA_HOME\/bin\/java -version\r\n<\/code><\/pre>\n<p>\u82e5\u4e24\u6761\u547d\u4ee4\u8f93\u51fa\u7684\u7ed3\u679c\u4e00\u81f4\uff0c\u4e14\u90fd\u4e3a\u6211\u4eec\u524d\u9762\u5b89\u88c5\u7684openjdk-1.7.0\u7684\u7248\u672c\uff0c\u5219\u8868\u660eJDK\u73af\u5883\u5df2\u7ecf\u6b63\u786e\u5b89\u88c5\u5e76\u914d\u7f6e\u3002<\/p>\n<h2 id=\"-hadoop\">\u5b89\u88c5 Hadoop<\/h2>\n<blockquote><p>\u4efb\u52a1\u65f6\u95f4\uff1a10min ~ 15min<\/p><\/blockquote>\n<h3 id=\"-hadoop\">\u4e0b\u8f7d Hadoop<\/h3>\n<p>\u672c\u6559\u7a0b\u4f7f\u7528hadoop-2.7\u7248\u672c\uff0c\u4f7f\u7528wget\u5de5\u5177\u5728\u7ebf\u4e0b\u8f7d\uff08\u6ce8\uff1a\u672c\u6559\u7a0b\u662f\u4ece\u6e05\u534e\u5927\u5b66\u7684\u955c\u50cf\u6e90\u4e0b\u8f7d\uff0c\u5982\u679c\u4e0b\u8f7d\u5931\u8d25\u6216\u62a5\u9519\uff0c\u53ef\u4ee5\u81ea\u5df1\u5728\u7f51\u4e0a\u627e\u5230\u56fd\u5185\u5176\u4ed6\u4e00\u4e2a\u955c\u50cf\u6e90\u4e0b\u8f7d2.7\u7248\u672c\u7684hadoop\u5373\u53ef\uff09\uff1a<\/p>\n<pre><code>wget https:\/\/mirrors.tuna.tsinghua.edu.cn\/apache\/hadoop\/common\/hadoop-2.7.4\/hadoop-2.7.4.tar.gz\r\n<\/code><\/pre>\n<h3 id=\"-hadoop\">\u5b89\u88c5 Hadoop<\/h3>\n<p>\u5c06Hadoop\u5b89\u88c5\u5230\/usr\/local\u76ee\u5f55\u4e0b:<\/p>\n<pre><code>tar -zxf hadoop-2.7.4.tar.gz -C \/usr\/local\r\n<\/code><\/pre>\n<p>\u5bf9\u5b89\u88c5\u7684\u76ee\u5f55\u8fdb\u884c\u91cd\u547d\u540d\uff0c\u4fbf\u4e8e\u540e\u7eed\u64cd\u4f5c\u65b9\u4fbf:<\/p>\n<pre><code>cd \/usr\/local\r\nmv .\/hadoop-2.7.4\/ .\/hadoop\r\n<\/code><\/pre>\n<p>\u68c0\u67e5Hadoop\u662f\u5426\u5df2\u7ecf\u6b63\u786e\u5b89\u88c5:<\/p>\n<pre><code>\/usr\/local\/hadoop\/bin\/hadoop version\r\n<\/code><\/pre>\n<p>\u5982\u679c\u6210\u529f\u8f93\u51fahadoop\u7684\u7248\u672c\u4fe1\u606f\uff0c\u8868\u660ehadoop\u5df2\u7ecf\u6210\u529f\u5b89\u88c5\u3002<\/p>\n<h2 id=\"hadoop-\">Hadoop \u4f2a\u5206\u5e03\u5f0f\u73af\u5883\u914d\u7f6e<\/h2>\n<blockquote><p>\u4efb\u52a1\u65f6\u95f4\uff1a15min ~ 30min<\/p><\/blockquote>\n<p>Hadoop\u4f2a\u5206\u5e03\u5f0f\u6a21\u5f0f\u4f7f\u7528\u591a\u4e2a\u5b88\u62a4\u7ebf\u7a0b\u6a21\u62df\u5206\u5e03\u7684\u4f2a\u5206\u5e03\u8fd0\u884c\u6a21\u5f0f\u3002<\/p>\n<h3 id=\"-hadoop-\">\u8bbe\u7f6e Hadoop \u7684\u73af\u5883\u53d8\u91cf<\/h3>\n<p><em>\u7f16\u8f91 ~\/.bashrc<\/em>\uff0c\u5728\u7ed3\u5c3e\u8ffd\u52a0\u5982\u4e0b\u5185\u5bb9\uff1a<\/p>\n<pre><code>export HADOOP_HOME=\/usr\/local\/hadoop\r\nexport HADOOP_INSTALL=$HADOOP_HOME\r\nexport HADOOP_MAPRED_HOME=$HADOOP_HOME\r\nexport HADOOP_COMMON_HOME=$HADOOP_HOME\r\nexport HADOOP_HDFS_HOME=$HADOOP_HOME\r\nexport YARN_HOME=$HADOOP_HOME\r\nexport HADOOP_COMMON_LIB_NATIVE_DIR=$HADOOP_HOME\/lib\/native\r\nexport PATH=$PATH:$HADOOP_HOME\/sbin:$HADOOP_HOME\/bin\r\n<\/code><\/pre>\n<p>\u4f7fHadoop\u73af\u5883\u53d8\u91cf\u914d\u7f6e\u751f\u6548:<\/p>\n<pre><code>source ~\/.bashrc\r\n<\/code><\/pre>\n<h3 id=\"-hadoop-\">\u4fee\u6539 Hadoop \u7684\u914d\u7f6e\u6587\u4ef6<\/h3>\n<p>Hadoop\u7684\u914d\u7f6e\u6587\u4ef6\u4f4d\u4e8e\u5b89\u88c5\u76ee\u5f55\u7684\/etc\/hadoop\u76ee\u5f55\u4e0b\uff0c\u5728\u672c\u6559\u7a0b\u4e2d\u5373\u4f4d\u4e8e\/url\/local\/hadoop\/etc\/hadoop\u76ee\u5f55\u4e0b\uff0c\u9700\u8981\u4fee\u6539\u7684\u914d\u7f6e\u6587\u4ef6\u4e3a\u5982\u4e0b\u4e24\u4e2a:<\/p>\n<pre><code>\/usr\/local\/hadoop\/etc\/hadoop\/core-site.xml\r\n\/usr\/local\/hadoop\/etc\/hadoop\/hdfs-site.xml\r\n<\/code><\/pre>\n<p><em>\u7f16\u8f91 core-site.xml<\/em>\uff0c\u4fee\u6539<code>&lt;configuration&gt;&lt;\/configuration&gt;<\/code>\u8282\u70b9\u7684\u5185\u5bb9\u4e3a\u5982\u4e0b\u6240\u793a\uff1a<\/p>\n<h5 id=\"-usr-local-hadoop-etc-hadoop-core-site-xml\">\u793a\u4f8b\u4ee3\u7801\uff1a\/usr\/local\/hadoop\/etc\/hadoop\/core-site.xml<\/h5>\n<pre><code>&lt;configuration&gt;\r\n    &lt;property&gt;\r\n        &lt;name&gt;hadoop.tmp.dir&lt;\/name&gt;\r\n        &lt;value&gt;file:\/usr\/local\/hadoop\/tmp&lt;\/value&gt;\r\n        &lt;description&gt;location to store temporary files&lt;\/description&gt;\r\n    &lt;\/property&gt;\r\n    &lt;property&gt;\r\n        &lt;name&gt;fs.defaultFS&lt;\/name&gt;\r\n        &lt;value&gt;hdfs:\/\/localhost:9000&lt;\/value&gt;\r\n    &lt;\/property&gt;\r\n&lt;\/configuration&gt;\r\n<\/code><\/pre>\n<p>\u540c\u7406\uff0c<em>\u7f16\u8f91 hdfs-site.xml<\/em>\uff0c\u4fee\u6539<code>&lt;configuration&gt;&lt;\/configuration&gt;<\/code>\u8282\u70b9\u7684\u5185\u5bb9\u4e3a\u5982\u4e0b\u6240\u793a\uff1a<\/p>\n<h5 id=\"-usr-local-hadoop-etc-hadoop-hdfs-site-xml\">\u793a\u4f8b\u4ee3\u7801\uff1a\/usr\/local\/hadoop\/etc\/hadoop\/hdfs-site.xml<\/h5>\n<pre><code>&lt;configuration&gt;\r\n    &lt;property&gt;\r\n        &lt;name&gt;dfs.replication&lt;\/name&gt;\r\n        &lt;value&gt;1&lt;\/value&gt;\r\n    &lt;\/property&gt;\r\n    &lt;property&gt;\r\n        &lt;name&gt;dfs.namenode.name.dir&lt;\/name&gt;\r\n        &lt;value&gt;file:\/usr\/local\/hadoop\/tmp\/dfs\/name&lt;\/value&gt;\r\n    &lt;\/property&gt;\r\n    &lt;property&gt;\r\n        &lt;name&gt;dfs.datanode.data.dir&lt;\/name&gt;\r\n        &lt;value&gt;file:\/usr\/local\/hadoop\/tmp\/dfs\/data&lt;\/value&gt;\r\n    &lt;\/property&gt;\r\n&lt;\/configuration&gt;\r\n<\/code><\/pre>\n<h3 id=\"-namenode\">\u683c\u5f0f\u5316 NameNode<\/h3>\n<p>\u683c\u5f0f\u5316NameNode:<\/p>\n<pre><code>\/usr\/local\/hadoop\/bin\/hdfs namenode -format\r\n<\/code><\/pre>\n<p>\u5728\u8f93\u51fa\u4fe1\u606f\u4e2d\u770b\u5230\u5982\u4e0b\u4fe1\u606f\uff0c\u5219\u8868\u793a\u683c\u5f0f\u5316\u6210\u529f:<\/p>\n<pre><code>Storage directory \/usr\/local\/hadoop\/tmp\/dfs\/name has been successfully formatted.\r\nExiting with status 0\r\n<\/code><\/pre>\n<h3 id=\"-namenode-datanode-\">\u542f\u52a8 NameNode \u548c DataNode \u5b88\u62a4\u8fdb\u7a0b<\/h3>\n<p>\u542f\u52a8NameNode\u548cDataNode\u8fdb\u7a0b:<\/p>\n<pre><code>\/usr\/local\/hadoop\/sbin\/start-dfs.sh\r\n<\/code><\/pre>\n<p>\u6267\u884c\u8fc7\u7a0b\u4e2d\u4f1a\u63d0\u793a\u8f93\u5165\u7528\u6237\u5bc6\u7801\uff0c\u8f93\u5165root\u7528\u6237\u5bc6\u7801\u5373\u53ef\u3002\u53e6\u5916\uff0c\u542f\u52a8\u65f6ssh\u4f1a\u663e\u793a\u8b66\u544a\u63d0\u793a\u662f\u5426\u7ee7\u7eed\u8fde\u63a5\uff0c\u8f93\u5165yes\u5373\u53ef\u3002<\/p>\n<p>\u68c0\u67e5 NameNode \u548c DataNode \u662f\u5426\u6b63\u5e38\u542f\u52a8:<\/p>\n<pre><code>jps\r\n<\/code><\/pre>\n<p>\u5982\u679cNameNode\u548cDataNode\u5df2\u7ecf\u6b63\u5e38\u542f\u52a8\uff0c\u4f1a\u663e\u793aNameNode\u3001DataNode\u548cSecondaryNameNode\u7684\u8fdb\u7a0b\u4fe1\u606f:<\/p>\n<pre><code>[hadoop@VM_80_152_centos ~]$ jps\r\n3689 SecondaryNameNode\r\n3520 DataNode\r\n3800 Jps\r\n3393 NameNode\r\n<\/code><\/pre>\n<h2 id=\"-hadoop-\">\u8fd0\u884c Hadoop \u4f2a\u5206\u5e03\u5f0f\u5b9e\u4f8b<\/h2>\n<blockquote><p>\u4efb\u52a1\u65f6\u95f4\uff1a10min ~ 20min<\/p><\/blockquote>\n<p>Hadoop\u81ea\u5e26\u4e86\u4e30\u5bcc\u7684\u4f8b\u5b50\uff0c\u5305\u62ec wordcount\u3001grep\u3001sort \u7b49\u3002\u4e0b\u9762\u6211\u4eec\u5c06\u4ee5grep\u4f8b\u5b50\u4e3a\u6559\u7a0b\uff0c\u8f93\u5165\u4e00\u6279\u6587\u4ef6\uff0c\u4ece\u4e2d\u7b5b\u9009\u51fa\u7b26\u5408\u6b63\u5219\u8868\u8fbe\u5f0f<code>dfs[a-z.]+<\/code>\u7684\u5355\u8bcd\u5e76\u7edf\u8ba1\u51fa\u73b0\u7684\u6b21\u6570\u3002<\/p>\n<h3 id=\"-hadoop-\">\u67e5\u770b Hadoop \u81ea\u5e26\u7684\u4f8b\u5b50<\/h3>\n<p>Hadoop \u9644\u5e26\u4e86\u4e30\u5bcc\u7684\u4f8b\u5b50, \u6267\u884c\u4e0b\u9762\u547d\u4ee4\u53ef\u4ee5\u67e5\u770b\uff1a<\/p>\n<pre><code>cd \/usr\/local\/hadoop\r\n.\/bin\/hadoop jar .\/share\/hadoop\/mapreduce\/hadoop-mapreduce-examples-2.7.4.jar\r\n<\/code><\/pre>\n<h3 id=\"-hdfs-\">\u5728 HDFS \u4e2d\u521b\u5efa\u7528\u6237\u76ee\u5f55<\/h3>\n<p>\u5728 HDFS \u4e2d\u521b\u5efa\u7528\u6237\u76ee\u5f55 hadoop\uff1a<\/p>\n<pre><code>\/usr\/local\/hadoop\/bin\/hdfs dfs -mkdir -p \/user\/hadoop\r\n<\/code><\/pre>\n<h3 id=\"-\">\u51c6\u5907\u5b9e\u9a8c\u6570\u636e<\/h3>\n<p>\u672c\u6559\u7a0b\u4e2d\uff0c\u6211\u4eec\u5c06\u4ee5 Hadoop \u6240\u6709\u7684 xml \u914d\u7f6e\u6587\u4ef6\u4f5c\u4e3a\u8f93\u5165\u6570\u636e\u6765\u5b8c\u6210\u5b9e\u9a8c\u3002\u6267\u884c\u4e0b\u9762\u547d\u4ee4\u5728 HDFS \u4e2d\u65b0\u5efa\u4e00\u4e2a input \u6587\u4ef6\u5939\u5e76\u5c06 hadoop \u914d\u7f6e\u6587\u4ef6\u4e0a\u4f20\u5230\u8be5\u6587\u4ef6\u5939\u4e0b\uff1a<\/p>\n<pre><code>cd \/usr\/local\/hadoop\r\n.\/bin\/hdfs dfs -mkdir \/user\/hadoop\/input\r\n.\/bin\/hdfs dfs -put .\/etc\/hadoop\/*.xml \/user\/hadoop\/input\r\n<\/code><\/pre>\n<p>\u4f7f\u7528\u4e0b\u9762\u547d\u4ee4\u53ef\u4ee5\u67e5\u770b\u521a\u521a\u4e0a\u4f20\u5230 HDFS \u7684\u6587\u4ef6:<\/p>\n<pre><code>\/usr\/local\/hadoop\/bin\/hdfs dfs -ls \/user\/hadoop\/input\r\n<\/code><\/pre>\n<h3 id=\"-\">\u8fd0\u884c\u5b9e\u9a8c<\/h3>\n<p>\u8fd0\u884c\u5b9e\u9a8c:<\/p>\n<pre><code>cd \/usr\/local\/hadoop\r\n.\/bin\/hadoop jar .\/share\/hadoop\/mapreduce\/hadoop-mapreduce-examples-2.7.4.jar grep \/user\/hadoop\/input \/user\/hadoop\/output 'dfs[a-z.]+'\r\n<\/code><\/pre>\n<p>\u4e0a\u8ff0\u547d\u4ee4\u4ee5 HDFS \u6587\u4ef6\u7cfb\u7edf\u4e2d\u7684 input \u4e3a\u8f93\u5165\u6570\u636e\u6765\u8fd0\u884c Hadoop \u81ea\u5e26\u7684 grep \u7a0b\u5e8f\uff0c\u63d0\u53d6\u5176\u4e2d\u7b26\u5408\u6b63\u5219\u8868\u8fbe\u5f0f dfs[a-z.]+ \u7684\u6570\u636e\u5e76\u8fdb\u884c\u6b21\u6570\u7edf\u8ba1\uff0c\u5c06\u7ed3\u679c\u8f93\u51fa\u5230 HDFS \u6587\u4ef6\u7cfb\u7edf\u7684 output \u6587\u4ef6\u5939\u4e0b\u3002<\/p>\n<h3 id=\"-\">\u67e5\u770b\u8fd0\u884c\u7ed3\u679c<\/h3>\n<p>\u4e0a\u8ff0\u4f8b\u5b50\u5b8c\u6210\u540e\u7684\u7ed3\u679c\u4fdd\u5b58\u5728 HDFS \u4e2d\uff0c\u901a\u8fc7\u4e0b\u9762\u547d\u4ee4\u67e5\u770b\u7ed3\u679c:<\/p>\n<pre><code>\/usr\/local\/hadoop\/bin\/hdfs dfs -cat \/user\/hadoop\/output\/*\r\n<\/code><\/pre>\n<p>\u5982\u679c\u8fd0\u884c\u6210\u529f\uff0c\u53ef\u4ee5\u770b\u5230\u5982\u4e0b\u7ed3\u679c:<\/p>\n<pre><code>1       dfsadmin\r\n1       dfs.replication\r\n1       dfs.namenode.name.dir\r\n1       dfs.datanode.data.dir\r\n<\/code><\/pre>\n<h3 id=\"-hdfs-\">\u5220\u9664 HDFS \u4e0a\u7684\u8f93\u51fa\u7ed3\u679c<\/h3>\n<p>\u5220\u9664 HDFS \u4e2d\u7684\u7ed3\u679c\u76ee\u5f55:<\/p>\n<pre><code>\/usr\/local\/hadoop\/bin\/hdfs dfs -rm -r \/user\/hadoop\/output\r\n<\/code><\/pre>\n<p>\u8fd0\u884c Hadoop \u7a0b\u5e8f\u65f6\uff0c\u4e3a\u4e86\u9632\u6b62\u8986\u76d6\u7ed3\u679c\uff0c\u7a0b\u5e8f\u6307\u5b9a\u7684\u8f93\u51fa\u76ee\u5f55\u4e0d\u80fd\u5b58\u5728\uff0c\u5426\u5219\u4f1a\u63d0\u793a\u9519\u8bef\uff0c\u56e0\u6b64\u5728\u4e0b\u6b21\u8fd0\u884c\u524d\u9700\u8981\u5148\u5220\u9664\u8f93\u51fa\u76ee\u5f55\u3002<\/p>\n<h3 id=\"-hadoop-\">\u5173\u95ed Hadoop \u8fdb\u7a0b<\/h3>\n<p>\u5173\u95ed Hadoop \u8fdb\u7a0b\uff1a<\/p>\n<pre><code>\/usr\/local\/hadoop\/sbin\/stop-dfs.sh\r\n<\/code><\/pre>\n<p>\u518d\u8d77\u542f\u52a8\u53ea\u9700\u8981\u6267\u884c\u4e0b\u9762\u547d\u4ee4\uff1a<\/p>\n<pre><code>\/usr\/local\/hadoop\/sbin\/start-dfs.sh\r\n<\/code><\/pre>\n<h2 id=\"-\">\u90e8\u7f72\u5b8c\u6210<\/h2>\n<blockquote><p>\u4efb\u52a1\u65f6\u95f4\uff1a\u65f6\u95f4\u672a\u77e5<\/p><\/blockquote>\n<h3 id=\"-\">\u5927\u529f\u544a\u6210<\/h3>\n<p>\u606d\u559c\u60a8\u5df2\u7ecf\u5b8c\u6210\u4e86\u642d\u5efa Hadoop \u4f2a\u5206\u5e03\u5f0f\u73af\u5883\u7684\u5b66\u4e60<\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u8f6f\u786c\u4ef6\u73af\u5883 CentOS 7.2 64\u4f4d OpenJDK-1.7 Hadoop-2.7 \u5173\u4e8e\u672c\u6559\u7a0b\u7684\u8bf4\u660e \u4e91\u5b9e\u9a8c\u5ba4\u4e91\u4e3b\u673a\u81ea\u52a8\u4f7f\u7528root\u8d26\u6237\u767b\u5f55\u7cfb\u7edf\uff0c\u56e0\u6b64\u672c\u6559\u7a0b\u4e2d\u6240\u6709\u7684\u64cd\u4f5c\u90fd\u662f\u4ee5root\u7528\u6237\u6765\u6267\u884c\u7684\u3002\u82e5\u8981\u5728\u81ea\u5df1\u7684\u4e91\u4e3b\u673a\u4e0a\u8fdb\u884c\u672c\u6559\u7a0b\u7684\u5b9e\u9a8c\uff0c\u4e3a\u4e86\u7cfb\u7edf\u5b89\u5168\uff0c\u5efa\u8bae\u65b0\u5efa\u4e00\u4e2a\u8d26\u6237\u767b\u5f55\u540e\u518d\u8fdb\u884c\u540e\u7eed\u64cd\u4f5c\u3002 \u5b89\u88c5 SSH \u5ba2\u6237\u7aef \u4efb\u52a1\u65f6\u95f4\uff1a1min ~ 5min \u5b89\u88c5SSH \u5b89\u88c5SSH\uff1a sudo yum install openssh-clients openssh-server \u5b89\u88c5\u5b8c\u6210\u540e\uff0c\u53ef\u4ee5\u4f7f\u7528\u4e0b\u9762\u547d\u4ee4\u8fdb\u884c\u6d4b\u8bd5\uff1a ssh localhost \u8f93\u5165root\u8d26\u6237\u7684\u5bc6\u7801\uff0c\u5982\u679c\u53ef\u4ee5\u6b63\u5e38\u767b\u5f55\uff0c\u5219\u8bf4\u660eSSH\u5b89\u88c5\u6ca1\u6709\u95ee\u9898\u3002\u6d4b\u8bd5\u6b63\u5e38\u540e\u4f7f\u7528exit\u547d\u4ee4\u9000\u51fassh\u3002 \u5b89\u88c5 JAVA \u73af\u5883 \u4efb\u52a1\u65f6\u95f4\uff1a5min ~ 10min \u5b89\u88c5 JDK \u4f7f\u7528yum\u6765\u5b89\u88c51.7\u7248\u672cOpenJDK\uff1a sudo yum install java-1.7.0-openjdk java-1.7.0-openjdk-devel \u5b89\u88c5\u5b8c\u6210\u540e\uff0c\u8f93\u5165java\u548cjavac\u547d\u4ee4\uff0c\u5982\u679c\u80fd\u8f93\u51fa\u5bf9\u5e94\u7684\u547d\u4ee4\u5e2e\u52a9\uff0c\u5219\u8868\u660ejdk\u5df2\u6b63\u786e\u5b89\u88c5\u3002 \u914d\u7f6e JAVA \u73af\u5883\u53d8\u91cf \u6267\u884c\u547d\u4ee4: \u7f16\u8f91 ~\/.bashrc\uff0c\u5728\u7ed3\u5c3e\u8ffd\u52a0\uff1a export JAVA_HOME=\/usr\/lib\/jvm\/java-1.7.0-openjdk \u4fdd\u5b58\u6587\u4ef6\u540e\u6267\u884c\u4e0b\u9762\u547d\u4ee4\u4f7fJAVA_HOME\u73af\u5883\u53d8\u91cf\u751f\u6548: source ~\/.bashrc \u4e3a\u4e86\u68c0\u6d4b\u7cfb\u7edf\u4e2dJAVA\u73af\u5883\u662f\u5426\u5df2\u7ecf\u6b63\u786e\u914d\u7f6e\u5e76\u751f\u6548\uff0c\u53ef\u4ee5\u5206\u522b\u6267\u884c\u4e0b\u9762\u547d\u4ee4: java -version $JAVA_HOME\/bin\/java &hellip; <a href=\"https:\/\/www.strongd.net\/?p=1420\" class=\"more-link\">Continue reading <span class=\"screen-reader-text\">\u642d\u5efa Hadoop \u4f2a\u5206\u5e03\u5f0f\u73af\u5883<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1,6,11,20],"tags":[48],"class_list":["post-1420","post","type-post","status-publish","format-standard","hentry","category-java","category-linux","category-11","category-20","tag-hadoop"],"_links":{"self":[{"href":"https:\/\/www.strongd.net\/index.php?rest_route=\/wp\/v2\/posts\/1420","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.strongd.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.strongd.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.strongd.net\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.strongd.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1420"}],"version-history":[{"count":1,"href":"https:\/\/www.strongd.net\/index.php?rest_route=\/wp\/v2\/posts\/1420\/revisions"}],"predecessor-version":[{"id":1421,"href":"https:\/\/www.strongd.net\/index.php?rest_route=\/wp\/v2\/posts\/1420\/revisions\/1421"}],"wp:attachment":[{"href":"https:\/\/www.strongd.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1420"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.strongd.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1420"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.strongd.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1420"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}