文档详情

Windows环境搭建Haddop2.8.1.docx

发布:2019-02-19约2.74千字共13页下载文档
文本预览下载声明
Windows环境搭建Hadoop2.8.1 自动化部CIM 尹小义 2017-09-29 安装准备 Hadoop软件下载 Hadoop相关版本下载地址: HYPERLINK /releases.html /releases.html Hadoop2.8.1下载地址: HYPERLINK /dyn/closer.cgi/hadoop/common/hadoop-2.8.1/hadoop-2.8.1.tar.gz /dyn/closer.cgi/hadoop/common/hadoop-2.8.1/hadoop-2.8.1.tar.gz 如下图:点击任何一个链接下载即可。 JDK下载jdk-8u121-windows-x64,暂时不提供,网上自己搜索 HADOOP在Windows上运行的包 环境配置 Hadoop2.8.1下载解压到本地,改名为HADOOP,解压后的机构如下图 环境变量配置HADOOP_HOME=D:\hadoop; 修改PATH,增加HADOOP的Bin,为DOS窗口执行命令 安装jdk-8u121-windows-x64,安装位置不要选择默认C:\Program Files\Java,因为路径之间有空格,hadoop启动的时候会报错,我安装在了D:\app\JAVA,配置JAVA_HOME. 也可以修改:D:\hadoop\etc\hadoop目录下的haoop-env.cmd 将下载的压缩包hadoop-utils解压,拷贝 hadoop.dll,winutils到D:\hadoop\bin,hadoop.dll等文件不要与hadoop冲突。为了不出现依赖性错误可以将hadoop.dll放到c:/windows/System32下一份。 hadoop环境测试,起一个cmd窗口,输入java –version, hadoop version,显示如下: Hadoop配置文件修改,打开hadoop/etc/hadoop下文件core-site.xml / hdfs-site.xml / mapred-site.xml / yarn-site.xml,修改 Core-site.xml configuration???? ???property???? ???????namefs.defaultFS/name???? ???????valuehdfs://localhost:9000/value???? ???/property?? /configuration?? hdfs-site.xml: configuration???? ???????property???? ???????????????namedfs.replication/name???? ????????????????value1/value???? ???????/property???? ???????property???? ????????????????name.dir/name???? ???????????????valuefile:/hadoop/hadoop2017/data/dfs/namenode/value???? ???????/property???? ???????property???? ???????????????namedfs.datanode.data.dir/name???? ???????????????valuefile:/hadoop/hadoop2017/data/dfs/datanode/value???? ???????/property? ??/configuration?? mapred-site.xml:没有,可以把mapred-site.xml.template重命名为mapred-site.xml configuration???? ???????property???? ??????????name/name???? ??????????valueyarn/value???? ???????/property???? /configuration???? yarn-site.xml:???? configuration???? ???????property???? ??????????nameyarn.nodemanager.aux-services/name???? ??????????valuemapreduce_shuffle/value???? ???????/property???? ???????property???? ??????????nameyarn.nodemanager.aux-s
显示全部
相似文档