基于HDP的Hadoop部署文档.docx

基于HDP的Hadoop部署文档前期准备：1.机器Centos6.5服务器版2.组件及机器配置cloud-vm1.hadoopcloud-vm2.hadoopcloud-vm3.hadoopcloud-vm4.hadoopcloud-vm5.hadoop安装1.创建虚拟机分区：fdisk -l ?查看磁盘已有的分区1.对sda进行分区操作，输入：fdisk /dev/sda输入n ?创建新的分区输入p ?创建主分区，原来已经有了2个，需要从第三个开始 ，cylinder也需要从第二块末尾算起。分区后 输入 w，这里会有个警告，需要重启生效2.输入reboot3.开机后进行格式化mke2fs -t ext4 /dev/vda34.写入/etc/fstab/dev/vda3 ? ? ? /hadoop ext4 ? ?defaults ? ? ? ?0 0?5.最后一步 挂载mount –a2.配置ip：eth0 DEVICE=eth0HWADDR=FA:16:3E:0a:c7:ccTYPE=EthernetUUID=759e33ba-6eb7-4163-baf2-0c5b64cadb6cONBOOT=yesNM_CONTROLLED=yesBOOTPROTO=staticIPADDR=69NETMASK=GATEWAY=3.配置hosts 68 cloud-vm1.hadoop69 cloud-vm2.hadoop7 cloud-vm3.hadoop70 cloud-vm4.hadoop71 cloud-vm5.hadoop4.配置/etc/sysconfig/network HOSTNAME=cloud-vm1.hadoop5.配置/etc/selinux/config SELINUX=disabled6.配置/etc/resolv.conf nameserver 7.配置源 Ambari：ambari.repo [Ambari]name=localbaseurl=27/hadoop/gpgcheck=0priority=1hdp：HDP.repo[HDP-2.4]name=HDP-2.4baseurl=27/hadoop/HDP/centos6/2.x/updates/path=/enabled=1gpgcheck=0HDP-UTILS.repo[HDP-UTILS-0]name=HDP-UTILS-0baseurl=27/hadoop/HDP-UTILS-0/repos/centos6path=/enabled=1gpgcheck=08.管理防火墙 service iptables stopservice ip6tables stop chkconfig iptables offchkconfig ip6tables off9.ntp控制节点：[root@Control1 ~]# yum install -y ntp[root@Control1 ~]# vi /etc/ntp.conf注销如下几行：结尾添加如下：server iburstrestrict mask 55 nomodify notrapFudge stratum 10Broadcastdelay 0.008[root@Control1 ~]# service ntpd start[root@Control1 ~]# chkconfig?ntpd?on计算节点：[root@Computer1 ~]# yum install -y ntp[root@Computer1 ~]# vi /etc/ntp.conf将服务器地址修改为控制节点服务器IP。server 71 iburst[root@Control1 ~]# service ntpd start[root@Control1 ~]# chkconfig?ntpd?on测试：ntpdate -d 71 调试同步时间ntpdate -u 71 同步时间10.ssh免密码登录 1. ssh-keygen -t rsa2. cat /root/.ssh/id_rsa.pub /root/.ssh/authorized_keys3. ssh-copy-id hdp-slave111.升级openssl 1.查看：openssl rpm -qa | grep opensslopenssl-1.0.1e-15.el6.x86_642.如果是15，要升级到16yum upgrade openssl12.jdk chmod –R 777 /hadoop vi /etc/profileexport JAVA_HOME=/hadoop/jdk1.7.0_79export CLASSPATH=.:$JAVA_HOME