AWS-CDH5.5安装-软件下载

2023-02-14,,,

1.下载安装介质

下载CM安装文件:

[root@ip---- cm5.5.0]# wget -c -r -nd -np -k -L -A rpm http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/
---- ::-- http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/
Resolving archive-primary.cloudera.com... 54.237.90.33
Connecting to archive-primary.cloudera.com|54.237.90.33|:... connected.
HTTP request sent, awaiting response... OK
Length: (.8K) [text/html]
Saving to: ?.ndex.html? %[=====================================================================================================================================================================>] , --.-K/s in 0s -- :: ( MB/s) - ?.ndex.html?.saved [/] Loading robots.txt; please ignore errors.
---- ::-- http://archive-primary.cloudera.com/robots.txt
Reusing existing connection to archive-primary.cloudera.com:.
HTTP request sent, awaiting response... Not Found
-- :: ERROR : Not Found. Removing index.html since it should be rejected. ---- ::-- http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=N;O=D
Reusing existing connection to archive-primary.cloudera.com:.
HTTP request sent, awaiting response... OK
Length: (.8K) [text/html]
Saving to: ?.ndex.html?C=N;O=D? %[=====================================================================================================================================================================>] , --.-K/s in 0s -- :: ( MB/s) - ?.ndex.html?C=N;O=D?.saved [/] Removing index.html?C=N;O=D since it should be rejected. ---- ::-- http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=M;O=A
Reusing existing connection to archive-primary.cloudera.com:.
HTTP request sent, awaiting response... OK
Length: (.8K) [text/html]
Saving to: ?.ndex.html?C=M;O=A? %[=====================================================================================================================================================================>] , --.-K/s in 0s -- :: ( MB/s) - ?.ndex.html?C=M;O=A?.saved [/] Removing index.html?C=M;O=A since it should be rejected. ---- ::-- http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=S;O=A
Reusing existing connection to archive-primary.cloudera.com:.
HTTP request sent, awaiting response... OK
Length: (.8K) [text/html]
Saving to: ?.ndex.html?C=S;O=A? %[=====================================================================================================================================================================>] , --.-K/s in 0s -- :: ( MB/s) - ?.ndex.html?C=S;O=A?.saved [/] Removing index.html?C=S;O=A since it should be rejected. ---- ::-- http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=D;O=A
Reusing existing connection to archive-primary.cloudera.com:.
HTTP request sent, awaiting response... OK
Length: (.8K) [text/html]
Saving to: ?.ndex.html?C=D;O=A? %[=====================================================================================================================================================================>] , --.-K/s in 0s -- :: ( MB/s) - ?.ndex.html?C=D;O=A?.saved [/] Removing index.html?C=D;O=A since it should be rejected. ---- ::-- http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/cloudera-manager-agent-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
Reusing existing connection to archive-primary.cloudera.com:.
HTTP request sent, awaiting response... OK
Length: (4.7M) [application/x-redhat-package-manager]
Saving to: ?.loudera-manager-agent-5.5.-.cm550.p0..el6.x86_64.rpm? %[=====================================================================================================================================================================>] ,, 3.09M/s in .5s -- :: (3.09 MB/s) - ?.loudera-manager-agent-5.5.-.cm550.p0..el6.x86_64.rpm?.saved [/] ---- ::-- http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/cloudera-manager-daemons-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
Reusing existing connection to archive-primary.cloudera.com:.
HTTP request sent, awaiting response... OK
Length: (509M) [application/x-redhat-package-manager]
Saving to: ?.loudera-manager-daemons-5.5.-.cm550.p0..el6.x86_64.rpm? %[=====================================================================================================================================================================>] ,, 3.90M/s in 1m 58s -- :: (4.30 MB/s) - ?.loudera-manager-daemons-5.5.-.cm550.p0..el6.x86_64.rpm?.saved [/] ---- ::-- http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/cloudera-manager-server-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
Reusing existing connection to archive-primary.cloudera.com:.
HTTP request sent, awaiting response... OK
Length: (.2K) [application/x-redhat-package-manager]
Saving to: ?.loudera-manager-server-5.5.-.cm550.p0..el6.x86_64.rpm? %[=====================================================================================================================================================================>] , --.-K/s in 0s -- :: ( MB/s) - ?.loudera-manager-server-5.5.-.cm550.p0..el6.x86_64.rpm?.saved [/] ---- ::-- http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/cloudera-manager-server-db-2-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
Reusing existing connection to archive-primary.cloudera.com:.
HTTP request sent, awaiting response... OK
Length: (.9K) [application/x-redhat-package-manager]
Saving to: ?.loudera-manager-server-db--5.5.-.cm550.p0..el6.x86_64.rpm? %[=====================================================================================================================================================================>] , --.-K/s in 0s -- :: ( MB/s) - ?.loudera-manager-server-db--5.5.-.cm550.p0..el6.x86_64.rpm?.saved [/] ---- ::-- http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/enterprise-debuginfo-5.5.0-1.cm550.p0.61.el6.x86_64.rpm
Reusing existing connection to archive-primary.cloudera.com:.
HTTP request sent, awaiting response... OK
Length: (957K) [application/x-redhat-package-manager]
Saving to: ?.nterprise-debuginfo-5.5.-.cm550.p0..el6.x86_64.rpm? %[=====================================================================================================================================================================>] , 4.88M/s in .2s -- :: (4.88 MB/s) - ?.nterprise-debuginfo-5.5.-.cm550.p0..el6.x86_64.rpm?.saved [/] ---- ::-- http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/jdk-6u31-linux-amd64.rpm
Reusing existing connection to archive-primary.cloudera.com:.
HTTP request sent, awaiting response... OK
Length: (68M) [application/x-redhat-package-manager]
Saving to: ?.dk-6u31-linux-amd64.rpm? %[=====================================================================================================================================================================>] ,, 4.58M/s in 15s -- :: (4.39 MB/s) - ?.dk-6u31-linux-amd64.rpm?.saved [/] ---- ::-- http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/oracle-j2sdk1.7-1.7.0+update67-1.x86_64.rpm
Reusing existing connection to archive-primary.cloudera.com:.
HTTP request sent, awaiting response... OK
Length: (135M) [application/x-redhat-package-manager]
Saving to: ?.racle-j2sdk1.-1.7.+update67-.x86_64.rpm? %[=====================================================================================================================================================================>] ,, 4.59M/s in 30s -- :: (4.58 MB/s) - ?.racle-j2sdk1.-1.7.+update67-.x86_64.rpm?.saved [/] ---- ::-- http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=N;O=A
Reusing existing connection to archive-primary.cloudera.com:.
HTTP request sent, awaiting response... OK
Length: (.8K) [text/html]
Saving to: ?.ndex.html?C=N;O=A? %[=====================================================================================================================================================================>] , --.-K/s in 0s -- :: ( MB/s) - ?.ndex.html?C=N;O=A?.saved [/] Removing index.html?C=N;O=A since it should be rejected. ---- ::-- http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=M;O=D
Reusing existing connection to archive-primary.cloudera.com:.
HTTP request sent, awaiting response... OK
Length: (.8K) [text/html]
Saving to: ?.ndex.html?C=M;O=D? %[=====================================================================================================================================================================>] , --.-K/s in 0s -- :: ( MB/s) - ?.ndex.html?C=M;O=D?.saved [/] Removing index.html?C=M;O=D since it should be rejected. ---- ::-- http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=S;O=D
Reusing existing connection to archive-primary.cloudera.com:.
HTTP request sent, awaiting response... OK
Length: (.8K) [text/html]
Saving to: ?.ndex.html?C=S;O=D? %[=====================================================================================================================================================================>] , --.-K/s in 0s -- :: ( MB/s) - ?.ndex.html?C=S;O=D?.saved [/] Removing index.html?C=S;O=D since it should be rejected. ---- ::-- http://archive-primary.cloudera.com/cm5/redhat/6/x86_64/cm/5/RPMS/x86_64/?C=D;O=D
Reusing existing connection to archive-primary.cloudera.com:.
HTTP request sent, awaiting response... OK
Length: (.8K) [text/html]
Saving to: ?.ndex.html?C=D;O=D? %[=====================================================================================================================================================================>] , --.-K/s in 0s -- :: ( MB/s) - ?.ndex.html?C=D;O=D?.saved [/] Removing index.html?C=D;O=D since it should be rejected. FINISHED ---- ::--
Downloaded: files, 718M in 2m 45s (4.35 MB/s)
Converted files in seconds.
[root@ip---- cm5.5.0]#

检查下载文件与官网大小是否一致,经常会发生在传输过程中出差,所以务必要检查您的安装文件和Cloudera官网上的大小一致:

[root@ip---- cm5.5.0]# ls -l
total
-rw-r--r-- root root Nov : cloudera-manager-agent-5.5.-.cm550.p0..el6.x86_64.rpm
-rw-r--r-- root root Nov : cloudera-manager-daemons-5.5.-.cm550.p0..el6.x86_64.rpm
-rw-r--r-- root root Nov : cloudera-manager-server-5.5.-.cm550.p0..el6.x86_64.rpm
-rw-r--r-- root root Nov : cloudera-manager-server-db--5.5.-.cm550.p0..el6.x86_64.rpm
-rw-r--r-- root root Nov : enterprise-debuginfo-5.5.-.cm550.p0..el6.x86_64.rpm
-rw-r--r-- root root Nov : jdk-6u31-linux-amd64.rpm
-rw-r--r-- root root Nov : oracle-j2sdk1.-1.7.+update67-.x86_64.rpm

2.下载CDH parcel及manifest文件:

[root@ip-172-31-30-175 cdh5.5.0]# wget http://archive-primary.cloudera.com/cdh5/parcels/5.5/CDH-5.5.0-1.cdh5.5.0.p0.8-el6.parcel
--2015-12-01 08:08:43-- http://archive-primary.cloudera.com/cdh5/parcels/5.5/CDH-5.5.0-1.cdh5.5.0.p0.8-el6.parcel
Resolving archive-primary.cloudera.com... 54.237.90.33
Connecting to archive-primary.cloudera.com|54.237.90.33|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 1485836821 (1.4G)
Saving to: ?.DH-5.5.0-1.cdh5.5.0.p0.8-el6.parcel?

100%[===================================================================================================================================================================>] 1,485,836,821 5.26M/s in 4m 44s

2015-12-01 08:13:27 (5.00 MB/s) - ?.DH-5.5.0-1.cdh5.5.0.p0.8-el6.parcel?.saved [1485836821/1485836821]

[root@ip-172-31-30-175 cdh5.5.0]# wget http://archive-primary.cloudera.com/cdh5/parcels/5.5/manifest.json
--2015-12-01 08:16:29-- http://archive-primary.cloudera.com/cdh5/parcels/5.5/manifest.json
Resolving archive-primary.cloudera.com... 54.237.90.33
Connecting to archive-primary.cloudera.com|54.237.90.33|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 49710 (49K) [application/json]
Saving to: ?.anifest.json?

100%[=====================================================================================================================================================================>] 49,710 --.-K/s in 0.1s

2015-12-01 08:16:30 (347 KB/s) - ?.anifest.json?.saved [49710/49710]

检查文件大小:

[root@ip---- cdh5.5.0]# ll
total
-rw-r--r-- root root Nov : CDH-5.5.-.cdh5.5.0.p0.-el6.parcel
-rw-r--r-- root root Nov : manifest.json
[root@ip---- cdh5.5.0]#

3.下载MySQL5.6和JDBC Driver

[root@ip---- cloudera]# wget http://dev.mysql.com/get/Downloads/MySQL-5.6/MySQL-server-5.6.27-1.el6.x86_64.rpm
---- ::-- http://dev.mysql.com/get/Downloads/MySQL-5.6/MySQL-server-5.6.27-1.el6.x86_64.rpm
Resolving dev.mysql.com... 137.254.60.11
Connecting to dev.mysql.com|137.254.60.11|:... connected.
HTTP request sent, awaiting response... Found
Location: http://cdn.mysql.com//Downloads/MySQL-5.6/MySQL-server-5.6.27-1.el6.x86_64.rpm [following]
---- ::-- http://cdn.mysql.com//Downloads/MySQL-5.6/MySQL-server-5.6.27-1.el6.x86_64.rpm
Resolving cdn.mysql.com... 23.198.164.152
Connecting to cdn.mysql.com|23.198.164.152|:... connected.
HTTP request sent, awaiting response... OK
Length: (53M) [application/x-redhat-package-manager]
Saving to: ?.ySQL-server-5.6.-.el6.x86_64.rpm? %[=====================================================================================================================================================================>] ,, 4.98M/s in 11s -- :: (5.08 MB/s) - ?.ySQL-server-5.6.-.el6.x86_64.rpm?.saved [/]

[root@ip-172-31-30-175 mysql]# wget http://dev.mysql.com/get/Downloads/MySQL-5.6/MySQL-client-5.6.27-1.el6.x86_64.rpm
--2015-12-01 08:24:01-- http://dev.mysql.com/get/Downloads/MySQL-5.6/MySQL-client-5.6.27-1.el6.x86_64.rpm
Resolving dev.mysql.com... 137.254.60.11
Connecting to dev.mysql.com|137.254.60.11|:80... connected.
HTTP request sent, awaiting response... 302 Found
Location: http://cdn.mysql.com//Downloads/MySQL-5.6/MySQL-client-5.6.27-1.el6.x86_64.rpm [following]
--2015-12-01 08:24:01-- http://cdn.mysql.com//Downloads/MySQL-5.6/MySQL-client-5.6.27-1.el6.x86_64.rpm
Resolving cdn.mysql.com... 23.198.164.152
Connecting to cdn.mysql.com|23.198.164.152|:80... connected.
HTTP request sent, awaiting response... 200 OK
Length: 18596528 (18M) [application/x-redhat-package-manager]
Saving to: ?.ySQL-client-5.6.27-1.el6.x86_64.rpm?

100%[=====================================================================================================================================================================>] 18,596,528 15.5M/s in 1.1s

2015-12-01 08:24:03 (15.5 MB/s) - ?.ySQL-client-5.6.27-1.el6.x86_64.rpm?.saved [18596528/18596528]

[root@ip---- mysql]# wget http://dev.mysql.com/get/Downloads/Connector-J/mysql-connector-java-5.1.37.tar.gz
---- ::-- http://dev.mysql.com/get/Downloads/Connector-J/mysql-connector-java-5.1.37.tar.gz
Resolving dev.mysql.com... 137.254.60.11
Connecting to dev.mysql.com|137.254.60.11|:... connected.
HTTP request sent, awaiting response... Found
Location: http://cdn.mysql.com//Downloads/Connector-J/mysql-connector-java-5.1.37.tar.gz [following]
---- ::-- http://cdn.mysql.com//Downloads/Connector-J/mysql-connector-java-5.1.37.tar.gz
Resolving cdn.mysql.com... 23.198.164.152
Connecting to cdn.mysql.com|23.198.164.152|:... connected.
HTTP request sent, awaiting response... OK
Length: (3.7M) [application/x-tar-gz]
Saving to: ?.ysql-connector-java-5.1..tar.gz? %[=====================================================================================================================================================================>] ,, --.-K/s in .1s -- :: (29.7 MB/s) - ?.ysql-connector-java-5.1..tar.gz?.saved [/]

检查大小:

[root@ip-172-31-30-175 mysql]# ll
total 76644
-rw-r--r-- 1 root root 18596528 Sep 21 16:32 MySQL-client-5.6.27-1.el6.x86_64.rpm
-rw-r--r-- 1 root root 3928553 Oct 6 13:24 mysql-connector-java-5.1.37.tar.gz
-rw-r--r-- 1 root root 55950588 Sep 21 16:33 MySQL-server-5.6.27-1.el6.x86_64.rpm

注意:这里还需要下载两个文件:MySQL-devel-5.6.27-1.el6.x86_64.rpm  MySQL-shared-compat-5.6.27-1.el6.x86_64.rpm,最后的文件目录应该如下:

[root@ip---- mysql]# ls
MySQL-client-5.6.-.el6.x86_64.rpm mysql-connector-java-5.1..zip MySQL-server-5.6.-.el6.x86_64.rpm
mysql-connector-java-5.1. MySQL-devel-5.6.-.el6.x86_64.rpm MySQL-shared-compat-5.6.-.el6.x86_64.rpm

AWS-CDH5.5安装-软件下载的相关教程结束。

《AWS-CDH5.5安装-软件下载.doc》

下载本文的Word格式文档,以方便收藏与打印。