CentOS7下編譯Hadoop-2.7.6

来源:https://www.cnblogs.com/zhanglianghhh/archive/2018/06/08/9157882.html
-Advertisement-
Play Games

1. 使用系統和軟體 2. 必要的包安裝 3. 安裝Jdk【java8】 3.1. 軟體安裝 3.2. 環境變數 4. 安裝maven 4.1. 軟體安裝 4.2. 環境變數 5. 安裝ant 5.1. 軟體安裝 5.2. 環境變數 6. 安裝findbugs 6.1. 軟體安裝 6.2. 環境變數 ...


 

1. 使用系統和軟體

操作系統:CentOS Linux release 7.4.1708 (Core)   64位
使用軟體如下:
jdk1.8.0_112.tar.gz
hadoop-2.7.6-src.tar.gz	
apache-ant-1.9.11-bin.tar.gz
apache-maven-3.5.3-bin.tar.gz
findbugs-3.0.1.tar.gz
protobuf-2.5.0.tar.gz

 

2. 必要的包安裝

[root@mini05 ~]# yum install -y cmake 
[root@mini05 ~]# yum install -y openssl-devel 
[root@mini05 ~]# yum install -y ncurses-devel 

  

3. 安裝Jdk【java8】

3.1.  軟體安裝

[root@mini05 software]# pwd
/app/software
[root@mini05 software]# tar xf jdk1.8.0_112.tar.gz 
[root@mini05 software]# ll
total 201392
drwxr-xr-x 8   10  143      4096 Dec 20 13:27 jdk1.8.0_112
-rw-r--r-- 1 root root 189815615 Mar 12 16:47 jdk1.8.0_112.tar.gz
[root@mini05 software]# mv jdk1.8.0_112/ /app/
[root@mini05 software]# cd /app/
[root@mini05 app]# ln -s jdk1.8.0_112/ jdk
[root@mini05 app]# ll
total 8
lrwxrwxrwx  1 root root    13 May 16 23:19 jdk -> jdk1.8.0_112/
drwxr-xr-x  8   10   143 4096 Dec 20 13:27 jdk1.8.0_112

  

3.2.  環境變數

[root@mini05 ~]$ pwd
/app
[root@mini05 ~]$ ll -d jdk*  # 可以根據實際情況選擇jdk版本,其中jdk1.8 可以相容 jdk1.7   
lrwxrwxrwx 1 yun yun   11 Mar 15 14:58 jdk -> jdk1.8.0_112
drwxr-xr-x 8 yun yun 4096 Dec 20 13:27 jdk1.8.0_112
[root@mini05 profile.d]$ pwd
/etc/profile.d
[root@mini05 profile.d]$ cat jdk.sh # java環境變數   
export JAVA_HOME=/app/jdk
export JRE_HOME=/app/jdk/jre
export CLASSPATH=.:$JAVA_HOME/lib/dt.jar:$JAVA_HOME/lib/tools.jar:$JRE_HOME/lib:$CLASSPATH
export PATH=$JAVA_HOME/bin:$PATH

[root@mini05 profile.d]# source /etc/profile
[root@mini05 profile.d]$ java -version  
java version "1.8.0_112"
Java(TM) SE Runtime Environment (build 1.8.0_112-b15)
Java HotSpot(TM) 64-Bit Server VM (build 25.112-b15, mixed mode)

  

4. 安裝maven

4.1.  軟體安裝

[root@mini05 software]# pwd
/app/software 
[root@mini05 software]# tar xf apache-maven-3.5.3-bin.tar.gz 
[root@mini05 software]# mv apache-maven-3.5.3 /app/ 
[root@mini05 software]# cd /app/
[root@mini05 app]# ln -s apache-maven-3.5.3 maven
[root@mini05 app]# ll
total 0
drwxr-xr-x 6 root root  99 Jun  8 10:18 apache-maven-3.5.3
lrwxrwxrwx 1 yun  yun   13 Jun  7 22:49 jdk -> jdk1.8.0_112/
drwxr-xr-x 8 yun  yun  255 Sep 23  2016 jdk1.8.0_112
lrwxrwxrwx 1 root root  18 Jun  8 10:19 maven -> apache-maven-3.5.3
drwxrwxr-x 2 yun  yun  222 Jun  8 10:18 software

  

4.2.  環境變數

[root@mini05 profile.d]# pwd
/etc/profile.d
[root@mini05 profile.d]# cat maven.sh 
export MAVEN_HOME=/app/maven/
export PATH=$MAVEN_HOME/bin:$PATH

[root@mini05 profile.d]# source /etc/profile 
[root@mini05 profile.d]# mvn -v  
Apache Maven 3.5.3 (3383c37e1f9e9b3bc3df5050c29c8aff9f295297; 2018-02-25T03:49:05+08:00)
Maven home: /app/maven
Java version: 1.8.0_112, vendor: Oracle Corporation
Java home: /app/jdk1.8.0_112/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux", version: "3.10.0-693.el7.x86_64", arch: "amd64", family: "unix"

  

5. 安裝ant

5.1.  軟體安裝

[root@mini05 software]# pwd
/app/software
[root@mini05 software]# tar xf apache-ant-1.9.11-bin.tar.gz  
[root@mini05 software]# mv apache-ant-1.9.11 /app/ 
[root@mini05 app]# ln -s apache-ant-1.9.11 ant  
[root@mini05 app]# ll
total 0
lrwxrwxrwx 1 root root  17 Jun  8 10:38 ant -> apache-ant-1.9.11
drwxr-xr-x 6 root root 235 Mar 24 01:08 apache-ant-1.9.11
drwxr-xr-x 6 root root  99 Jun  8 10:18 apache-maven-3.5.3
lrwxrwxrwx 1 yun  yun   13 Jun  7 22:49 jdk -> jdk1.8.0_112/
drwxr-xr-x 8 yun  yun  255 Sep 23  2016 jdk1.8.0_112
lrwxrwxrwx 1 root root  18 Jun  8 10:19 maven -> apache-maven-3.5.3
drwxrwxr-x 2 yun  yun  222 Jun  8 10:18 software

  

5.2.  環境變數

[root@mini05 profile.d]# pwd
/etc/profile.d 
[root@mini05 profile.d]# vim ant.sh 
export ANT_HOME="/app/ant"
export PATH=$ANT_HOME/bin:$PATH

[root@mini05 profile.d]# source /etc/profile  
[root@mini05 profile.d]# ant -version   
Apache Ant(TM) version 1.9.11 compiled on March 23 2018

  

6. 安裝findbugs

6.1.  軟體安裝

[root@mini05 software]# pwd
/app/software
[root@mini05 software]# tar xf findbugs-3.0.1.tar.gz 
[root@mini05 software]# mv findbugs-3.0.1 /app/
[root@mini05 software]# cd /app/
[root@mini05 app]# ln -s findbugs-3.0.1/ findbugs  
[root@mini05 app]# ll
total 0
lrwxrwxrwx 1 root root  17 Jun  8 10:38 ant -> apache-ant-1.9.11
drwxr-xr-x 6 root root 235 Mar 24 01:08 apache-ant-1.9.11
drwxr-xr-x 6 root root  99 Jun  8 10:18 apache-maven-3.5.3
lrwxrwxrwx 1 root root  15 Jun  8 11:01 findbugs -> findbugs-3.0.1/
drwxr-xr-x 8 root root 104 Jun  8 11:00 findbugs-3.0.1
lrwxrwxrwx 1 yun  yun   13 Jun  7 22:49 jdk -> jdk1.8.0_112/
drwxr-xr-x 8 yun  yun  255 Sep 23  2016 jdk1.8.0_112
lrwxrwxrwx 1 root root  18 Jun  8 10:19 maven -> apache-maven-3.5.3
drwxrwxr-x 2 yun  yun  222 Jun  8 11:01 software

  

6.2.  環境變數

[root@mini05 profile.d]# pwd
/etc/profile.d
[root@mini05 profile.d]# cat findbugs.sh 
export FINDBUGS_HOME="/app/findbugs"
export PATH=$FINDBUGS_HOME/bin:$PATH

[root@mini05 profile.d]# source /etc/profile  
[root@mini05 profile.d]# findbugs -version   
3.0.1

  

7. 安裝protobuf

# 不能使用 protobuf-2.6.1.tar.gz 會出錯 
[root@mini05 software]# pwd
/app/software
[root@mini05 software]# tar xf protobuf-2.5.0.tar.gz  
[root@mini05 software]# cd protobuf-2.5.0/ 
[root@mini05 protobuf-2.5.0]# pwd
/app/software/protobuf-2.5.0
[root@mini05 protobuf-2.6.1]# ./configure 
………………
[root@mini05 protobuf-2.6.1]# make  
………………
[root@mini05 protobuf-2.6.1]# make install 
………………
[root@mini05 protobuf-2.6.1]# protoc --version  
libprotoc 2.5.0

  

8. 編譯Hadoop

8.1.  編譯Hadoop

 

[root@mini05 software]# pwd
/app/software
[root@mini05 software]# tar xf  hadoop-2.7.6-src.tar.gz 
[root@mini05 software]# cd hadoop-2.7.6-src/ 
[root@mini05 hadoop-2.7.6-src]# pwd
/app/software/hadoop-2.7.6-src
[root@mini05 hadoop-2.7.6-src]# mvn clean install -DskipTests  # clean 參數可以省略 
………………
### 持續時間較長,中間也有可能一直卡主,如果卡主那麼Ctrl+C 之後再執行即可。總過程可能會有多次卡主那麼中斷後再執行該命令。 
………………………………
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop Main 2.7.6 ........................... SUCCESS [  1.098 s]
[INFO] Apache Hadoop Build Tools .......................... SUCCESS [  1.151 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [  0.851 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [  0.390 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [  0.298 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [  0.158 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [  1.494 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [  3.178 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [  1.902 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [  0.916 s]
[INFO] Apache Hadoop Common ............................... SUCCESS [ 38.980 s]
[INFO] Apache Hadoop NFS .................................. SUCCESS [  1.097 s]
[INFO] Apache Hadoop KMS .................................. SUCCESS [ 13.255 s]
[INFO] Apache Hadoop Common Project ....................... SUCCESS [  0.099 s]
[INFO] Apache Hadoop HDFS ................................. SUCCESS [ 57.047 s]
[INFO] Apache Hadoop HttpFS ............................... SUCCESS [  7.958 s]
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SUCCESS [ 49.933 s]
[INFO] Apache Hadoop HDFS-NFS ............................. SUCCESS [  0.632 s]
[INFO] Apache Hadoop HDFS Project ......................... SUCCESS [  0.048 s]
[INFO] hadoop-yarn ........................................ SUCCESS [  0.045 s]
[INFO] hadoop-yarn-api .................................... SUCCESS [  3.861 s]
[INFO] hadoop-yarn-common ................................. SUCCESS [01:35 min]
[INFO] hadoop-yarn-server ................................. SUCCESS [  0.030 s]
[INFO] hadoop-yarn-server-common .......................... SUCCESS [  1.002 s]
[INFO] hadoop-yarn-server-nodemanager ..................... SUCCESS [  1.825 s]
[INFO] hadoop-yarn-server-web-proxy ....................... SUCCESS [  0.499 s]
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SUCCESS [  0.940 s]
[INFO] hadoop-yarn-server-resourcemanager ................. SUCCESS [  3.872 s]
[INFO] hadoop-yarn-server-tests ........................... SUCCESS [  0.759 s]
[INFO] hadoop-yarn-client ................................. SUCCESS [  0.687 s]
[INFO] hadoop-yarn-server-sharedcachemanager .............. SUCCESS [  0.850 s]
[INFO] hadoop-yarn-applications ........................... SUCCESS [  0.034 s]
[INFO] hadoop-yarn-applications-distributedshell .......... SUCCESS [  0.396 s]
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SUCCESS [  0.272 s]
[INFO] hadoop-yarn-site ................................... SUCCESS [  0.040 s]
[INFO] hadoop-yarn-registry ............................... SUCCESS [  0.711 s]
[INFO] hadoop-yarn-project ................................ SUCCESS [  0.248 s]
[INFO] hadoop-mapreduce-client ............................ SUCCESS [  0.114 s]
[INFO] hadoop-mapreduce-client-core ....................... SUCCESS [  2.589 s]
[INFO] hadoop-mapreduce-client-common ..................... SUCCESS [  1.546 s]
[INFO] hadoop-mapreduce-client-shuffle .................... SUCCESS [  0.467 s]
[INFO] hadoop-mapreduce-client-app ........................ SUCCESS [  1.305 s]
[INFO] hadoop-mapreduce-client-hs ......................... SUCCESS [  0.780 s]
[INFO] hadoop-mapreduce-client-jobclient .................. SUCCESS [ 19.947 s]
[INFO] hadoop-mapreduce-client-hs-plugins ................. SUCCESS [  0.364 s]
[INFO] Apache Hadoop MapReduce Examples ................... SUCCESS [  0.831 s]
[INFO] hadoop-mapreduce ................................... SUCCESS [  0.169 s]
[INFO] Apache Hadoop MapReduce Streaming .................. SUCCESS [  8.894 s]
[INFO] Apache Hadoop Distributed Copy ..................... SUCCESS [ 34.396 s]
[INFO] Apache Hadoop Archives ............................. SUCCESS [  0.309 s]
[INFO] Apache Hadoop Rumen ................................ SUCCESS [  0.471 s]
[INFO] Apache Hadoop Gridmix .............................. SUCCESS [  0.484 s]
[INFO] Apache Hadoop Data Join ............................ SUCCESS [  0.187 s]
[INFO] Apache Hadoop Ant Tasks ............................ SUCCESS [  0.099 s]
[INFO] Apache Hadoop Extras ............................... SUCCESS [  0.386 s]
[INFO] Apache Hadoop Pipes ................................ SUCCESS [  0.024 s]
[INFO] Apache Hadoop OpenStack support .................... SUCCESS [  0.445 s]
[INFO] Apache Hadoop Amazon Web Services support .......... SUCCESS [03:23 min]
[INFO] Apache Hadoop Azure support ........................ SUCCESS [ 17.180 s]
[INFO] Apache Hadoop Client ............................... SUCCESS [  1.042 s]
[INFO] Apache Hadoop Mini-Cluster ......................... SUCCESS [  0.862 s]
[INFO] Apache Hadoop Scheduler Load Simulator ............. SUCCESS [  1.292 s]
[INFO] Apache Hadoop Tools Dist ........................... SUCCESS [  0.614 s]
[INFO] Apache Hadoop Tools ................................ SUCCESS [  0.033 s]
[INFO] Apache Hadoop Distribution 2.7.6 ................... SUCCESS [  0.124 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 09:51 min
[INFO] Finished at: 2018-06-08T16:28:47+08:00
[INFO] ------------------------------------------------------------------------

[root@mini05 hadoop-2.7.6-src]# mvn package -Pdist,native -DskipTests -Dtar   
…………………………
[INFO] Executing tasks
main:
     [exec] $ tar cf hadoop-2.7.6.tar hadoop-2.7.6
     [exec] $ gzip -f hadoop-2.7.6.tar
     [exec] 
     [exec] Hadoop dist tar available at: /app/software/hadoop-2.7.6-src/hadoop-dist/target/hadoop-2.7.6.tar.gz  # Hadoop編譯好的jar包位置 
     [exec] 
[INFO] Executed tasks
[INFO] 
[INFO] --- maven-javadoc-plugin:2.8.1:jar (module-javadocs) @ hadoop-dist ---
[INFO] Building jar: /app/software/hadoop-2.7.6-src/hadoop-dist/target/hadoop-dist-2.7.6-javadoc.jar
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO] 
[INFO] Apache Hadoop Main 2.7.6 ........................... SUCCESS [  7.433 s]
[INFO] Apache Hadoop Build Tools .......................... SUCCESS [  0.789 s]
[INFO] Apache Hadoop Project POM .......................... SUCCESS [ 21.333 s]
[INFO] Apache Hadoop Annotations .......................... SUCCESS [  1.470 s]
[INFO] Apache Hadoop Assemblies ........................... SUCCESS [  0.135 s]
[INFO] Apache Hadoop Project Dist POM ..................... SUCCESS [ 13.132 s]
[INFO] Apache Hadoop Maven Plugins ........................ SUCCESS [  2.676 s]
[INFO] Apache Hadoop MiniKDC .............................. SUCCESS [  3.423 s]
[INFO] Apache Hadoop Auth ................................. SUCCESS [  3.391 s]
[INFO] Apache Hadoop Auth Examples ........................ SUCCESS [  2.545 s]
[INFO] Apache Hadoop Common ............................... SUCCESS [01:06 min]
[INFO] Apache Hadoop NFS .................................. SUCCESS [  3.635 s]
[INFO] Apache Hadoop KMS .................................. SUCCESS [  9.051 s]
[INFO] Apache Hadoop Common Project ....................... SUCCESS [  0.044 s]
[INFO] Apache Hadoop HDFS ................................. SUCCESS [01:17 min]
[INFO] Apache Hadoop HttpFS ............................... SUCCESS [ 12.516 s]
[INFO] Apache Hadoop HDFS BookKeeper Journal .............. SUCCESS [  9.920 s]
[INFO] Apache Hadoop HDFS-NFS ............................. SUCCESS [  2.311 s]
[INFO] Apache Hadoop HDFS Project ......................... SUCCESS [  0.029 s]
[INFO] hadoop-yarn ........................................ SUCCESS [  0.036 s]
[INFO] hadoop-yarn-api .................................... SUCCESS [ 22.028 s]
[INFO] hadoop-yarn-common ................................. SUCCESS [ 16.103 s]
[INFO] hadoop-yarn-server ................................. SUCCESS [  0.041 s]
[INFO] hadoop-yarn-server-common .......................... SUCCESS [  6.938 s]
[INFO] hadoop-yarn-server-nodemanager ..................... SUCCESS [ 10.326 s]
[INFO] hadoop-yarn-server-web-proxy ....................... SUCCESS [  2.036 s]
[INFO] hadoop-yarn-server-applicationhistoryservice ....... SUCCESS [  4.360 s]
[INFO] hadoop-yarn-server-resourcemanager ................. SUCCESS [ 11.051 s]
[INFO] hadoop-yarn-server-tests ........................... SUCCESS [  3.508 s]
[INFO] hadoop-yarn-client ................................. SUCCESS [  3.938 s]
[INFO] hadoop-yarn-server-sharedcachemanager .............. SUCCESS [  2.340 s]
[INFO] hadoop-yarn-applications ........................... SUCCESS [  0.022 s]
[INFO] hadoop-yarn-applications-distributedshell .......... SUCCESS [  1.674 s]
[INFO] hadoop-yarn-applications-unmanaged-am-launcher ..... SUCCESS [  1.333 s]
[INFO] hadoop-yarn-site ................................... SUCCESS [  0.020 s]
[INFO] hadoop-yarn-registry ............................... SUCCESS [  3.027 s]
[INFO] hadoop-yarn-project ................................ SUCCESS [  2.675 s]
[INFO] hadoop-mapreduce-client ............................ SUCCESS [  0.086 s]
[INFO] hadoop-mapreduce-client-core ....................... SUCCESS [ 11.176 s]
[INFO] hadoop-mapreduce-client-common ..................... SUCCESS [ 10.672 s]
[INFO] hadoop-mapreduce-client-shuffle .................... SUCCESS [  2.336 s]
[INFO] hadoop-mapreduce-client-app ........................ SUCCESS [  5.157 s]
[INFO] hadoop-mapreduce-client-hs ......................... SUCCESS [  3.429 s]
[INFO] hadoop-mapreduce-client-jobclient .................. SUCCESS [  2.947 s]
[INFO] hadoop-mapreduce-client-hs-plugins ................. SUCCESS [  1.182 s]
[INFO] Apache Hadoop MapReduce Examples ................... SUCCESS [  3.813 s]
[INFO] hadoop-mapreduce ................................... SUCCESS [  1.939 s]
[INFO] Apache Hadoop MapReduce Streaming .................. SUCCESS [  2.445 s]
[INFO] Apache Hadoop Distributed Copy ..................... SUCCESS [  5.319 s]
[INFO] Apache Hadoop Archives ............................. SUCCESS [  1.183 s]
[INFO] Apache Hadoop Rumen ................................ SUCCESS [  3.061 s]
[INFO] Apache Hadoop Gridmix .............................. SUCCESS [  2.350 s]
[INFO] Apache Hadoop Data Join ............................ SUCCESS [  1.619 s]
[INFO] Apache Hadoop Ant Tasks ............................ SUCCESS [  1.436 s]
[INFO] Apache Hadoop Extras ............................... SUCCESS [  1.817 s]
[INFO] Apache Hadoop Pipes ................................ SUCCESS [  5.664 s]
[INFO] Apache Hadoop OpenStack support .................... SUCCESS [  2.720 s]
[INFO] Apache Hadoop Amazon Web Services support .......... SUCCESS [  2.630 s]
[INFO] Apache Hadoop Azure support ........................ SUCCESS [  2.453 s]
[INFO] Apache Hadoop Client ............................... SUCCESS [  6.406 s]
[INFO] Apache Hadoop Mini-Cluster ......................... SUCCESS [  0.674 s]
[INFO] Apache Hadoop Scheduler Load Simulator ............. SUCCESS [  3.096 s]
[INFO] Apache Hadoop Tools Dist ........................... SUCCESS [  6.273 s]
[INFO] Apache Hadoop Tools ................................ SUCCESS [  0.032 s]
[INFO] Apache Hadoop Distribution 2.7.6 ................... SUCCESS [ 25.962 s]
[INFO] ------------------------------------------------------------------------
[INFO] BUILD SUCCESS
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 07:28 min
[INFO] Finished at: 2018-06-08T16:37:06+08:00
[INFO] ------------------------------------------------------------------------

  

8.2.  查看Native

[root@mini05 native]# pwd
/app/software/hadoop-2.7.6-src/hadoop-dist/target/hadoop-2.7.6/lib/native
[root@mini05 native]# file *  
libhadoop.a:        current ar archive
libhadooppipes.a:   current ar archive
libhadoop.so:       symbolic link to `libhadoop.so.1.0.0'
libhadoop.so.1.0.0: ELF 64-bit LSB shared object, x86-64, version 1 (SYSV), dynamically linked, BuildID[sha1]=1092bb61838f0b1c0d982b20dc8223ae93ba708f, not stripped
libhadooputils.a:   current ar archive
libhdfs.a:          current ar archive
libhdfs.so:         symbolic link to `libhdfs.so.0.0.0'
libhdfs.so.0.0.0:   ELF 64-bit LSB shared object, x86-64, version 1 (SYSV), dynamically linked, BuildID[sha1]=e719718169b5319c4f9109b5b5d8f33cebe65ed6, not stripped

  

8.3.  jar包位置

[root@mini05 target]# pwd
/app/software/hadoop-2.7.6-src/hadoop-dist/target
[root@mini05 target]# ll -h 	
total 571M
drwxr-xr-x 2 root root   28 Jun  8 16:28 antrun
drwxr-xr-x 3 root root   22 Jun  8 16:28 classes
-rw-r--r-- 1 root root 1.9K Jun  8 16:36 dist-layout-stitching.sh
-rw-r--r-- 1 root root  643 Jun  8 16:36 dist-tar-stitching.sh
drwxr-xr-x 9 root root  149 Jun  8 16:36 hadoop-2.7.6
-rw-r--r-- 1 root root 190M Jun  8 16:36 hadoop-2.7.6.tar.gz
-rw-r--r-- 1 root root  26K Jun  8 16:36 hadoop-dist-2.7.6.jar
-rw-r--r-- 1 root root 381M Jun  8 16:37 hadoop-dist-2.7.6-javadoc.jar
-rw-r--r-- 1 root root  24K Jun  8 16:36 hadoop-dist-2.7.6-sources.jar
-rw-r--r-- 1 root root  24K Jun  8 16:36 hadoop-dist-2.7.6-test-sources.jar
drwxr-xr-x 2 root root   51 Jun  8 16:36 javadoc-bundle-options
drwxr-xr-x 2 root root   28 Jun  8 16:28 maven-archiver
drwxr-xr-x 3 root root   22 Jun  8 16:28 maven-shared-archive-resources
drwxr-xr-x 3 root root   22 Jun  8 16:28 test-classes
drwxr-xr-x 2 root root    6 Jun  8 16:28 test-dir

  

PS:

1 相關編譯所需的軟體放在了雲盤中,其中CentOS-7.4_hadoop-2.7.6.tar.gz 是上面編譯好的 hadoop-2.7.6.tar.gz 進行的重命名,直接使用即可。
2 
3 鏈接:https://pan.baidu.com/s/1saAbQdoO4GRIbdCH--prkw 密碼:372f

 

9. 文章參考

1、hadoop2.7.3編譯和安裝

2、hadoop搭建時為什麼最好重新編譯源碼的原因

 


您的分享是我們最大的動力!

-Advertisement-
Play Games
更多相關文章
  • 一、什麼是API網關 API網關是一個伺服器,是系統對外的唯一入口。API網關封裝了系統內部架構,為每個客戶端提供一個定製的API。API網關方式的核心要點是,所有的客戶端和消費端都通過統一的網關接入微服務,在網關層處理所有的非業務功能。通常,網關也是提供REST/HTTP的訪問API。服務端通過A ...
  • 本文主要介紹一些常見情況的實現,包括:集合更新、翻頁、排序、過濾等等。但是仍然是Richardson成熟度為2級的Web API,未達到RESTful API的標準。 本代碼已經更新至ASP.NET Core 2.1. ...
  • 關於下載更新數據於滾動條類似PrograssBar控制項的問題,我網上搜索了下,總體結合大致採用微軟的定時器Timer控制項更新數據。 在網上發現了典型的例子是使用TImer定時器和BackgroundWorker組件的結合更新PrograssBar進度的操作,網址如下: http://www.cnbl ...
  • 摘自:https://www.cnblogs.com/tdfblog/p/entity-framework-core-generate-tracking-columns.html Ef Core 官方文檔: https://docs.microsoft.com/zh-cn/ef/core/ 文章列舉 ...
  • 第一,你要知道,並行線程會有一個蛋疼的地方。他不會每次執行都給你去開一個線程。 我一開始以為每次執行都會去開一個新的線程。。。。 result 這就導致,如果我們在當前線程上下文綁定了sessionFactory就會導致,重用線程會獲取到一樣的session 如果在前面一個線程中我們關閉了sessi ...
  • 背景:最近公司有個需求,外網希望自動保存數據到內網,內網有2台伺服器可以相互訪問,其中一臺伺服器外網可以訪問,於是想在 這台伺服器上放個中轉的介面。後來做出來以後測試發現沒有問題就放線上去了,不顧發現工程助理 在使用是時候沒有自動上傳 ,於是猜想可能是文件過大被限制了。 使用Fiddle測試後發現確 ...
  • 最近在做項目過程中,經常會遇到生成訂單流水號唯一性的應用,也有不少同事也請教我對唯一性的 "流水號"的問題,根據個人所見,一般生成的規則都是根據日期來進行操作,我目前在做的一個項目:”報告卡“上的編碼就是根據 ”yyyyMMdd+四位數字(累加)“的格式生成,一般對這一類的操作最好是在存儲過程中生成 ...
  • 使用Vim編輯器寫腳本時,經常會遇到多重迴圈語句,習慣上會用tab鍵來補齊。這時設置tab鍵占用的長度,可以調節界面的鬆緊度,使其達到令人滿意的效果。 在針對個別用戶和所有用戶來設置時,與編輯SSH相應的配置文件十分類似。 一.設置當前用戶的Tab鍵的長度 編輯配置文件~/.vimrc即可 保存並退 ...
一周排行
    -Advertisement-
    Play Games
  • 移動開發(一):使用.NET MAUI開發第一個安卓APP 對於工作多年的C#程式員來說,近來想嘗試開發一款安卓APP,考慮了很久最終選擇使用.NET MAUI這個微軟官方的框架來嘗試體驗開發安卓APP,畢竟是使用Visual Studio開發工具,使用起來也比較的順手,結合微軟官方的教程進行了安卓 ...
  • 前言 QuestPDF 是一個開源 .NET 庫,用於生成 PDF 文檔。使用了C# Fluent API方式可簡化開發、減少錯誤並提高工作效率。利用它可以輕鬆生成 PDF 報告、發票、導出文件等。 項目介紹 QuestPDF 是一個革命性的開源 .NET 庫,它徹底改變了我們生成 PDF 文檔的方 ...
  • 項目地址 項目後端地址: https://github.com/ZyPLJ/ZYTteeHole 項目前端頁面地址: ZyPLJ/TreeHoleVue (github.com) https://github.com/ZyPLJ/TreeHoleVue 目前項目測試訪問地址: http://tree ...
  • 話不多說,直接開乾 一.下載 1.官方鏈接下載: https://www.microsoft.com/zh-cn/sql-server/sql-server-downloads 2.在下載目錄中找到下麵這個小的安裝包 SQL2022-SSEI-Dev.exe,運行開始下載SQL server; 二. ...
  • 前言 隨著物聯網(IoT)技術的迅猛發展,MQTT(消息隊列遙測傳輸)協議憑藉其輕量級和高效性,已成為眾多物聯網應用的首選通信標準。 MQTTnet 作為一個高性能的 .NET 開源庫,為 .NET 平臺上的 MQTT 客戶端與伺服器開發提供了強大的支持。 本文將全面介紹 MQTTnet 的核心功能 ...
  • Serilog支持多種接收器用於日誌存儲,增強器用於添加屬性,LogContext管理動態屬性,支持多種輸出格式包括純文本、JSON及ExpressionTemplate。還提供了自定義格式化選項,適用於不同需求。 ...
  • 目錄簡介獲取 HTML 文檔解析 HTML 文檔測試參考文章 簡介 動態內容網站使用 JavaScript 腳本動態檢索和渲染數據,爬取信息時需要模擬瀏覽器行為,否則獲取到的源碼基本是空的。 本文使用的爬取步驟如下: 使用 Selenium 獲取渲染後的 HTML 文檔 使用 HtmlAgility ...
  • 1.前言 什麼是熱更新 游戲或者軟體更新時,無需重新下載客戶端進行安裝,而是在應用程式啟動的情況下,在內部進行資源或者代碼更新 Unity目前常用熱更新解決方案 HybridCLR,Xlua,ILRuntime等 Unity目前常用資源管理解決方案 AssetBundles,Addressable, ...
  • 本文章主要是在C# ASP.NET Core Web API框架實現向手機發送驗證碼簡訊功能。這裡我選擇是一個互億無線簡訊驗證碼平臺,其實像阿裡雲,騰訊雲上面也可以。 首先我們先去 互億無線 https://www.ihuyi.com/api/sms.html 去註冊一個賬號 註冊完成賬號後,它會送 ...
  • 通過以下方式可以高效,並保證數據同步的可靠性 1.API設計 使用RESTful設計,確保API端點明確,並使用適當的HTTP方法(如POST用於創建,PUT用於更新)。 設計清晰的請求和響應模型,以確保客戶端能夠理解預期格式。 2.數據驗證 在伺服器端進行嚴格的數據驗證,確保接收到的數據符合預期格 ...