Apache Hadoop 生態圈軟體下載地址：http://archive.apache.org/dist/hadoop/hadoop下載地址 http://archive.apache.org/dist/hadoop/common 安裝環境 虛擬機中的 CentOS 64位 需要安裝軟體： jd ...
Apache Hadoop 生態圈軟體下載地址：http://archive.apache.org/dist/hadoop/
hadoop下載地址 http://archive.apache.org/dist/hadoop/common
安裝環境 虛擬機中的 CentOS 64位
需要安裝軟體：
jdk: jdk-7u45-linux-x64.rpm hadoop:hadoop-2.7.2-src.tar.gz maven:apache-maven-3.0.5-bin.tar.gz protobuf:protobuf-2.5.0.tar.gz 在hadoop目錄下有個BUILDING.txt文件，編譯源碼需要準備的軟體，及編譯方法進行了說明，可參考使用Requirements: * Unix System * JDK 1.7+ * Maven 3.0 or later * Findbugs 1.3.9 (if running findbugs) * ProtocolBuffer 2.5.0 * CMake 2.6 or newer (if compiling native code), must be 3.0 or newer on Mac * Zlib devel (if compiling native code) * openssl devel ( if compiling native hadoop-pipes and to get the best HDFS encryption performance ) * Jansson C XML parsing library ( if compiling libwebhdfs ) * Linux FUSE (Filesystem in Userspace) version 2.6 or above ( if compiling fuse_dfs ) * Internet connection for first build (to fetch all Maven and Hadoop dependencies)
1.下載Hadoop
wget http://apache.opencas.org/hadoop/common/hadoop-2.7.2/hadoop-2.7.2-src.tar.gz tar -zxvf hadoop-2.7.2-src.tar.gz2.安裝JDK
sudo yum install jdk-7u45-linux-x64.rpm 查看jdk安裝位置： which java /usr/java/jdk1.7.0_45/bin/java 添加jdk到環境變數(~/.bash_profile)： export JAVA_HOME=/usr/java/jdk1.7.0_45 export PATH=.:$JAVA_HOME/bin:$PATH 驗證： java -version java version "1.7.0_45" Java(TM) SE Runtime Environment (build 1.7.0_45-b18) Java HotSpot(TM) 64-Bit Server VM (build 24.45-b08, mixed mode)
3、安裝maven
wgethttp://apache.fayea.com/maven/maven-3/3.0.5/binaries/apache-maven-3.0.5-bin.tar.gz tar -xzvf apache-maven-3.0.5-bin.tar.gz 添加maven到環境變數(~/.bash_profile): export MAVEN_HOME=/home/hadoop/app/apache-maven-3.0.5 export PATH=.:$MAVEN_HOME/bin:$PATH 驗證： mvn -version Apache Maven 3.0.5 (r01de14724cdef164cd33c7c8c2fe155faf9602da; 2013-02-19 05:51:28-0800) Maven home: /home/hadoop/app/apache-maven-3.0.5 Java version: 1.7.0_45, vendor: Oracle Corporation Java home: /usr/java/jdk1.7.0_45/jre Default locale: en_US, platform encoding: UTF-8 OS name: "linux", version: "2.6.32-358.el6.x86_64", arch: "amd64", family: "unix" 如果設置代理，需要修改maven配置文件。 <proxy> <id>optional</id> <active>true</active> <protocol>http</protocol> <host>x.x.x.x</host> <port>8080</port> </proxy> 下載失敗可以換鏡像 <mirror> <id>CN</id> <name>OSChina Central</name> <url>http://maven.oschina.net/content/groups/public/</url> <mirrorOf>central</mirrorOf> </mirror>
4、安裝protobuf
protobuf的官方地址貌似上不了，自行下載protobuf安裝包；為了編譯安裝protobuf，需要先gcc/gcc-c++/make sudo apt-get install gcc sudo apt-get install c++ sudo apt-get install cmake sudo apt-get install gcc-c++ tar -zvxf protobuf-2.5.0.tar.gz cd protobuf-2.5.0 ./configure --prefix=/usr/local/protoc/ sudo make sudo make install 添加protobuf到環境變數(~/.bash_profile): export PATH=.:/usr/local/protoc/bin:$PATH 驗證： protoc --version libprotoc 2.5.05、安裝其他依賴
sudo yum install cmake sudo yum install openssl-devel sudo yum install ncurses-devel
6、編譯hadoop源代碼
cd ~/app/hadoop-2.7.2-src mvn package -DskipTests -Pdist,native 編譯後的代碼在hadoop-2.7.2-src/hadoop-dist/target/hadoop-2.7.2下問題：
一、編譯過程中下載jar失敗。java.net.UnknownHostException: archive.apache.org
