The import org.apache.hadoop.mapreduce cannot be resolved

ubuntu@VM---ubuntu:~$ sudo apt-get install hadoop-2.8.-src.tar.gz

Reading package lists... Done

Building dependency tree

Reading state information... Done

E: Unable to locate package hadoop-2.8.-src.tar.gz

E: Couldn't find any package by glob 'hadoop-2.8.-src.tar.gz'

E: Couldn't find any package by regex 'hadoop-2.8.-src.tar.gz'

ubuntu@VM---ubuntu:~$ sudo wget http://mirror.bit.edu.cn/apache/hadoop/common/hadoop-2.8.0/hadoop-2.8.0-src.tar.gz

---- ::--  http://mirror.bit.edu.cn/apache/hadoop/common/hadoop-2.8.0/hadoop-2.8.0-src.tar.gz

Resolving mirror.bit.edu.cn (mirror.bit.edu.cn)... 202.204.80.77, :da8::::56ff:fea1:

Connecting to mirror.bit.edu.cn (mirror.bit.edu.cn)|202.204.80.77|:... connected.

HTTP request sent, awaiting response...  OK

Length:  (33M) [application/octet-stream]

Saving to: 'hadoop-2.8.0-src.tar.gz'

hadoop-2.8.-src.tar.gz          %[==========================================================>]  32.91M  .10MB/s    in 31s

-- :: (1.05 MB/s) - 'hadoop-2.8.0-src.tar.gz' saved [/]

ubuntu@VM---ubuntu:~$

Hadoop
计算框架

基于Java开发
安装jdk

sudo apt-get install openjdk-8-jdk

ubuntu@VM-52-248-ubuntu:~$ java -version

openjdk version "1.8.0_131"

OpenJDK Runtime Environment (build 1.8.0_131-8u131-b11-0ubuntu1.16.04.2-b11)

OpenJDK 64-Bit Server VM (build 25.131-b11, mixed mode)

ubuntu@VM-52-248-ubuntu:~$

https://www.linuxhelp.com/how-to-install-hadoop-in-ubuntu/

{

cd /usr/local/

sudo wget http://mirror.bit.edu.cn/apache/hadoop/common/hadoop-2.8.1/hadoop-2.8.1.tar.gz

tar -xvzf hadoop-2.8.1-src.tar.gz

sudo mv hadoop-2.8.1 hadoop

sudo chown -R hadoop  sci:sci

vim hadoop-env.sh

export JAVA_HOME=/usr/lib/jvm/java-8-openjdk-amd64/jre/

export JAVA_HOME=$(readlink -f /usr/bin/java | sed "s:bin/java::")

}

验证安装成功
mkdir ~/cicsoinput
cp /usr/local/hadoop/etc/hadoop/*.xml ~/cicsoinput

/usr/local/hadoop/bin/hadoop jar /usr/local/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.8..jar grep ~/cicsoinput ~/grep_example 'apache'

sci@ubuntu:~/grep_example$ ll

total 20

drwxrwxr-x  2 sci sci 4096 Oct 24 06:12 ./

drwxr-xr-x 12 sci sci 4096 Oct 24 06:12 ../

-rw-r--r--  1 sci sci    9 Oct 24 06:12 part-r-00000

-rw-r--r--  1 sci sci   12 Oct 24 06:12 .part-r-00000.crc

-rw-r--r--  1 sci sci    0 Oct 24 06:12 _SUCCESS

-rw-r--r--  1 sci sci    8 Oct 24 06:12 ._SUCCESS.crc

sci@ubuntu:~/grep_example$ cat *0

9	apache

sci@ubuntu:~/grep_example$

The import org.apache.hadoop.mapreduce cannot be resolved - Stack Overflow https://stackoverflow.com/questions/21658724/the-import-org-apache-hadoop-mapreduce-cannot-be-resolved

import org.apache.hadoop.conf.Configuration;
import org.apache.hadoop.fs.Path;
import org.apache.hadoop.io.IntWritable;
import org.apache.hadoop.io.Text;
import org.apache.hadoop.mapreduce.Job;
import org.apache.hadoop.mapreduce.Mapper;

<!-- https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-common -->
<dependency>
    <groupId>org.apache.hadoop</groupId>
    <artifactId>hadoop-common</artifactId>
    <version>3.1.0</version>
</dependency>

<!-- https://mvnrepository.com/artifact/org.apache.hadoop/hadoop-client -->
<dependency>
    <groupId>org.apache.hadoop</groupId>
    <artifactId>hadoop-client</artifactId>
    <version>3.1.0</version>
</dependency>

巴特西

The import org.apache.hadoop.mapreduce cannot be resolved

最新文章

热门文章