在线安装CM集群

https://www.cloudera.com/documentation/manager/5-0-x/Cloudera-Manager-Installation-Guide/cm5ig_install_path_B.html

前期准备工作不多说了

先给每个节点配置镜像源，我这里以节点2为例

[cloudera-manager]

# Packages for Cloudera Manager, Version , on RedHat or CentOS  x86_64

name=Cloudera Manager

baseurl=https://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5.13.0/

gpgkey =https://archive.cloudera.com/cm5/redhat/6/x86_64/cm/RPM-GPG-KEY-cloudera

gpgcheck =

卸载centos6.5自带的jdk后就安装jdk,也是3个节点都安装

在节点1安装server

sudo yum install cloudera-manager-daemons cloudera-manager-server

在每个节点都安装agent

sudo yum install cloudera-manager-agent cloudera-manager-daemons

在每个节点 vim /etc/cloudera-scm-agent/config.ini

下载rpm包到电脑上

上传到cm1节点

sudo yum --nogpgcheck localinstall cloudera-cdh-5-0.x86_64.rpm

sudo rpm --import http://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/RPM-GPG-KEY-cloudera

sudo yum install avro-tools crunch flume-ng hadoop-hdfs-fuse hadoop-hdfs-nfs3 hadoop-httpfs 
hbase-solr hive-hbase hive-webhcat hue-beeswax hue-hbase hue-impala hue-pig hue-plugins hue-rdbms 
hue-search hue-spark hue-sqoop hue-zookeeper impala impala-shell kite llama mahout oozie pig pig-udf-datafu search sentry solr-mapreduce spark-python sqoop sqoop2 whirr

安装完之后，在cm1节点启动server服务

在3个节点都启动agent服务

但是没有能打开

查看日志

in org.springframework.beans.factory.support.DefaultListableBeanFactory@1fe903d5: defining beans [commandLineConfigurationBean,entityManagerFactoryBean,com.cloudera.server.cmf.TrialState,com.cloudera.server.cmf.TrialManager,com.cloudera.cmf.crypto.LicenseLoader]; root of factory hierarchy

-- ::, ERROR main:com.cloudera.server.cmf.Main: Server failed.

org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'com.cloudera.server.cmf.TrialState': Cannot resolve reference to bean 'entityManagerFactoryBean' while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'entityManagerFactoryBean': FactoryBean threw exception on object creation; nested exception is javax.persistence.PersistenceException: [PersistenceUnit: cmf.server] Unable to build EntityManagerFactory

    at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:)

    at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:)

    at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:)

    at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:)

    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:)

    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:)

    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:)

    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:)

    at org.springframework.beans.factory.support.AbstractBeanFactory$.getObject(AbstractBeanFactory.java:)

    at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:)

    at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:)

    at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:)

    at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:)

    at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:)

    at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:)

    at com.cloudera.server.cmf.Main.bootstrapSpringContext(Main.java:)

    at com.cloudera.server.cmf.Main.<init>(Main.java:)

    at com.cloudera.server.cmf.Main.main(Main.java:)

Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'entityManagerFactoryBean': FactoryBean threw exception on object creation; nested exception is javax.persistence.PersistenceException: [PersistenceUnit: cmf.server] Unable to build EntityManagerFactory

    at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:)

    at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.getObjectFromFactoryBean(FactoryBeanRegistrySupport.java:)

    at org.springframework.beans.factory.support.AbstractBeanFactory.getObjectForBeanInstance(AbstractBeanFactory.java:)

    at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:)

    at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:)

    at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:)

    ...  more

Caused by: javax.persistence.PersistenceException: [PersistenceUnit: cmf.server] Unable to build EntityManagerFactory

    at org.hibernate.ejb.Ejb3Configuration.buildEntityManagerFactory(Ejb3Configuration.java:)

    at org.hibernate.ejb.Ejb3Configuration.buildEntityManagerFactory(Ejb3Configuration.java:)

    at org.hibernate.ejb.HibernatePersistence.createEntityManagerFactory(HibernatePersistence.java:)

    at javax.persistence.Persistence.createEntityManagerFactory(Persistence.java:)

    at com.cloudera.enterprise.CommonMain.setupHibernate(CommonMain.java:)

    at com.cloudera.server.cmf.bootstrap.EntityManagerFactoryBean.getObject(EntityManagerFactoryBean.java:)

    at com.cloudera.server.cmf.bootstrap.EntityManagerFactoryBean.getObject(EntityManagerFactoryBean.java:)

    at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:)

    ...  more

Caused by: org.hibernate.service.classloading.spi.ClassLoadingException: HHH010003: JDBC Driver class not found: com.mysql.jdbc.Driver

    at org.hibernate.service.jdbc.connections.internal.C3P0ConnectionProvider.configure(C3P0ConnectionProvider.java:)

    at org.hibernate.service.internal.StandardServiceRegistryImpl.configureService(StandardServiceRegistryImpl.java:)

    at org.hibernate.service.internal.AbstractServiceRegistryImpl.initializeService(AbstractServiceRegistryImpl.java:)

    at org.hibernate.service.internal.AbstractServiceRegistryImpl.getService(AbstractServiceRegistryImpl.java:)

    at org.hibernate.engine.jdbc.internal.JdbcServicesImpl.buildJdbcConnectionAccess(JdbcServicesImpl.java:)

    at org.hibernate.engine.jdbc.internal.JdbcServicesImpl.configure(JdbcServicesImpl.java:)

    at org.hibernate.service.internal.StandardServiceRegistryImpl.configureService(StandardServiceRegistryImpl.java:)

    at org.hibernate.service.internal.AbstractServiceRegistryImpl.initializeService(AbstractServiceRegistryImpl.java:)

    at org.hibernate.service.internal.AbstractServiceRegistryImpl.getService(AbstractServiceRegistryImpl.java:)

    at org.hibernate.cfg.Configuration.buildTypeRegistrations(Configuration.java:)

    at org.hibernate.cfg.Configuration.buildSessionFactory(Configuration.java:)

    at org.hibernate.ejb.EntityManagerFactoryImpl.<init>(EntityManagerFactoryImpl.java:)

    at org.hibernate.ejb.Ejb3Configuration.buildEntityManagerFactory(Ejb3Configuration.java:)

    ...  more

Caused by: org.hibernate.service.classloading.spi.ClassLoadingException: Unable to load class [com.mysql.jdbc.Driver]

    at org.hibernate.service.classloading.internal.ClassLoaderServiceImpl.classForName(ClassLoaderServiceImpl.java:)

    at org.hibernate.service.jdbc.connections.internal.C3P0ConnectionProvider.configure(C3P0ConnectionProvider.java:)

    ...  more

Caused by: java.lang.ClassNotFoundException: Could not load requested class : com.mysql.jdbc.Driver

    at org.hibernate.service.classloading.internal.ClassLoaderServiceImpl$AggregatedClassLoader.findClass(ClassLoaderServiceImpl.java:)

    at java.lang.ClassLoader.loadClass(ClassLoader.java:)

    at java.lang.ClassLoader.loadClass(ClassLoader.java:)

    at java.lang.Class.forName0(Native Method)

    at java.lang.Class.forName(Class.java:)

    at org.hibernate.service.classloading.internal.ClassLoaderServiceImpl.classForName(ClassLoaderServiceImpl.java:)

    ...  more

[root@cm1 cloudera-scm-server]# pwd

/var/log/cloudera-scm-server

[root@cm1 cloudera-scm-server]# cat cloudera-scm-server.log

没有安装数据库的驱动

sudo yum install mysql-server

我们登录进mysql

create database amon DEFAULT CHARACTER SET utf8;

grant all on amon.* TO 'amon'@'%' IDENTIFIED BY 'amon_password';

grant all on *.* TO 'amon'@'cm1' IDENTIFIED BY 'amon_password';

grant all on amon.* TO 'amon'@'localhost' IDENTIFIED BY 'amon_password';

create database rman DEFAULT CHARACTER SET utf8;

grant all on rman.* TO 'rman'@'%' IDENTIFIED BY 'rman_password';

grant all on *.* TO 'rman'@'cm1' IDENTIFIED BY 'rman_password';

grant all on rman.* TO 'rman'@'localhost' IDENTIFIED BY 'rman_password';

create database nav DEFAULT CHARACTER SET utf8;

grant all on nav.* TO 'nav'@'%' IDENTIFIED BY 'nav_password';

grant all on *.* TO 'nav'@'cm1' IDENTIFIED BY 'nav_password';

grant all on nav.* TO 'nav'@'localhost' IDENTIFIED BY 'nav_password';

create database hive DEFAULT CHARACTER SET utf8;

grant all on hive.* TO 'hive'@'%' IDENTIFIED BY 'hive_password';

grant all on *.* TO 'hive'@'cm1' IDENTIFIED BY 'hive_password';

grant all on hive.* TO 'hive'@'localhost' IDENTIFIED BY 'hive_password';

create database scm DEFAULT CHARACTER SET utf8;
grant all on scm.* TO 'scm'@'%' IDENTIFIED BY 'scm_password';
grant all on *.* TO 'scm'@'cm1' IDENTIFIED BY 'scm_password';
grant all on scm.* TO 'scm'@'localhost' IDENTIFIED BY 'scm_password';

create database oozie DEFAULT CHARACTER SET utf8;
grant all on oozie.* TO 'oozie'@'localhost' IDENTIFIED BY 'oozie_password';
grant all on *.* TO 'oozie'@'cm1' IDENTIFIED BY 'oozie_password';
grant all on oozie.* TO 'oozie'@'%' IDENTIFIED BY 'oozie_password';

create database hue DEFAULT CHARACTER SET utf8;
grant all on hue.* TO 'hue'@'localhost' IDENTIFIED BY 'hue_password';
grant all on *.* TO 'hue'@'cm1' IDENTIFIED BY 'hue_password';
grant all on hue.* TO 'hue'@'%' IDENTIFIED BY 'hue_password';
flush privileges;

flush privileges;

mysql> create database amon DEFAULT CHARACTER SET utf8;

Query OK,  row affected (0.00 sec)

mysql> grant all on amon.* TO 'amon'@'%' IDENTIFIED BY 'amon_password';

Query OK,  rows affected (0.00 sec)

mysql> grant all on *.* TO 'amon'@'cm1' IDENTIFIED BY 'amon_password';

Query OK,  rows affected (0.00 sec)

mysql> grant all on amon.* TO 'amon'@'localhost' IDENTIFIED BY 'amon_password';

Query OK,  rows affected (0.00 sec)

mysql> create database rman DEFAULT CHARACTER SET utf8;

Query OK,  row affected (0.00 sec)

mysql> grant all on rman.* TO 'rman'@'%' IDENTIFIED BY 'rman_password';

Query OK,  rows affected (0.00 sec)

mysql> grant all on *.* TO 'rman'@'cm1' IDENTIFIED BY 'rman_password';

Query OK,  rows affected (0.00 sec)

mysql> grant all on rman.* TO 'rman'@'localhost' IDENTIFIED BY 'rman_password';

Query OK,  rows affected (0.00 sec)

mysql> create database nav DEFAULT CHARACTER SET utf8;

Query OK,  row affected (0.00 sec)

mysql> grant all on nav.* TO 'nav'@'%' IDENTIFIED BY 'nav_password';

Query OK,  rows affected (0.00 sec)

mysql> grant all on *.* TO 'nav'@'cm1' IDENTIFIED BY 'nav_password';

Query OK,  rows affected (0.00 sec)

mysql> grant all on nav.* TO 'nav'@'localhost' IDENTIFIED BY 'nav_password';

Query OK,  rows affected (0.00 sec)

mysql> create database metastore DEFAULT CHARACTER SET utf8;

Query OK,  row affected (0.00 sec)

mysql> grant all on hive.* TO 'hive'@'%' IDENTIFIED BY 'hive_password';

Query OK,  rows affected (0.00 sec)

mysql> grant all on *.* TO 'hive'@'cm1' IDENTIFIED BY 'hive_password';

Query OK,  rows affected (0.00 sec)

mysql> grant all on *.* TO 'hive'@'cm1' IDENTIFIED BY 'hive_password';

Query OK,  rows affected (0.00 sec)

mysql>flush privileges;