Hadoop+Hive+HBase+Spark 集群部署（二）

  • 2019 年 10 月 6 日
  • 筆記

hadoophivehbasespark

1. Hbase

hbase-env.sh

export JAVA_HOME=/usr/java/jdk1.8.0_162  export HADOOP_HOME=/opt/soft/hadoop-2.8.3  export HBASE_HOME=/opt/soft/hbase-2.0.0  export HBASE_CLASSPATH=/opt/soft/hadoop-2.8.3/etc/hadoop  export HBASE_PID_DIR=/opt/data/hbase_data/pids  export HBASE_MANAGES_ZK=false

hbase-site.xml

    <property>          <name>hbase.rootdir</name>          <value>hdfs://node:8020/hbase</value>          <description>The directory shared byregion servers.</description>      </property>      <!-- hbase埠 -->      <property>          <name>hbase.zookeeper.property.clientPort</name>          <value>2181</value>      </property>      <!-- 超時時間 -->      <property>          <name>zookeeper.session.timeout</name>          <value>120000</value>      </property>      <!--防止伺服器時間不同步出錯 -->      <property>          <name>hbase.master.maxclockskew</name>          <value>150000</value>      </property>      <!-- 集群主機配置 -->      <property>          <name>hbase.zookeeper.quorum</name>          <value>node,node1,node2,node3</value>      </property>       <property>          <name>hbase.zookeeper.property.dataDir</name>          <value>/opt/data/zookeeper_data/</value>      </property>      <!--   路徑存放 -->      <property>          <name>hbase.tmp.dir</name>          <value>/opt/data/hbase_data/tmp</value>      </property>      <!-- true表示分散式 -->      <property>          <name>hbase.cluster.distributed</name>          <value>true</value>      </property>      <!-- 指定master -->      <property>          <name>hbase.master</name>          <value>node:60000</value>      </property>       <property>          <name>hbase.coprocessor.abortonerror</name>          <value>false</value>      </property>

regionservers

node1  node2  node3

啟動 / 停止 命令

start-hbase.sh  stop-hbase.sh

Hbase_webUI 埠

  • 16010

shell

[root@node ~]# hbase shell  SLF4J: Class path contains multiple SLF4J bindings.  SLF4J: Found binding in [jar:file:/opt/soft/hbase-2.0.0/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]  SLF4J: Found binding in [jar:file:/opt/soft/hadoop-2.8.3/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]  SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.  SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]  HBase Shell  Use "help" to get list of supported commands.  Use "exit" to quit this interactive shell.  Version 2.0.0, r7483b111e4da77adbfc8062b3b22cbe7c2cb91c1, Sun Apr 22 20:26:55 PDT 2018  Took 0.0040 seconds  hbase(main):001:0> list  TABLE  0 row(s)  Took 0.9192 seconds  => []  hbase(main):002:0> status  1 active master, 0 backup masters, 3 servers, 0 dead, 0.6667 average load  Took 0.2078 seconds  hbase(main):003:0>

PS.

  • RPC版本可能不一致，所以HBase lib目錄中的Hadoop jar版本應和安裝的Hadoop版本一致，將相應jar拷貝至HBase lib中

本文由 bytebye 創作 本站文章除註明轉載/出處外，均為本站原創或翻譯，轉載前請務必署名

VirMach 便宜 VPS

QNews

QNews