hive单机安装

int32位 posted @ Dec 01, 2014 01:06:56 PM in hadoop/spark , 1481 阅读

转载请注明：http://krystism.is-programmer.com/若有错误，请多多指正，谢谢！

安装要求

java1.7+
hadoop2.x
mysql5.5+(非必须，建议使用mysql存储元数据)

安装前的环境

JAVA_HOME: java安装目录
HADOOP_HOME: hadoop安装目录
CLASSPATH: 除了hadoop和hive的必须包，还需要包括mysql java驱动，这里使用的是mysql-connector-java-5.1.25.jar，并把它放入到lib下

安装过程

Step 1 下载tar包

在hive官网下载最新的tar包，当前最新包为apache-hive-0.14.0-bin.tar.gz。

Step 2 解压包

假定安装路径为/opt/hive：

sudo mv apache-hive-0.14.0-bin.tar.gz /opt
sudo tar xvf apache-hive-0.14.0-bin.tar.gz
sudo ln -s apache-hive-0.14.0-bin hive
sudo mv mysql-connector-java-5.1.25.jar /opt/hive/lib

Step 3 配置

创建配置文件，直接从模板文件创建即可

sudo rename 's/\.template//' *
sudo touch hive-site.xml

编辑hive-env.sh文件，设置HADOOP_HOME=${HADOOP_HOME-:/opt/hadoop}
创建hive-site-xml文件，添加以下内容:

<property>
  <name>javax.jdo.option.ConnectionURL</name>
  <value>jdbc:mysql://localhost:3306/metastore?createDatabaseIfNotExist=true</value>
  <description>the URL of the MySQL database</description>
</property>

<property>
  <name>javax.jdo.option.ConnectionDriverName</name>
  <value>com.mysql.jdbc.Driver</value>
</property>

<property>
  <name>javax.jdo.option.ConnectionUserName</name>
  <value>hive</value>
</property>

<property>
  <name>javax.jdo.option.ConnectionPassword</name>
  <value>HIVE_DBPASS</value>
</property>

<property>
  <name>datanucleus.autoCreateSchema</name>
  <value>true</value>
</property>

<property>
  <name>datanucleus.fixedDatastore</name>
  <value>false</value>
</property>

<property>
  <name>datanucleus.autoCreateTables</name>
  <value>true</value>
</property>

<property>
  <name>datanucleus.autoCreateColumns</name>
  <value>true</value>
</property>

<property>
  <name>datanucleus.autoStartMechanism</name> 
  <value>SchemaTable</value>
</property> 

<property>
    <name>hive.metastore.warehouse.dir</name>
    <value>/user/hive/warehouse</value>
</property>

<!--
<property>
  <name>hive.metastore.uris</name>
  <value>thrift://localhost:9083</value>
  <description>IP address (or fully-qualified domain name) and port of the metastore host</description>
</property>

<property>
  <name>hive.aux.jars.path</name>
  <value>file:///opt/hive/lib/zookeeper-3.4.5.jar,file:///opt/hive/lib/hive-hbase-handler-0.14.0.jar,file:///opt/hive/lib/guava-11.0.2.jar</value>
</property>
-->

<property>
 <name>hbase.zookeeper.quorum</name>
<value>localhost</value>
</property>

<property>
  <name>hive.support.concurrency</name>
  <description>Enable Hive's Table Lock Manager Service</description>
  <value>true</value>
</property>

</configuration>

mysql设置。修改/etc/mysql/my.cnf，修改bind-address 为0.0.0.0,重启mysql服务。
在hdfs创建必要目录:

$HADOOP_HOME/bin/hdfs dfs -mkdir /tmp
$HADOOP_HOME/bin/hdfs dfs -mkdir /user/hive
$HADOOP_HOME/bin/hdfs dfs -chown hive /user/hive
$HADOOP_HOME/bin/hdfs dfs -mkdir  /user/hive/warehouse
$HADOOP_HOME/bin/hdfs dfs -chmod g+w   /tmp
$HADOOP_HOME/bin/hdfs dfs -chmod 777   /user/hive/warehouse
$HADOOP_HOME/bin/hdfs dfs -chmod a+t /user/hive/warehouse

运行$HIVE_HOME/bin/hive, OK!

转载请注明：http://krystism.is-programmer.com/若有错误，请多多指正，谢谢！

相关文章
全局相关文章

无匹配

无匹配

[回复]

amarnath helicopter 说:
2024年6月06日 09:39

I would like to thank you for the efforts you have made in writing this article. I am hoping the same best work from you in the future as well. In fact your creative writing abilities has inspired me to start my own Blog Engine blog now. Really the blogging is spreading its wings rapidly. Your write up is a fine example of it.

[回复]

tech 说:
2024年9月07日 01:33

It has really well-researched stuff and superb writing. I became engrossed in the content so quickly that I couldn't wait to read it. I'm in awe of your talent and labor. Regards. Indijski uvjeti za e vizu Češki državljani

[回复]

tech 说:
2024年10月23日 21:29

More readers would be interested in the works of authors if more of them took the time to create excellent material, as you do. I've gained much too much knowledge from your post. turkey visa eligibility burkina faso citizensMore readers would be interested in the works of authors if more of them took the time to create excellent material, as you do. I've gained much too much knowledge from your post. turkey visa eligibility burkina faso citizens

[回复]

tech 说:
2024年12月04日 04:32

Excellent work! I want everyone to be aware of how excellent the information in your piece is. In regards to this matter, your opinions and mine are very similar. I know, so I'll check out your blog every day. For me, that may be really advantageous. turkey visa eligibility comorian citizens

[回复]

tech 说:
2025年1月05日 23:01

This is so creative and inspiring easter bunny for rent

[回复]

tech 说:
2025年1月08日 06:04

[回复]

tech 说:
2025年2月16日 03:14

My tendency is to read blogs in my spare time, which is how I ended up on your blog. I was so delighted with it that I made the decision to set aside some valuable time to visit it repeatedly. Regards. cambodia e visa for uae citizens

self.println("HelloWorld!")

int32bit

公告

文章分类

最新评论

最新留言

友情链接

RSS

功能

热门文章

随机文章

存档

访问次数

hive单机安装

安装要求

安装前的环境

安装过程

Step 1 下载tar包

Step 2 解压包

Step 3 配置