impala 3.3 源码编辑安装

张映 发表于 2019-10-29

分类目录: hadoop/spark/scala

标签:, ,

没有用cdh系列,但是又想用impala 3.3。安装impala有二种方式,一种源码安装,一种是rpm安装。impala早期版本,还可以设置yum源,进行安装。

不管是哪种方式安装,最终都是cdh中的impala

1,下载地址

http://archive.apache.org/dist/impala/3.3.0/

2,安装依赖

# yum install boost boost-devel redhat-lsb  python-devel cyrus-sasl-devel \
cyrus-sasl lzo-devel lzo gcc-c++ gcc cmake maven python pip python-devel

# pip install sh thrift-sasl ibis

3,遇到的错误,以及解决办法

bitarray/_bitarray.c:9:20: fatal error: Python.h: 没有那个文件或目录

解决办法:

# yum install python-devel

sasl/saslwrapper.cpp:21:23: fatal error: sasl/sasl.h: 没有那个文件或目录

解决办法:

# yum install cyrus-sasl-devel cyrus-sasl

2019-10-29 10:53:43,051 Thread-3 INFO: Removing existing package directory /bigdata/apache-impala-3.3.0/toolchain/llvm-5.0.1-asserts-p1
2019-10-29 10:53:43,314 Thread-3 INFO: Downloading https://native-toolchain.s3.amazonaws.com/build/51-03506fd053/llvm/5.0.1-asserts-p1-gcc-4.9.2/llvm-5.0.1-asserts-p1-gcc-4.9.2-ec2-package-centos-7.tar.gz to /bigdata/apache-impala-3.3.0/toolchain/llvm-5.0.1-asserts-p1-gcc-4.9.2-ec2-package-centos-7.tar.gz (attempt 1)
2019-10-29 10:53:43,341 Thread-3 INFO: Extracting llvm-5.0.1-asserts-p1-gcc-4.9.2-ec2-package-centos-7.tar.gz
Traceback (most recent call last):
File "/bigdata/apache-impala-3.3.0/bin/bootstrap_toolchain.py", line 562, in <module>
bootstrap(toolchain_root, packages)
File "/bigdata/apache-impala-3.3.0/bin/bootstrap_toolchain.py", line 225, in bootstrap
execute_many(handle_package, packages)
File "/bigdata/apache-impala-3.3.0/bin/bootstrap_toolchain.py", line 401, in execute_many
return pool.map(f, args, 1)
File "/usr/lib64/python2.7/multiprocessing/pool.py", line 250, in map
return self.map_async(func, iterable, chunksize).get()
File "/usr/lib64/python2.7/multiprocessing/pool.py", line 554, in get
raise self._value
sh.ErrorReturnCode_2

这个最坑,解决办法,就是/bigdata/apache-impala-3.3.0/toolchain目录下,把报错的文件和文件删除重新安装。

4,安装impala

# cd /bigdata/apache-impala-3.3.0
# export IMPALA_HOME=`pwd`
# $IMPALA_HOME/buildall.sh -noclean -notests

出现以下内容说明成功了

impala 源码安装

impala 源码安装

impala 安装成功

impala 安装成功

安装成功后,我并没有启动impala,因为bin/impala-config.sh中的hadoop,hive,hbase等,根现有的冲突。如果改bin/impala-config.sh里面配置,也是比较麻烦。所以建议,还是不要源码安装。



转载请注明
作者:海底苍鹰
地址:http://blog.51yip.com/hadoop/2218.html

留下评论

留下评论
  • (必需)
  • (必需) (will not be published)
  • (必需)   2X5=?