using python read/write HBase data

A. operations on Server side

1. ensure hadoop and hbase are working properly

2. install thrift: apt-get install thrift

3. download hbase source code package: HERE(hbase 0.98 src) . Then extract package to /home/hadoop/hbase-0.98.12.1

4. cd /home/hadoop/hbase-0.98.12.1

thrift --gen py /hbase-thrift/src/main/resources/org/apache/hadoop/hbase/thrift/Hbase.thrift

5. cd /hbase-thrift/src/main/resources/org/apache/hadoop/hbase/thrift/

cp -r gen-py/ /usr/lib/python2.7/

6. RUN HBase Thrift： hbase thrift -p 9090 start

B. operation on Client side

1. pip install thrift

pip install hbase-thrift

C. TEST

1. on Server side, enter hbase shell

create'member','member_id','address','info'

create 'member1','member_id','address','info'

create 'member2','member_id','address','info'

2. on Client side,

from thrift import Thrift

from thrift.transport import TSocket

from thrift.transport import TTransport

from thrift.protocol import TBinaryProtocol

from hbase import Hbase

from hbase.ttypes import *

transport =TSocket.TSocket('192.168.2.107', 9090)

transport =TTransport.TBufferedTransport(transport)

protocol =TBinaryProtocol.TBinaryProtocol(transport)

client = Hbase.Client(protocol)

transport.open()

print(client.getTableNames())

3. run

REF:

http://www.cnblogs.com/hitandrew/archive/2013/01/21/2870419.html

http://edu.dataguru.cn/thread-354800-1-1.html

http://blog.csdn.net/a1368783069/article/details/51019835

巴特西

using python read/write HBase data

最新文章

热门文章