HBase Thrift2 Python客戶端API無效

Question

我正在寫一個python腳本從hbase加載數據。 但是thrift生成的文件似乎出了問題。 這是我的代碼：

def create_hbase_connection():
    thrift_socket = TSocket.TSocket(thrift_server, thrift_port)
    thrift_socket.setTimeout(thrift_timeout)
    thrift_transport = TTransport.TFramedTransport(thrift_socket)
    thrift_protocol = TBinaryProtocol.TBinaryProtocolAccelerated(thrift_transport)
    thrift_client = THBaseService.Client(thrift_protocol)
    try:
        thrift_transport.open()
    except Exception as e:
        print "connect to hbase thrift failed. (%s)" % e
        sys.exit()

    return thrift_protocol, thrift_client

def fetch_rows_from_hbase(thrift_protocol, thrift_client, start_row = None):
    tscan = ttypes.TScan()
    if start_row != None:
        tscan.startRow = start_row
    tscan.maxVersions = max_versions
    tscan.filterString = "FamilyFilter(!=, 'binary:ge')"
    scan_id = thrift_client.openScanner(hbase_table_name, tscan)
    result = thrift_client.getScannerRows(scan_id, row_limits + 1)
    print result
    print "=================================================\n"
    thrift_client.closeScanner(scan_id)
    thrift_protocol.close()

if __name__ == '__main__':
    thrift_protocol, thrift_client = create_hbase_connection()
    fetch_rows_from_hbase(thrift_protocol, thrift_client)

這是錯誤：

追溯（最近一次通話最近）：fetch_rows_from_hbase（thrift_protocol，thrift_client）中的文件“ ./load_hbase.py”，第46行，fetch_rows_from_hbase中的文件“ ./load_hbase.py”，第37行，scan_id = thrift_client.openScanner（hscan_table_name， ）在openScanner返回的self.recv_openScanner（）文件“ /home/lishaohua/kpn/load_hbase/thrift2/hbase/THBaseService.py”中，行715 ”，在recv_openScanner result.read（iprot）文件中的第735行，在讀取fastbinary.decode_binary（self，iprot.trans，（self）中的“ /home/lishaohua/kpn/load_hbase/thrift2/hbase/THBaseService.py”，第3278行， 。class ，self.thrift_spec））AttributeError：“ TFramedTransport”對象沒有屬性“ trans”

我檢查TTransport.py的代碼， TFramedTransport具有屬性self.__trans 。 如何解決這個問題？ 我可以簡單地將tans更改為__trans ，但是還有更多問題。

Answer 1

我使用了TBufferedTransport而不是TFramedTransport ，並且它起作用了。 您可以在下面嘗試我的解決方案：

class ThriftConn(object):
    def __init__(self, ip, port, service_cls):
        self.socket = TSocket.TSocket(ip, port)
        self.trans = TTransport.TBufferedTransport(self.socket)                                                                                                                                                   
        self.protocol = TBinaryProtocol.TBinaryProtocol(self.trans)
        self.client = service_cls.Client(self.protocol)

    def __enter__(self):
        self.trans.open()

    def __exit__(self, exception_type, exception_value, 
        exception_traceback):
        self.trans.close()

HBASE_SERVER_CLIENT = ThriftConn(ip, port, THBaseService)
with HBASE_SERVER_CLIENT:
    scan = TScan()
    scan_id = HBASE_SERVER_CLIENT.client.openScanner(table, scan)