2016.02.20 / 16:56
HBase - Client 접속시 Z 노드(zookeeper.znode.parent) 설정
야옹이
추천 수 541
# HBase 원격 접속 오류
> HBase master 서버에 직접 접속한 상태에서는 정상적인 작업이 진행 되지만, 외부에서 접근시 아래와 같은 오류가 발생하는 경우
java.net.SocketTimeoutException: callTimeout=600000, callDuration=863625:
at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:156)
at org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:3390)
at org.apache.hadoop.hbase.client.HBaseAdmin.disableTableAsync(HBaseAdmin.java:935)
at org.apache.hadoop.hbase.client.HBaseAdmin.disableTable(HBaseAdmin.java:967)
at org.apache.hadoop.hbase.client.HBaseAdmin.disableTable(HBaseAdmin.java:1002)
at iq_project.hbase_test_0_1.HBase_Test.tFixedFlowInput_1Process(HBase_Test.java:1032)
at iq_project.hbase_test_0_1.HBase_Test.tJava_1Process(HBase_Test.java:442)
at iq_project.hbase_test_0_1.HBase_Test.runJobInTOS(HBase_Test.java:1700)
at iq_project.hbase_test_0_1.HBase_Test.main(HBase_Test.java:1527)
Caused by: org.apache.hadoop.hbase.MasterNotRunningException: java.io.IOException: Can't get master address from ZooKeeper; znode data == null
at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$StubMaker.makeStub(ConnectionManager.java:1627)
at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$MasterServiceStubMaker.makeStub(ConnectionManager.java:1653)
at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.getKeepAliveMasterService(ConnectionManager.java:1860)
at org.apache.hadoop.hbase.client.HBaseAdmin$MasterCallable.prepare(HBaseAdmin.java:3363)
at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:125)
... 8 more
Caused by: java.io.IOException: Can't get master address from ZooKeeper; znode data == null
at org.apache.hadoop.hbase.zookeeper.MasterAddressTracker.getMasterAddress(MasterAddressTracker.java:114)
at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$StubMaker.makeStubNoRetries(ConnectionManager.java:1554)
at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$StubMaker.makeStub(ConnectionManager.java:1599)
... 12 more
at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:156)
at org.apache.hadoop.hbase.client.HBaseAdmin.executeCallable(HBaseAdmin.java:3390)
at org.apache.hadoop.hbase.client.HBaseAdmin.disableTableAsync(HBaseAdmin.java:935)
at org.apache.hadoop.hbase.client.HBaseAdmin.disableTable(HBaseAdmin.java:967)
at org.apache.hadoop.hbase.client.HBaseAdmin.disableTable(HBaseAdmin.java:1002)
at iq_project.hbase_test_0_1.HBase_Test.tFixedFlowInput_1Process(HBase_Test.java:1032)
at iq_project.hbase_test_0_1.HBase_Test.tJava_1Process(HBase_Test.java:442)
at iq_project.hbase_test_0_1.HBase_Test.runJobInTOS(HBase_Test.java:1700)
at iq_project.hbase_test_0_1.HBase_Test.main(HBase_Test.java:1527)
Caused by: org.apache.hadoop.hbase.MasterNotRunningException: java.io.IOException: Can't get master address from ZooKeeper; znode data == null
at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$StubMaker.makeStub(ConnectionManager.java:1627)
at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$MasterServiceStubMaker.makeStub(ConnectionManager.java:1653)
at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation.getKeepAliveMasterService(ConnectionManager.java:1860)
at org.apache.hadoop.hbase.client.HBaseAdmin$MasterCallable.prepare(HBaseAdmin.java:3363)
at org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:125)
... 8 more
Caused by: java.io.IOException: Can't get master address from ZooKeeper; znode data == null
at org.apache.hadoop.hbase.zookeeper.MasterAddressTracker.getMasterAddress(MasterAddressTracker.java:114)
at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$StubMaker.makeStubNoRetries(ConnectionManager.java:1554)
at org.apache.hadoop.hbase.client.ConnectionManager$HConnectionImplementation$StubMaker.makeStub(ConnectionManager.java:1599)
... 12 more
> 원인 : 원격지 Client에서 HBase master에 접근할 수 있는 Z 노드(zookeeper.znode.parent) 경로가 없을때 발생
보안 서비스가 실행중일경우에는 /hbase-secure 상태로 변경
> zookeeper.znode.parent 경로 확인
1) 설정 파일에서 확인 : $HBASE_HOME/conf/hbase-site.xml
1 2 3 4 | <property> <name>zookeeper.znode.parent</name> <value>/hbase-unsecure</value> </property> |
2) HBase shell 에서 확인
hbase(main):001:0> zk_dump
HBase is rooted at /hbase-unsecure
Active master address: single.iqdp,16000,1446957095899
Backup master addresses:
Region server holding hbase:meta: single.iqdp,16020,1446957107759
Region servers:
single.iqdp,16020,1446957107759
/hbase-unsecure/replication:
/hbase-unsecure/replication/peers:
/hbase-unsecure/replication/rs:
/hbase-unsecure/replication/rs/single.iqdp,16020,1446957107759:
Quorum Server Statistics:
single.iqdp:2181
Zookeeper version: 3.4.6-2950--1, built on 09/30/2015 17:44 GMT
Clients:
/192.168.1.14:59999[1](queued=0,recved=19186,sent=19186)
/192.168.1.14:56554[1](queued=0,recved=5812,sent=5812)
/192.168.1.14:39439[1](queued=0,recved=12,sent=12)
/192.168.1.14:56551[1](queued=0,recved=11496,sent=11551)
/192.168.1.14:39424[1](queued=0,recved=4,sent=4)
/192.168.1.14:58305[1](queued=0,recved=77885,sent=77885)
/192.168.1.14:56563[1](queued=0,recved=5959,sent=5959)
/192.168.1.14:56564[1](queued=0,recved=5813,sent=5813)
/192.168.1.14:56572[1](queued=0,recved=5811,sent=5811)
/192.168.1.14:56552[1](queued=0,recved=5816,sent=5816)
/192.168.1.14:56555[1](queued=0,recved=6673,sent=6673)
/192.168.1.14:39443[0](queued=0,recved=1,sent=0)
Latency min/avg/max: 0/0/28
Received: 271514
Sent: 271798
Connections: 12
Outstanding: 0
Zxid: 0x142e
Mode: standalone
Node count: 873
HBase is rooted at /hbase-unsecure
Active master address: single.iqdp,16000,1446957095899
Backup master addresses:
Region server holding hbase:meta: single.iqdp,16020,1446957107759
Region servers:
single.iqdp,16020,1446957107759
/hbase-unsecure/replication:
/hbase-unsecure/replication/peers:
/hbase-unsecure/replication/rs:
/hbase-unsecure/replication/rs/single.iqdp,16020,1446957107759:
Quorum Server Statistics:
single.iqdp:2181
Zookeeper version: 3.4.6-2950--1, built on 09/30/2015 17:44 GMT
Clients:
/192.168.1.14:59999[1](queued=0,recved=19186,sent=19186)
/192.168.1.14:56554[1](queued=0,recved=5812,sent=5812)
/192.168.1.14:39439[1](queued=0,recved=12,sent=12)
/192.168.1.14:56551[1](queued=0,recved=11496,sent=11551)
/192.168.1.14:39424[1](queued=0,recved=4,sent=4)
/192.168.1.14:58305[1](queued=0,recved=77885,sent=77885)
/192.168.1.14:56563[1](queued=0,recved=5959,sent=5959)
/192.168.1.14:56564[1](queued=0,recved=5813,sent=5813)
/192.168.1.14:56572[1](queued=0,recved=5811,sent=5811)
/192.168.1.14:56552[1](queued=0,recved=5816,sent=5816)
/192.168.1.14:56555[1](queued=0,recved=6673,sent=6673)
/192.168.1.14:39443[0](queued=0,recved=1,sent=0)
Latency min/avg/max: 0/0/28
Received: 271514
Sent: 271798
Connections: 12
Outstanding: 0
Zxid: 0x142e
Mode: standalone
Node count: 873
> Client에 Z 노드(zookeeper.znode.parent) 값 설정
1) Java 소스상에서의 속성 값 설정
1 2 3 4 5 | Configuration conf = HBaseConfiguration.create(); conf.clear(); conf.set("hbase.zookeeper.quorum", "zookeeper_host"); conf.set("zookeeper.znode.parent", "/hbase-unsecure"); |
2) TOSBD(Talend Open Studio for Big Data) 의 설정
