Errors during installing edge-qpid-server

Google Cloud Apigee
1

Hi,

I tried to install Edge for Private cloud with 5 nodes, but resulted in error.

I did:

/opt/apigee/apigee-setup/bin/setup.sh -p sax -f /usr/local/myConfig

I saw these logs:

tailed install log is below:

apigee-service: edge-qpid-server: OK
apigee-service: edge-qpid-server: edge-qpid-server is running
Checking for qpid-server on 127.0.0.1 port 8083  .............................
qpid-server failed to answer on 127.0.0.1 port 8083.
Error: setup.sh: /opt/apigee/apigee-service/bin/apigee-service exited with unexpected status 1

/opt/apigee/var/log/edge-qpid-server/logs/system.log also has error lines:

2017-08-10 06:22:32,484  main INFO  ZOOKEEPER - ZooKeeperServiceImpl.exists() : Retry path existence path: /types, reason: KeeperErrorCode =
ConnectionLoss for /types
2017-08-10 06:22:32,485  main ERROR ZOOKEEPER - ZooKeeperServiceImpl.exists() : Could not detect existence of path: /types, reason: KeeperErr
orCode = ConnectionLoss for /types
2017-08-10 06:22:32,487  CuratorFramework-0-EventThread ERROR o.a.c.ConnectionState - ConnectionState.checkState() : Authentication failed

2017-08-10 06:22:32,508  main ERROR KERNEL.DEPLOYMENT - ServiceDeployer.init() : ServiceDeployer.init() : Got a life cycle exception while in
itializing service [ServerRegistrationService, Error while checking path existence for path : /types] : {}
com.apigee.zookeeper.ZooKeeperException: Error while checking path existence for path : /types
        at com.apigee.zookeeper.impl.ZooKeeperServiceImpl.exists(ZooKeeperServiceImpl.java:407) ~[zookeeper-1.0.0.jar:na]
        at com.apigee.zookeeper.impl.ZooKeeperServiceImpl.exists(ZooKeeperServiceImpl.java:391) ~[zookeeper-1.0.0.jar:na]
        at com.apigee.services.repository.zookeeper.ZKRepository.exists(ZKRepository.java:311) ~[repository-impl-1.0.0.jar:na]
        at com.apigee.services.repository.RepositoryServiceImpl.exists(RepositoryServiceImpl.java:224) ~[repository-impl-1.0.0.jar:na]
        at com.apigee.registration.ServerRegistrationServiceImpl.getServerTypes(ServerRegistrationServiceImpl.java:272) ~[registration-1.0.0.
jar:na]
        at com.apigee.registration.ServerRegistrationServiceImpl.initResolutionScopes(ServerRegistrationServiceImpl.java:289) ~[registration-
1.0.0.jar:na]
        at com.apigee.registration.ServerRegistrationServiceImpl.init(ServerRegistrationServiceImpl.java:130) ~[registration-1.0.0.jar:na]
        at com.apigee.kernel.service.deployment.ServiceDeployer.init(ServiceDeployer.java:145) [microkernel-1.0.0.jar:na]
        at com.apigee.kernel.service.deployment.ServiceDeployer.initDependantServices(ServiceDeployer.java:372) [microkernel-1.0.0.jar:na]
        at com.apigee.kernel.service.deployment.ServiceDeployer.init(ServiceDeployer.java:159) [microkernel-1.0.0.jar:na]
        at com.apigee.kernel.service.deployment.ServiceDeployer.initDependantServices(ServiceDeployer.java:372) [microkernel-1.0.0.jar:na]
        at com.apigee.kernel.service.deployment.ServiceDeployer.init(ServiceDeployer.java:159) [microkernel-1.0.0.jar:na]
        at com.apigee.kernel.MicroKernel.initAll(MicroKernel.java:229) [microkernel-1.0.0.jar:na]
        at com.apigee.kernel.MicroKernel.init(MicroKernel.java:133) [microkernel-1.0.0.jar:na]
        at com.apigee.kernel.MicroKernel.start(MicroKernel.java:139) [microkernel-1.0.0.jar:na]
        at com.apigee.kernel.MicroKernel.main(MicroKernel.java:91) [microkernel-1.0.0.jar:na]
Caused by: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /types
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:99) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
        at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
        at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1073) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
        at com.apigee.zookeeper.impl.ZooKeeperServiceImpl.exists(ZooKeeperServiceImpl.java:399) ~[zookeeper-1.0.0.jar:na]
        ... 15 common frames omitted
2017-08-10 06:22:32,511  main ERROR KERNEL - MicroKernel.initAll() : MicroKernel.initAll() : Error in Initializing the deployment : ZooKeeperService
com.apigee.zookeeper.ZooKeeperException: Error while checking path existence for path : /types
        at com.apigee.zookeeper.impl.ZooKeeperServiceImpl.exists(ZooKeeperServiceImpl.java:407) ~[zookeeper-1.0.0.jar:na]
        at com.apigee.zookeeper.impl.ZooKeeperServiceImpl.exists(ZooKeeperServiceImpl.java:391) ~[zookeeper-1.0.0.jar:na]
        at com.apigee.services.repository.zookeeper.ZKRepository.exists(ZKRepository.java:311) ~[repository-impl-1.0.0.jar:na]
        at com.apigee.services.repository.RepositoryServiceImpl.exists(RepositoryServiceImpl.java:224) ~[repository-impl-1.0.0.jar:na]
        at com.apigee.registration.ServerRegistrationServiceImpl.getServerTypes(ServerRegistrationServiceImpl.java:272) ~[registration-1.0.0.jar:na]
        at com.apigee.registration.ServerRegistrationServiceImpl.initResolutionScopes(ServerRegistrationServiceImpl.java:289) ~[registration-1.0.0.jar:na]
        at com.apigee.registration.ServerRegistrationServiceImpl.init(ServerRegistrationServiceImpl.java:130) ~[registration-1.0.0.jar:na]
        at com.apigee.kernel.service.deployment.ServiceDeployer.init(ServiceDeployer.java:145) ~[microkernel-1.0.0.jar:na]
        at com.apigee.kernel.service.deployment.ServiceDeployer.initDependantServices(ServiceDeployer.java:372) ~[microkernel-1.0.0.jar:na]
        at com.apigee.kernel.service.deployment.ServiceDeployer.init(ServiceDeployer.java:159) ~[microkernel-1.0.0.jar:na]
        at com.apigee.kernel.service.deployment.ServiceDeployer.initDependantServices(ServiceDeployer.java:372) ~[microkernel-1.0.0.jar:na]
        at com.apigee.kernel.service.deployment.ServiceDeployer.init(ServiceDeployer.java:159) ~[microkernel-1.0.0.jar:na]
        at com.apigee.kernel.MicroKernel.initAll(MicroKernel.java:229) [microkernel-1.0.0.jar:na]
        at com.apigee.kernel.MicroKernel.init(MicroKernel.java:133) [microkernel-1.0.0.jar:na]
        at com.apigee.kernel.MicroKernel.start(MicroKernel.java:139) [microkernel-1.0.0.jar:na]
        at com.apigee.kernel.MicroKernel.main(MicroKernel.java:91) [microkernel-1.0.0.jar:na]
Caused by: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /types
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:99) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
        at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
        at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1073) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
        at com.apigee.zookeeper.impl.ZooKeeperServiceImpl.exists(ZooKeeperServiceImpl.java:399) ~[zookeeper-1.0.0.jar:na]
        ... 15 common frames omitted

2017-08-10 06:22:32,512  main ERROR KERNEL - MicroKernel.main() : MicroKernel.main() : Error in starting up the kernel : Error while checking path existence for path : /types
com.apigee.zookeeper.ZooKeeperException: Error while checking path existence for path : /types
        at com.apigee.zookeeper.impl.ZooKeeperServiceImpl.exists(ZooKeeperServiceImpl.java:407) ~[zookeeper-1.0.0.jar:na]
        at com.apigee.zookeeper.impl.ZooKeeperServiceImpl.exists(ZooKeeperServiceImpl.java:391) ~[zookeeper-1.0.0.jar:na]
        at com.apigee.services.repository.zookeeper.ZKRepository.exists(ZKRepository.java:311) ~[repository-impl-1.0.0.jar:na]
        at com.apigee.services.repository.RepositoryServiceImpl.exists(RepositoryServiceImpl.java:224) ~[repository-impl-1.0.0.jar:na]
        at com.apigee.registration.ServerRegistrationServiceImpl.getServerTypes(ServerRegistrationServiceImpl.java:272) ~[registration-1.0.0.jar:na]
        at com.apigee.registration.ServerRegistrationServiceImpl.initResolutionScopes(ServerRegistrationServiceImpl.java:289) ~[registration-1.0.0.jar:na]
        at com.apigee.registration.ServerRegistrationServiceImpl.init(ServerRegistrationServiceImpl.java:130) ~[registration-1.0.0.jar:na]
        at com.apigee.kernel.service.deployment.ServiceDeployer.init(ServiceDeployer.java:145) ~[microkernel-1.0.0.jar:na]
        at com.apigee.kernel.service.deployment.ServiceDeployer.initDependantServices(ServiceDeployer.java:372) ~[microkernel-1.0.0.jar:na]
        at com.apigee.kernel.service.deployment.ServiceDeployer.init(ServiceDeployer.java:159) ~[microkernel-1.0.0.jar:na]
        at com.apigee.kernel.service.deployment.ServiceDeployer.initDependantServices(ServiceDeployer.java:372) ~[microkernel-1.0.0.jar:na]
        at com.apigee.kernel.service.deployment.ServiceDeployer.init(ServiceDeployer.java:159) ~[microkernel-1.0.0.jar:na]
        at com.apigee.kernel.MicroKernel.initAll(MicroKernel.java:229) ~[microkernel-1.0.0.jar:na]
        at com.apigee.kernel.MicroKernel.init(MicroKernel.java:133) ~[microkernel-1.0.0.jar:na]
        at com.apigee.kernel.MicroKernel.start(MicroKernel.java:139) ~[microkernel-1.0.0.jar:na]
        at com.apigee.kernel.MicroKernel.main(MicroKernel.java:91) ~[microkernel-1.0.0.jar:na]
Caused by: org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /types
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:99) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
        at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1045) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
        at org.apache.zookeeper.ZooKeeper.exists(ZooKeeper.java:1073) ~[zookeeper-3.4.6.jar:3.4.6-1569965]
        at com.apigee.zookeeper.impl.ZooKeeperServiceImpl.exists(ZooKeeperServiceImpl.java:399) ~[zookeeper-1.0.0.jar:na]
        ... 15 common frames omitted
  • environment
    • apigee-edge: version 4.17.01 (local repo)
    • OS: CentOS 7.3 (CentOS Linux release 7.3.1611 (Core))
    • java: openjdk version “1.8.0_141”
    • config: attached myconfig.txt

I already did these solutions:

  • remove ipv6 line from /etc/hosts
  • create /opt/apigee/customer/default.sh, and PORT_TIMEOUT=1200
  • entropy related problem

How can I fix this problem?

2

@Akihiro Honda

the error you are getting is this

2017-08-1006:22:32,487CuratorFramework-0-EventThread ERROR o.a.c.ConnectionState-ConnectionState.checkState():Authentication failed<br>

Please check what your hostname -i resolves to and that it is the IP address of the server.  Also check if you have both private and or public IP's on that same node.  If the hostname -i can't resolve it looks on local host therefore not connecting to ZK or C* and errors out.
3

@Christin Brown

thank you for answering my question, and sorry for late to see this article

the server for sax has only one private IP address.

$ hostname -i
192.168.122.204

and also that host is reachable to ZK hosts..

$ ping 192.168.122.201
PING 192.168.122.201 (192.168.122.201) 56(84) bytes of data.
64 bytes from 192.168.122.201: icmp_seq=1 ttl=64 time=0.751 ms
$ ping 192.168.122.202
PING 192.168.122.202 (192.168.122.202) 56(84) bytes of data.
64 bytes from 192.168.122.202: icmp_seq=1 ttl=64 time=1.47 ms
$ ping 192.168.122.203
PING 192.168.122.203 (192.168.122.203) 56(84) bytes of data.
64 bytes from 192.168.122.203: icmp_seq=1 ttl=64 time=1.13 ms
4

Any luck solving this? I’m having the exactly same problem with all-in-one installation.

5

I had this exact same issue(errors and all) with all in one(aio) installation.

Not sure if this would work for you, but I changed the configFile default settings for Zookeeper from:

ZK_HOSTS="$IP1 $IP2 $IP3"# IP/DNS names of all ZooKeeper nodes. <br>ZK_CLIENT_HOSTS="$IP1 $IP2 $IP3"# IP/DNS names of all ZooKeeper nodes.

to:

ZK_HOSTS="$IP1"# IP/DNS names of all ZooKeeper nodes. <br>ZK_CLIENT_HOSTS="$IP1"# IP/DNS names of all ZooKeeper nodes.

Which fixed it for me. I suspect that this issue is hostname-related(having multiple of the same hostnames for aio may have triggered this error).

6

Could you please update how this was resolved in 5 node installation?