jboss7.x - Infinispan Initial State Transfer Hangs and times out -

jboss7.x - Infinispan Initial State Transfer Hangs and times out -

i'm trying cluster pair of servers shared infinispan cache (replicated asynchronously). 1 starts successfully, , registers jdbc database. when other starts, registers database, , see bunch of chatter between them, then, while waiting on response sec server,

`org.infinispan.commons.cacheexception: initial statue transfer timed out`

i think it's issue of configuration, i'm not sure how debug configuration issues. i've spent several days configuring , re-configuring infinispan xml, , jgroups.xml:

infinispan:

<?xml version="1.0" encoding="utf-8"?> <infinispan xmlns:xsi="http://www.w3.org/2001/xmlschema-instance" xmlns="urn:infinispan:config:6.0" xsi:schemalocation="urn:infinispan:config:6.0 http://www.infinispan.org/schemas/infinispan-config-6.0.xsd urn:infinispan:config:remote:6.0 http://www.infinispan.org/schemas/infinispan-cachestore-remote-config-6.0.xsd" xmlns:remote="urn:infinispan:config:remote:6.0" > <!-- *************************** --> <!-- system-wide global settings --> <!-- *************************** --> <global> <shutdown hookbehavior="default"/> <transport clustername="dslobjectcache"> <properties> <property name="configurationfile" value="jgroups.xml"/> </properties> </transport> <globaljmxstatistics enabled="false" cachemanagername="complex.com"/> </global> <namedcache name="objectcache"> <transaction transactionmode="transactional" /> <locking uselockstriping="false" /> <invocationbatching enabled="true"/> <clustering mode="replication"> <async asyncmarshalling="true" usereplqueue="true" replqueueinterval="100" replqueuemaxelements="100"/> <statetransfer fetchinmemorystate="true" /> </clustering> <eviction strategy="lirs" maxentries="500000"/> <expiration lifespan="86400000" wakeupinterval="1000" /> </namedcache> <default> <!-- configure synchronous replication cache --> <locking uselockstriping="false" /> <clustering mode="replication"> <async asyncmarshalling="true" usereplqueue="true" replqueueinterval="100" replqueuemaxelements="100"/> <statetransfer fetchinmemorystate="true" /> </clustering> <eviction strategy="lirs" maxentries="500000"/> <expiration lifespan="86400000" wakeupinterval="1000" /> <persistence> <cluster remotecalltimeout="60000" /> </persistence> </default> </infinispan>

jboss.xml:

<config xmlns="urn:org:jgroups" xmlns:xsi="http://www.w3.org/2001/xmlschema-instance" xsi:schemalocation="urn:org:jgroups http://www.jgroups.org/schema/jgroups-3.0.xsd"> <!-- default external_addr #deadbeef can see errors coming through on backend --> <tcp external_addr="${injected.external.address:222.173.190.239}" receive_on_all_interfaces="true" bind_addr="0.0.0.0" bind_port="${injected.bind.port:12345}" conn_expire_time="0" reaper_interval="0" sock_conn_timeout="20000" tcp_nodelay="true" /> <jdbc_ping datasource_jndi_name="java:jboss/datasources/dsl/control" /> <merge2 max_interval="30000" min_interval="10000"/> <fd_sock external_addr="${injected.external.address:222.173.190.239}" bind_addr="0.0.0.0" /> <fd timeout="10000" max_tries="5"/> <verify_suspect timeout="1500" bind_addr="0.0.0.0" /> <pbcast.nakack use_mcast_xmit="false" retransmit_timeouts="300,600,1200,2400,4800" discard_delivered_msgs="true"/> <unicast3 ack_batches_immediately="true" /> <rsvp ack_on_delivery="true" throw_exception_on_timeout="true" timeout="1000" /> <pbcast.stable stability_delay="1000" desired_avg_gossip="50000" max_bytes="400000"/> <pbcast.gms print_local_addr="true" join_timeout="5000" view_bundling="true" view_ack_collection_timeout="5000"/> <frag2 frag_size="60000"/> <pbcast.state_sock bind_port="54321" external_addr="${injected.external.address:222.173.190.239}" bind_addr="0.0.0.0" /> <pbcast.flush timeout="1000"/> </config>

i've tried, frankly, every configuration alternative can think of, , i'm not sure why replication keeps timing out. communication between these servers wide open. sorry dump much xml, i'm not sure how collect more information.

continued exploration indicated infinispan pushing logs server.log, - due configuration, not duplicated on console. farther inspection revealed left single element in cache objects unserializable - making impossible written wire , transferred. logs very specific, making easy problem track downwards 1 time realized logs beingness written.

if come here future, advice tail every single log can on working server, , see comes up.

jboss7.x infinispan jgroups