postgres-xc-general Mailing List for Postgres-XC

Guys I am using pgxc_ctl to built a HA postgres-xc cluster with 4 
coordinator/datanodes and 2 gtm nodes:

I use the postgres-xc user and I have passwordless ssh between all nodes 
and the separate pgxc_ctl machine.
The dirs ~/bin and ~/pgxc/bin are in the $PATH of postgres-xc user.

These are the steps I followed:

1) Complile pgxc and tools:

postgres-xc@node-pgxc-ctl:~/pgxc-v1.0.2$ ./configure 
--prefix=/var/lib/postgres-xc/pgxc
postgres-xc@node-pgxc-ctl:~/pgxc-v1.0.2$ make
postgres-xc@node-pgxc-ctl:~/pgxc-v1.0.2$ make install
postgres-xc@node-pgxc-ctl:~/pgxc-v1.0.2$ cd contrib/
postgres-xc@node-pgxc-ctl:~/pgxc-v1.0.2/contrib$ make install
postgres-xc@node-pgxc-ctl:~/pgxc-v1.0.2/contrib$ cd pgxc_monitor/ # This 
is not included in latest pgxc. I had to download it separately.
postgres-xc@node-pgxc-ctl:~/pgxc-v1.0.2/contrib/pgxc_monitor$ make install

2) Download script:

I downloaded the pgxc_ctl in ~/bin and patched line 4566 (put a space in 
front of ']')

3) Cinfiguration of pgxc_ctl

Created the config file:

postgres-xc@node-pgxc-ctl:~$ pgxc_ctl prepare config

I edited ~/pgxc/pgxcConf such as:

http://pastebin.com/DHwpwdr1

4) Deployed:

postgres-xc@node-pgxc-ctl:~$ pgxc_ctl deploy all
wk.tgz 100% 7365KB   7.2MB/s   00:00
wk.tgz 100% 7365KB   7.2MB/s   00:00
wk.tgz 100% 7365KB   7.2MB/s   00:00
wk.tgz 100% 7365KB   7.2MB/s   00:00
wk.tgz 100% 7365KB   7.2MB/s   00:00
wk.tgz 100% 7365KB   7.2MB/s   00:01

deploy log:

http://pastebin.com/eETjNmmV

5) Initialize all:

postgres-xc@node-pgxc-ctl:~$ pgxc_ctl init

This gives a lot of errors. Init log:

http://pastebin.com/ML5HLJ2i

6) Monitor all

postgres-xc@node-pgxc-ctl:~$ pgxc_ctl monitor all
GTM master (gtm): running.    host: node-pgxcgtm01, port: 20001, dir: 
/var/lib/postgres-xc/pgxc/nodes/gtm
GTM slave (gtm): running.    host: node-pgxcgtm02, port: 20001, dir: 
/var/lib/postgres-xc/pgxc/nodes/gtm
GTM proxy (gtm_pxy1): running.    host: node-pgxcdb01, port: 20001, dir: 
/var/lib/postgres-xc/pgxc/nodes/gtm_pxy
GTM proxy (gtm_pxy2): running.    host: node-pgxcdb02, port: 20001, dir: 
/var/lib/postgres-xc/pgxc/nodes/gtm_pxy
GTM proxy (gtm_pxy3): running.    host: node-pgxcdb03, port: 20001, dir: 
/var/lib/postgres-xc/pgxc/nodes/gtm_pxy
GTM proxy (gtm_pxy4): running.    host: node-pgxcdb04, port: 20001, dir: 
/var/lib/postgres-xc/pgxc/nodes/gtm_pxy
Coordinator master (coord1): running.    host: node-pgxcdb01, port: 
20004, dir: /var/lib/postgres-xc/pgxc/nodes/coord
Coordinator master (coord2): running.    host: node-pgxcdb02, port: 
20005, dir: /var/lib/postgres-xc/pgxc/nodes/coord
Coordinator master (coord3): running.    host: node-pgxcdb03, port: 
20004, dir: /var/lib/postgres-xc/pgxc/nodes/coord
Coordinator master (coord4): running.    host: node-pgxcdb04, port: 
20005, dir: /var/lib/postgres-xc/pgxc/nodes/coord
Coordinator slave (coord1): running.    host: node-pgxcdb02, port: 
20004, dir: /var/lib/postgres-xc/pgxc/nodes/coord_slave
Coordinator slave (coord2): running.    host: node-pgxcdb03, port: 
20005, dir: /var/lib/postgres-xc/pgxc/nodes/coord_slave
Coordinator slave (coord3): running.    host: node-pgxcdb04, port: 
20004, dir: /var/lib/postgres-xc/pgxc/nodes/coord_slave
Coordinator slave (coord4): running.    host: node-pgxcdb01, port: 
20005, dir: /var/lib/postgres-xc/pgxc/nodes/coord_slave
Datanode master (datanode1): not running.    host: node-pgxcdb01, port: 
20008, dir: /var/lib/postgres-xc/pgxc/nodes/dn_master
Datanode master (datanode2): not running.    host: node-pgxcdb02, port: 
20009, dir: /var/lib/postgres-xc/pgxc/nodes/dn_master
Datanode master (datanode3): not running.    host: node-pgxcdb03, port: 
20008, dir: /var/lib/postgres-xc/pgxc/nodes/dn_master
Datanode master (datanode4): not running.    host: node-pgxcdb04, port: 
20009, dir: /var/lib/postgres-xc/pgxc/nodes/dn_master
Datanode slave (datanode1): not running.    host: node-pgxcdb02, port: 
20008, dir: /var/lib/postgres-xc/pgxc/nodes/dn_slave
Datanode slave (datanode2): not running.    host: node-pgxcdb03, port: 
20009, dir: /var/lib/postgres-xc/pgxc/nodes/dn_slave
Datanode slave (datanode3): not running.    host: node-pgxcdb04, port: 
20008, dir: /var/lib/postgres-xc/pgxc/nodes/dn_slave
Datanode slave (datanode4): not running.    host: node-pgxcdb01, port: 
20009, dir: /var/lib/postgres-xc/pgxc/nodes/dn_slave

But not all of the above information is true. Coordinators are all up 
but only the datanode masters are working:

# dsh -a 'echo "" ; echo $HOSTNAME ; echo "------------" ; ps auxw | 
grep postgres | grep dn'

node-pgxcdb01
------------
999      13843  0.0  0.3  53236  7308 ?        S    13:15   0:00 
/var/lib/postgres-xc/pgxc/bin/postgres -X -D 
/var/lib/postgres-xc/pgxc/nodes/dn_master -i
root     18229  0.0  0.0  11008  1432 ?        Ss   14:21   0:00 bash -c 
echo "" ; echo $HOSTNAME ; echo "------------" ; ps auxw | grep postgres 
| grep dn

node-pgxcdb02
------------
999      12911  0.0  0.3  53232  7304 ?        S    13:15   0:00 
/var/lib/postgres-xc/pgxc/bin/postgres -X -D 
/var/lib/postgres-xc/pgxc/nodes/dn_master -i
root     17295  0.0  0.0  11008  1436 ?        Ss   14:21   0:00 bash -c 
echo "" ; echo $HOSTNAME ; echo "------------" ; ps auxw | grep postgres 
| grep dn

node-pgxcdb03
------------
999      12918  0.0  0.3  53232  7312 ?        S    13:15   0:00 
/var/lib/postgres-xc/pgxc/bin/postgres -X -D 
/var/lib/postgres-xc/pgxc/nodes/dn_master -i
root     17383  0.0  0.0  11008  1436 ?        Ss   14:21   0:00 bash -c 
echo "" ; echo $HOSTNAME ; echo "------------" ; ps auxw | grep postgres 
| grep dn

node-pgxcdb04
------------
999      12920  0.0  0.3  53240  7316 ?        S    13:15   0:00 
/var/lib/postgres-xc/pgxc/bin/postgres -X -D 
/var/lib/postgres-xc/pgxc/nodes/dn_master -i
root     17270  0.0  0.0  11008  1432 ?        Ss   14:21   0:00 bash -c 
echo "" ; echo $HOSTNAME ; echo "------------" ; ps auxw | grep postgres 
| grep dn

node-pgxcgtm01
------------
root      7087  0.0  0.0  11008  1432 ?        Ss   14:21   0:00 bash -c 
echo "" ; echo $HOSTNAME ; echo "------------" ; ps auxw | grep postgres 
| grep dn

node-pgxcgtm02
------------
root      5913  0.0  0.0  11008  1432 ?        Ss   14:21   0:00 bash -c 
echo "" ; echo $HOSTNAME ; echo "------------" ; ps auxw | grep postgres 
| grep dn


Trying to start the slaves manually I get:
postgres-xc@node-pgxcdb01:~$ /var/lib/postgres-xc/pgxc/bin/postgres -X 
-D /var/lib/postgres-xc/pgxc/nodes/dn_slave/ -i
FATAL:  "/var/lib/postgres-xc/pgxc/nodes/dn_slave" is not a valid data 
directory
DETAIL:  File "/var/lib/postgres-xc/pgxc/nodes/dn_slave/PG_VERSION" is 
missing.

The datanode slaves have not been initialized because pg_basebackup 
fails with:

Questions:

a) Any idea what I am doing wrong? Init logs are not very clear what is 
the problem.

b) Can I run "pgxc_ctl deploy all" again? Will this mess up the current 
setup if I do?

c) Why does pgxc_monitor reports that datanode masters are down when are 
in fact working?

Guys hello

I get this

$ pgxc_ctl start coordinator master
/var/lib/postgres-xc/bin/pgxc_ctl: line 4566: [: missing `]'

I had to change this:

         if [ "$1" == "gtm" ] || [ "$1" == "$gtmName"]; then

to this:

         if [ "$1" == "gtm" ] || [ "$1" == "$gtmName" ]; then