postgres-xc-general Mailing List for Postgres-XC

Hello to all

I am trying to setup a HA postgres-xc cluster according to this guide:

http://wiki.postgresql.org/images/4/44/Pgxc_HA_20121024.pdf

I am at the first step, configuring the GTM master (page 39). I have 
this configuration:

nodename = 'mygtmnode01'
listen_addresses = '*'
port = 6666
startup = ACT

I run this command as postgres-xc:
$ gtm_ctl -Z gtm -D /var/lib/postgres-xc/GTM start

The server start apparently at port 6666:

# netstat -lnptu | grep gtm
tcp        0      0 0.0.0.0:6666            0.0.0.0:* LISTEN      2408/gtm
tcp6       0      0 :::6666                 :::* LISTEN      2408/gtm

But checking the logs I get repeatedly the following messages:

1:139871852988224:2013-03-01 19:28:36.528 EET -LOG:  Any GTM standby 
node not found in registered node(s).
LOCATION:  gtm_standby_connect_to_standby_int, 
/build/buildd/postgres-xc-1.0.2/build/../src/gtm/main/gtm_standby.c:378
1:139871844607744:2013-03-01 19:28:36.528 EET -FATAL:  Expecting a 
startup message, but received �
LOCATION:  GTM_ThreadMain, 
/build/buildd/postgres-xc-1.0.2/build/../src/gtm/main/main.c:985
1:139871844607744:2013-03-01 19:28:36.529 EET -LOG:  Cleaning up thread 
state
LOCATION:  GTM_ThreadCleanup, 
/build/buildd/postgres-xc-1.0.2/build/../src/gtm/main/gtm_thread.c:265

That FATAL error above is scaring me. Am I doing something wrong?

I am running a 64 bit ubuntu (13.04) and I have install postegres-xc 
from the repositories.

I haven't set up the GTM standy yet.

Secondary question 1:

In the guide it says:
nodename = 'gtmName'
for both master and standby. Does this imply that they should have the 
same node name? Does it have to be the same as the hostname?

Secondary question 2:

In the GTM proxy procedure when the master fails it suggests to 
reconfigure the proxy to the new master (ex standby). Can we just switch 
the IP from master to slave using heartbeat or keepalived and avoid this 
step?

You would probably have figure it out already that my postgres-xc status 
is "newbie" :)

Thanks

Theo

Thank you for your fast responses,

We are running metrics on the system now, we loaded some data recently, and continuing to do so now. If Hint bits are the case, what steps can I take to relieve some of this IO?

From: Mason Sharp [mailto:ma...@st...]
Sent: Friday, March 01, 2013 2:29 PM
To: Arni Sumarlidason
Cc: pos...@li...; Postgres-XC Developers (pos...@li...)
Subject: Re: [Postgres-xc-general] IO PGXC


Sent from my IPhone

On Mar 1, 2013, at 4:13 PM, Arni Sumarlidason <Arn...@md...<mailto:Arn...@md...>> wrote:
Users,

I have 20 nodes sitting on a disk arrays, with multiple LUNs. when I issue queries – `select count(1) from table` for example, I am experiencing heavy writes and heavy reads. I expected the reads but not the writes and it has really thrown a wrench in the caching. My first assumption would be the log files, do you have any other ideas what could be causing all these writes with a select?

It could be vacuum. Also, did you just load data? Hint bits get updated, dirtying pages and causing them to be written.



Arni Sumarlidason | Software Engineer, Information Technology
MDA | 820 West Diamond Ave | Gaithersburg, MD | USA
O: 240-833-8200 D: 240-833-8318 M: 256-393-2803
arn...@md...<mailto:arn...@md...>| http://www.mdaus.com<https://console.mxlogic.com/redir/?4sMUMqenzhOqejrUVBxB4QsCzAS02lgRKDbUrLOrb0VVdOXMUTsSHJaM1l9RyGwgVsSYOYMrhpsjhsshpvdIICMnWhEwdbomHip6fQbxZyV7Uv7jPiWq80Qc6y0b181x8TfM-u0USyrpdIIczxNEVvsdD8rO>

------------------------------------------------------------------------------
Everyone hates slow websites. So do we.
Make your web apps faster with AppDynamics
Download AppDynamics Lite for free today:
http://p.sf.net/sfu/appdyn_d2d_feb<https://console.mxlogic.com/redir/?8VxNwQsL6zAQsCTNPb3a9EVd79I06JR7u1KktrPlBA2Q1l1d0ltYwrLOrb0VVdOXMUTsSHJaM1l9RyGwgVsSYOYMrhpsjhsshpvdIICMnWhEwdbomHip6fQbxZyV7Uv7jPiWq80Qc6y0b181x8TfM-u0USCrpdIIczxNEVvsdBa9a>
_______________________________________________
Postgres-xc-general mailing list
Pos...@li...<mailto:Pos...@li...>
https://lists.sourceforge.net/lists/listinfo/postgres-xc-general<https://console.mxlogic.com/redir/?2eosod7bNEVd79JYsOMOyqejhOr9PCJhbcfBiteFlKdLt00_MdM-l9QM-l9OwXn5GQChzZ2UvoKh-7NQYTvASm1POrBTxNKVJnqlw2GjH5l0xOVJVBVwSyOUCyUUyO-rppdwLQzh0qmMJmAOcvEn3X5OfM-eDCBQQg1Eod40m2g32hKvxYY1NJASOrpop73zhO-Ur0CfpYIDr>

Sent from my IPhone

On Mar 1, 2013, at 4:13 PM, Arni Sumarlidason <Arn...@md...> wrote:

> Users,
>  
> I have 20 nodes sitting on a disk arrays, with multiple LUNs. when I issue queries – `select count(1) from table` for example, I am experiencing heavy writes and heavy reads. I expected the reads but not the writes and it has really thrown a wrench in the caching. My first assumption would be the log files, do you have any other ideas what could be causing all these writes with a select?

It could be vacuum. Also, did you just load data? Hint bits get updated, dirtying pages and causing them to be written.

>  
> Arni Sumarlidason | Software Engineer, Information Technology
> MDA | 820 West Diamond Ave | Gaithersburg, MD | USA
> O: 240-833-8200 D: 240-833-8318 M: 256-393-2803
> arn...@md...| http://www.mdaus.com 
>  
> ------------------------------------------------------------------------------
> Everyone hates slow websites. So do we.
> Make your web apps faster with AppDynamics
> Download AppDynamics Lite for free today:
> http://p.sf.net/sfu/appdyn_d2d_feb
> _______________________________________________
> Postgres-xc-general mailing list
> Pos...@li...
> https://lists.sourceforge.net/lists/listinfo/postgres-xc-general

Hi Arni,

Am guessing that hint bits could be causing the I/O. See here:

http://wiki.postgresql.org/wiki/Hint_Bits

Regards,
Nikhils

On Fri, Mar 1, 2013 at 8:43 PM, Arni Sumarlidason
<Arn...@md...> wrote:
> Users,
>
>
>
> I have 20 nodes sitting on a disk arrays, with multiple LUNs. when I issue
> queries – `select count(1) from table` for example, I am experiencing heavy
> writes and heavy reads. I expected the reads but not the writes and it has
> really thrown a wrench in the caching. My first assumption would be the log
> files, do you have any other ideas what could be causing all these writes
> with a select?
>
>
>
> Arni Sumarlidason | Software Engineer, Information Technology
>
> MDA | 820 West Diamond Ave | Gaithersburg, MD | USA
>
> O: 240-833-8200 D: 240-833-8318 M: 256-393-2803
>
> arn...@md...| http://www.mdaus.com
>
>
>
>
> ------------------------------------------------------------------------------
> Everyone hates slow websites. So do we.
> Make your web apps faster with AppDynamics
> Download AppDynamics Lite for free today:
> http://p.sf.net/sfu/appdyn_d2d_feb
> _______________________________________________
> Postgres-xc-general mailing list
> Pos...@li...
> https://lists.sourceforge.net/lists/listinfo/postgres-xc-general
>



-- 
StormDB - http://www.stormdb.com
The Database Cloud
Postgres-XC Support and Service

Users,

I have 20 nodes sitting on a disk arrays, with multiple LUNs. when I issue queries - `select count(1) from table` for example, I am experiencing heavy writes and heavy reads. I expected the reads but not the writes and it has really thrown a wrench in the caching. My first assumption would be the log files, do you have any other ideas what could be causing all these writes with a select?

Arni Sumarlidason | Software Engineer, Information Technology
MDA | 820 West Diamond Ave | Gaithersburg, MD | USA
O: 240-833-8200 D: 240-833-8318 M: 256-393-2803
arn...@md...<mailto:arn...@md...>| http://www.mdaus.com<http://www.mdaus.com/>

I see.   Maybe we should have your experience in our Wiki page for other's.

Regards;
----------
Koichi Suzuki


2013/3/1 Maz Mohammadi <mmo...@pe...>:
> Hi Koichi,
>
> Thanks for replying to my email.  http://www.postgresql.org/docs/9.2/static/ssl-tcp.html  is a good introductory document.  But I already got the SSL working on postgres-xc and verified it from psql.  The best document to set it up was http://gurjeet-tech.blogspot.in/2012/04/generating-self-signed-ssl-certificates.html
>
> My problem now is connecting postgres from a java application server (tomcat).  I've already read and followed the instructions in http://jdbc.postgresql.org/documentation/91/ssl-client.html .  Frankly there are on 2 steps....
>
> 1) openssl x509 -in pg_server.crt -out pg_server.crt.der -outform der
> 2) keytool -keystore $JAVA_HOME/lib/security/cacerts -alias postgresql -import -file pg_server.crt.der
>
> I also augmented the JDBC url with the right parameters.
> ssl=true and
> sslfactory=org.postgresql.ssl.NonValidatingFactory
> I've added the JVM parameters....
> java -Djavax.net.ssl.trustStore=mystore -Djavax.net.ssl.trustStorePassword=password
>
> something I want to mention is that postgres-xc is running as user "postgres-xc".  My tomcat is running as user "adminuser"
>
> anything I'm missing on the java side?
>
> It looks like no one has done this before. :(
>
> -maz
>
> -----Original Message-----
> From: Koichi Suzuki [mailto:koi...@gm...]
> Sent: Thursday, February 28, 2013 2:58 AM
> To: Maz Mohammadi
> Cc: Jim Mlodgenski; pos...@li...
> Subject: Re: [Postgres-xc-general] can't access server through SSL
>
> How's
> http://www.postgresql.org/docs/9.2/static/ssl-tcp.html ?
> https://kb.berkeley.edu/page.php?id=23113 may include some more info.
> ----------
> Koichi Suzuki
>
>
> 2013/2/27 Maz Mohammadi <mmo...@pe...>:
>> BTW, I also added the mapping option in pg_hba.conf and created a
>> mapping in pg_ident.conf which maps the OS user that runs tomcat to my
>> postgres-xc user.  Still I'm getting the same error :(
>>
>> I've also turned on the debugging of ssl on jvm and getting a lot of message on console?  Can anyone suggest on what I should look for?
>>
>> -maz
>>
>> -----Original Message-----
>> From: Maz Mohammadi
>> Sent: Tuesday, February 26, 2013 9:18 AM
>> To: 'Jim Mlodgenski'
>> Cc: Nikhil Sontakke; pos...@li...
>> Subject: RE: [Postgres-xc-general] can't access server through SSL
>>
>> Well,
>>
>> First let me say, this document http://gurjeet-tech.blogspot.in/2012/04/generating-self-signed-ssl-certificates.html  was very helpful in enabling SSL on my server + accessing it through psql using a certificate.  It clearly specifies how each file (server.* and client.*) is created and how it is used.
>>
>> As for the 2nd part my problem of reaching it from tomcat server, I'm still getting the same error.
>> "Connection attempt failed: FATAL: connection requires a valid client certificate"
>>
>> http://jdbc.postgresql.org/documentation/91/ssl-client.html#nonvalidating does not contain a very complex set of steps.
>>
>> 1) openssl x509 -in pg_server.crt -out pg_server.crt.der -outform der
>> 2) keytool -keystore $JAVA_HOME/lib/security/cacerts -alias postgresql
>> -import -file pg_server.crt.der
>>
>> pg_server.crt is the same as server.crt file that I got from the blog posting's instructions.
>>
>> And this is my url.
>> "jdbc:postgresql://localhost:5432:testdb?ssl=true&sslfactory=org.postgresql.ssl.NonValidatingFactory"
>>
>> Do I need to sign the certificate?
>>
>> -----Original Message-----
>> From: Jim Mlodgenski [mailto:ji...@gm...]
>> Sent: Monday, February 25, 2013 2:18 PM
>> To: Maz Mohammadi
>> Cc: Nikhil Sontakke; pos...@li...
>> Subject: Re: [Postgres-xc-general] can't access server through SSL
>>
>> On Mon, Feb 25, 2013 at 1:42 PM, Maz Mohammadi <mmo...@pe...> wrote:
>>> Tada....
>>>
>>> postgres-xc@adminuser-VirtualBox:~/.postgresql$ psql -h localhost -p
>>> 5432 testdb psql (PGXC 1.0.0, based on PG 9.1.4) SSL connection
>>> (cipher: DHE-RSA-AES256-SHA, bits: 256) Type "help" for help.
>>>
>>> testdb=#
>>>
>>> now I gotta get it working from tomcat ;)
>>
>> Take a look at
>> http://jdbc.postgresql.org/documentation/91/ssl-client.html#nonvalidat
>> ing
>>
>> You'll probably want to have JDBC not validate the cert against the CA
>> until you can at least connect from Tomcat. To do that, you'll need to
>> append the following to you connection string
>> sslfactory=org.postgresql.ssl.NonValidatingFactory
>>
>>>
>>> -maz
>>>
>>> -----Original Message-----
>>> From: Jim Mlodgenski [mailto:ji...@gm...]
>>> Sent: Monday, February 25, 2013 11:31 AM
>>> To: Maz Mohammadi
>>> Cc: Nikhil Sontakke; pos...@li...
>>> Subject: Re: [Postgres-xc-general] can't access server through SSL
>>>
>>> On Mon, Feb 25, 2013 at 11:12 AM, Maz Mohammadi <mmo...@pe...> wrote:
>>>> Something tells me, I might not be doing things right :(
>>>
>>> It does appear things are a little twisted up.
>>>
>>>>
>>>> postgres-xc@adminuser-VirtualBox:~/coord$ echo $PGSSLKEY
>>>> /var/lib/postgres-xc/.postgresql/client.key
>>>> postgres-xc@adminuser-VirtualBox:~/coord$ echo $PGSSLCERT
>>>> /var/lib/postgres-xc/coord/server.crt
>>>> postgres-xc@adminuser-VirtualBox:~/coord$ openssl verify -CAfile
>>>> ../coord/root.crt client.crt
>>>> client.crt: OK
>>>> postgres-xc@adminuser-VirtualBox:~/coord$ psql -U postgres-xc -h
>>>> localhost -p 5432
>>>> psql: could not load private key file
>>>> "/var/lib/postgres-xc/.postgresql/client.key": key values mismatch
>>>> postgres-xc@adminuser-VirtualBox:~/coord$
>>>>
>>>
>>> Start first with just making sure you can connect via SSL on the server before adding in the certificate authentication. Try changing your pg_hba to:
>>> hostssl all             postgres-xc             127.0.0.1/32            trust
>>>
>>> And see if you can connect via psql. There will be a message displayed when connected that it is an ssl connection.
>>>
>>> Once you get past that, you can revert back to the original pg_hba and focus on the cert auth. Getting the client certificate correct is a little tricky. I believe you need to sign it using the server certificate, but I need to look that up to be sure. I think you also need to make sure you have the proper mapping in the pg_ident file even though the names might be the same.
>>>
>>>> when I generated the key for the client, I used 'postgres-xc' for Common Name, and when I generated it for the server, I used 'localhost'
>>>>
>>>> Do you think I'm digging myself into a whole?  Should I start from scratch and install postgres?
>>>
>>> You'll have the same issue using PostgreSQL. Its not a XC vs PG issue, just a severe lack of documentation on how to do it properly.
>>>
>>>>
>>>> -maz
>>>>
>>>> -----Original Message-----
>>>> From: Nikhil Sontakke [mailto:ni...@st...]
>>>> Sent: Monday, February 25, 2013 10:21 AM
>>>> To: Maz Mohammadi
>>>> Cc: Michael Paquier; pos...@li...
>>>> Subject: Re: [Postgres-xc-general] can't access server through SSL
>>>>
>>>> Try using
>>>>
>>>> PGSSLKEY=/path/to/agent.key in psql.
>>>>
>>>> Regards,
>>>> Nikhils
>>>>
>>>> On Mon, Feb 25, 2013 at 7:51 PM, Maz Mohammadi <mmo...@pe...> wrote:
>>>>> Well,  it seems that this is the way to connect it from the
>>>>> standard psql client.  But I'm getting there ;(
>>>>>
>>>>>
>>>>>
>>>>> --------------
>>>>>
>>>>> postgres-xc@adminuser-VirtualBox:~/coord$ whoami
>>>>>
>>>>> postgres-xc
>>>>>
>>>>> postgres-xc@adminuser-VirtualBox:~/coord$ echo $PSGSSLMODE
>>>>>
>>>>> require
>>>>>
>>>>> postgres-xc@adminuser-VirtualBox:~/coord$ echo $PGSSLCERT
>>>>>
>>>>> /var/lib/postgres-xc/datanode1/server.crt
>>>>>
>>>>> postgres-xc@adminuser-VirtualBox:~/coord$ ls -l server.*
>>>>>
>>>>> -rw-rw-r-- 1 postgres-xc postgres-xc 4608 Feb 25 09:00 server.crt
>>>>>
>>>>> -rw------- 1 postgres-xc postgres-xc 1679 Feb 25 09:00 server.key
>>>>>
>>>>> -rw-rw-r-- 1 postgres-xc postgres-xc 3587 Feb 25 09:00 server.req
>>>>>
>>>>> postgres-xc@adminuser-VirtualBox:~/coord$ psql -U postgres-xc -h
>>>>> localhost -p 5432
>>>>>
>>>>> psql: certificate present, but not private key file
>>>>> "/var/lib/postgres-xc/.postgresql/postgresql.key"
>>>>>
>>>>> postgres-xc@adminuser-VirtualBox:~/coord$ pwd
>>>>>
>>>>> /var/lib/postgres-xc/coord
>>>>>
>>>>> postgres-xc@adminuser-VirtualBox:~/coord$
>>>>>
>>>>> --------------
>>>>>
>>>>>
>>>>>
>>>>> Does the user 'postgres-xc' need to generate a private key file?
>>>>>
>>>>>
>>>>>
>>>>> postgresql.key does not exist.  I take it that it IS NOT the same
>>>>> as server.key which is under /var/lib/postgres-xc/coord.  Am I correct?
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> From: Michael Paquier [mailto:mic...@gm...]
>>>>> Sent: Monday, February 25, 2013 2:17 AM
>>>>> To: Nikhil Sontakke
>>>>> Cc: Maz Mohammadi; pos...@li...
>>>>>
>>>>>
>>>>> Subject: Re: [Postgres-xc-general] can't access server through SSL
>>>>>
>>>>>
>>>>>
>>>>>
>>>>>
>>>>> On Mon, Feb 25, 2013 at 4:10 PM, Nikhil Sontakke
>>>>> <ni...@st...>
>>>>> wrote:
>>>>>
>>>>> Hi Maz,
>>>>>
>>>>>
>>>>>> Is there a way to connect to the server using the psql by using a
>>>>>> certificate?
>>>>>>
>>>>>
>>>>> Does the below work for you?
>>>>>
>>>>> PSGSSLMODE=require PGSSLCERT=/path/to/agent.crt psql -d postgres -h
>>>>> localhost -p 5432
>>>>>
>>>>> Change PSGSSLMODE by PGSSLMODE. My 2c.
>>>>>
>>>>> --
>>>>> Michael
>>>>
>>>>
>>>>
>>>> --
>>>> StormDB - http://www.stormdb.com
>>>> The Database Cloud
>>>> Postgres-XC Support and Service
>>>>
>>>> --------------------------------------------------------------------
>>>> -
>>>> -
>>>> -------- Everyone hates slow websites. So do we.
>>>> Make your web apps faster with AppDynamics Download AppDynamics Lite
>>>> for free today:
>>>> http://p.sf.net/sfu/appdyn_d2d_feb
>>>> _______________________________________________
>>>> Postgres-xc-general mailing list
>>>> Pos...@li...
>>>> https://lists.sourceforge.net/lists/listinfo/postgres-xc-general
>>
>> ----------------------------------------------------------------------
>> -------- Everyone hates slow websites. So do we.
>> Make your web apps faster with AppDynamics Download AppDynamics Lite
>> for free today:
>> http://p.sf.net/sfu/appdyn_d2d_feb
>> _______________________________________________
>> Postgres-xc-general mailing list
>> Pos...@li...
>> https://lists.sourceforge.net/lists/listinfo/postgres-xc-general