postgres-xc-developers Mailing List for Postgres-XC (Page 2)

On Wed, 2011-10-12 at 17:29 +0900, Michael Paquier wrote:
> What is the environment you are using?
> I have it working on CentOS 5.6 and Ubuntu 10.04. 

Fedora 15, gcc 4.6.1.

..and just duplicated it on Scientific Linux 6.1  (See bottom for more)

============================================================
============== creating temporary installation        ==============
============== initializing database system           ==============
============== starting postmaster                    ==============
============== starting GTM process                   ==============
running on port 57333 with PID 4883 for Coordinator 1
running on port 5433 with PID 4884 for Coordinator 2
running on port 5434 with PID 4886 for Datanode 1
running on port 5435 with PID 4888 for Datanode 2
============== creating database "regression"         ==============
psql: could not connect to server: No such file or directory
	Is the server running locally and accepting
	connections on Unix domain socket "/tmp/.s.PGSQL.57333"?
command failed: "/home/devrim/tmp/pgxc-0.9.6/src/test/regress/./tmp_check/install//usr/local/pgsql/bin/psql" -X -c "CREATE DATABASE \"regression\" TEMPLATE=template0" "postgres"
pg_ctl: PID file "/home/devrim/tmp/pgxc-0.9.6/src/test/regress/./tmp_check/data_co1/postmaster.pid" does not exist
Is server running?

pg_regress: could not stop postmaster: exit code was 256



Well, looking at the logs, here is what I have found (symptoms are different on SL and Fedora, though)

* AFAICS XC picks up ports starting with 5433. That is not good, since I
have already an instance running on 5433 on my SL 6.1 box.

* Apparently postmaster could not start for the Datanodes, because of
limited shmmax availability on my SL box (even though the message above
claims that postmaster is running)

*  cat postmaster_2.log 
FATAL:  could not open lock file "/tmp/.s.PGSQL.5434.lock": Permission
denied

This is on my Fedora box, and apparently it is because of the port
selection again:

ls -al /tmp/.s.PGSQL.5434.lock
-rw------- 1 postgres postgres 52 Oct  6 03:42 /tmp/.s.PGSQL.5434.lock


Hope these help.



-- 
Devrim GÜNDÜZ
Principal Systems Engineer @ EnterpriseDB: http://www.enterprisedb.com
PostgreSQL Danışmanı/Consultant, Red Hat Certified Engineer
Community: devrim~PostgreSQL.org, devrim.gunduz~linux.org.tr
http://www.gunduz.org  Twitter: http://twitter.com/devrimgunduz

What is the environment you are using?
I have it working on CentOS 5.6 and Ubuntu 10.04.

2011/10/12 Devrim GÜNDÜZ <de...@gu...>

> On Wed, 2011-10-12 at 10:42 +0900, Michael Paquier wrote:
> >
> > I just pushed in repository a new stable branch called REL0_9_6_STABLE
> > on
> > which will be based release 0.9.6.
>
> make check fails:
>
> mkdir ./testtablespace
> ../../../src/test/regress/pg_regress --inputdir=.
> --temp-install=./tmp_check --top-builddir=../../..   --dlpath=.
> --schedule=./parallel_schedule
> ============== removing existing temp installation    ==============
> ============== creating temporary installation        ==============
> ============== initializing database system           ==============
> ============== starting postmaster                    ==============
> ============== starting GTM process                   ==============
> running on port 57333 with PID 10638 for Coordinator 1
> running on port 5433 with PID 10647 for Coordinator 2
> running on port 5434 with PID 10656 for Datanode 1
> running on port 5435 with PID 10657 for Datanode 2
> ============== creating database "regression"         ==============
> ERROR:  Failed to get pooled connections
> command failed:
> "/home/devrim/Downloads/pgxc-0.9.6/src/test/regress/./tmp_check/install//usr/local/pgxc096/bin/psql"
> -X -c "CREATE DATABASE \"regression\" TEMPLATE=template0" "postgres"
> pg_ctl: PID file
> "/home/devrim/Downloads/pgxc-0.9.6/src/test/regress/./tmp_check/data_dn1/postmaster.pid"
> does not exist
> Is server running?
>
> pg_regress: could not stop postmaster: exit code was 256
> make[2]: *** [check] Error 2
> make[2]: Leaving directory
> `/home/devrim/Downloads/pgxc-0.9.6/src/test/regress'
> make[1]: *** [check] Error 2
> make[1]: Leaving directory `/home/devrim/Downloads/pgxc-0.9.6/src/test'
> make: *** [check] Error 2
>
> --
> Devrim GÜNDÜZ
> Principal Systems Engineer @ EnterpriseDB: http://www.enterprisedb.com
> PostgreSQL Danışmanı/Consultant, Red Hat Certified Engineer
> Community: devrim~PostgreSQL.org, devrim.gunduz~linux.org.tr
> http://www.gunduz.org  Twitter: http://twitter.com/devrimgunduz
>



-- 
Michael Paquier
http://michael.otacoo.com

On Wed, 2011-10-12 at 10:42 +0900, Michael Paquier wrote:
> 
> I just pushed in repository a new stable branch called REL0_9_6_STABLE
> on
> which will be based release 0.9.6. 

make check fails:

mkdir ./testtablespace
../../../src/test/regress/pg_regress --inputdir=. --temp-install=./tmp_check --top-builddir=../../..   --dlpath=. --schedule=./parallel_schedule   
============== removing existing temp installation    ==============
============== creating temporary installation        ==============
============== initializing database system           ==============
============== starting postmaster                    ==============
============== starting GTM process                   ==============
running on port 57333 with PID 10638 for Coordinator 1
running on port 5433 with PID 10647 for Coordinator 2
running on port 5434 with PID 10656 for Datanode 1
running on port 5435 with PID 10657 for Datanode 2
============== creating database "regression"         ==============
ERROR:  Failed to get pooled connections
command failed: "/home/devrim/Downloads/pgxc-0.9.6/src/test/regress/./tmp_check/install//usr/local/pgxc096/bin/psql" -X -c "CREATE DATABASE \"regression\" TEMPLATE=template0" "postgres"
pg_ctl: PID file "/home/devrim/Downloads/pgxc-0.9.6/src/test/regress/./tmp_check/data_dn1/postmaster.pid" does not exist
Is server running?

pg_regress: could not stop postmaster: exit code was 256
make[2]: *** [check] Error 2
make[2]: Leaving directory `/home/devrim/Downloads/pgxc-0.9.6/src/test/regress'
make[1]: *** [check] Error 2
make[1]: Leaving directory `/home/devrim/Downloads/pgxc-0.9.6/src/test'
make: *** [check] Error 2

-- 
Devrim GÜNDÜZ
Principal Systems Engineer @ EnterpriseDB: http://www.enterprisedb.com
PostgreSQL Danışmanı/Consultant, Red Hat Certified Engineer
Community: devrim~PostgreSQL.org, devrim.gunduz~linux.org.tr
http://www.gunduz.org  Twitter: http://twitter.com/devrimgunduz

Hi all,

I just pushed in repository a new stable branch called REL0_9_6_STABLE on
which will be based release 0.9.6.
This branch includes all the commits of branch 9.1 stable up to yesterday
from postgres GIT repository.

Regards,
-- 
Michael Paquier
http://michael.otacoo.com

Hi all,

Please find attached a patch that fixes regression tests with serial
schedule in the case where multiple coordinators are in use. With 5 tests in
a row, I saw no assertion failures.
This patch helps also in stabilizing parallel scheduling by making disappear
freeze issues.
This is an important fix, so it would be nice if extra testing is done
before commit.

Regards,
-- 
Michael Paquier
http://michael.otacoo.com

I applied only that fix for now since these are two different bugs

Sent from my iPhone

On 03-Oct-2011, at 6:41 PM, Michael Paquier <mic...@gm...> wrote:

> Has the patch been correctly applied on master?
> This commit mail, gitweb, and the commit fetched look kind of weird, only the diffs in explain.c appear.
> -- 
> Michael Paquier
> http://michael.otacoo.com
> ------------------------------------------------------------------------------
> All the data continuously generated in your IT infrastructure contains a
> definitive record of customers, application performance, security
> threats, fraudulent activity and more. Splunk takes this data and makes
> sense of it. Business sense. IT sense. Common sense.
> http://p.sf.net/sfu/splunk-d2dcopy1
> _______________________________________________
> Postgres-xc-developers mailing list
> Pos...@li...
> https://lists.sourceforge.net/lists/listinfo/postgres-xc-developers

Has the patch been correctly applied on master?
This commit mail, gitweb, and the commit fetched look kind of weird, only
the diffs in explain.c appear.
-- 
Michael Paquier
http://michael.otacoo.com

Hi Michael,
I was able to run the regression (make installcheck with 2 datanodes, 1
coordinator) 4 times in row without rebuilding data cluster or re-booting
the XC instances. So, it looks like the patch you gave has fixed the
assertion failure, which I could observe in two successive runs of
regression.

On Mon, Oct 3, 2011 at 11:30 AM, Ashutosh Bapat <
ash...@en...> wrote:

> I am running regression with your previous patch. It consistently gave me
> Failed to get pooled connections error. So, I rebuilt data cluster and now
> the regression is running. I will try again to see if the issue is gone.
>
> On Mon, Oct 3, 2011 at 11:26 AM, Michael Paquier <
> mic...@gm...> wrote:
>
>> Hi,
>>
>> Please find attached the patch fixing all the regression issues and stable
>> with DBT-1.
>> I think this patch is good for commit.
>>
>> Regards,
>>
>> --
>> Michael Paquier
>> http://michael.otacoo.com
>>
>>
>> ------------------------------------------------------------------------------
>> All the data continuously generated in your IT infrastructure contains a
>> definitive record of customers, application performance, security
>> threats, fraudulent activity and more. Splunk takes this data and makes
>> sense of it. Business sense. IT sense. Common sense.
>> http://p.sf.net/sfu/splunk-d2dcopy1
>> _______________________________________________
>> Postgres-xc-developers mailing list
>> Pos...@li...
>> https://lists.sourceforge.net/lists/listinfo/postgres-xc-developers
>>
>>
>
>
> --
> Best Wishes,
> Ashutosh Bapat
> EntepriseDB Corporation
> The Enterprise Postgres Company
>
>


-- 
Best Wishes,
Ashutosh Bapat
EntepriseDB Corporation
The Enterprise Postgres Company

I am running regression with your previous patch. It consistently gave me
Failed to get pooled connections error. So, I rebuilt data cluster and now
the regression is running. I will try again to see if the issue is gone.

On Mon, Oct 3, 2011 at 11:26 AM, Michael Paquier
<mic...@gm...>wrote:

> Hi,
>
> Please find attached the patch fixing all the regression issues and stable
> with DBT-1.
> I think this patch is good for commit.
>
> Regards,
>
> --
> Michael Paquier
> http://michael.otacoo.com
>
>
> ------------------------------------------------------------------------------
> All the data continuously generated in your IT infrastructure contains a
> definitive record of customers, application performance, security
> threats, fraudulent activity and more. Splunk takes this data and makes
> sense of it. Business sense. IT sense. Common sense.
> http://p.sf.net/sfu/splunk-d2dcopy1
> _______________________________________________
> Postgres-xc-developers mailing list
> Pos...@li...
> https://lists.sourceforge.net/lists/listinfo/postgres-xc-developers
>
>


-- 
Best Wishes,
Ashutosh Bapat
EntepriseDB Corporation
The Enterprise Postgres Company

Hi,

Please find attached the patch fixing all the regression issues and stable
with DBT-1.
I think this patch is good for commit.

Regards,
-- 
Michael Paquier
http://michael.otacoo.com

Hi,

Here is a patch stabilizing the regressions for the issue with curval.
The issue disappears when running multiple regression tests, but there is
still an issue with the regression test privileges due to permissions on the
database when creating a schema. I am digging into that but it looks to be
an old issue.
Could you check that your regressions got better?
-- 
Michael Paquier
http://michael.otacoo.com

Hi,

I found that the problem is a little bit more generic.
When you disconnect a backend on a remote XC node, with a CLEAN CONNECTION,
you need to close a pooler connection.
I found that a PGXC node always cleans up its session if a temporary object
has been used during the session.
Cleaning up means the usage of DISCARD queries automatically, so it means
that a transaction ID has to be consumed.
I am changing that in a way such as when a closing session on a remote XC
node looks for a transaction ID from GTM and closes nicely.
-- 
Michael Paquier
http://michael.otacoo.com