postgres-xc-general Mailing List for Postgres-XC (Page 28)

Yes, check the section of the postgresql.conf file with heading
DATA NODES AND CONNECTION POOLING
and change the parameters max_coordinators and max_datanodes to the values
you like.



On Tue, Sep 17, 2013 at 5:09 PM, Bartłomiej Wójcik <
bar...@tu...> wrote:

>  Hello,
>
> But can I have more then 16 coordinators and 16 datanodes the cluster
> scaling ?
>
> Regards!
>
>
> W dniu 2013-09-17 12:55, Abbas Butt pisze:
>
>  Hi,
>
> Nodes are stored in a table in shared memory, which cannot be resized in
> dynamic fashion. Hence limits are required at startup time to determine
> shared memory size. You can have a cluster with any nodes less than the max
> values defined in the configuration file and then later on add more nodes
> to the cluster until that limit is reached. To add more nodes the
> configuration needs to be changed and the cluster needs to be restarted.
>  Thanks.
>
>
>
> On Tue, Sep 17, 2013 at 3:35 PM, Bartłomiej Wójcik <
> bar...@tu...> wrote:
>
>> Hello,
>>
>> I have a question about default max Coordinators which we can see
>> in the configuration file - postgres.conf and in some presentations
>> about pgxc
>>
>> What happens when you exceed the limit and after crossing?
>>
>> (similar restriction is for nodes)    -    why ?
>>
>> Regards!
>> bw
>>
>>
>>
>> ------------------------------------------------------------------------------
>> LIMITED TIME SALE - Full Year of Microsoft Training For Just $49.99!
>> 1,500+ hours of tutorials including VisualStudio 2012, Windows 8,
>> SharePoint
>> 2013, SQL 2012, MVC 4, more. BEST VALUE: New Multi-Library Power Pack
>> includes
>> Mobile, Cloud, Java, and UX Design. Lowest price ever! Ends 9/20/13.
>>
>> http://pubads.g.doubleclick.net/gampad/clk?id=58041151&iu=/4140/ostg.clktrk
>> _______________________________________________
>> Postgres-xc-general mailing list
>> Pos...@li...
>> https://lists.sourceforge.net/lists/listinfo/postgres-xc-general
>>
>
>
>
> --
> --
> *Abbas*
>  Architect
>
> Ph: 92.334.5100153
>  Skype ID: gabbasb
>  www.enterprisedb.co <http://www.enterprisedb.com/>m<http://www.enterprisedb.com/>
> *
> Follow us on Twitter*
> @EnterpriseDB
>
> Visit EnterpriseDB for tutorials, webinars, whitepapers<http://www.enterprisedb.com/resources-community>and more<http://www.enterprisedb.com/resources-community>
>
>
>


-- 
-- 
*Abbas*
 Architect

Ph: 92.334.5100153
 Skype ID: gabbasb
www.enterprisedb.co
<http://www.enterprisedb.com/>m<http://www.enterprisedb.com/>
*
Follow us on Twitter*
@EnterpriseDB

Visit EnterpriseDB for tutorials, webinars,
whitepapers<http://www.enterprisedb.com/resources-community>and
more<http://www.enterprisedb.com/resources-community>

Hello,

But can I have more then 16 coordinators and 16 datanodes the cluster 
scaling ?

Regards!


W dniu 2013-09-17 12:55, Abbas Butt pisze:
> Hi,
>
> Nodes are stored in a table in shared memory, which cannot be resized 
> in dynamic fashion. Hence limits are required at startup time to 
> determine shared memory size. You can have a cluster with any nodes 
> less than the max values defined in the configuration file and then 
> later on add more nodes to the cluster until that limit is reached. To 
> add more nodes the configuration needs to be changed and the cluster 
> needs to be restarted.
> Thanks.
>
>
>
> On Tue, Sep 17, 2013 at 3:35 PM, Bartłomiej Wójcik 
> <bar...@tu... 
> <mailto:bar...@tu...>> wrote:
>
>     Hello,
>
>     I have a question about default max Coordinators which we can see
>     in the configuration file - postgres.conf and in some presentations
>     about pgxc
>
>     What happens when you exceed the limit and after crossing?
>
>     (similar restriction is for nodes)    -    why ?
>
>     Regards!
>     bw
>
>
>     ------------------------------------------------------------------------------
>     LIMITED TIME SALE - Full Year of Microsoft Training For Just $49.99!
>     1,500+ hours of tutorials including VisualStudio 2012, Windows 8,
>     SharePoint
>     2013, SQL 2012, MVC 4, more. BEST VALUE: New Multi-Library Power
>     Pack includes
>     Mobile, Cloud, Java, and UX Design. Lowest price ever! Ends 9/20/13.
>     http://pubads.g.doubleclick.net/gampad/clk?id=58041151&iu=/4140/ostg.clktrk
>     _______________________________________________
>     Postgres-xc-general mailing list
>     Pos...@li...
>     <mailto:Pos...@li...>
>     https://lists.sourceforge.net/lists/listinfo/postgres-xc-general
>
>
>
>
> -- 
> -- 
> *Abbas*
> Architect
>
> Ph: 92.334.5100153
> Skype ID: gabbasb
> www.enterprisedb.co <http://www.enterprisedb.com/>m 
> <http://www.enterprisedb.com/>
> *
> Follow us on Twitter*
> @EnterpriseDB
>
> Visit EnterpriseDB for tutorials, webinars, whitepapers 
> <http://www.enterprisedb.com/resources-community>and more 
> <http://www.enterprisedb.com/resources-community>

Hi,

Nodes are stored in a table in shared memory, which cannot be resized in
dynamic fashion. Hence limits are required at startup time to determine
shared memory size. You can have a cluster with any nodes less than the max
values defined in the configuration file and then later on add more nodes
to the cluster until that limit is reached. To add more nodes the
configuration needs to be changed and the cluster needs to be restarted.
Thanks.



On Tue, Sep 17, 2013 at 3:35 PM, Bartłomiej Wójcik <
bar...@tu...> wrote:

> Hello,
>
> I have a question about default max Coordinators which we can see
> in the configuration file - postgres.conf and in some presentations
> about pgxc
>
> What happens when you exceed the limit and after crossing?
>
> (similar restriction is for nodes)    -    why ?
>
> Regards!
> bw
>
>
>
> ------------------------------------------------------------------------------
> LIMITED TIME SALE - Full Year of Microsoft Training For Just $49.99!
> 1,500+ hours of tutorials including VisualStudio 2012, Windows 8,
> SharePoint
> 2013, SQL 2012, MVC 4, more. BEST VALUE: New Multi-Library Power Pack
> includes
> Mobile, Cloud, Java, and UX Design. Lowest price ever! Ends 9/20/13.
> http://pubads.g.doubleclick.net/gampad/clk?id=58041151&iu=/4140/ostg.clktrk
> _______________________________________________
> Postgres-xc-general mailing list
> Pos...@li...
> https://lists.sourceforge.net/lists/listinfo/postgres-xc-general
>



-- 
-- 
*Abbas*
 Architect

Ph: 92.334.5100153
 Skype ID: gabbasb
www.enterprisedb.co
<http://www.enterprisedb.com/>m<http://www.enterprisedb.com/>
*
Follow us on Twitter*
@EnterpriseDB

Visit EnterpriseDB for tutorials, webinars,
whitepapers<http://www.enterprisedb.com/resources-community>and
more<http://www.enterprisedb.com/resources-community>

Hello,

I have a question about default max Coordinators which we can see
in the configuration file - postgres.conf and in some presentations
about pgxc

What happens when you exceed the limit and after crossing?

(similar restriction is for nodes)    -    why ?

Regards!
bw

On Mon, Sep 16, 2013 at 7:28 PM, Bartłomiej Wójcik <
bar...@tu...> wrote:

>  How many clients/threads/processes did you have in the test? Just one?
> It seems like it based on that not many cores were being used.
>
> Just one client:  psql -d test < insert.sql (100000 inserts) sequentially
> with  psql -d test < select.sql (100000 selects)
>
>  Was the test being run on the same server as the database?
>
> Yes, it was.
>
>
Try to insert the rows in parallel using multiple sessions (and if there
are more than one coordinators, use multiple coordinators.)


>  Also, all of the "nodes" are sharing the same storage device, not
> dedicated for each?
>
> All of the "nodes" are local. Storage device the same but it is very large
> throughput  ~Gbit/s
>
>  For a better test, you should use multiple clients and ideally multiple
> servers, and preferably  dedicated storage.
>
> I wanted to test it on localhost and check WRITE performance when adding
> datanodes local ( *see the read performance but why not write ?**??* )
>
>
> Regards!
>
>
>
> W dniu 2013-09-16 14:43, Mason Sharp pisze:
>
>
>
>
> On Mon, Sep 16, 2013 at 6:34 AM, Bartłomiej Wójcik <
> bar...@tu...> wrote:
>
>> Hello,
>>
>> Today I am testing the following simple cluster:    Host1(vm1, IP1,
>> 6cores 4GB ram, disk storage(very large throughput  ~Gbit/s)):    1
>> gtm    +    1 coordinator    +    (1,2,3) datanode
>>
>> Loading the database 100000 inserts and I received the time:       3m1s
>> and    2m57s     (2 of 6 cores work mainly) -    100% of the data at
>> each datanode (checked)
>> Then I do simple selects on that data and I received the time:
>> 28m29s  and  28m25s    (2 of 6 cores work mainly)
>>
>> I refresh the database (drop and create database)
>> Then I add second datanode to the cluster, do the same test(inserts,
>> selects) and I received:
>>
>> 2m59s    and  2m57s  (inserts)    (2 of 6 cores work mainly) - 50% of
>> the data at each datanode (checked)
>> 15m2s  and  13m41s  (selects)    (2 of 6 cores work mainly)
>>
>> I refresh the database (drop and create database again)
>> Then I add third datanode and I received:
>>
>> 3m1s    and    2m58  (inserts)    (2 of 6 cores work mainly)    - 33% of
>> the data at each datanode (checked)
>> 9m35s  and  10m5s (selects)    (2 of 6 cores work mainly)
>>
>>
>> Is this results ok ? Why did not increase write performance(inserts)
>> after adding a datanode? Why did not benefit more from other cores ?
>>
>>
>> The results are reproducible (as you can see)
>>
>
>  How many clients/threads/processes did you have in the test? Just one?
> It seems like it based on that not many cores were being used.
>
>  Was the test being run on the same server as the database?
>
>  Also, all of the "nodes" are sharing the same storage device, not
> dedicated for each?
>
>  For a better test, you should use multiple clients and ideally multiple
> servers, and preferably  dedicated storage.
>
>
>
>>
>>
>> Regards!
>>
>> BW
>>
>>
>>
>> ------------------------------------------------------------------------------
>> LIMITED TIME SALE - Full Year of Microsoft Training For Just $49.99!
>> 1,500+ hours of tutorials including VisualStudio 2012, Windows 8,
>> SharePoint
>> 2013, SQL 2012, MVC 4, more. BEST VALUE: New Multi-Library Power Pack
>> includes
>> Mobile, Cloud, Java, and UX Design. Lowest price ever! Ends 9/20/13.
>>
>> http://pubads.g.doubleclick.net/gampad/clk?id=58041151&iu=/4140/ostg.clktrk
>> _______________________________________________
>> Postgres-xc-general mailing list
>> Pos...@li...
>> https://lists.sourceforge.net/lists/listinfo/postgres-xc-general
>>
>
>
> Regards,
>
>  --
> Mason Sharp
>
> StormDB - http://www.stormdb.com
> The Database Cloud
> Postgres-XC Support and Services
>
>
>
>
> ------------------------------------------------------------------------------
> LIMITED TIME SALE - Full Year of Microsoft Training For Just $49.99!
> 1,500+ hours of tutorials including VisualStudio 2012, Windows 8,
> SharePoint
> 2013, SQL 2012, MVC 4, more. BEST VALUE: New Multi-Library Power Pack
> includes
> Mobile, Cloud, Java, and UX Design. Lowest price ever! Ends 9/20/13.
> http://pubads.g.doubleclick.net/gampad/clk?id=58041151&iu=/4140/ostg.clktrk
> _______________________________________________
> Postgres-xc-general mailing list
> Pos...@li...
> https://lists.sourceforge.net/lists/listinfo/postgres-xc-general
>
>


-- 
Best Wishes,
Ashutosh Bapat
EnterpriseDB Corporation
The Postgres Database Company

How many clients/threads/processes did you have in the test? Just one? 
It seems like it based on that not many cores were being used.

Just one client:  psql -d test < insert.sql (100000 inserts) 
sequentially with psql -d test < select.sql (100000 selects)

Was the test being run on the same server as the database?

Yes, it was.

Also, all of the "nodes" are sharing the same storage device, not 
dedicated for each?

All of the "nodes" are local. Storage device the same but it is very 
large throughput  ~Gbit/s

For a better test, you should use multiple clients and ideally multiple 
servers, and preferably  dedicated storage.

I wanted to test it on localhost and check WRITE performance when adding 
datanodes local ( *see the read performance but why not write ?**??* )


Regards!



W dniu 2013-09-16 14:43, Mason Sharp pisze:
>
>
>
> On Mon, Sep 16, 2013 at 6:34 AM, Bartłomiej Wójcik 
> <bar...@tu... 
> <mailto:bar...@tu...>> wrote:
>
>     Hello,
>
>     Today I am testing the following simple cluster:  Host1(vm1, IP1,
>     6cores 4GB ram, disk storage(very large throughput  ~Gbit/s)):    1
>     gtm    +    1 coordinator    +    (1,2,3) datanode
>
>     Loading the database 100000 inserts and I received the time:      
>     3m1s
>     and    2m57s     (2 of 6 cores work mainly) -    100% of the data at
>     each datanode (checked)
>     Then I do simple selects on that data and I received the time:
>     28m29s  and  28m25s    (2 of 6 cores work mainly)
>
>     I refresh the database (drop and create database)
>     Then I add second datanode to the cluster, do the same test(inserts,
>     selects) and I received:
>
>     2m59s    and  2m57s  (inserts)    (2 of 6 cores work mainly) - 50% of
>     the data at each datanode (checked)
>     15m2s  and  13m41s  (selects)    (2 of 6 cores work mainly)
>
>     I refresh the database (drop and create database again)
>     Then I add third datanode and I received:
>
>     3m1s    and    2m58  (inserts)    (2 of 6 cores work mainly)    -
>     33% of
>     the data at each datanode (checked)
>     9m35s  and  10m5s (selects)    (2 of 6 cores work mainly)
>
>
>     Is this results ok ? Why did not increase write performance(inserts)
>     after adding a datanode? Why did not benefit more from other cores ?
>
>
>     The results are reproducible (as you can see)
>
>
> How many clients/threads/processes did you have in the test? Just one? 
> It seems like it based on that not many cores were being used.
>
> Was the test being run on the same server as the database?
>
> Also, all of the "nodes" are sharing the same storage device, not 
> dedicated for each?
>
> For a better test, you should use multiple clients and ideally 
> multiple servers, and preferably  dedicated storage.
>
>
>
>     Regards!
>
>     BW
>
>
>     ------------------------------------------------------------------------------
>     LIMITED TIME SALE - Full Year of Microsoft Training For Just $49.99!
>     1,500+ hours of tutorials including VisualStudio 2012, Windows 8,
>     SharePoint
>     2013, SQL 2012, MVC 4, more. BEST VALUE: New Multi-Library Power
>     Pack includes
>     Mobile, Cloud, Java, and UX Design. Lowest price ever! Ends 9/20/13.
>     http://pubads.g.doubleclick.net/gampad/clk?id=58041151&iu=/4140/ostg.clktrk
>     _______________________________________________
>     Postgres-xc-general mailing list
>     Pos...@li...
>     <mailto:Pos...@li...>
>     https://lists.sourceforge.net/lists/listinfo/postgres-xc-general
>
>
>
> Regards,
>
> -- 
> Mason Sharp
>
> StormDB - http://www.stormdb.com
> The Database Cloud
> Postgres-XC Support and Services

On Mon, Sep 16, 2013 at 6:34 AM, Bartłomiej Wójcik <
bar...@tu...> wrote:

> Hello,
>
> Today I am testing the following simple cluster:    Host1(vm1, IP1,
> 6cores 4GB ram, disk storage(very large throughput  ~Gbit/s)):    1
> gtm    +    1 coordinator    +    (1,2,3) datanode
>
> Loading the database 100000 inserts and I received the time:       3m1s
> and    2m57s     (2 of 6 cores work mainly) -    100% of the data at
> each datanode (checked)
> Then I do simple selects on that data and I received the time:
> 28m29s  and  28m25s    (2 of 6 cores work mainly)
>
> I refresh the database (drop and create database)
> Then I add second datanode to the cluster, do the same test(inserts,
> selects) and I received:
>
> 2m59s    and  2m57s  (inserts)    (2 of 6 cores work mainly) - 50% of
> the data at each datanode (checked)
> 15m2s  and  13m41s  (selects)    (2 of 6 cores work mainly)
>
> I refresh the database (drop and create database again)
> Then I add third datanode and I received:
>
> 3m1s    and    2m58  (inserts)    (2 of 6 cores work mainly)    - 33% of
> the data at each datanode (checked)
> 9m35s  and  10m5s (selects)    (2 of 6 cores work mainly)
>
>
> Is this results ok ? Why did not increase write performance(inserts)
> after adding a datanode? Why did not benefit more from other cores ?
>
>
> The results are reproducible (as you can see)
>

How many clients/threads/processes did you have in the test? Just one? It
seems like it based on that not many cores were being used.

Was the test being run on the same server as the database?

Also, all of the "nodes" are sharing the same storage device, not dedicated
for each?

For a better test, you should use multiple clients and ideally multiple
servers, and preferably  dedicated storage.



>
>
> Regards!
>
> BW
>
>
>
> ------------------------------------------------------------------------------
> LIMITED TIME SALE - Full Year of Microsoft Training For Just $49.99!
> 1,500+ hours of tutorials including VisualStudio 2012, Windows 8,
> SharePoint
> 2013, SQL 2012, MVC 4, more. BEST VALUE: New Multi-Library Power Pack
> includes
> Mobile, Cloud, Java, and UX Design. Lowest price ever! Ends 9/20/13.
> http://pubads.g.doubleclick.net/gampad/clk?id=58041151&iu=/4140/ostg.clktrk
> _______________________________________________
> Postgres-xc-general mailing list
> Pos...@li...
> https://lists.sourceforge.net/lists/listinfo/postgres-xc-general
>


Regards,

-- 
Mason Sharp

StormDB - http://www.stormdb.com
The Database Cloud
Postgres-XC Support and Services

Hello,

Today I am testing the following simple cluster:    Host1(vm1, IP1, 
6cores 4GB ram, disk storage(very large throughput  ~Gbit/s)):    1 
gtm    +    1 coordinator    +    (1,2,3) datanode

Loading the database 100000 inserts and I received the time:       3m1s 
and    2m57s     (2 of 6 cores work mainly) -    100% of the data at 
each datanode (checked)
Then I do simple selects on that data and I received the time:      
28m29s  and  28m25s    (2 of 6 cores work mainly)

I refresh the database (drop and create database)
Then I add second datanode to the cluster, do the same test(inserts, 
selects) and I received:

2m59s    and  2m57s  (inserts)    (2 of 6 cores work mainly) - 50% of 
the data at each datanode (checked)
15m2s  and  13m41s  (selects)    (2 of 6 cores work mainly)

I refresh the database (drop and create database again)
Then I add third datanode and I received:

3m1s    and    2m58  (inserts)    (2 of 6 cores work mainly)    - 33% of 
the data at each datanode (checked)
9m35s  and  10m5s (selects)    (2 of 6 cores work mainly)


Is this results ok ? Why did not increase write performance(inserts) 
after adding a datanode? Why did not benefit more from other cores ?


The results are reproducible (as you can see)


Regards!

BW

Hi Bartlomiej,


On Thu, Sep 12, 2013 at 6:05 AM, Bartłomiej Wójcik <
bar...@tu...> wrote:

> Hello!
>
> I'd like to thanks for Postgres-xc existence!
>
>
> and I have a question:
>
> Is it safely to use it for the production purposes ? Could you tell us
> by whom it is used ?
>


Yes, Postgres-XC is being used in production by our customers and another
one is in the process of testing to deploy soon. I don't have permission to
disclose them.

Feel free to send me a private email if you would like to have a call on
which you can ask me your questions and I can provide general
(non-identifying) info.

Regards,

-- 
Mason Sharp

StormDB - http://www.stormdb.com
The Database Cloud
Postgres-XC Support and Services

On Thu, Sep 12, 2013 at 6:49 AM, Bartłomiej Wójcik <
bar...@tu...> wrote:

> Hello,
>
> When I add every new node to my cluster the performance of the entire
> cluster decreases by 20 percent.
>
> Cluster scheme:
>
> Host1(vm1, IP1, 2core 4GB ram): gtm
> Host2(vm2, IP2, 2core 4GB ram): 1 gtm_proxy + 1 coordinator + 1 datanode
> Host3(vm3, IP3, 2core 4GB ram): 1 gtm_proxy + 1 coordinator + 1 datanode
> Host4(vm4, IP4, 2core 4GB ram): 1 gtm_proxy + 1 coordinator + 1 datanode
>
> I run pgbench (-S) and getting:    ~1200 tps (on each)
>
> when I use (host1 and host2 and host3) the result is: ~1500 tps (on each)
>
> when I use (host 1 and host 2) the result is: ~1800 tps
>
>
> Is this normal behavior ?
>
> All hosts  use the same  disk storage(very large  throughput  ~Gbit/s),
> cores  are not common, ramare not common
>
>
> Regards!
>
>
>
I'm a lurker on the list, but I thought pg-xc was not designed to maximize
transaction rate. Rather its designed for quickly completing a few very
large transactions.

THK


>
> ------------------------------------------------------------------------------
> How ServiceNow helps IT people transform IT departments:
> 1. Consolidate legacy IT systems to a single system of record for IT
> 2. Standardize and globalize service processes across IT
> 3. Implement zero-touch automation to replace manual, redundant tasks
> http://pubads.g.doubleclick.net/gampad/clk?id=51271111&iu=/4140/ostg.clktrk
> _______________________________________________
> Postgres-xc-general mailing list
> Pos...@li...
> https://lists.sourceforge.net/lists/listinfo/postgres-xc-general
>



-- 
http://www.keittlab.org/

On Thu, Sep 12, 2013 at 5:19 PM, Bartłomiej Wójcik <
bar...@tu...> wrote:

> Hello,
>
> When I add every new node to my cluster the performance of the entire
> cluster decreases by 20 percent.
>
> Cluster scheme:
>
> Host1(vm1, IP1, 2core 4GB ram): gtm
> Host2(vm2, IP2, 2core 4GB ram): 1 gtm_proxy + 1 coordinator + 1 datanode
> Host3(vm3, IP3, 2core 4GB ram): 1 gtm_proxy + 1 coordinator + 1 datanode
> Host4(vm4, IP4, 2core 4GB ram): 1 gtm_proxy + 1 coordinator + 1 datanode
>
> I run pgbench (-S) and getting:    ~1200 tps (on each)
>
> when I use (host1 and host2 and host3) the result is: ~1500 tps (on each)
>
> when I use (host 1 and host 2) the result is: ~1800 tps
>
>
> Is this normal behavior ?
>

Are you using pgbench supplied with the XC ? If so, AFAIR pgbench has been
modified to distribute the pgbench_accounts table on "bid" field. This was
done to improve pgbench TPCC queries. I can see that it can adversely
affect the -S case though.

Can you try using the pgbench supplied with stock Postgres ? The automatic
distribution will cause the pgbench_accounts table being distributed on the
"aid" which is also the column used in WHERE clause of the select only
queries of -S option. I would expect no performance drop in that case.
Whether you can get a performance improvement with additional nodes will
depend on the workload though. You really want to have a work load which
can not fit your single server. IOW a scale factor such that the entire
pgbench_accounts table does not fit the RAM of a single server will be
appropriate. You would also want to run the test long enough so that shared
buffers are populated with the data.

Thanks,
Pavan

-- 
Pavan Deolasee
http://www.linkedin.com/in/pavandeolasee

Hello,

When I add every new node to my cluster the performance of the entire 
cluster decreases by 20 percent.

Cluster scheme:

Host1(vm1, IP1, 2core 4GB ram): gtm
Host2(vm2, IP2, 2core 4GB ram): 1 gtm_proxy + 1 coordinator + 1 datanode
Host3(vm3, IP3, 2core 4GB ram): 1 gtm_proxy + 1 coordinator + 1 datanode
Host4(vm4, IP4, 2core 4GB ram): 1 gtm_proxy + 1 coordinator + 1 datanode

I run pgbench (-S) and getting:    ~1200 tps (on each)

when I use (host1 and host2 and host3) the result is: ~1500 tps (on each)

when I use (host 1 and host 2) the result is: ~1800 tps


Is this normal behavior ?

All hosts  use the same  disk storage(very large  throughput  ~Gbit/s), cores  are not common, ramare not common


Regards!

Hello!

I'd like to thanks for Postgres-xc existence!


and I have a question:

Is it safely to use it for the production purposes ? Could you tell us 
by whom it is used ?

Best Regards!

I feel it's better to maintain pgxc_ctl in a separate repo and include a
snapshot into XC core release for user's convenience, as done in many of
the contrib modules of PG.

---
Koichi Suzuki


2013/9/9 Michael Paquier <mic...@gm...>

> On Mon, Sep 9, 2013 at 11:11 AM, 鈴木 幸市 <ko...@in...> wrote:
> > Having pgxc_ctl as a part of XC material (not a core, it's in the
> contrib) will make deploying simpler.   I agree to have pgxc_ctl repo
> independent and can update separately to provide more flexible and quicker
> fix/enhancement.
> Thanks. Note that my suggestion is not for 1.1 stable branch where
> this module is already integrated in code and released, as we
> shouldn't change the features there at this point, but only for master
> and future releases.
> --
> Michael
>

On Mon, Sep 9, 2013 at 11:11 AM, 鈴木 幸市 <ko...@in...> wrote:
> Having pgxc_ctl as a part of XC material (not a core, it's in the contrib) will make deploying simpler.   I agree to have pgxc_ctl repo independent and can update separately to provide more flexible and quicker fix/enhancement.
Thanks. Note that my suggestion is not for 1.1 stable branch where
this module is already integrated in code and released, as we
shouldn't change the features there at this point, but only for master
and future releases.
-- 
Michael

Having pgxc_ctl as a part of XC material (not a core, it's in the contrib) will make deploying simpler.   I agree to have pgxc_ctl repo independent and can update separately to provide more flexible and quicker fix/enhancement.

Regards;
---
Koichi Suzuki

On 2013/09/09, at 11:05, Michael Paquier <mic...@gm...>
 wrote:

> On Mon, Sep 9, 2013 at 9:45 AM, Koichi Suzuki <koi...@gm...> wrote:
>> +1.   Hope the tool support many pgxc_ctl feature, including node addition
>> and removal.
> Cool initiative. Instead of having a new user in github for that, why
> not transferring this repository directly in the organization
> postgres-xc with the other folders like dbt-1 and friends? It would
> make sense to have all those things grouped together, and github
> offers enough granularity to have a repository-based control of
> permissions for committers, allowing us to assign some users as
> committers for this installer but not for core for example.
> 
> Something not related to this thread, and perhaps like a
> silly-old-lonely-man-muttering-to-himself thought but... I am still
> wondering why pgxc_ctl is not out of core and delivered as an
> independent module like this installer. Having it makes any
> architecture-related modifications depending on it, for example let's
> imagine that Coordinator and Datanodes are merged at some point (What
> would make sense IMO)...
> -- 
> Michael
> 
> ------------------------------------------------------------------------------
> Learn the latest--Visual Studio 2012, SharePoint 2013, SQL 2012, more!
> Discover the easy way to master current and previous Microsoft technologies
> and advance your career. Get an incredible 1,500+ hours of step-by-step
> tutorial videos with LearnDevNow. Subscribe today and save!
> http://pubads.g.doubleclick.net/gampad/clk?id=58041391&iu=/4140/ostg.clktrk
> _______________________________________________
> Postgres-xc-general mailing list
> Pos...@li...
> https://lists.sourceforge.net/lists/listinfo/postgres-xc-general
> 

On Mon, Sep 9, 2013 at 9:45 AM, Koichi Suzuki <koi...@gm...> wrote:
> +1.   Hope the tool support many pgxc_ctl feature, including node addition
> and removal.
Cool initiative. Instead of having a new user in github for that, why
not transferring this repository directly in the organization
postgres-xc with the other folders like dbt-1 and friends? It would
make sense to have all those things grouped together, and github
offers enough granularity to have a repository-based control of
permissions for committers, allowing us to assign some users as
committers for this installer but not for core for example.

Something not related to this thread, and perhaps like a
silly-old-lonely-man-muttering-to-himself thought but... I am still
wondering why pgxc_ctl is not out of core and delivered as an
independent module like this installer. Having it makes any
architecture-related modifications depending on it, for example let's
imagine that Coordinator and Datanodes are merged at some point (What
would make sense IMO)...
-- 
Michael

+1.   Hope the tool support many pgxc_ctl feature, including node addition
and removal.
---
Koichi Suzuki


2013/9/6 Ashutosh Bapat <ash...@en...>

> I personally think, this is a nice initiative. It will help a lot, if it
> gives interface to pgxc_ctl.
>
>
> On Fri, Sep 6, 2013 at 9:13 AM, Tomonari Katsumata <
> kat...@po...> wrote:
>
>> suzuki-san
>>
>> Thank you for comments.
>> I've add below contents on wiki.
>>
>> The aim of this project is increasing users of
>> Postgres-XC!
>>
>> ----------------------------------------------------------------------
>> * Motivation
>> Postgres-XC is growing step by step.
>> Although many developers are developing in the world,
>> but I think there are a few user(especially in Japan).
>> So I want many people to know and use Postgres-XC.
>> To install Postgres-XC easily is helping for new user.
>> This is the motivation of this installer.
>>
>> * Goal or roadmap
>> I don't have a detail goal or roadmap, but I will make this
>> installer more convenience.
>> So I will add "uninstall" or "add/drop node" functions at least.
>> I want it to be something like "controller".
>>
>> * Relationship with existing tools
>> This installer colaborates with old pgxc_ctl script.
>> I'll change this to colaborate with new pgxc_ctl contrib module.
>> ----------------------------------------------------------------------
>>
>> regards,
>> ------------
>> NTT Software Corporation
>> Tomonari Katsumata
>>
>> (2013/09/05 17:59), Koichi Suzuki wrote:
>> > Tomo;
>> >
>> > I'd advice to include the following in the page or in your announcement,
>> >
>> > * Motivation,
>> > * Goal or roadmap,
>> > * Relationship with existing tools such as pgxc_ctl.
>> >
>> > It will be nice to post your announcement to announces ML as well.
>> >
>> > Regards;
>> >
>> > ---
>> > Koichi Suzuki
>> >
>> >
>> > 2013/9/5 Tomonari Katsumata <kat...@po...>
>> >
>> >> Hi,
>> >>
>> >> I'm pleased to announce the first release of Postgres-XC-Installer.
>> >> Postgres-XC-Installer is GUI Installer for Postgres-XC.
>> >>
>> >> [document]
>> >> https://github.com/xctools/postgres-xc-installer/wiki
>> >>
>> >> [download]
>> >> https://github.com/xctools/postgres-xc-installer/releases
>> >>
>> >> enjoy!
>> >> --------------
>> >> NTT Software Corporation
>> >> Tomonari Katsumata
>> >>
>> >>
>> >>
>> >>
>> >>
>> ------------------------------------------------------------------------------
>> >> Learn the latest--Visual Studio 2012, SharePoint 2013, SQL 2012, more!
>> >> Discover the easy way to master current and previous Microsoft
>> technologies
>> >> and advance your career. Get an incredible 1,500+ hours of step-by-step
>> >> tutorial videos with LearnDevNow. Subscribe today and save!
>> >>
>> http://pubads.g.doubleclick.net/gampad/clk?id=58041391&iu=/4140/ostg.clktrk
>> >> _______________________________________________
>> >> Postgres-xc-general mailing list
>> >> Pos...@li...
>> >> https://lists.sourceforge.net/lists/listinfo/postgres-xc-general
>> >>
>>
>>
>>
>>
>>
>> ------------------------------------------------------------------------------
>> Learn the latest--Visual Studio 2012, SharePoint 2013, SQL 2012, more!
>> Discover the easy way to master current and previous Microsoft
>> technologies
>> and advance your career. Get an incredible 1,500+ hours of step-by-step
>> tutorial videos with LearnDevNow. Subscribe today and save!
>>
>> http://pubads.g.doubleclick.net/gampad/clk?id=58041391&iu=/4140/ostg.clktrk
>> _______________________________________________
>> Postgres-xc-general mailing list
>> Pos...@li...
>> https://lists.sourceforge.net/lists/listinfo/postgres-xc-general
>>
>
>
>
> --
> Best Wishes,
> Ashutosh Bapat
> EnterpriseDB Corporation
> The Postgres Database Company
>

I personally think, this is a nice initiative. It will help a lot, if it
gives interface to pgxc_ctl.


On Fri, Sep 6, 2013 at 9:13 AM, Tomonari Katsumata <
kat...@po...> wrote:

> suzuki-san
>
> Thank you for comments.
> I've add below contents on wiki.
>
> The aim of this project is increasing users of
> Postgres-XC!
>
> ----------------------------------------------------------------------
> * Motivation
> Postgres-XC is growing step by step.
> Although many developers are developing in the world,
> but I think there are a few user(especially in Japan).
> So I want many people to know and use Postgres-XC.
> To install Postgres-XC easily is helping for new user.
> This is the motivation of this installer.
>
> * Goal or roadmap
> I don't have a detail goal or roadmap, but I will make this
> installer more convenience.
> So I will add "uninstall" or "add/drop node" functions at least.
> I want it to be something like "controller".
>
> * Relationship with existing tools
> This installer colaborates with old pgxc_ctl script.
> I'll change this to colaborate with new pgxc_ctl contrib module.
> ----------------------------------------------------------------------
>
> regards,
> ------------
> NTT Software Corporation
> Tomonari Katsumata
>
> (2013/09/05 17:59), Koichi Suzuki wrote:
> > Tomo;
> >
> > I'd advice to include the following in the page or in your announcement,
> >
> > * Motivation,
> > * Goal or roadmap,
> > * Relationship with existing tools such as pgxc_ctl.
> >
> > It will be nice to post your announcement to announces ML as well.
> >
> > Regards;
> >
> > ---
> > Koichi Suzuki
> >
> >
> > 2013/9/5 Tomonari Katsumata <kat...@po...>
> >
> >> Hi,
> >>
> >> I'm pleased to announce the first release of Postgres-XC-Installer.
> >> Postgres-XC-Installer is GUI Installer for Postgres-XC.
> >>
> >> [document]
> >> https://github.com/xctools/postgres-xc-installer/wiki
> >>
> >> [download]
> >> https://github.com/xctools/postgres-xc-installer/releases
> >>
> >> enjoy!
> >> --------------
> >> NTT Software Corporation
> >> Tomonari Katsumata
> >>
> >>
> >>
> >>
> >>
> ------------------------------------------------------------------------------
> >> Learn the latest--Visual Studio 2012, SharePoint 2013, SQL 2012, more!
> >> Discover the easy way to master current and previous Microsoft
> technologies
> >> and advance your career. Get an incredible 1,500+ hours of step-by-step
> >> tutorial videos with LearnDevNow. Subscribe today and save!
> >>
> http://pubads.g.doubleclick.net/gampad/clk?id=58041391&iu=/4140/ostg.clktrk
> >> _______________________________________________
> >> Postgres-xc-general mailing list
> >> Pos...@li...
> >> https://lists.sourceforge.net/lists/listinfo/postgres-xc-general
> >>
>
>
>
>
>
> ------------------------------------------------------------------------------
> Learn the latest--Visual Studio 2012, SharePoint 2013, SQL 2012, more!
> Discover the easy way to master current and previous Microsoft technologies
> and advance your career. Get an incredible 1,500+ hours of step-by-step
> tutorial videos with LearnDevNow. Subscribe today and save!
> http://pubads.g.doubleclick.net/gampad/clk?id=58041391&iu=/4140/ostg.clktrk
> _______________________________________________
> Postgres-xc-general mailing list
> Pos...@li...
> https://lists.sourceforge.net/lists/listinfo/postgres-xc-general
>



-- 
Best Wishes,
Ashutosh Bapat
EnterpriseDB Corporation
The Postgres Database Company

suzuki-san

Thank you for comments.
I've add below contents on wiki.

The aim of this project is increasing users of
Postgres-XC!

----------------------------------------------------------------------
* Motivation
Postgres-XC is growing step by step.
Although many developers are developing in the world,
but I think there are a few user(especially in Japan).
So I want many people to know and use Postgres-XC.
To install Postgres-XC easily is helping for new user.
This is the motivation of this installer.

* Goal or roadmap
I don't have a detail goal or roadmap, but I will make this
installer more convenience.
So I will add "uninstall" or "add/drop node" functions at least.
I want it to be something like "controller".

* Relationship with existing tools
This installer colaborates with old pgxc_ctl script.
I'll change this to colaborate with new pgxc_ctl contrib module.
----------------------------------------------------------------------

regards,
------------
NTT Software Corporation
Tomonari Katsumata

(2013/09/05 17:59), Koichi Suzuki wrote:
> Tomo;
>
> I'd advice to include the following in the page or in your announcement,
>
> * Motivation,
> * Goal or roadmap,
> * Relationship with existing tools such as pgxc_ctl.
>
> It will be nice to post your announcement to announces ML as well.
>
> Regards;
>
> ---
> Koichi Suzuki
>
>
> 2013/9/5 Tomonari Katsumata <kat...@po...>
>
>> Hi,
>>
>> I'm pleased to announce the first release of Postgres-XC-Installer.
>> Postgres-XC-Installer is GUI Installer for Postgres-XC.
>>
>> [document]
>> https://github.com/xctools/postgres-xc-installer/wiki
>>
>> [download]
>> https://github.com/xctools/postgres-xc-installer/releases
>>
>> enjoy!
>> --------------
>> NTT Software Corporation
>> Tomonari Katsumata
>>
>>
>>
>>
>> ------------------------------------------------------------------------------
>> Learn the latest--Visual Studio 2012, SharePoint 2013, SQL 2012, more!
>> Discover the easy way to master current and previous Microsoft technologies
>> and advance your career. Get an incredible 1,500+ hours of step-by-step
>> tutorial videos with LearnDevNow. Subscribe today and save!
>> http://pubads.g.doubleclick.net/gampad/clk?id=58041391&iu=/4140/ostg.clktrk
>> _______________________________________________
>> Postgres-xc-general mailing list
>> Pos...@li...
>> https://lists.sourceforge.net/lists/listinfo/postgres-xc-general
>>

Hello!

Postgres-XC project page was renewed.   New page is now redirected to
sourceforge MediaWiki, which is much more flexible for frequent updates.

Enjoy;
---
Koichi Suzuki

Tomo;

I'd advice to include the following in the page or in your announcement,

* Motivation,
* Goal or roadmap,
* Relationship with existing tools such as pgxc_ctl.

It will be nice to post your announcement to announces ML as well.

Regards;

---
Koichi Suzuki


2013/9/5 Tomonari Katsumata <kat...@po...>

> Hi,
>
> I'm pleased to announce the first release of Postgres-XC-Installer.
> Postgres-XC-Installer is GUI Installer for Postgres-XC.
>
> [document]
> https://github.com/xctools/postgres-xc-installer/wiki
>
> [download]
> https://github.com/xctools/postgres-xc-installer/releases
>
> enjoy!
> --------------
> NTT Software Corporation
> Tomonari Katsumata
>
>
>
>
> ------------------------------------------------------------------------------
> Learn the latest--Visual Studio 2012, SharePoint 2013, SQL 2012, more!
> Discover the easy way to master current and previous Microsoft technologies
> and advance your career. Get an incredible 1,500+ hours of step-by-step
> tutorial videos with LearnDevNow. Subscribe today and save!
> http://pubads.g.doubleclick.net/gampad/clk?id=58041391&iu=/4140/ostg.clktrk
> _______________________________________________
> Postgres-xc-general mailing list
> Pos...@li...
> https://lists.sourceforge.net/lists/listinfo/postgres-xc-general
>

Thanks.


On Thu, Sep 5, 2013 at 6:46 AM, Mason Sharp <ma...@st...> wrote:

> StormDB has released RPMs for Postgres-XC version 1.1 here:
>
> http://yum.stormdb.com/repos/Postgres-XC/1.1.0/
>
> Enjoy!
>
> --
> Mason Sharp
>
> StormDB - http://www.stormdb.com
> The Database Cloud
> Postgres-XC Support and Services
>
>
> ------------------------------------------------------------------------------
> Learn the latest--Visual Studio 2012, SharePoint 2013, SQL 2012, more!
> Discover the easy way to master current and previous Microsoft technologies
> and advance your career. Get an incredible 1,500+ hours of step-by-step
> tutorial videos with LearnDevNow. Subscribe today and save!
> http://pubads.g.doubleclick.net/gampad/clk?id=58041391&iu=/4140/ostg.clktrk
> _______________________________________________
> Postgres-xc-general mailing list
> Pos...@li...
> https://lists.sourceforge.net/lists/listinfo/postgres-xc-general
>
>


-- 
Best Wishes,
Ashutosh Bapat
EnterpriseDB Corporation
The Postgres Database Company

Hi,

I'm pleased to announce the first release of Postgres-XC-Installer.
Postgres-XC-Installer is GUI Installer for Postgres-XC.

[document]
https://github.com/xctools/postgres-xc-installer/wiki

[download]
https://github.com/xctools/postgres-xc-installer/releases

enjoy!
--------------
NTT Software Corporation
Tomonari Katsumata

On Thu, Sep 5, 2013 at 10:16 AM, Mason Sharp <ma...@st...> wrote:
> StormDB has released RPMs for Postgres-XC version 1.1 here:
>
> http://yum.stormdb.com/repos/Postgres-XC/1.1.0/
+1.
-- 
Michael