Menu
▾
▴
postgres-xc-general — General info and messages
You can subscribe to this list here.
| 2010 |
Jan
|
Feb
|
Mar
|
Apr
|
May
(2) |
Jun
|
Jul
|
Aug
(6) |
Sep
|
Oct
(19) |
Nov
(1) |
Dec
|
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 2011 |
Jan
(12) |
Feb
(1) |
Mar
(4) |
Apr
(4) |
May
(32) |
Jun
(12) |
Jul
(11) |
Aug
(1) |
Sep
(6) |
Oct
(3) |
Nov
|
Dec
(10) |
| 2012 |
Jan
(11) |
Feb
(1) |
Mar
(3) |
Apr
(25) |
May
(53) |
Jun
(38) |
Jul
(103) |
Aug
(54) |
Sep
(31) |
Oct
(66) |
Nov
(77) |
Dec
(20) |
| 2013 |
Jan
(91) |
Feb
(86) |
Mar
(103) |
Apr
(107) |
May
(25) |
Jun
(37) |
Jul
(17) |
Aug
(59) |
Sep
(38) |
Oct
(78) |
Nov
(29) |
Dec
(15) |
| 2014 |
Jan
(23) |
Feb
(82) |
Mar
(118) |
Apr
(101) |
May
(103) |
Jun
(45) |
Jul
(6) |
Aug
(10) |
Sep
|
Oct
(32) |
Nov
|
Dec
(9) |
| 2015 |
Jan
(3) |
Feb
(5) |
Mar
|
Apr
(1) |
May
|
Jun
|
Jul
(9) |
Aug
(4) |
Sep
(3) |
Oct
|
Nov
|
Dec
|
| 2016 |
Jan
(3) |
Feb
|
Mar
|
Apr
|
May
|
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
| 2017 |
Jan
|
Feb
|
Mar
|
Apr
|
May
|
Jun
(3) |
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
| 2018 |
Jan
|
Feb
|
Mar
|
Apr
|
May
(4) |
Jun
|
Jul
|
Aug
|
Sep
|
Oct
|
Nov
|
Dec
|
|
From: Adam E. <est...@gm...> - 2013-01-08 01:18:28
|
All, I see in the documentation that XC does not yet support triggers. If I have a table with hundreds of millions of records, I want partition my data out in to partition tables to help speed my queries up. The ON INSERT trigger decides which function to call (the function has all the partition rules in it) which is the postgresql way to do it. How is this handled in XC if there is no trigger capability? Thanks, Adam |
|
From: Michael P. <mic...@gm...> - 2013-01-07 13:13:31
|
On Sun, Jan 6, 2013 at 3:01 PM, Andrei Martsinchyk < and...@gm...> wrote: > File gtm_c.h was not copied during XC install. > This is old problem, I thought was fixed. > Please copy that file manually from the <xc_source>/src/include/gtm/ to > <xc_install_dir>/include/postgresql/server/gtm/ > Yes, all the header files of src/include/gtm were not included in install until recently and it has been fixed by commit 2af4826 on master and backported as e5b2b0c on 1.0 stable. This bug was still present in 1.0.1, but will be included in 1.0.2 and next major release of XC. -- Michael Paquier http://michael.otacoo.com |
|
From: Ashutosh B. <ash...@en...> - 2013-01-07 04:19:20
|
Hi Adam,
This has been fixed in the current head and will be available in the
next release.
On Sat, Jan 5, 2013 at 2:41 AM, Adam McManus <ada...@gm...> wrote:
> I'm evaluating XC to store geo data across multiple servers, but I'm seeing
> strange behavior in early testing.
>
> xc_storage=# select id from geo_store where id in (19700858, 19983820);
> id
> ----------
> 19983820
> 19700858
> (2 rows)
>
> xc_storage=# select id from geo_store where id in (19700858, 19983820) order
> by id;
> id
> ----------
> 19700858
> 19983820
> (2 rows)
>
> Logs from one data node
>
> 2013-01-04 15:01:44 CST [19733]: [193-1] LOG: duration: 0.000 ms
> statement: SELECT id FROM geo_store WHERE (id = ANY (ARRAY[19700858,
> 19983820]))
>
> 2013-01-04 15:02:15 CST [19733]: [194-1] LOG: duration: 0.000 ms
> statement: SELECT id, user_ref, geo_data, distance, created_date,
> updated_date, uuid FROM ONLY geo_store WHERE (id = ANY
> ('{19700858,19983820}'::integer[]))
>
> Why does the addition of the order by statement result in a select of all
> columns in the geo_store table on the data node? Any way around this?
>
> Thanks,
>
> --
> Adam McManus
>
> ------------------------------------------------------------------------------
> Master HTML5, CSS3, ASP.NET, MVC, AJAX, Knockout.js, Web API and
> much more. Get web development skills now with LearnDevNow -
> 350+ hours of step-by-step video tutorials by Microsoft MVPs and experts.
> SALE $99.99 this month only -- learn more at:
> http://p.sf.net/sfu/learnmore_122812
> _______________________________________________
> Postgres-xc-general mailing list
> Pos...@li...
> https://lists.sourceforge.net/lists/listinfo/postgres-xc-general
>
--
Best Wishes,
Ashutosh Bapat
EntepriseDB Corporation
The Enterprise Postgres Company
|
|
From: Andrei M. <and...@gm...> - 2013-01-05 11:54:21
|
CREATE EXTENSION works in general, but there is something in the Postgis' script that does not work. Like create+populate table. 05.01.2013 11:55 пользователь "Michael Paquier" <mic...@gm...> написал: On Sat, Jan 5, 2013 at 5:22 PM, Andrei Martsinchyk < and...@gm...> wrote: > > PostGIS... Meh? CREATE EXTENSION does not work? Last time (something like 1~2 months ago) I used it with 1.0 and master it worked correctly. > > > 2012/12/29 Michael Paquier <mic...@gm...> >> >> >> >> On Sat, Dec 29, 2012 at 4:1... -- Michael Paquier http://michael.otacoo.com |
|
From: Michael P. <mic...@gm...> - 2013-01-05 09:55:58
|
On Sat, Jan 5, 2013 at 5:22 PM, Andrei Martsinchyk < and...@gm...> wrote: > PostGIS can not be installed on Postgres-XC using standard CREATE > EXTENSION command due to some technical issues. > But there is a way to hack them around. > We put everything together in a tutorial and publish on our web-site: > http://www.stormdb.com/content/enabling-postgis-postgres-xc > Meh? CREATE EXTENSION does not work? Last time (something like 1~2 months ago) I used it with 1.0 and master it worked correctly. > > 2012/12/29 Michael Paquier <mic...@gm...> > >> >> >> On Sat, Dec 29, 2012 at 4:17 AM, Mason Sharp <ma...@st...> wrote: >> >>> Hi Arni, >>> >>> On Thu, Dec 27, 2012 at 5:29 PM, Arni Sumarlidason >>> <Arn...@md...> wrote: >>> >>> > >>> > I have been looking for documentation regarding integrating / >>> installing >>> > postgis onto a XC cluster. Can anyone point me in the right direction? >>> It >>> > looks like a commercial service stormdb has implemented this. Any >>> assistance >>> > would be great! >>> >>> We can put together a tutorial on how to integrate PostGIS with >>> Postgres-XC. Please give us a week or so, and we will follow up on >>> this thread. >>> >> +1 on this. >> -- >> Michael Paquier >> http://michael.otacoo.com >> >> ------------------------------------------------------------------------------ >> Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, >> MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current >> with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft >> >> MVPs and experts. SALE $99.99 this month only -- learn more at: >> http://p.sf.net/sfu/learnmore_122912 >> >> _______________________________________________ >> Postgres-xc-general mailing list >> Pos...@li... >> https://lists.sourceforge.net/lists/listinfo/postgres-xc-general >> >> > > > -- > Andrei Martsinchyk > > > StormDB - http://www.stormdb.com > The Database Cloud > > -- Michael Paquier http://michael.otacoo.com |
|
From: Andrei M. <and...@gm...> - 2013-01-05 08:22:36
|
PostGIS can not be installed on Postgres-XC using standard CREATE EXTENSION command due to some technical issues. But there is a way to hack them around. We put everything together in a tutorial and publish on our web-site: http://www.stormdb.com/content/enabling-postgis-postgres-xc 2012/12/29 Michael Paquier <mic...@gm...> > > > On Sat, Dec 29, 2012 at 4:17 AM, Mason Sharp <ma...@st...> wrote: > >> Hi Arni, >> >> On Thu, Dec 27, 2012 at 5:29 PM, Arni Sumarlidason >> <Arn...@md...> wrote: >> >> > >> > I have been looking for documentation regarding integrating / installing >> > postgis onto a XC cluster. Can anyone point me in the right direction? >> It >> > looks like a commercial service stormdb has implemented this. Any >> assistance >> > would be great! >> >> We can put together a tutorial on how to integrate PostGIS with >> Postgres-XC. Please give us a week or so, and we will follow up on >> this thread. >> > +1 on this. > -- > Michael Paquier > http://michael.otacoo.com > > ------------------------------------------------------------------------------ > Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, > MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current > with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft > MVPs and experts. SALE $99.99 this month only -- learn more at: > http://p.sf.net/sfu/learnmore_122912 > _______________________________________________ > Postgres-xc-general mailing list > Pos...@li... > https://lists.sourceforge.net/lists/listinfo/postgres-xc-general > > -- Andrei Martsinchyk StormDB - http://www.stormdb.com The Database Cloud |
|
From: Abbas B. <abb...@en...> - 2013-01-05 07:31:54
|
I tried your test case on latest head and found that the query sent to the
data node does not contain any extra columns.
I think this might be attributed to this commit
35a6dee96d84c70f4984a7dd5ea67d91d591546e
Are you testing the version that contains this commit or not?
I think XC version 1.0 or 1.0.1 does not contain this commit.
Regards
On Sat, Jan 5, 2013 at 2:11 AM, Adam McManus <ada...@gm...> wrote:
> I'm evaluating XC to store geo data across multiple servers, but I'm
> seeing strange behavior in early testing.
>
> xc_storage=# select id from geo_store where id in (19700858, 19983820);
> id
> ----------
> 19983820
> 19700858
> (2 rows)
>
> xc_storage=# select id from geo_store where id in (19700858, 19983820)
> order by id;
> id
> ----------
> 19700858
> 19983820
> (2 rows)
>
> Logs from one data node
>
> 2013-01-04 15:01:44 CST [19733]: [193-1] LOG: duration: 0.000 ms
> statement: SELECT id FROM geo_store WHERE (id = ANY (ARRAY[19700858,
> 19983820]))
>
> 2013-01-04 15:02:15 CST [19733]: [194-1] LOG: duration: 0.000 ms
> statement: SELECT id, user_ref, geo_data, distance, created_date,
> updated_date, uuid FROM ONLY geo_store WHERE (id = ANY
> ('{19700858,19983820}'::integer[]))
>
> Why does the addition of the order by statement result in a select of all
> columns in the geo_store table on the data node? Any way around this?
>
> Thanks,
>
> --
> Adam McManus
>
>
> ------------------------------------------------------------------------------
> Master HTML5, CSS3, ASP.NET, MVC, AJAX, Knockout.js, Web API and
> much more. Get web development skills now with LearnDevNow -
> 350+ hours of step-by-step video tutorials by Microsoft MVPs and experts.
> SALE $99.99 this month only -- learn more at:
> http://p.sf.net/sfu/learnmore_122812
> _______________________________________________
> Postgres-xc-general mailing list
> Pos...@li...
> https://lists.sourceforge.net/lists/listinfo/postgres-xc-general
>
>
--
--
Abbas
Architect
EnterpriseDB Corporation
The Enterprise PostgreSQL Company
Phone: 92-334-5100153
Website: www.enterprisedb.com
EnterpriseDB Blog: http://blogs.enterprisedb.com/
Follow us on Twitter: http://www.twitter.com/enterprisedb
This e-mail message (and any attachment) is intended for the use of
the individual or entity to whom it is addressed. This message
contains information from EnterpriseDB Corporation that may be
privileged, confidential, or exempt from disclosure under applicable
law. If you are not the intended recipient or authorized to receive
this for the intended recipient, any use, dissemination, distribution,
retention, archiving, or copying of this communication is strictly
prohibited. If you have received this e-mail in error, please notify
the sender immediately by reply e-mail and delete this message.
|
|
From: Adam M. <ada...@gm...> - 2013-01-04 21:11:31
|
I'm evaluating XC to store geo data across multiple servers, but I'm seeing
strange behavior in early testing.
xc_storage=# select id from geo_store where id in (19700858, 19983820);
id
----------
19983820
19700858
(2 rows)
xc_storage=# select id from geo_store where id in (19700858, 19983820)
order by id;
id
----------
19700858
19983820
(2 rows)
Logs from one data node
2013-01-04 15:01:44 CST [19733]: [193-1] LOG: duration: 0.000 ms
statement: SELECT id FROM geo_store WHERE (id = ANY (ARRAY[19700858,
19983820]))
2013-01-04 15:02:15 CST [19733]: [194-1] LOG: duration: 0.000 ms
statement: SELECT id, user_ref, geo_data, distance, created_date,
updated_date, uuid FROM ONLY geo_store WHERE (id = ANY
('{19700858,19983820}'::integer[]))
Why does the addition of the order by statement result in a select of all
columns in the geo_store table on the data node? Any way around this?
Thanks,
--
Adam McManus
|
|
From: Mason S. <ma...@st...> - 2012-12-31 13:23:28
|
Hi Iwan, We don't want want to discourage you from using XC. Just give your self enough time to test where you can simulate the workload that you experience in production. If you can partition/distribute your tables cleanly such that all joins always take place locally, XC should help you. If that is not the case, XC will resort to shipping a lot of data to a single coordinator to join. So, you may notice that most operations seem to scale, but a handful of statements now take several minutes or more (something we have addressed in StormDB's fork of XC). As the others have said, you could look at tuning standard PG first, looking at shared_buffers, work_mem, etc., moving WAL off to its own disk. You may want to also log long queries by setting log_min_duration_statement to a couple of seconds (perhaps less) and see if any particular statement is slow due to a missing index or untuned parameters. On Mon, Dec 31, 2012 at 7:47 AM, Iwan Sofana <iwa...@ya...> wrote: > ** > At peek hour is about 1000 transaction per second, and the aggregates run > over 1250000 rows, possibly will increase again. > Send by Ojolinux > ------------------------------ > *From: * Jim Mlodgenski <ji...@gm...> > *Date: *Sun, 30 Dec 2012 10:39:55 -0500 > *To: *Iwan Sofana<iwa...@ya...> > *Cc: *<pos...@li...> > *Subject: *Re: [Postgres-xc-general] Postgresql - Postgres-XC > > > > On Sun, Dec 30, 2012 at 10:01 AM, Iwan Sofana <iwa...@ya...>wrote: > >> I am glade to hear that. >> >> >> > The limit to a single table in PostgreSQL is 32TB so 800GB is still >> only a moderately sized database. >> >> Hundred users from different area can access application and insert >> data. >> The application doing math calculation (average, sum, min, max) and store >> the result in several tables. >> > > About how many transactions per second are you seeing? 100, 1000, 10000? > The aggregates (average, sum) are run over how many rows? 1000, 1 million, > 100 million? > > >> >> > What is the application doing to produce such a high CPU load? Is it >> many concurrent users? A lot of large sorts? etc? >> >> > Understanding why the CPU is high will help determine if XC is the >> right solution to solve your problem. It could be that some simple tuning >> or database maintenance could reduce the CPU load and delay your need to >> move beyond a single server. >> > > > > ------------------------------------------------------------------------------ > Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, > MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current > with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft > MVPs and experts. SALE $99.99 this month only -- learn more at: > http://p.sf.net/sfu/learnmore_122412 > _______________________________________________ > Postgres-xc-general mailing list > Pos...@li... > https://lists.sourceforge.net/lists/listinfo/postgres-xc-general > > -- Mason Sharp StormDB - http://www.stormdb.com The Database Cloud Postgres-XC Support and Services |
|
From: Iwan S. <iwa...@ya...> - 2012-12-31 12:42:01
|
At peek hour is about 1000 transaction per second, and the aggregates run over 1250000 rows, possibly will increase again. Send by Ojolinux -----Original Message----- From: Jim Mlodgenski <ji...@gm...> Date: Sun, 30 Dec 2012 10:39:55 To: Iwan Sofana<iwa...@ya...> Cc: <pos...@li...> Subject: Re: [Postgres-xc-general] Postgresql - Postgres-XC On Sun, Dec 30, 2012 at 10:01 AM, Iwan Sofana <iwa...@ya...> wrote: > I am glade to hear that. > > > > The limit to a single table in PostgreSQL is 32TB so 800GB is still only > a moderately sized database. > > Hundred users from different area can access application and insert data. > The application doing math calculation (average, sum, min, max) and store > the result in several tables. > About how many transactions per second are you seeing? 100, 1000, 10000? The aggregates (average, sum) are run over how many rows? 1000, 1 million, 100 million? > > > What is the application doing to produce such a high CPU load? Is it > many concurrent users? A lot of large sorts? etc? > > > Understanding why the CPU is high will help determine if XC is the right > solution to solve your problem. It could be that some simple tuning or > database maintenance could reduce the CPU load and delay your need to move > beyond a single server. > |
|
From: Jim M. <ji...@gm...> - 2012-12-30 15:40:01
|
On Sun, Dec 30, 2012 at 10:01 AM, Iwan Sofana <iwa...@ya...> wrote: > I am glade to hear that. > > > > The limit to a single table in PostgreSQL is 32TB so 800GB is still only > a moderately sized database. > > Hundred users from different area can access application and insert data. > The application doing math calculation (average, sum, min, max) and store > the result in several tables. > About how many transactions per second are you seeing? 100, 1000, 10000? The aggregates (average, sum) are run over how many rows? 1000, 1 million, 100 million? > > > What is the application doing to produce such a high CPU load? Is it > many concurrent users? A lot of large sorts? etc? > > > Understanding why the CPU is high will help determine if XC is the right > solution to solve your problem. It could be that some simple tuning or > database maintenance could reduce the CPU load and delay your need to move > beyond a single server. > |
|
From: Iwan S. <iwa...@ya...> - 2012-12-30 15:01:37
|
I am glade to hear that. > The limit to a single table in PostgreSQL is 32TB so 800GB is still only a moderately sized database. Hundred users from different area can access application and insert data. The application doing math calculation (average, sum, min, max) and store the result in several tables. > What is the application doing to produce such a high CPU load? Is it many concurrent users? A lot of large sorts? etc? > Understanding why the CPU is high will help determine if XC is the right solution to solve your problem. It could be that some simple tuning or database maintenance could reduce the CPU load and delay your need to move beyond a single server. |
|
From: Michael P. <mic...@gm...> - 2012-12-30 14:34:39
|
On Sun, Dec 30, 2012 at 11:30 PM, Iwan Sofana <iwa...@ya...> wrote: > The system use heavily write operations. > > > > Does your system use heavily read or write operations? > > Does it mean I should make cluster system for specific table only? Yes, if your system uses a lot of write operations, you will need to balance the writes between nodes by distributing the tables. Btw, as Jim mentionned, it is true that 50%-60% of CPU is pretty high. Don't you have a couple of things running in background or isn't it possible to tune your application or PG server to reduce that? You should consider first tuning the systems that are in place before migrating your PG server to XC. -- Michael Paquier http://michael.otacoo.com |
|
From: Iwan S. <iwa...@ya...> - 2012-12-30 14:30:32
|
The system use heavily write operations. > Does your system use heavily read or write operations? Does it mean I should make cluster system for specific table only? > The tables that are heavily read would need to be replicated to share the read load > between nodes and the tables being written a lot would need to be distributed. Regards, Iwan S. |
|
From: Jim M. <ji...@gm...> - 2012-12-30 13:50:46
|
On Sun, Dec 30, 2012 at 8:40 AM, Michael Paquier <mic...@gm...>wrote: > > > On Sun, Dec 30, 2012 at 2:59 AM, Iwan Sofana <iwa...@ya...> wrote: > >> Hi Michael, >> >> Thank you for comprehensive explanation. >> >> About 2 months ago, we start using PostgreSQL on 4 Core >> Xeon. The size of database now increase up to 800 GB and CPU utilization >> is about 40-60%. >> > I heard the limit of a Postgres database is 2TB somewhere so you still got > some time until reaching that but yes the CPU might become a bottleneck if > the use rate has such an average. > The limit to a single table in PostgreSQL is 32TB so 800GB is still only a moderately sized database. What is the application doing to produce such a high CPU load? Is it many concurrent users? A lot of large sorts? etc? Understanding why the CPU is high will help determine if XC is the right solution to solve your problem. It could be that some simple tuning or database maintenance could reduce the CPU load and delay your need to move beyond a single server. > > >> I am not sure the server is strong enough for next two/three months. >> I just thinking to replace it with a new one. >> But by doing this the old server become useable. >> It seems I need write scalability clustering. >> > Does your system use heavily read or write operations? > The tables that are heavily read would need to be replicated to share the > read load between nodes and the tables being written a lot would need to be > distributed. > -- > Michael Paquier > http://michael.otacoo.com > > ------------------------------------------------------------------------------ > Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, > MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current > with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft > MVPs and experts. ON SALE this month only -- learn more at: > http://p.sf.net/sfu/learnmore_123012 > _______________________________________________ > Postgres-xc-general mailing list > Pos...@li... > https://lists.sourceforge.net/lists/listinfo/postgres-xc-general > > |
|
From: Michael P. <mic...@gm...> - 2012-12-30 13:40:14
|
On Sun, Dec 30, 2012 at 2:59 AM, Iwan Sofana <iwa...@ya...> wrote: > Hi Michael, > > Thank you for comprehensive explanation. > > About 2 months ago, we start using PostgreSQL on 4 Core > Xeon. The size of database now increase up to 800 GB and CPU utilization > is about 40-60%. > I heard the limit of a Postgres database is 2TB somewhere so you still got some time until reaching that but yes the CPU might become a bottleneck if the use rate has such an average. > I am not sure the server is strong enough for next two/three months. > I just thinking to replace it with a new one. > But by doing this the old server become useable. > It seems I need write scalability clustering. > Does your system use heavily read or write operations? The tables that are heavily read would need to be replicated to share the read load between nodes and the tables being written a lot would need to be distributed. -- Michael Paquier http://michael.otacoo.com |
|
From: Iwan S. <iwa...@ya...> - 2012-12-29 17:59:27
|
Hi Michael, Thank you for comprehensive explanation. About 2 months ago, we start using PostgreSQL on 4 CoreXeon. The size of database now increase up to 800 GB and CPU utilizationis about 40-60%. I am not sure the server is strong enough for next two/three months.I just thinking to replace it with a new one. But by doing this the old server become useable.It seems I need write scalability clustering. Regards, Iwan S. |
|
From: Michael P. <mic...@gm...> - 2012-12-29 12:44:30
|
On Sat, Dec 29, 2012 at 8:54 AM, Iwan Sofana <iwa...@ya...> wrote:
> Hi,
>
> I am newbie and need some advice.
> I read documentations but not fully understand the implementation
> of postgres-xc on existing server.
>
> We have two computers at office, one computer runs postgresql ver 9.1
> and another computer for Apache 2.xx Web server.
> I want to make postgres cluster and add two more computers.
>
> My questions:
> 1. Should I reinstall existing DB server with postgres-xc?
>
You question is too much general, so... Before considering moving to an XC
server be sure about the following things:
1) Does your application really need XC? Are you looking for
write-scalability/read scalability? Depending on what you are looking for
PostgreSQL itself might be enough.
2) Are the queries used by your application compatible with what is
supported in XC (For example RETURNING and triggers are not supported in
version 1.0)
If after answering those questions you think that it is worth moving to an
XC server, then you will need to choose the correct distribution strategy
for each table of your application deoending on if you want to achieve a
model of read or write scalability.
For example with read scalability you could replication all the table on
all the nodes but the write scaling will suck.
You can also distribute the tables that are under heavy writes to achieve
write scale.
(Is there any documentations about migration?)
>
The only difference at the SQL level between XC and Postgres are for CREATE
TABLE, CREATE TABLE AS and ALTER TABLE (not in 1.0 for data redistribution)
where you can specify the type of distribution you want to use for a given
table. Please refer here:
http://postgres-xc.sourceforge.net/docs/1_0/sql-createtable.html
http://postgres-xc.sourceforge.net/docs/1_0/sql-createtableas.html
2. Should I use the same computer spec for every computer on cluster?
>
You are honestly not obliged to have the same spec for each computer in an
XC cluster.
For example, let's consider 2 examples in the case where you want to create
a cluster with 2 servers:
1) All the coordinators on 1 server and all the datanodes on 1 server:
Coordinators are CPU-bound and datanodes are IO bound, so you will need
more CPU power for the server with Coordinators and won't really need
powerful disks there. On the contrary, the Datanodes will need better disks
as they store data.
2) Coordinator and Datanodes on the same server.
In this case similar spec is recommended.
Please note that as you can also distribute tables on a portion of nodes,
you are able to balance the join or data materialization on certain
dedicated nodes, making them require more or less CPU and shared memory
power.
--
Michael Paquier
http://michael.otacoo.com
|
|
From: Michael P. <mic...@gm...> - 2012-12-29 05:09:14
|
On Sat, Dec 29, 2012 at 4:17 AM, Mason Sharp <ma...@st...> wrote: > Hi Arni, > > On Thu, Dec 27, 2012 at 5:29 PM, Arni Sumarlidason > <Arn...@md...> wrote: > > > > > I have been looking for documentation regarding integrating / installing > > postgis onto a XC cluster. Can anyone point me in the right direction? It > > looks like a commercial service stormdb has implemented this. Any > assistance > > would be great! > > We can put together a tutorial on how to integrate PostGIS with > Postgres-XC. Please give us a week or so, and we will follow up on > this thread. > +1 on this. -- Michael Paquier http://michael.otacoo.com |
|
From: Iwan S. <iwa...@ya...> - 2012-12-28 23:54:42
|
Hi, I am newbie and need some advice. I read documentations but not fully understand the implementation of postgres-xc on existing server. We have two computers at office, one computer runs postgresql ver 9.1 and another computer for Apache 2.xx Web server. I want to make postgres cluster and add two more computers. My questions: 1. Should I reinstall existing DB server with postgres-xc? (Is there any documentations about migration?) 2. Should I use the same computer spec for every computer on cluster? Thank you Regards, Iwan |
|
From: Mason S. <ma...@st...> - 2012-12-28 19:49:05
|
Hi Arni, On Thu, Dec 27, 2012 at 5:29 PM, Arni Sumarlidason <Arn...@md...> wrote: > > I have been looking for documentation regarding integrating / installing > postgis onto a XC cluster. Can anyone point me in the right direction? It > looks like a commercial service stormdb has implemented this. Any assistance > would be great! We can put together a tutorial on how to integrate PostGIS with Postgres-XC. Please give us a week or so, and we will follow up on this thread. Regards, -- Mason Sharp StormDB - http://www.stormdb.com The Database Cloud Postgres-XC Support and Services |
|
From: Arni S. <Arn...@md...> - 2012-12-28 19:26:25
|
That would be amazing, thank you so much Mason! -----Original Message----- From: Mason Sharp [mailto:ma...@st...] Sent: Friday, December 28, 2012 2:17 PM To: Arni Sumarlidason Cc: pos...@li... Subject: Re: [Postgres-xc-general] Hello & postgis Hi Arni, On Thu, Dec 27, 2012 at 5:29 PM, Arni Sumarlidason <Arn...@md...> wrote: > > I have been looking for documentation regarding integrating / > installing postgis onto a XC cluster. Can anyone point me in the right > direction? It looks like a commercial service stormdb has implemented > this. Any assistance would be great! We can put together a tutorial on how to integrate PostGIS with Postgres-XC. Please give us a week or so, and we will follow up on this thread. Regards, -- Mason Sharp StormDB - https://console.mxlogic.com/redir/?17cec6zBUQsCzAS-epophd79EVdw0GjH5l0xOVK_9TLuZXTLsTsSHJaM1l9RyGwgVsSCUNsSyO-UejjjopdI8CMnWhEwdbomHip6fQbxZyV7Uv7jPiWq80LVVZjh0Qq85GQChBgTfM-ub7Xa1J4Syrpop73zhO-Urfa_1TkAaDzy The Database Cloud Postgres-XC Support and Services |
|
From: Koichi S. <koi...@gm...> - 2012-12-28 02:45:05
|
Thanks a lot for your interest in XC. We've given XC tutorial at PGCon 2012. The following page leads to tutorial material which will be the best at present to begin with. http://www.pgcon.org/2012/schedule/events/424.en.html Good luck! ---------- Koichi Suzuki 2012/12/28 Arni Sumarlidason <Arn...@md...>: > Hello Everyone, > > > > I have been looking for documentation regarding integrating / installing > postgis onto a XC cluster. Can anyone point me in the right direction? It > looks like a commercial service stormdb has implemented this. Any assistance > would be great! > > > > Arni Sumarlidason | Web Developer, Information Technology > > MDA | 820 West Diamond Ave | Gaithersburg, MD | USA > > O: 240-833-8200 D: 240-833-8318 M: 256-393-2803 > > arn...@md...| http://www.mdaus.com > > > > > ------------------------------------------------------------------------------ > Master Visual Studio, SharePoint, SQL, ASP.NET, C# 2012, HTML5, CSS, > MVC, Windows 8 Apps, JavaScript and much more. Keep your skills current > with LearnDevNow - 3,200 step-by-step video tutorials by Microsoft > MVPs and experts. ON SALE this month only -- learn more at: > http://p.sf.net/sfu/learnmore_122712 > _______________________________________________ > Postgres-xc-general mailing list > Pos...@li... > https://lists.sourceforge.net/lists/listinfo/postgres-xc-general > |
|
From: Arni S. <Arn...@md...> - 2012-12-27 22:45:35
|
Hello Everyone, I have been looking for documentation regarding integrating / installing postgis onto a XC cluster. Can anyone point me in the right direction? It looks like a commercial service stormdb has implemented this. Any assistance would be great! Arni Sumarlidason | Web Developer, Information Technology MDA | 820 West Diamond Ave | Gaithersburg, MD | USA O: 240-833-8200 D: 240-833-8318 M: 256-393-2803 arn...@md...<mailto:arn...@md...>| http://www.mdaus.com<http://www.mdaus.com/> |
43 messages has been excluded from this view by a project administrator.
