developers-list-request-d/
2012-10-19 14:48:45 UTC
This message was forwarded from developers-list-d/***@public.gmane.org The MonetDB
mailing lists have moved to monetdb.org. Please subscribe to
developers-list-d/***@public.gmane.org, and unsubscribe from this list.
See: http://mail.monetdb.org/mailman/listinfo/developers-list
Send developers-list mailing list submissions to
developers-list-d/***@public.gmane.org
To subscribe or unsubscribe via the World Wide Web, visit
http://mail.monetdb.org/mailman/listinfo/developers-list
or, via email, send a message with subject or body 'help' to
developers-list-request-d/***@public.gmane.org
You can reach the person managing the list at
developers-list-owner-d/***@public.gmane.org
When replying, please edit your Subject line so it is more specific
than "Re: Contents of developers-list digest..."
Today's Topics:
1. Some questions (Sid Just)
2. width_bucket function (metin d)
3. Re: datetime extract function performance (Ying Zhang)
4. Re: width_bucket function (Ying Zhang)
5. Re: datetime extract function performance (metin d)
----------------------------------------------------------------------
Message: 1
Date: Fri, 19 Oct 2012 12:18:28 +0200
From: "Sid Just" <justsid-***@public.gmane.org>
To: developers-list-d/***@public.gmane.org
Subject: Some questions
Message-ID: <20121019101828.11700-***@public.gmane.org>
Content-Type: text/plain; charset="utf-8"
Greetings all,
I have a simple question about MonetDB.
I'm evaluating different several column-store db and I have some questions about Monet :
*
Is MonetDB a column-store database ? If yes I can't understand how I can query it with standard SQL (it'so simple bue it seem to be the ONLY column-store db that support SQL) *
Can MonetDB scale-out over several machines (to build a cluster) for the same database ? *
There is no .NET provider that I can use to connect to MonetDB for fast accessing from C# instead of using ODBC ?In general I'm looking for a database that can perform realtime queries against milions of records, because we are going to build a web application that need real fast access to the data.
What are best practices in desing tables in MonetDB ?
Thanks a lot to everyone!
S
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.monetdb.org/pipermail/developers-list/attachments/20121019/bd40fa53/attachment.html>
------------------------------
Message: 2
Date: Fri, 19 Oct 2012 05:19:49 -0700 (PDT)
From: metin d <metdos-/***@public.gmane.org>
To: "developers-list-d/***@public.gmane.org" <developers-list-d/***@public.gmane.org>
Subject: width_bucket function
Message-ID:
<1350649189.39548.YahooMailNeo-+7zY+oFt7UzK0anN2EpufZEhsgyP+***@public.gmane.org>
Content-Type: text/plain; charset="iso-8859-1"
Hey,
In features web page it says?that?monetDB?is based on the SQL 2003 standard, but?width_bucket function doesn't work although it is in??SQL 2003 standard (http://savage.net.au/SQL/sql-2003-2.bnf.html#width bucket function).
Thanks.
Metin
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.monetdb.org/pipermail/developers-list/attachments/20121019/559b9f82/attachment.html>
------------------------------
Message: 3
Date: Fri, 19 Oct 2012 16:08:05 +0200
From: Ying Zhang <Y.Zhang-rh8NL+***@public.gmane.org>
To: "Communication channel for developers of the MonetDB suite."
<developers-list-d/***@public.gmane.org>
Subject: Re: datetime extract function performance
Message-ID: <20121019140805.GF21437-rh8NL+***@public.gmane.org>
Content-Type: text/plain; charset=us-ascii
Hello Metin,
Before we can say anything about your use case, would you please provide
us the following information:
- query
- db schema
- db size
- output of 'mserver5 --version'
- OS
- Postgres version (assuming it's running on the same machine?)
- execution time of your "extract" function on MonetDB and Postgres
- how did you measure those times?
Kind regards,
Jennie
Message: 4
Date: Fri, 19 Oct 2012 16:10:47 +0200
From: Ying Zhang <Y.Zhang-rh8NL+***@public.gmane.org>
To: "Communication channel for developers of the MonetDB suite."
<developers-list-d/***@public.gmane.org>
Subject: Re: width_bucket function
Message-ID: <20121019141046.GG21437-rh8NL+***@public.gmane.org>
Content-Type: text/plain; charset=us-ascii
Hello Metin,
MonetDB is indeed based on SQL:2003, but we don't support all SQL:2003
features. This page gives an overview of what we do support:
http://www.monetdb.org/Documentation/Manuals/SQLreference/Features/Supported
You can consider submitting a feature request.
Kind regards,
Jennie
Message: 5
Date: Fri, 19 Oct 2012 07:48:40 -0700 (PDT)
From: metin d <metdos-/***@public.gmane.org>
To: "Communication channel for developers of the MonetDB suite."
<developers-list-d/***@public.gmane.org>
Subject: Re: datetime extract function performance
Message-ID:
<1350658120.81805.YahooMailNeo-+7zY+oFt7UzK0anN2EpufZEhsgyP+***@public.gmane.org>
Content-Type: text/plain; charset="iso-8859-1"
Hi Ying,
Here the information yo asked.
Best Regards,
Metin
- queries and execution times (internel time reports of DBs) - there is only one day in the dataset
I used time difference between queries with extract and without extract. For this examples, it is around 4x assuming difference is because of extract function.
MonetDB:
Ex. time: 4.8s
SELECT
??? extract(day from event_time) as event_day,
??? act,
??? count(*)
FROM
??? events
GROUP BY
??? act,
??? event_day;
Ex. time: 70ms
SELECT
??? act,
??? count(*)
FROM
??? events
GROUP BY
??? act;
Postgres:
Ex. time: 2.9s
SELECT
??? extract(day from event_time) as event_day,
??? act,
??? count(*)
FROM
??? events
GROUP BY
??? act,
??? event_day;
Ex. time: 1.7s
SELECT
??? act,
??? count(*)
FROM
??? events
GROUP BY
??? act;
-db schema
CREATE TABLE events(
??? event_time timestamp,
??? event varchar(100)
);
- db size
300 MB
- output of 'mserver5 --version'
MonetDB 5 server v11.11.11 "Jul2012-SP2" (64-bit, 64-bit oids)
- OS
Ubuntu 12.04 LTS
- Postgres version
9.1.6
________________________________
From: Ying Zhang <Y.Zhang-rh8NL+***@public.gmane.org>
To: Communication channel for developers of the MonetDB suite. <developers-list-d/***@public.gmane.org>
Sent: Friday, October 19, 2012 5:08 PM
Subject: Re: datetime extract function performance
Hello Metin,
Before we can say anything about your use case, would you please provide
us the following information:
- query
- db schema
- db size
- output of 'mserver5 --version'
- OS
- Postgres version (assuming it's running on the same machine?)
- execution time of your "extract" function on MonetDB and Postgres
- how did you measure those times?
Kind regards,
Jennie
developers-list mailing list
developers-list-d/***@public.gmane.org
http://mail.monetdb.org/mailman/listinfo/developers-list
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.monetdb.org/pipermail/developers-list/attachments/20121019/c18d1215/attachment.html>
------------------------------
_______________________________________________
developers-list mailing list
developers-list-d/***@public.gmane.org
http://mail.monetdb.org/mailman/listinfo/developers-list
End of developers-list Digest, Vol 2, Issue 8
*********************************************
mailing lists have moved to monetdb.org. Please subscribe to
developers-list-d/***@public.gmane.org, and unsubscribe from this list.
See: http://mail.monetdb.org/mailman/listinfo/developers-list
Send developers-list mailing list submissions to
developers-list-d/***@public.gmane.org
To subscribe or unsubscribe via the World Wide Web, visit
http://mail.monetdb.org/mailman/listinfo/developers-list
or, via email, send a message with subject or body 'help' to
developers-list-request-d/***@public.gmane.org
You can reach the person managing the list at
developers-list-owner-d/***@public.gmane.org
When replying, please edit your Subject line so it is more specific
than "Re: Contents of developers-list digest..."
Today's Topics:
1. Some questions (Sid Just)
2. width_bucket function (metin d)
3. Re: datetime extract function performance (Ying Zhang)
4. Re: width_bucket function (Ying Zhang)
5. Re: datetime extract function performance (metin d)
----------------------------------------------------------------------
Message: 1
Date: Fri, 19 Oct 2012 12:18:28 +0200
From: "Sid Just" <justsid-***@public.gmane.org>
To: developers-list-d/***@public.gmane.org
Subject: Some questions
Message-ID: <20121019101828.11700-***@public.gmane.org>
Content-Type: text/plain; charset="utf-8"
Greetings all,
I have a simple question about MonetDB.
I'm evaluating different several column-store db and I have some questions about Monet :
*
Is MonetDB a column-store database ? If yes I can't understand how I can query it with standard SQL (it'so simple bue it seem to be the ONLY column-store db that support SQL) *
Can MonetDB scale-out over several machines (to build a cluster) for the same database ? *
There is no .NET provider that I can use to connect to MonetDB for fast accessing from C# instead of using ODBC ?In general I'm looking for a database that can perform realtime queries against milions of records, because we are going to build a web application that need real fast access to the data.
What are best practices in desing tables in MonetDB ?
Thanks a lot to everyone!
S
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.monetdb.org/pipermail/developers-list/attachments/20121019/bd40fa53/attachment.html>
------------------------------
Message: 2
Date: Fri, 19 Oct 2012 05:19:49 -0700 (PDT)
From: metin d <metdos-/***@public.gmane.org>
To: "developers-list-d/***@public.gmane.org" <developers-list-d/***@public.gmane.org>
Subject: width_bucket function
Message-ID:
<1350649189.39548.YahooMailNeo-+7zY+oFt7UzK0anN2EpufZEhsgyP+***@public.gmane.org>
Content-Type: text/plain; charset="iso-8859-1"
Hey,
In features web page it says?that?monetDB?is based on the SQL 2003 standard, but?width_bucket function doesn't work although it is in??SQL 2003 standard (http://savage.net.au/SQL/sql-2003-2.bnf.html#width bucket function).
Thanks.
Metin
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.monetdb.org/pipermail/developers-list/attachments/20121019/559b9f82/attachment.html>
------------------------------
Message: 3
Date: Fri, 19 Oct 2012 16:08:05 +0200
From: Ying Zhang <Y.Zhang-rh8NL+***@public.gmane.org>
To: "Communication channel for developers of the MonetDB suite."
<developers-list-d/***@public.gmane.org>
Subject: Re: datetime extract function performance
Message-ID: <20121019140805.GF21437-rh8NL+***@public.gmane.org>
Content-Type: text/plain; charset=us-ascii
Hello Metin,
Before we can say anything about your use case, would you please provide
us the following information:
- query
- db schema
- db size
- output of 'mserver5 --version'
- OS
- Postgres version (assuming it's running on the same machine?)
- execution time of your "extract" function on MonetDB and Postgres
- how did you measure those times?
Kind regards,
Jennie
Hey,
I'm running a small performance test on MonetDB and
Postgres. According to my results "extract" function in monetDB (http:/
/www.monetdb.org/Documentation/SQLreference/Temporal) is nearly 10x
slower then Postgres.
Do you know the reason, or do you have any idea which can make
"extract" function faster in MonetDB ?
Thanks,
Metin
_______________________________________________
developers-list mailing list
http://mail.monetdb.org/mailman/listinfo/developers-list
------------------------------I'm running a small performance test on MonetDB and
Postgres. According to my results "extract" function in monetDB (http:/
/www.monetdb.org/Documentation/SQLreference/Temporal) is nearly 10x
slower then Postgres.
Do you know the reason, or do you have any idea which can make
"extract" function faster in MonetDB ?
Thanks,
Metin
_______________________________________________
developers-list mailing list
http://mail.monetdb.org/mailman/listinfo/developers-list
Message: 4
Date: Fri, 19 Oct 2012 16:10:47 +0200
From: Ying Zhang <Y.Zhang-rh8NL+***@public.gmane.org>
To: "Communication channel for developers of the MonetDB suite."
<developers-list-d/***@public.gmane.org>
Subject: Re: width_bucket function
Message-ID: <20121019141046.GG21437-rh8NL+***@public.gmane.org>
Content-Type: text/plain; charset=us-ascii
Hello Metin,
MonetDB is indeed based on SQL:2003, but we don't support all SQL:2003
features. This page gives an overview of what we do support:
http://www.monetdb.org/Documentation/Manuals/SQLreference/Features/Supported
You can consider submitting a feature request.
Kind regards,
Jennie
Hey,
In features web page it says that monetDB is based on the SQL 2003
standard, but width_bucket function doesn't work although it is in SQL
2003 standard (http://savage.net.au/SQL/sql-2003-2.bnf.html#width
bucket function).
Thanks.
Metin
_______________________________________________
developers-list mailing list
http://mail.monetdb.org/mailman/listinfo/developers-list
------------------------------In features web page it says that monetDB is based on the SQL 2003
standard, but width_bucket function doesn't work although it is in SQL
2003 standard (http://savage.net.au/SQL/sql-2003-2.bnf.html#width
bucket function).
Thanks.
Metin
_______________________________________________
developers-list mailing list
http://mail.monetdb.org/mailman/listinfo/developers-list
Message: 5
Date: Fri, 19 Oct 2012 07:48:40 -0700 (PDT)
From: metin d <metdos-/***@public.gmane.org>
To: "Communication channel for developers of the MonetDB suite."
<developers-list-d/***@public.gmane.org>
Subject: Re: datetime extract function performance
Message-ID:
<1350658120.81805.YahooMailNeo-+7zY+oFt7UzK0anN2EpufZEhsgyP+***@public.gmane.org>
Content-Type: text/plain; charset="iso-8859-1"
Hi Ying,
Here the information yo asked.
Best Regards,
Metin
- queries and execution times (internel time reports of DBs) - there is only one day in the dataset
I used time difference between queries with extract and without extract. For this examples, it is around 4x assuming difference is because of extract function.
MonetDB:
Ex. time: 4.8s
SELECT
??? extract(day from event_time) as event_day,
??? act,
??? count(*)
FROM
??? events
GROUP BY
??? act,
??? event_day;
Ex. time: 70ms
SELECT
??? act,
??? count(*)
FROM
??? events
GROUP BY
??? act;
Postgres:
Ex. time: 2.9s
SELECT
??? extract(day from event_time) as event_day,
??? act,
??? count(*)
FROM
??? events
GROUP BY
??? act,
??? event_day;
Ex. time: 1.7s
SELECT
??? act,
??? count(*)
FROM
??? events
GROUP BY
??? act;
-db schema
CREATE TABLE events(
??? event_time timestamp,
??? event varchar(100)
);
- db size
300 MB
- output of 'mserver5 --version'
MonetDB 5 server v11.11.11 "Jul2012-SP2" (64-bit, 64-bit oids)
- OS
Ubuntu 12.04 LTS
- Postgres version
9.1.6
________________________________
From: Ying Zhang <Y.Zhang-rh8NL+***@public.gmane.org>
To: Communication channel for developers of the MonetDB suite. <developers-list-d/***@public.gmane.org>
Sent: Friday, October 19, 2012 5:08 PM
Subject: Re: datetime extract function performance
Hello Metin,
Before we can say anything about your use case, would you please provide
us the following information:
- query
- db schema
- db size
- output of 'mserver5 --version'
- OS
- Postgres version (assuming it's running on the same machine?)
- execution time of your "extract" function on MonetDB and Postgres
- how did you measure those times?
Kind regards,
Jennie
Hey,
I'm running a small performance test on MonetDB and
Postgres. According to my results "extract" function in monetDB (http:/
/www.monetdb.org/Documentation/SQLreference/Temporal) is nearly 10x
slower then Postgres.
Do you know the reason, or do you have any idea which can make
"extract" function faster in MonetDB ?
Thanks,
Metin
_______________________________________________
developers-list mailing list
http://mail.monetdb.org/mailman/listinfo/developers-list
_______________________________________________I'm running a small performance test on MonetDB and
Postgres. According to my results "extract" function in monetDB (http:/
/www.monetdb.org/Documentation/SQLreference/Temporal) is nearly 10x
slower then Postgres.
Do you know the reason, or do you have any idea which can make
"extract" function faster in MonetDB ?
Thanks,
Metin
_______________________________________________
developers-list mailing list
http://mail.monetdb.org/mailman/listinfo/developers-list
developers-list mailing list
developers-list-d/***@public.gmane.org
http://mail.monetdb.org/mailman/listinfo/developers-list
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mail.monetdb.org/pipermail/developers-list/attachments/20121019/c18d1215/attachment.html>
------------------------------
_______________________________________________
developers-list mailing list
developers-list-d/***@public.gmane.org
http://mail.monetdb.org/mailman/listinfo/developers-list
End of developers-list Digest, Vol 2, Issue 8
*********************************************