on 1/31/04 9:50 PM, Norman Palardy at palardyn /AT/ shaw .D.O.T ca wrote:
>>> - tables stored in multiple physical files that I can move to separate
>>> drives for extra search speed. Oh, the search engine has to be able to
>>> paralellize the query so all portions of the table are searched
>>> simultaneously therefore resulting in faster queries. Obviously this
>>> means I want a multi threaded DB engine as well
>>
>> Again let's clarify.
>>
>> This is possible say in Valentina Server, because it is SEPARATE
>> PROCESS
>> which have many threads. REALBasic plugin -- client is single thread.
>> And is just a bridge.
>>
>> If talk about V4RB LOCAL, which self contains engine, I think it also
>> will
>> be single thread.
>
> In the server within EACH of those query threads I'd want a query to be
Okay, so you speak about SERVER APPLICATION, not about plugin.
> split into MANY sub threads so that the various portions of tables
> (which are on several different disks) can all be searched at once. The
> main thread for this would then aggregate all the results and return
> them to the valentina client.
Yes, I see what you mean -- parallel execution of sub-tasks of query.
> This way if a portion on TABLE_A, from rowID 1 to 100, is on disk 1,
> rows 101 to 200 on disk 2 and rows 201 to 300 on disk 3 a query like
>
> select * from TABLE_A should be split into 3 sub threads and run as
>
> on disk 1 -> select * from TABLE_A gets rows in the 1 to 100 range
> on disk 2 -> select * from TABLE_A gets rows in the 101 to 200 range
> on disk 3 -> select * from TABLE_A gets rows in the 201 to 300 range
>
> group and sort all results into one result set
>
> return results to query
>
> BUT the first 3 steps are run simultaneously
> Obviously this is a very simplified example. The more partitions the
> more subthreads can be spawned. On a single CPU system this might make
> little difference, but with multiple drives it should make some. On
> multiCPU systems this could be a huge performance gain.
Yes. Correct.
This is HUGE task. As theoretical, so practical.
--
Best regards,
Ruslan Zasukhin [ I feel the need...the need for speed ]
-------------------------------------------------------------
e-mail: ruslan@paradigmasoft.com
web: http://www.paradigmasoft.com
To subscribe to the Valentina mail list go to:
http://lists.macserve.net/mailman/listinfo/valentina
-------------------------------------------------------------
_______________________________________________
Valentina mailing list
Valentina /AT/ lists .D.O.T macserve.net
http://lists.macserve.net/mailman/listinfo/valentina
©2004 Ruslan Zasukhin |
