Re: [NF] For those interested in Big Data

Author: Stephen Russell

Posted: 2011-09-24 at 09:36:33

On Sat, Sep 24, 2011 at 8:15 AM, Malcolm Greene <profox@bdurham.com> wrote:

> Paul,

>

>> I think most people just store the image data, video data, whatever, as a node in the database. You want to limit the number of things to search for and pulling the pointer from the database and then the file from the filesystem wouldn't be as fast as just pulling the blob from the db to begin with.

>

> I respectfully disagree with your position. There was a recent thread on

> the SQLite mailing list that included some benchmarks that argued

> against use of blobs for storing files. While much of the discussion was

> SQLite specific, I think that many of the principles would also apply to

> other databases.

>

> Some generic reasons to store files outside of a database include the

> ability to use lower cost/speed file systems for file storage, faster

> database backups, and faster database maintenance activities when

> schemas change. Also much less database fragmentation.

>

> The only reason I can think to store files inside a database is for

> convenience, eg. having a single container for all your data.

---------------

I think HIPAA rules state that you have to keep the image in a secure

fashion, more about the alteration and loss of images to a patient as

well as who did any of it. All that distills down to the storage of

images in the db and that one table is usually the PIG in the db in

size. When I was a db for a EMR company one client had an 800 gig

table for images alone.

That made restore the hard time to overcome.

When that big client left I think they took the storage to Racker county.

--

Stephen Russell

Unified Health Services

60 Germantown Court

Suite 220

Cordova, TN 38018

Telephone: 888.510.2667

901.246-0159 cell

_______________________________________________

Post Messages to: ProFox@leafe.com

Subscription Maintenance: http://leafe.com/mailman/listinfo/profox

OT-free version of this list: http://leafe.com/mailman/listinfo/profoxtech

Searchable Archive: http://leafe.com/archives/search/profox

This message: http://leafe.com/archives/byMID/profox/CAJidMY+OSQtHkCUy1_2xWi2TrzByGecDOOEtWfUkWvOCGCRUQQ@mail.gmail.com

** All postings, unless explicitly stated otherwise, are the opinions of the author, and do not constitute legal or medical advice. This statement is added to the messages for those lawyers who are too stupid to see the obvious.

©2011 Stephen Russell