dbTalk Databases Forums  

Storing parsed XML-elements as blobs

comp.databases.mysql comp.databases.mysql


Discuss Storing parsed XML-elements as blobs in the comp.databases.mysql forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
Maccabi
 
Posts: n/a

Default Storing parsed XML-elements as blobs - 05-30-2011 , 01:42 AM






Hello!

I am looking for an efficient way of storing large amounts of data in
mysql, so that it is quick to access and efficient in store. Im using
PHP.

One idea I am playing with, is parsing (deserializing) the elements
and saving the DOMElements (in their binary existience) as BLOBS to be
retrieved and parsed for different type of contained data when
necessary.

One danger I see is that in this way I am "bound" to a platform. I
guess Java or Perl programs on the same platform, or even PHP program
on a different platform, will not be able to utilize the data (is this
really the case, BTW?).

The question is: is it really as efficient as I imagine it to be?
could the efficiency outweigh the disadvantages?

The alternative is to store the XML element as a serialized string,
deserialize it at retrieve time, and analyzing / extracting /
modifying before re-storing as a string.

Any experience / know-how out there?

Thanks a lot!

Michael

Reply With Quote
  #2  
Old   
Jerry Stuckle
 
Posts: n/a

Default Re: Storing parsed XML-elements as blobs - 05-30-2011 , 07:57 AM






On 5/30/2011 2:42 AM, Maccabi wrote:
Quote:
Hello!

I am looking for an efficient way of storing large amounts of data in
mysql, so that it is quick to access and efficient in store. Im using
PHP.

One idea I am playing with, is parsing (deserializing) the elements
and saving the DOMElements (in their binary existience) as BLOBS to be
retrieved and parsed for different type of contained data when
necessary.

One danger I see is that in this way I am "bound" to a platform. I
guess Java or Perl programs on the same platform, or even PHP program
on a different platform, will not be able to utilize the data (is this
really the case, BTW?).

The question is: is it really as efficient as I imagine it to be?
could the efficiency outweigh the disadvantages?

The alternative is to store the XML element as a serialized string,
deserialize it at retrieve time, and analyzing / extracting /
modifying before re-storing as a string.

Any experience / know-how out there?

Thanks a lot!

Michael

Impossible to tell from your description. The best way to save data is
almost always based on what the data is.

Personally, I don't save DOM elements or XML in MySQL. I save the data.

--
==================
Remove the "x" from my email address
Jerry Stuckle
JDS Computer Training Corp.
jstucklex (AT) attglobal (DOT) net
==================

Reply With Quote
  #3  
Old   
Mathieu Maes
 
Posts: n/a

Default Re: Storing parsed XML-elements as blobs - 05-30-2011 , 09:57 AM



On 30 mei, 14:57, Jerry Stuckle <jstuck... (AT) attglobal (DOT) net> wrote:
Quote:
On 5/30/2011 2:42 AM, Maccabi wrote:









Hello!

I am looking for an efficient way of storing large amounts of data in
mysql, so that it is quick to access and efficient in store. Im using
PHP.

One idea I am playing with, is parsing (deserializing) the elements
and saving the DOMElements (in their binary existience) as BLOBS to be
retrieved and parsed for different type of contained data when
necessary.

One danger I see is that in this way I am "bound" to a platform. I
guess Java or Perl programs on the same platform, or even PHP program
on a different platform, will not be able to utilize the data (is this
really the case, BTW?).

The question is: is it really as efficient as I imagine it to be?
could the efficiency outweigh the disadvantages?

The alternative is to store the XML element as a serialized string,
deserialize it at retrieve time, and analyzing / extracting /
modifying before re-storing as a string.

Any experience / know-how out there?

Thanks a lot!

Michael

Impossible to tell from your description. *The best way to save data is
almost always based on what the data is.

Personally, I don't save DOM elements or XML in MySQL. *I save the data..

--
==================
Remove the "x" from my email address
Jerry Stuckle
JDS Computer Training Corp.
jstuck... (AT) attglobal (DOT) net
==================
Hi Michael,

Everything depends on how you want to use the data. Storing XML or
serialized objects in a database may result in certain limitations,
ie. if you want to perform queries on the data.

Serializing may not be a good idea if the data needs to be available
from different platforms.


Kind regards,
Mathew

Reply With Quote
  #4  
Old   
Axel Schwenke
 
Posts: n/a

Default Re: Storing parsed XML-elements as blobs - 05-30-2011 , 01:10 PM



Maccabi <norway.maccabi (AT) gmail (DOT) com> wrote:
Quote:
I am looking for an efficient way of storing large amounts of data in
mysql, so that it is quick to access and efficient in store.
What is "large amount"? Access based on what?

Quote:
One idea I am playing with, is parsing (deserializing) the elements
and saving the DOMElements (in their binary existience) as BLOBS to be
retrieved and parsed for different type of contained data when
necessary.
Yes, this can be done.

Quote:
One danger I see is that in this way I am "bound" to a platform. I
guess Java or Perl programs on the same platform, or even PHP program
on a different platform, will not be able to utilize the data (is this
really the case, BTW?).
What do you mean? A BLOB is a BLOB is a BLOB. Its an array of bytes,
in most client programming languages represented as binary string.
It does not matter what languange or platform that is.

Quote:
The question is: is it really as efficient as I imagine it to be?
It depends on what you intend to do with the data.

Quote:
The alternative is to store the XML element as a serialized string,
deserialize it at retrieve time, and analyzing / extracting /
modifying before re-storing as a string.
From the database point of view this is not different from storing
the binary representation. A BLOB is an opaque object to MySQL.
Just like a XML lump in textual representation. Of course there
are some XML functions which work on strings only. RTFM!

But if we talk of "efficient" in relation to RDBMS, and specifically
MySQL, then storing XML in a BLOB is not much different than storing
it in a file. Accessing rows based on content (say: matching an XPATH
expression) will be painfully slow because it does a table scan.
Things get better when you extract the data you want to use to locate
certain XML fragments and store it in separate columns (with an index).

But overall "XML" and "RDBMS" are pretty orthogonal concepts. RDBMS
operate efficiently on data with a fixed record structure. XML is the
idea of a highly flexible record structure. No good match.


XL

Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.