dbTalk Databases Forums  

Backups with MySQL/InnoDB

mailing.database.myodbc mailing.database.myodbc


Discuss Backups with MySQL/InnoDB in the mailing.database.myodbc forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
AT
 
Posts: n/a

Default Backups with MySQL/InnoDB - 05-07-2006 , 11:27 AM






------_=_NextPart_001_01C671F3.23D14354
Content-Type: text/plain;
charset="us-ascii"
Content-Transfer-Encoding: quoted-printable

What are people doing for backups on very large MySQL/InnoDB databases?
Say for databases greater than 200 GB. Curious about the backup methods,
procedures, and frequency.

------_=_NextPart_001_01C671F3.23D14354--


Reply With Quote
  #2  
Old   
AT
 
Posts: n/a

Default Re: Backups with MySQL/InnoDB - 05-07-2006 , 08:14 PM






--Sr1nOIr3CvdE5hEN
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline

On Sunday, 7 May 2006 at 9:27:31 -0700, Robert DiFalco wrote:
Quote:
What are people doing for backups on very large MySQL/InnoDB databases?
Say for databases greater than 200 GB. Curious about the backup methods,
procedures, and frequency.
A second question, but not for the first time: how would you *like* to
do backups if you had the choice? We're currently in the final stages
of the design of an online backup solution, and in the near future
I'll publish the specs. I won't mention them now to avoid influencing
you, but now's the time to speak up if you want something specific.

Greg
--
Greg Lehey, Senior Software Engineer
MySQL AB, http://www.mysql.com/
Echunga, South Australia
Phone: +61-8-8388-8286 Mobile: +61-418-838-708

Are you MySQL certified? http://www.mysql.com/certification/

--Sr1nOIr3CvdE5hEN
Content-Type: application/pgp-signature
Content-Disposition: inline

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.2 (FreeBSD)

iD8DBQFEXptrIubykFB6QiMRApHxAJ4xFlLUlzvwtZ7ZZp4Yvi +d00qTNgCdFN51
+Sd2nt87OX3G97SttQ77Npw=
=y35S
-----END PGP SIGNATURE-----

--Sr1nOIr3CvdE5hEN--


Reply With Quote
  #3  
Old   
AT
 
Posts: n/a

Default RE: Backups with MySQL/InnoDB - 05-07-2006 , 11:30 PM



Fast, incremental, compressed, and no max-size limitations. Must be
transaction safe; able to run while transactions are going on without
including any started after the backup began; the usual stuff. =20

-----Original Message-----
From: Greg 'groggy' Lehey [mailto:grog (AT) mysql (DOT) com]=20
Sent: Sunday, May 07, 2006 6:14 PM
To: Robert DiFalco
Cc: mysql (AT) lists (DOT) mysql.com
Subject: Re: Backups with MySQL/InnoDB

On Sunday, 7 May 2006 at 9:27:31 -0700, Robert DiFalco wrote:
Quote:
What are people doing for backups on very large MySQL/InnoDB
databases?
Say for databases greater than 200 GB. Curious about the backup=20
methods, procedures, and frequency.
A second question, but not for the first time: how would you *like* to
do backups if you had the choice? We're currently in the final stages
of the design of an online backup solution, and in the near future I'll
publish the specs. I won't mention them now to avoid influencing you,
but now's the time to speak up if you want something specific.

Greg
--
Greg Lehey, Senior Software Engineer
MySQL AB, http://www.mysql.com/
Echunga, South Australia
Phone: +61-8-8388-8286 Mobile: +61-418-838-708

Are you MySQL certified? http://www.mysql.com/certification/


--
MySQL General Mailing List
For list archives: http://lists.mysql.com/mysql
To unsubscribe: http://lists.mysql.com/mysql?unsub=3...ie.nctu.edu.tw



Reply With Quote
  #4  
Old   
AT
 
Posts: n/a

Default Re: Backups with MySQL/InnoDB - 05-08-2006 , 08:03 PM



--byLs0wutDcxFdwtm
Content-Type: text/plain; charset=us-ascii
Content-Disposition: inline

On Sunday, May 07, 2006 6:14 PM, Greg 'groggy' Lehey wrote:
Quote:
On Sunday, 7 May 2006 at 9:27:31 -0700, Robert DiFalco wrote:
What are people doing for backups on very large MySQL/InnoDB
databases? Say for databases greater than 200 GB. Curious about
the backup methods, procedures, and frequency.

A second question, but not for the first time: how would you *like* to
do backups if you had the choice? We're currently in the final stages
of the design of an online backup solution, and in the near future I'll
publish the specs. I won't mention them now to avoid influencing you,
but now's the time to speak up if you want something specific.
On Monday, 8 May 2006 at 8:15:17 -0700, paul rivers wrote:
Quote:
I would suggest looking at the functionality of Microsoft SQL Server
or Sybase backups. It's extremely nice from an admin point of view,
and certainly covers all of what Robert mentions.
Yes, from an administrative perspective we're trying to make something
that feels "intuitive", and particularly the Microsoft approach seems
a good starting point for this aspect. If you have a pet feature not
discussed below, let me know.

On Sunday, May 07, 2006 9:30 PM, Robert DiFalco wrote:
Quote:
Fast, incremental, compressed, and no max-size limitations. Must be
transaction safe; able to run while transactions are going on
without including any started after the backup began; the usual
stuff.
We're certainly planning incremental backups, but they probably won't
be in the first release. We don't plan any size limitations (this is
a streaming backup), and it will be transaction-safe (statement-safe
for MyISAM) and online (i.e. concurrently with normal processing).

Compression is a different issue. We haven't considered it so far,
and though it's desirable, I don't see why we can't get an external
program to do this (bzip2 or gzip, for example; the choice depends on
your personal tradeoffs between time and space).

On Monday, 8 May 2006 at 15:55:07 -0300, Daniel da Veiga wrote:
Quote:
On 5/8/06, David Hillman wrote:
On May 7, 2006, at 11:29 PM, Robert DiFalco wrote:
Fast, incremental, compressed, and no max-size limitations. Must be
transaction safe; able to run while transactions are going on without
including any started after the backup began; the usual stuff.

Incremental, transaction safe, compressed, fast, no-max-size.
( In order )


Those are certainly the most important features (and I'll be glad to
beta-test it I'll add: manage multiple servers, deal with
replication (using the replicated server as a backup would be cool),
manage binlogs (date and purge) and be compatible with version 4.1 and
above (I don't plan on using the 5 version any time soon).
The component we're working on at the moment is the streaming online
backup API. Basically you issue an SQL command BACKUP DATABASE, and
it outputs a data stream that you can point at your tape drive, to a
disk, or across the network to something like VERITAS. We're very
conscious of the multiple server issue, but it's going to have to wait
until we can back up one server properly. Dealing with replication is
a special case of multiple servers, so that will wait too. We will
backup the binlog, though, and our current thinking is to use it for
incremental backups, though this may change.

On Monday, 8 May 2006 at 16:09:23 -0500, Rich Duzenbury wrote:
Quote:
In addition, I'd like to see a configurable option for how often to
take a full and or incremental backups, a mechanism to age the
backups and drop them after a certain amount of time. For example,
I want a simple way to keep four weekly near line backups each
month, then age off and keep one backup for each of the previous 11
months, and then just one backup per year. This would be about 1T
of data for us.
This is also another aspect of the backup solution we're working on.
I'll put it down on the wish list.

On Tuesday, 9 May 2006 at 7:18:28 +1000, David Logan wrote:
Quote:
Hi Greg,

Maybe similar features to that of bacula (my current backup software of
choice for my wifes business servers). This is a very comprehensive open
source solution that has many of the features requested below. eg.
multiple servers, pooling, aging etc. It is a good example of what my
own requirements would be.
I don't know Bacula, but I suppose I should investigate it. Do you
know anybody in the project?

Quote:
Is the intention to have a MySQL type plugin? eg. will it have an
api that will be open to other backup solutions being able to
utilise what will be written?
Yes, this is very much the intention. It's the API that we're
defining now. We've been talking to Zmanda (http://www.zmanda.com/),
who are interested in extending amanda with MySQL plugins, and we'd be
more than happy for others to join in.

Quote:
It would be nice to be able to utilise a standard XBSA solution giving
access to the database from any one of the major enterprise backup
solutions, eg. Legato Networker, Veritas Netbackup, HP Dataprotector
etc. etc. This would allow an enormously simple and straightforward
integration into many of the existing corporate solutions that exist
around the world.
Yes, this is also on the horizon, and we're working on it.

Thanks to all of you for your input. I'll try to get more information
out for review in about 10 days.

Greg
--
Greg Lehey, Senior Software Engineer
MySQL AB, http://www.mysql.com/
Echunga, South Australia
Phone: +61-8-8388-8286 Mobile: +61-418-838-708

Are you MySQL certified? http://www.mysql.com/certification/

--byLs0wutDcxFdwtm
Content-Type: application/pgp-signature
Content-Disposition: inline

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.2 (FreeBSD)

iD8DBQFEX+pEIubykFB6QiMRAjhbAJ9rUFK2idFHcm3Ih1MdT5 +d0nRThgCfaYHB
4sM08YRLsa3FxXLP8migjS0=
=dr4T
-----END PGP SIGNATURE-----

--byLs0wutDcxFdwtm--


Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2013, Jelsoft Enterprises Ltd.