dbTalk Databases Forums  

Q-Pointed Unix Directories Corrupted in a Bizarre Way

comp.databases.pick comp.databases.pick


Discuss Q-Pointed Unix Directories Corrupted in a Bizarre Way in the comp.databases.pick forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
Jay
 
Posts: n/a

Default Q-Pointed Unix Directories Corrupted in a Bizarre Way - 05-11-2010 , 09:56 AM






System Info:

D3 Version: D3 lx-7.5.12-.Z
Linux Version: RedHat Enterprise Linux (RHEL) 5.2 x64 running kernel
2.6.18-92.1.22.el5PAE
Running on: Dell PowerEdge 1900 with dual Intel Xeon E5320 processors
with a PERC 5/i RAID controller in (I believe) RAID 5 configuration

Problem:

Last week we had a power outage which caused the system to reboot (for
some reason the UPS did not hold up the system).

Shortly thereafter we noticed that Unix directories contained files
that should have been written to other directories. Moreover (and
here's the really strange part) the files were not named what they
should have been stored as. Instead, they had the names of files that
they overwrote. All the directories involved are Q-Pointed Unix
directories:

These directories (4 in all) were all Q-Pointed D3 "files". Picture
this:

Pick File Q-Pointed to

UQ.ARTISTS /var/music/artists
UQ.GUNS /var/dangerous_things/guns

The artists directory (pick file UQ.ARTISTS) contains a file (pick
item) called BEATLES that looks like this (sans the numbers):

001 Paul
002 George
003 John
004 Ringo

The guns directory (pick file UQ.GUNS) contains a file (pick item)
called RUGER that looks like this (sans the numbers):

001 .357 Magnum
002 9MM
003 12 Gauge Shot Gun

Now, imagine our surprise when we went to display the record in
UQ.ARTISTS called BEATLES and instead we got the record about the
guns. All in all, there about 20 of these mis-written items.

The applications and the databases are unrelated but happen to be on
the same CPU and Virtual Machine. The oddest thing for us is that we
can't figure out how the name of the guns item was changed to BEATLES
(never mind how it got filed in the ARTISTS directory). If strange
stuff like this were to happen shouldn't it be less organized than
this... it's not random enough. Why are only the Q-Pointed dirs
affected? How did the Unix file name (pick item name) come to be named
the same name as the file it clobbered? Why is there no "garbage" or
remnants in the items like you might find with a GFE?

Has anyone else seen this?

When I started poking around looking at the issue and trying to fix
records, the var partition switched itself to read only. We did a
reboot and found the var partition to be corrupted. A fsck was
performed and files were "fixed" (well, fsck said they were fixed but
the data is gone). During the fsck all the Unix QP's were reported on
the screen ... and ONLY the Unix QP's were listed as problematic.

Never seen anything like this and I haven't a clue. Anyone? Bueller?

Thanks Much,

J. Alosa

Reply With Quote
  #2  
Old   
Kevin Powick
 
Posts: n/a

Default Re: Q-Pointed Unix Directories Corrupted in a Bizarre Way - 05-11-2010 , 12:07 PM






On 2010-05-11 10:56:56 -0400, Jay <jayalosa (AT) gmail (DOT) com> said:

Quote:
Last week we had a power outage which caused the system to reboot (for
some reason the UPS did not hold up the system).
That's pretty much the issue right there.

I'm not sure why you're surprised that the system is corrupted, even if
it appears to be pseudo-organzied corruption. What exactly are you
trying to determine? When a multi-user, virtual memory system reboots
while in use, anything could happen.

--
Kevin Powick

Reply With Quote
  #3  
Old   
mvdbman
 
Posts: n/a

Default Re: Q-Pointed Unix Directories Corrupted in a Bizarre Way - 05-11-2010 , 12:43 PM



On May 11, 12:07*pm, Kevin Powick <nos... (AT) spamless (DOT) com> wrote:
Quote:
On 2010-05-11 10:56:56 -0400, Jay <jayal... (AT) gmail (DOT) com> said:

When a multi-user, virtual memory system reboots
while in use, anything could happen.

--
Kevin Powick

............and usually does!

Reply With Quote
  #4  
Old   
Frank Winans
 
Posts: n/a

Default Re: Q-Pointed Unix Directories Corrupted in a Bizarre Way - 05-11-2010 , 03:25 PM



"Kevin Powick" wrote
Quote:
On 2010-05-11 10:56:56 -0400, Jay said:

Last week we had a power outage which caused the system to reboot (for
some reason the UPS did not hold up the system).

That's pretty much the issue right there.

I'm not sure why you're surprised that the system is corrupted, even if
it appears to be pseudo-organzied corruption. What exactly are you
trying to determine? When a multi-user, virtual memory system reboots
while in use, anything could happen.

Well, _almost_ anything can happen -- if you've got journalling on for that
filesystem [that is, type is ext3 instead of ext2] then you have the narrowly-defined
assurance that your subdirectory structure will be correct later, though data files
in those folders are not protected. Am not sure if changes to spelling of
folder names are under the umbrella of journalling, but at least you won't end up
with a cross-link where an expected directory node is replaced with some data
node during crash. The e2fsck largely prunes crosslinks, won't really replace
messed up data from a crash...

The -j option of tune2fs and mke2fs adds journalling to a filesystem.

Reply With Quote
  #5  
Old   
Jay
 
Posts: n/a

Default Re: Q-Pointed Unix Directories Corrupted in a Bizarre Way - 05-12-2010 , 06:02 AM



On May 11, 4:25*pm, "Frank Winans" <fwin... (AT) sbcglobal (DOT) net> wrote:
Quote:
"Kevin Powick" wrote> On 2010-05-11 10:56:56 -0400, Jay said:

Last week we had a power outage which caused the system to reboot (for
some reason the UPS did not hold up the system).

That's pretty much the issue right there.

I'm not sure why you're surprised that the system is corrupted, even if
it appears to be pseudo-organzied corruption. *What exactly are you
trying to determine? *When a multi-user, virtual memory system reboots
while in use, anything could happen.

Well, *_almost_ *anything can happen -- *if you've got journalling on for that
filesystem *[that is, type is *ext3 instead of ext2] *then you havethe narrowly-defined
assurance that your subdirectory structure will be correct later, though data files
in those folders are not protected. *Am not sure if changes to spellingof
folder names are under the umbrella of journalling, but at least you won't end up
with a cross-link where an expected directory node is replaced with some data
node during crash. *The e2fsck *largely prunes crosslinks, won't really replace
messed up data from a crash...

The * *-j *option of * tune2fs * and * *mke2fs * adds journalling to a filesystem.
Thanks Frank I will chase that down.

Reply With Quote
  #6  
Old   
Jay
 
Posts: n/a

Default Re: Q-Pointed Unix Directories Corrupted in a Bizarre Way - 05-12-2010 , 06:05 AM



On May 11, 1:07*pm, Kevin Powick <nos... (AT) spamless (DOT) com> wrote:
Quote:
On 2010-05-11 10:56:56 -0400, Jay <jayal... (AT) gmail (DOT) com> said:

Last week we had a power outage which caused the system to reboot (for
some reason the UPS did not hold up the system).

That's pretty much the issue right there.

I'm not sure why you're surprised that the system is corrupted, even if
it appears to be pseudo-organzied corruption. *What exactly are you
trying to determine? *When a multi-user, virtual memory system reboots
while in use, anything could happen.

--
Kevin Powick
Yeah, I suppose you're right. I guess I'm taken back that it is the
Linux file system that is corrupted BUT it it's only the D3 QP's that
are affected. It's like a grassy knoll conspiracy thing - too much
order in that chaos.

Reply With Quote
  #7  
Old   
J B
 
Posts: n/a

Default Re: Q-Pointed Unix Directories Corrupted in a Bizarre Way - 05-12-2010 , 06:17 AM



On May 12, 7:05*am, Jay <jayal... (AT) gmail (DOT) com> wrote:
Quote:
On May 11, 1:07*pm, Kevin Powick <nos... (AT) spamless (DOT) com> wrote:

On 2010-05-11 10:56:56 -0400, Jay <jayal... (AT) gmail (DOT) com> said:

Last week we had a power outage which caused the system to reboot (for
some reason the UPS did not hold up the system).

That's pretty much the issue right there.

I'm not sure why you're surprised that the system is corrupted, even if
it appears to be pseudo-organzied corruption. *What exactly are you
trying to determine? *When a multi-user, virtual memory system reboots
while in use, anything could happen.

--
Kevin Powick

Yeah, I suppose you're right. I guess I'm taken back that it is the
Linux file system that is corrupted BUT it it's only the D3 QP's that
are affected. It's like a grassy knoll conspiracy thing - too much
order in that chaos.
Oh, and one more thing... some of the items in those misguided
directories were put there by PERL scripts that accessed the files
from Linux, not Pick. The PERL scripts were, however EXECUTEd by D3.
I'm chocking/chalking? this up to a blip in the space/time continuum.
Thanks to all who responded, now I will try to forget this ever
happened.

Reply With Quote
  #8  
Old   
Mike Preece
 
Posts: n/a

Default Re: Q-Pointed Unix Directories Corrupted in a Bizarre Way - 05-12-2010 , 07:56 AM



On May 12, 12:05*pm, Jay <jayal... (AT) gmail (DOT) com> wrote:
Quote:
On May 11, 1:07*pm, Kevin Powick <nos... (AT) spamless (DOT) com> wrote:

On 2010-05-11 10:56:56 -0400, Jay <jayal... (AT) gmail (DOT) com> said:

Last week we had a power outage which caused the system to reboot (for
some reason the UPS did not hold up the system).

That's pretty much the issue right there.

I'm not sure why you're surprised that the system is corrupted, even if
it appears to be pseudo-organzied corruption. *What exactly are you
trying to determine? *When a multi-user, virtual memory system reboots
while in use, anything could happen.

--
Kevin Powick

Yeah, I suppose you're right. I guess I'm taken back that it is the
Linux file system that is corrupted BUT it it's only the D3 QP's that
are affected. It's like a grassy knoll conspiracy thing - too much
order in that chaos.
So - reading between the lines - you're really trying to say it was
John Lennon that took the shot?

Reply With Quote
  #9  
Old   
Ross Ferris
 
Posts: n/a

Default Re: Q-Pointed Unix Directories Corrupted in a Bizarre Way - 05-13-2010 , 04:53 AM



Perhaps it is simply that the D3 application you are running is/was
the only thing that was creating/updating files at the time .... so
there is no knoll, just a single shooter!

Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.