dbTalk Databases Forums  

HPL Unload using query - mixing up the rows problem

comp.databases.informix comp.databases.informix


Discuss HPL Unload using query - mixing up the rows problem in the comp.databases.informix forum.



Reply
 
Thread Tools Search this Thread Display Modes
  #1  
Old   
mohitanchlia@gmail.com
 
Posts: n/a

Default HPL Unload using query - mixing up the rows problem - 07-03-2007 , 09:12 PM






I have unload job that uses query expression to unload the data from
table. After the unload job finishes it reports correct no. of rows
that was unloaded. But when I check the output file I see that unload
job didn't unload all the columns and have concatenated another row in
some places, which is really messing things up. Could you somebody
tell me what could be the reason ?

For example if I am expecting output:

1|2|3|ABC
4|5|6|DEF

I get:

1|2|4|5|6|DEF as one row.


Reply With Quote
  #2  
Old   
Keith Simmons
 
Posts: n/a

Default Re: HPL Unload using query - mixing up the rows problem - 07-04-2007 , 03:45 AM






On 04/07/07, mohitanchlia (AT) gmail (DOT) com <mohitanchlia (AT) gmail (DOT) com> wrote:
Quote:
I have unload job that uses query expression to unload the data from
table. After the unload job finishes it reports correct no. of rows
that was unloaded. But when I check the output file I see that unload
job didn't unload all the columns and have concatenated another row in
some places, which is really messing things up. Could you somebody
tell me what could be the reason ?

For example if I am expecting output:

1|2|3|ABC
4|5|6|DEF

I get:

1|2|4|5|6|DEF as one row.

_______________________________________________
Informix-list mailing list
Informix-list (AT) iiug (DOT) org
http://www.iiug.org/mailman/listinfo/informix-list

Platform? O/S? IDS Version? Query? The contributors to this list are
good, but no one (that I am aware of) claims to be psychic !!

Keith


Reply With Quote
  #3  
Old   
scottishpoet
 
Posts: n/a

Default Re: HPL Unload using query - mixing up the rows problem - 07-04-2007 , 05:39 AM



Some rows got concatenated but it unloaded the right number of rows?
so there are duplicate rows somewhere? or random extra rows?

What happens if you just run the query in dbaccess? does the same
concatenation occur?


Reply With Quote
  #4  
Old   
mohitanchlia@gmail.com
 
Posts: n/a

Default Re: HPL Unload using query - mixing up the rows problem - 07-04-2007 , 11:34 AM



On Jul 4, 2:39 am, scottishpoet <drybur... (AT) yahoo (DOT) com> wrote:
Quote:
Some rows got concatenated but it unloaded the right number of rows?
so there are duplicate rows somewhere? or random extra rows?

What happens if you just run thequeryin dbaccess? does the same
concatenation occur?
IDS 10 running on HP-UX 11. Query is a simple select * from abc where
a > 100;

Yes. Some rows got concatenated but log shows that right number of
rows were unloaded. So If I take the count of lines in the file that
has the unloaded data it has less number of rows because some of them
were concatenated. When I run thought dbaccess it unloads properly.

Also if I remove where clause from the query then it works fine.



Reply With Quote
  #5  
Old   
Fernando Nunes
 
Posts: n/a

Default Re: HPL Unload using query - mixing up the rows problem - 07-04-2007 , 04:22 PM



mohitanchlia (AT) gmail (DOT) com wrote:
Quote:
On Jul 4, 2:39 am, scottishpoet <drybur... (AT) yahoo (DOT) com> wrote:
Some rows got concatenated but it unloaded the right number of rows?
so there are duplicate rows somewhere? or random extra rows?

What happens if you just run thequeryin dbaccess? does the same
concatenation occur?

IDS 10 running on HP-UX 11. Query is a simple select * from abc where
a > 100;

Yes. Some rows got concatenated but log shows that right number of
rows were unloaded. So If I take the count of lines in the file that
has the unloaded data it has less number of rows because some of them
were concatenated. When I run thought dbaccess it unloads properly.

Also if I remove where clause from the query then it works fine.

Weird...
Try this:

1- Confirm that the mappings and formats are OK... Or recreate your job.
2- Confirm that the output file is correctly defined... Just one file, not an
array etc.
3- If the above fails, post the table schema
4- Consider checking with support... but I never notice any similar bug...
5- Verify your data... can you have weird characters like CONTROL-??? in your data?

Regards


--
Fernando Nunes
Portugal

http://informix-technology.blogspot.com
My email works... but I don't check it frequently...


Reply With Quote
  #6  
Old   
mohitanchlia@gmail.com
 
Posts: n/a

Default Re: HPL Unload using query - mixing up the rows problem - 07-04-2007 , 11:24 PM



On Jul 4, 1:22 pm, Fernando Nunes <s... (AT) domus (DOT) online.pt> wrote:
Quote:
mohitanch... (AT) gmail (DOT) com wrote:
On Jul 4, 2:39 am, scottishpoet <drybur... (AT) yahoo (DOT) com> wrote:
Some rows got concatenated but it unloaded the right number of rows?
so there are duplicate rows somewhere? or random extra rows?

What happens if you just run thequeryin dbaccess? does the same
concatenation occur?

IDS 10 running on HP-UX 11.Queryis a simple select * from abc where
a > 100;

Yes. Some rows got concatenated but log shows that right number of
rows were unloaded. So If I take the count of lines in the file that
has the unloaded data it has less number of rows because some of them
were concatenated. When I run thought dbaccess it unloads properly.

Also if I remove where clause from thequerythen it works fine.

Weird...
Try this:

1- Confirm that the mappings and formats are OK... Or recreate your job.
2- Confirm that the output file is correctly defined... Just one file, not an
array etc.
3- If the above fails, post the table schema
4- Consider checking with support... but I never notice any similar bug...
5- Verify your data... can you have weird characters like CONTROL-??? in your data?

Regards

--
Fernando Nunes
Portugal

http://informix-technology.blogspot.com
My email works... but I don't check it frequently...
I have already tried all the above. In fact when I use device having 2
files then I am getting correct count - bizzare. So to me it looked
like as if another process is writing to the same file and it's
getting mixed up. So there are my findings, but please let me know if
I am at right track:

1. I created a normal unload job with no queries. And I saw number of
onpload jobs spawned for this unload job are around 15.
2. Then I created query based job and I saw number of onpload
processes higher, I think it was 19 or 20.
3. Then I added another file to device array and recreated the query
based job and I saw number of onpload processes drop to 15. And this
got all the rows correctly.

this is so bizzare, I don't understand why onpladm spawn extra job for
point no. 2. And I think that's why rows are mixing up. I am not
getting the explanation because I want to make sure there are no
uncertainties in unload job, because it's imperative that these jobs
are reliable.



Reply With Quote
Reply




Thread Tools Search this Thread
Search this Thread:

Advanced Search
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2009, Jelsoft Enterprises Ltd.