dbTalk Databases Forums  

Best Practice? X Transform Data tasks per connections in GUI?

microsoft.public.sqlserver.dts microsoft.public.sqlserver.dts


Discuss Best Practice? X Transform Data tasks per connections in GUI? in the microsoft.public.sqlserver.dts forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
Jeff Price
 
Posts: n/a

Default Best Practice? X Transform Data tasks per connections in GUI? - 01-12-2004 , 12:54 PM






We are migrating from Oracle to SQL Server. I'm attempting to create the
DTS packages we'll need to migrate the data. We will have already created
the tables on SQL Server so we'll just be copying data.

Our plan is to copy the data twice. Once for testing and to use as we
convert our apps, and a 2nd time as we move into production.

Our first attempt at a DTS package includes one SQL task to truncate all the
tables we're copying data into, one Oracle data provider and one SQL Server
provider, then 60 Transform Data tasks between the two. We gradually built
the GUI up to about 40 of the tables and saved the package at the end of the
day. When the DTS package was opened the next day, only 11 of the
transformation steps remained.

Is there a limit to the number of transformation steps allowed per
connection? Is there some other error?

We're not a VB shop so I have no desire to save the steps to VB. What
should we be doing?

--
Jeffrey R. Price
Database Manager
Computing & Communication Services
Max M. Fisher College of Business
The Ohio State University
320F Mason Hall
250 W. Woodruff Avenue
Columbus, OH 43210-1309



Reply With Quote
  #2  
Old   
Allan Mitchell
 
Posts: n/a

Default Re: Best Practice? X Transform Data tasks per connections in GUI? - 01-12-2004 , 01:13 PM






In one of my packages I move data to and from Oracle. There are 2 distinct
Oracle connections and 2 distinct SQL Server connections. There are 2500
DataPump tasks so I do not think that this is a problem. A very Quick way
to test would be that if you only have 11 remaining then it would seem that
12 was the breaking point and DTS left the ones it permitted. Add another
Data Pump task | save | Close | open.

Still there ?

--
--

Allan Mitchell MCSE,MCDBA, (Microsoft SQL Server MVP)
www.allisonmitchell.com - Expert SQL Server Consultancy.
www.SQLDTS.com - The site for all your DTS needs.
I support PASS - the definitive, global community
for SQL Server professionals - http://www.sqlpass.org


"Jeff Price" <price.9 (AT) osu (DOT) edu> wrote

Quote:
We are migrating from Oracle to SQL Server. I'm attempting to create the
DTS packages we'll need to migrate the data. We will have already created
the tables on SQL Server so we'll just be copying data.

Our plan is to copy the data twice. Once for testing and to use as we
convert our apps, and a 2nd time as we move into production.

Our first attempt at a DTS package includes one SQL task to truncate all
the
tables we're copying data into, one Oracle data provider and one SQL
Server
provider, then 60 Transform Data tasks between the two. We gradually
built
the GUI up to about 40 of the tables and saved the package at the end of
the
day. When the DTS package was opened the next day, only 11 of the
transformation steps remained.

Is there a limit to the number of transformation steps allowed per
connection? Is there some other error?

We're not a VB shop so I have no desire to save the steps to VB. What
should we be doing?

--
Jeffrey R. Price
Database Manager
Computing & Communication Services
Max M. Fisher College of Business
The Ohio State University
320F Mason Hall
250 W. Woodruff Avenue
Columbus, OH 43210-1309





Reply With Quote
  #3  
Old   
Joe
 
Posts: n/a

Default Re: Best Practice? X Transform Data tasks per connections in GUI? - 01-12-2004 , 01:34 PM



I'm certain there is no limit. I have seen 100's of individual
tranformations in packages before. Get's quite ugly to look at - but they
work.

"Allan Mitchell" <allan (AT) no-spam (DOT) sqldts.com> wrote

Quote:
In one of my packages I move data to and from Oracle. There are 2
distinct
Oracle connections and 2 distinct SQL Server connections. There are 2500
DataPump tasks so I do not think that this is a problem. A very Quick way
to test would be that if you only have 11 remaining then it would seem
that
12 was the breaking point and DTS left the ones it permitted. Add another
Data Pump task | save | Close | open.

Still there ?

--
--

Allan Mitchell MCSE,MCDBA, (Microsoft SQL Server MVP)
www.allisonmitchell.com - Expert SQL Server Consultancy.
www.SQLDTS.com - The site for all your DTS needs.
I support PASS - the definitive, global community
for SQL Server professionals - http://www.sqlpass.org


"Jeff Price" <price.9 (AT) osu (DOT) edu> wrote in message
news:%23qRUA2T2DHA.1264 (AT) TK2MSFTNGP11 (DOT) phx.gbl...
We are migrating from Oracle to SQL Server. I'm attempting to create
the
DTS packages we'll need to migrate the data. We will have already
created
the tables on SQL Server so we'll just be copying data.

Our plan is to copy the data twice. Once for testing and to use as we
convert our apps, and a 2nd time as we move into production.

Our first attempt at a DTS package includes one SQL task to truncate all
the
tables we're copying data into, one Oracle data provider and one SQL
Server
provider, then 60 Transform Data tasks between the two. We gradually
built
the GUI up to about 40 of the tables and saved the package at the end of
the
day. When the DTS package was opened the next day, only 11 of the
transformation steps remained.

Is there a limit to the number of transformation steps allowed per
connection? Is there some other error?

We're not a VB shop so I have no desire to save the steps to VB. What
should we be doing?

--
Jeffrey R. Price
Database Manager
Computing & Communication Services
Max M. Fisher College of Business
The Ohio State University
320F Mason Hall
250 W. Woodruff Avenue
Columbus, OH 43210-1309







Reply With Quote
  #4  
Old   
Darren Green
 
Posts: n/a

Default Re: Best Practice? X Transform Data tasks per connections in GUI? - 01-12-2004 , 03:41 PM



In message <#qRUA2T2DHA.1264 (AT) TK2MSFTNGP11 (DOT) phx.gbl>, Jeff Price
<price.9 (AT) osu (DOT) edu> writes
Quote:
We are migrating from Oracle to SQL Server. I'm attempting to create the
DTS packages we'll need to migrate the data. We will have already created
the tables on SQL Server so we'll just be copying data.

Our plan is to copy the data twice. Once for testing and to use as we
convert our apps, and a 2nd time as we move into production.

Our first attempt at a DTS package includes one SQL task to truncate all the
tables we're copying data into, one Oracle data provider and one SQL Server
provider, then 60 Transform Data tasks between the two. We gradually built
the GUI up to about 40 of the tables and saved the package at the end of the
day. When the DTS package was opened the next day, only 11 of the
transformation steps remained.

Is there a limit to the number of transformation steps allowed per
connection? Is there some other error?

We're not a VB shop so I have no desire to save the steps to VB. What
should we be doing?

Are you sure this is not just a GUI issue? If you only had one icon for
each connection and had 40 black lines then it may just have got lost
behind each other. Try using auto-layout to re-generate the layout
information. To force the layout info to be re-created use the object
model to load and save the package. Then re-open it in the designer.


For clarity you can create multiple icons that all use teh same
connection, by selecting Existing Connection when you add a new
connection onto teh design sheet. For performance however it is better
to use individual connections, not just icons assuming you wish to run
task in parallel.

--
Darren Green (SQL Server MVP)
DTS - http://www.sqldts.com

PASS - the definitive, global community for SQL Server professionals
http://www.sqlpass.org



Reply With Quote
  #5  
Old   
Jeff Price
 
Posts: n/a

Default Re: Best Practice? X Transform Data tasks per connections in GUI? - 01-12-2004 , 04:04 PM



Thanks to all!

It appears to be an operator error....not sure what I saved, or where, but I
can add all I need although I think I'll continue to save with a new file
name [name (X)] every 5-10 tables.

"Darren Green" <darren.green (AT) reply-to-newsgroup-sqldts (DOT) com> wrote

Quote:
In message <#qRUA2T2DHA.1264 (AT) TK2MSFTNGP11 (DOT) phx.gbl>, Jeff Price
price.9 (AT) osu (DOT) edu> writes
We are migrating from Oracle to SQL Server. I'm attempting to create the
DTS packages we'll need to migrate the data. We will have already
created
the tables on SQL Server so we'll just be copying data.

Our plan is to copy the data twice. Once for testing and to use as we
convert our apps, and a 2nd time as we move into production.

Our first attempt at a DTS package includes one SQL task to truncate all
the
tables we're copying data into, one Oracle data provider and one SQL
Server
provider, then 60 Transform Data tasks between the two. We gradually
built
the GUI up to about 40 of the tables and saved the package at the end of
the
day. When the DTS package was opened the next day, only 11 of the
transformation steps remained.

Is there a limit to the number of transformation steps allowed per
connection? Is there some other error?

We're not a VB shop so I have no desire to save the steps to VB. What
should we be doing?


Are you sure this is not just a GUI issue? If you only had one icon for
each connection and had 40 black lines then it may just have got lost
behind each other. Try using auto-layout to re-generate the layout
information. To force the layout info to be re-created use the object
model to load and save the package. Then re-open it in the designer.


For clarity you can create multiple icons that all use teh same
connection, by selecting Existing Connection when you add a new
connection onto teh design sheet. For performance however it is better
to use individual connections, not just icons assuming you wish to run
task in parallel.

--
Darren Green (SQL Server MVP)
DTS - http://www.sqldts.com

PASS - the definitive, global community for SQL Server professionals
http://www.sqlpass.org




Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.