![]() | |
![]() |
| | Thread Tools | Display Modes |
#1
| |||
| |||
|
#2
| |||
| |||
|
|
Quick question: Is it possible to change the graphical connections associated with a Transform Data Task? I have a have a DTS package with 30 Transform Data Tasks all pointing at the same database connection, all with precedence constaints designed to result in a serial execution of each task. Now that I have gotten this successfully working and debugged, I want to alter this design to introduce a few more connections where possible to improve performance. This is easy enough to accomplish using the Disconnected Edit feature. I simply change the DestinationConnectionID and voila, it works. Peeking inside the task, it is clearly using the new connection, but graphically, the task is still pointing to the old connection. Now, I've put several hours into the design and debugging of each of these 30 transforms, so I don't want to delete them simply to change the graphical appearance. At the same time I'd like the DTS graphical view to be accurate. |
#3
| |||
| |||
|
|
OK. Yes you can easily change the Source and destination connection properties and the SourceObjectName and DestinationObjectName for the DataPump task . The problem comes in the Transformation objects. If the Source and destination attribute names are the same then no problems. DTS will only read the metadata and not have to change anything. if however the names change then the Transformations are invalidated. You will then need to remap them yourself. -- -- Allan Mitchell MCSE,MCDBA, (Microsoft SQL Server MVP) www.SQLDTS.com - The site for all your DTS needs. I support PASS - the definitive, global community for SQL Server professionals - http://www.sqlpass.org "Isak Dinesen" <no5pam (AT) hotmail (DOT) com> wrote in message news:Nszmc.126$KE6.20 (AT) newsread3 (DOT) news.atl.earthlink.net... Quick question: Is it possible to change the graphical connections associated with a Transform Data Task? I have a have a DTS package with 30 Transform Data Tasks all pointing at the same database connection, all with precedence constaints designed to result in a serial execution of each task. Now that I have gotten this successfully working and debugged, I want to alter this design to introduce a few more connections where possible to improve performance. This is easy enough to accomplish using the Disconnected Edit feature. I simply change the DestinationConnectionID and voila, it works. Peeking inside the task, it is clearly using the new connection, but graphically, the task is still pointing to the old connection. Now, I've put several hours into the design and debugging of each of these 30 transforms, so I don't want to delete them simply to change the graphical appearance. At the same time I'd like the DTS graphical view to be accurate. |
#4
| |||
| |||
|
|
Thanks for your reply, but I am afraid you've misunderstood the question: Is it possible to change the graphical appearance of the task such that it is visually connected to the new DestinationConnection after making the aforementioned changes? "Allan Mitchell" <allan (AT) no-spam (DOT) sqldts.com> wrote in message news:OuX4TiANEHA.556 (AT) TK2MSFTNGP10 (DOT) phx.gbl... OK. Yes you can easily change the Source and destination connection properties and the SourceObjectName and DestinationObjectName for the DataPump task .. The problem comes in the Transformation objects. If the Source and destination attribute names are the same then no problems. DTS will only read the metadata and not have to change anything. if however the names change then the Transformations are invalidated. You will then need to remap them yourself. -- -- Allan Mitchell MCSE,MCDBA, (Microsoft SQL Server MVP) www.SQLDTS.com - The site for all your DTS needs. I support PASS - the definitive, global community for SQL Server professionals - http://www.sqlpass.org "Isak Dinesen" <no5pam (AT) hotmail (DOT) com> wrote in message news:Nszmc.126$KE6.20 (AT) newsread3 (DOT) news.atl.earthlink.net... Quick question: Is it possible to change the graphical connections associated with a Transform Data Task? I have a have a DTS package with 30 Transform Data Tasks all pointing at the same database connection, all with precedence constaints designed to result in a serial execution of each task. Now that I have gotten this successfully working and debugged, I want to alter this design to introduce a few more connections where possible to improve performance. This is easy enough to accomplish using the Disconnected Edit feature. I simply change the DestinationConnectionID and voila, it works. Peeking inside the task, it is clearly using the new connection, but graphically, the task is still pointing to the old connection. Now, I've put several hours into the design and debugging of each of these 30 transforms, so I don't want to delete them simply to change the graphical appearance. At the same time I'd like the DTS graphical view to be accurate. |
#5
| |||
| |||
|
|
Thanks for your reply, but I am afraid you've misunderstood the question: Is it possible to change the graphical appearance of the task such that it is visually connected to the new DestinationConnection after making the aforementioned changes? "Allan Mitchell" <allan (AT) no-spam (DOT) sqldts.com> wrote in message news:OuX4TiANEHA.556 (AT) TK2MSFTNGP10 (DOT) phx.gbl... OK. Yes you can easily change the Source and destination connection properties and the SourceObjectName and DestinationObjectName for the DataPump task .. The problem comes in the Transformation objects. If the Source and destination attribute names are the same then no problems. DTS will only read the metadata and not have to change anything. if however the names change then the Transformations are invalidated. You will then need to remap them yourself. -- -- Allan Mitchell MCSE,MCDBA, (Microsoft SQL Server MVP) www.SQLDTS.com - The site for all your DTS needs. I support PASS - the definitive, global community for SQL Server professionals - http://www.sqlpass.org "Isak Dinesen" <no5pam (AT) hotmail (DOT) com> wrote in message news:Nszmc.126$KE6.20 (AT) newsread3 (DOT) news.atl.earthlink.net... Quick question: Is it possible to change the graphical connections associated with a Transform Data Task? I have a have a DTS package with 30 Transform Data Tasks all pointing at the same database connection, all with precedence constaints designed to result in a serial execution of each task. Now that I have gotten this successfully working and debugged, I want to alter this design to introduce a few more connections where possible to improve performance. This is easy enough to accomplish using the Disconnected Edit feature. I simply change the DestinationConnectionID and voila, it works. Peeking inside the task, it is clearly using the new connection, but graphically, the task is still pointing to the old connection. Now, I've put several hours into the design and debugging of each of these 30 transforms, so I don't want to delete them simply to change the graphical appearance. At the same time I'd like the DTS graphical view to be accurate. |
#6
| |||
| |||
|
| I have never really thought about this as I see a connection object as just that. If I have Source connections i call them something like SOURCE_system or for destinations DESTINATION_system This way when i move between environments I change the properties of the connection and that's that. What is it that you want to represent? If you start changing the names of things then Steps and Tasks quickly start getting orphaned and nasty. -- -- Allan Mitchell MCSE,MCDBA, (Microsoft SQL Server MVP) www.SQLDTS.com - The site for all your DTS needs. I support PASS - the definitive, global community for SQL Server professionals - http://www.sqlpass.org "Isak Dinesen" <no5pam (AT) hotmail (DOT) com> wrote in message news:3KKmc.620$KE6.141 (AT) newsread3 (DOT) news.atl.earthlink.net... Thanks for your reply, but I am afraid you've misunderstood the question: Is it possible to change the graphical appearance of the task such that it is visually connected to the new DestinationConnection after making the aforementioned changes? "Allan Mitchell" <allan (AT) no-spam (DOT) sqldts.com> wrote in message news:OuX4TiANEHA.556 (AT) TK2MSFTNGP10 (DOT) phx.gbl... OK. Yes you can easily change the Source and destination connection properties and the SourceObjectName and DestinationObjectName for the DataPump task . The problem comes in the Transformation objects. If the Source and destination attribute names are the same then no problems. DTS will only read the metadata and not have to change anything. if however the names change then the Transformations are invalidated. You will then need to remap them yourself. -- -- Allan Mitchell MCSE,MCDBA, (Microsoft SQL Server MVP) www.SQLDTS.com - The site for all your DTS needs. I support PASS - the definitive, global community for SQL Server professionals - http://www.sqlpass.org "Isak Dinesen" <no5pam (AT) hotmail (DOT) com> wrote in message news:Nszmc.126$KE6.20 (AT) newsread3 (DOT) news.atl.earthlink.net... Quick question: Is it possible to change the graphical connections associated with a Transform Data Task? I have a have a DTS package with 30 Transform Data Tasks all pointing at the same database connection, all with precedence constaints designed to result in a serial execution of each task. Now that I have gotten this successfully working and debugged, I want to alter this design to introduce a few more connections where possible to improve performance. This is easy enough to accomplish using the Disconnected Edit feature. I simply change the DestinationConnectionID and voila, it works. Peeking inside the task, it is clearly using the new connection, but graphically, the task is still pointing to the old connection. Now, I've put several hours into the design and debugging of each of these 30 transforms, so I don't want to delete them simply to change the graphical appearance. At the same time I'd like the DTS graphical view to be accurate. |
#7
| |||
| |||
|
|
I am loading a series of tables, most of which follow a simple relationship heirarchy (mostly requiring they be loaded in parent-child order to maintain RI). Within this structure there are a few very large tables that I'd like to load in parallel with the other tables. While I may be able to load multiple tables in parallel through one connection, it is my understanding from available literature that it is better to run parallel loads to a single database via a separate connection (to that db) for each parallel task, as each connection in a DTS package can only handle one thread at a time. So I now have a separate connection for these larger tables, and I can redirect existing tasks at the new connection, but visually each task still appears to use the old connection, incorrectly suggesting to someone unfamiliar with this package that those tasks are being performed in serial. I have similar issues reading text files: Currently when loading multiple tables from one text file, I have multiple tasks all sharing the same source connection (running in serial). If I want to load these in parallel, I'd have to set up different source connections pointing to the same text file. I can change this using Disconnected Edit, but I want the DTS package designer to visually reflect what is going on under the covers. Source: http://support.microsoft.com/default...242391&sd=tech "Allan Mitchell" <allan (AT) no-spam (DOT) sqldts.com> wrote in message news:OCV#D4CNEHA.1348 (AT) TK2MSFTNGP12 (DOT) phx.gbl... I have never really thought about this as I see a connection object as just that. If I have Source connections i call them something like SOURCE_system or for destinations DESTINATION_system This way when i move between environments I change the properties of the connection and that's that. What is it that you want to represent? If you start changing the names of things then Steps and Tasks quickly start getting orphaned and nasty. -- -- Allan Mitchell MCSE,MCDBA, (Microsoft SQL Server MVP) www.SQLDTS.com - The site for all your DTS needs. I support PASS - the definitive, global community for SQL Server professionals - http://www.sqlpass.org "Isak Dinesen" <no5pam (AT) hotmail (DOT) com> wrote in message news:3KKmc.620$KE6.141 (AT) newsread3 (DOT) news.atl.earthlink.net... Thanks for your reply, but I am afraid you've misunderstood the question: Is it possible to change the graphical appearance of the task such that it is visually connected to the new DestinationConnection after making the aforementioned changes? "Allan Mitchell" <allan (AT) no-spam (DOT) sqldts.com> wrote in message news:OuX4TiANEHA.556 (AT) TK2MSFTNGP10 (DOT) phx.gbl... OK. Yes you can easily change the Source and destination connection properties and the SourceObjectName and DestinationObjectName for the DataPump task . The problem comes in the Transformation objects. If the Source and destination attribute names are the same then no problems. DTS will only read the metadata and not have to change anything. if however the names change then the Transformations are invalidated. You will then need to remap them yourself. -- -- Allan Mitchell MCSE,MCDBA, (Microsoft SQL Server MVP) www.SQLDTS.com - The site for all your DTS needs. I support PASS - the definitive, global community for SQL Server professionals - http://www.sqlpass.org "Isak Dinesen" <no5pam (AT) hotmail (DOT) com> wrote in message news:Nszmc.126$KE6.20 (AT) newsread3 (DOT) news.atl.earthlink.net... Quick question: Is it possible to change the graphical connections associated with a Transform Data Task? I have a have a DTS package with 30 Transform Data Tasks all pointing at the same database connection, all with precedence constaints designed to result in a serial execution of each task. Now that I have gotten this successfully working and debugged, I want to alter this design to introduce a few more connections where possible to improve performance. This is easy enough to accomplish using the Disconnected Edit feature. I simply change the DestinationConnectionID and voila, it works. Peeking inside the task, it is clearly using the new connection, but graphically, the task is still pointing to the old connection. Now, I've put several hours into the design and debugging of each of these 30 transforms, so I don't want to delete them simply to change the graphical appearance. At the same time I'd like the DTS graphical view to be accurate. |
#8
| |||
| |||
|
|
ok So you have n Source connections and n destination connections You are correct that it is better to have multiple connections even if to the same object on the database. Be aware though that it is pointless and sometimes degrading to have Num Processes executing in parallel >= Num of Source CPUs. You will see a great deal of context switches and it will hurt you. Why do you want to reuse these connections? I would build the package up front named accordingley and the name wouldn't change. I wouldn't reuse a connection like I think you mean either. I would add as many connection objects as I thought I needed at the design of the package and be done with it. -- -- Allan Mitchell MCSE,MCDBA, (Microsoft SQL Server MVP) www.SQLDTS.com - The site for all your DTS needs. I support PASS - the definitive, global community for SQL Server professionals - http://www.sqlpass.org "Isak Dinesen" <no5pam (AT) hotmail (DOT) com> wrote in message news:IYLmc.690$KE6.495 (AT) newsread3 (DOT) news.atl.earthlink.net... I am loading a series of tables, most of which follow a simple relationship heirarchy (mostly requiring they be loaded in parent-child order to maintain RI). Within this structure there are a few very large tables that I'd like to load in parallel with the other tables. While I may be able to load multiple tables in parallel through one connection, it is my understanding from available literature that it is better to run parallel loads to a single database via a separate connection (to that db) for each parallel task, as each connection in a DTS package can only handle one thread at a time. So I now have a separate connection for these larger tables, and I can redirect existing tasks at the new connection, but visually each task still appears to use the old connection, incorrectly suggesting to someone unfamiliar with this package that those tasks are being performed in serial. I have similar issues reading text files: Currently when loading multiple tables from one text file, I have multiple tasks all sharing the same source connection (running in serial). If I want to load these in parallel, I'd have to set up different source connections pointing to the same text file. I can change this using Disconnected Edit, but I want the DTS package designer to visually reflect what is going on under the covers. Source: http://support.microsoft.com/default...242391&sd=tech "Allan Mitchell" <allan (AT) no-spam (DOT) sqldts.com> wrote in message news:OCV#D4CNEHA.1348 (AT) TK2MSFTNGP12 (DOT) phx.gbl... I have never really thought about this as I see a connection object as just that. If I have Source connections i call them something like SOURCE_system or for destinations DESTINATION_system This way when i move between environments I change the properties of the connection and that's that. What is it that you want to represent? If you start changing the names of things then Steps and Tasks quickly start getting orphaned and nasty. -- -- Allan Mitchell MCSE,MCDBA, (Microsoft SQL Server MVP) www.SQLDTS.com - The site for all your DTS needs. I support PASS - the definitive, global community for SQL Server professionals - http://www.sqlpass.org "Isak Dinesen" <no5pam (AT) hotmail (DOT) com> wrote in message news:3KKmc.620$KE6.141 (AT) newsread3 (DOT) news.atl.earthlink.net... Thanks for your reply, but I am afraid you've misunderstood the question: Is it possible to change the graphical appearance of the task such that it is visually connected to the new DestinationConnection after making the aforementioned changes? "Allan Mitchell" <allan (AT) no-spam (DOT) sqldts.com> wrote in message news:OuX4TiANEHA.556 (AT) TK2MSFTNGP10 (DOT) phx.gbl... OK. Yes you can easily change the Source and destination connection properties and the SourceObjectName and DestinationObjectName for the DataPump task . The problem comes in the Transformation objects. If the Source and destination attribute names are the same then no problems. DTS will only read the metadata and not have to change anything. if however the names change then the Transformations are invalidated. You will then need to remap them yourself. -- -- Allan Mitchell MCSE,MCDBA, (Microsoft SQL Server MVP) www.SQLDTS.com - The site for all your DTS needs. I support PASS - the definitive, global community for SQL Server professionals - http://www.sqlpass.org "Isak Dinesen" <no5pam (AT) hotmail (DOT) com> wrote in message news:Nszmc.126$KE6.20 (AT) newsread3 (DOT) news.atl.earthlink.net... Quick question: Is it possible to change the graphical connections associated with a Transform Data Task? I have a have a DTS package with 30 Transform Data Tasks all pointing at the same database connection, all with precedence constaints designed to result in a serial execution of each task. Now that I have gotten this successfully working and debugged, I want to alter this design to introduce a few more connections where possible to improve performance. This is easy enough to accomplish using the Disconnected Edit feature. I simply change the DestinationConnectionID and voila, it works. Peeking inside the task, it is clearly using the new connection, but graphically, the task is still pointing to the old connection. Now, I've put several hours into the design and debugging of each of these 30 transforms, so I don't want to delete them simply to change the graphical appearance. At the same time I'd like the DTS graphical view to be accurate. |
#9
| |||
| |||
|
|
This is a dual CPU system, no problem there. Regarding your 'solution' to simply start with a perfect design, well, that is simply unrealistic. :-) In trying to compile the VB package exported from DTS, the Main method appears to exceed the 64k procedure size limit -- It is in fact 214k... "Allan Mitchell" <allan (AT) no-spam (DOT) sqldts.com> wrote in message news:ecILYpDNEHA.268 (AT) TK2MSFTNGP11 (DOT) phx.gbl... ok So you have n Source connections and n destination connections You are correct that it is better to have multiple connections even if to the same object on the database. Be aware though that it is pointless and sometimes degrading to have Num Processes executing in parallel >= Num of Source CPUs. You will see a great deal of context switches and it will hurt you. Why do you want to reuse these connections? I would build the package up front named accordingley and the name wouldn't change. I wouldn't reuse a connection like I think you mean either. I would add as many connection objects as I thought I needed at the design of the package and be done with it. -- -- Allan Mitchell MCSE,MCDBA, (Microsoft SQL Server MVP) www.SQLDTS.com - The site for all your DTS needs. I support PASS - the definitive, global community for SQL Server professionals - http://www.sqlpass.org "Isak Dinesen" <no5pam (AT) hotmail (DOT) com> wrote in message news:IYLmc.690$KE6.495 (AT) newsread3 (DOT) news.atl.earthlink.net... I am loading a series of tables, most of which follow a simple relationship heirarchy (mostly requiring they be loaded in parent-child order to maintain RI). Within this structure there are a few very large tables that I'd like to load in parallel with the other tables. While I may be able to load multiple tables in parallel through one connection, it is my understanding from available literature that it is better to run parallel loads to a single database via a separate connection (to that db) for each parallel task, as each connection in a DTS package can only handle one thread at a time. So I now have a separate connection for these larger tables, and I can redirect existing tasks at the new connection, but visually each task still appears to use the old connection, incorrectly suggesting to someone unfamiliar with this package that those tasks are being performed in serial. I have similar issues reading text files: Currently when loading multiple tables from one text file, I have multiple tasks all sharing the same source connection (running in serial). If I want to load these in parallel, I'd have to set up different source connections pointing to the same text file. I can change this using Disconnected Edit, but I want the DTS package designer to visually reflect what is going on under the covers. Source: http://support.microsoft.com/default...242391&sd=tech "Allan Mitchell" <allan (AT) no-spam (DOT) sqldts.com> wrote in message news:OCV#D4CNEHA.1348 (AT) TK2MSFTNGP12 (DOT) phx.gbl... I have never really thought about this as I see a connection object as just that. If I have Source connections i call them something like SOURCE_system or for destinations DESTINATION_system This way when i move between environments I change the properties of the connection and that's that. What is it that you want to represent? If you start changing the names of things then Steps and Tasks quickly start getting orphaned and nasty. -- -- Allan Mitchell MCSE,MCDBA, (Microsoft SQL Server MVP) www.SQLDTS.com - The site for all your DTS needs. I support PASS - the definitive, global community for SQL Server professionals - http://www.sqlpass.org "Isak Dinesen" <no5pam (AT) hotmail (DOT) com> wrote in message news:3KKmc.620$KE6.141 (AT) newsread3 (DOT) news.atl.earthlink.net... Thanks for your reply, but I am afraid you've misunderstood the question: Is it possible to change the graphical appearance of the task such that it is visually connected to the new DestinationConnection after making the aforementioned changes? "Allan Mitchell" <allan (AT) no-spam (DOT) sqldts.com> wrote in message news:OuX4TiANEHA.556 (AT) TK2MSFTNGP10 (DOT) phx.gbl... OK. Yes you can easily change the Source and destination connection properties and the SourceObjectName and DestinationObjectName for the DataPump task . The problem comes in the Transformation objects. If the Source and destination attribute names are the same then no problems. DTS will only read the metadata and not have to change anything. if however the names change then the Transformations are invalidated. You will then need to remap them yourself. -- -- Allan Mitchell MCSE,MCDBA, (Microsoft SQL Server MVP) www.SQLDTS.com - The site for all your DTS needs. I support PASS - the definitive, global community for SQL Server professionals - http://www.sqlpass.org "Isak Dinesen" <no5pam (AT) hotmail (DOT) com> wrote in message news:Nszmc.126$KE6.20 (AT) newsread3 (DOT) news.atl.earthlink.net... Quick question: Is it possible to change the graphical connections associated with a Transform Data Task? I have a have a DTS package with 30 Transform Data Tasks all pointing at the same database connection, all with precedence constaints designed to result in a serial execution of each task. Now that I have gotten this successfully working and debugged, I want to alter this design to introduce a few more connections where possible to improve performance. This is easy enough to accomplish using the Disconnected Edit feature. I simply change the DestinationConnectionID and voila, it works. Peeking inside the task, it is clearly using the new connection, but graphically, the task is still pointing to the old connection. Now, I've put several hours into the design and debugging of each of these 30 transforms, so I don't want to delete them simply to change the graphical appearance. At the same time I'd like the DTS graphical view to be accurate. |
![]() |
| Thread Tools | |
| Display Modes | |
| |