dbTalk Databases Forums  

Order of execution

microsoft.public.sqlserver.dts microsoft.public.sqlserver.dts


Discuss Order of execution in the microsoft.public.sqlserver.dts forum.



Reply
 
Thread Tools Display Modes
  #1  
Old   
statistical
 
Posts: n/a

Default Order of execution - 06-17-2004 , 07:27 AM






I have a DTS package that downloads a large number of tables from a remote database into SQL Server. Each download has its own source and destination connection and a datapump. I am still experimenting with the number of parallel tasks to use to get the optimal download time. What I need to is to change the order in which the datapumps are processed in a manner that is easier than copying the information from one datapump to another. I have seen this done before but can't remember how to do it. Any help would be appreciated.

Example:

Currently processing datapump1, then 2 then 3 then 4 then 5

want to change it to
Datapump 4, then 3, then 1, then 5 then 2.

Reply With Quote
  #2  
Old   
Allan Mitchell
 
Posts: n/a

Default Re: Order of execution - 06-17-2004 , 07:54 AM






You can do this using Workflow Constraints

Introduction to Workflow
(http://www.sqldts.com/default.aspx?287)

--

----------------------------

Allan Mitchell MCSE,MCDBA, (Microsoft SQL Server MVP)
www.SQLDTS.com - The site for all your DTS needs.
I support PASS - the definitive, global community
for SQL Server professionals - http://www.sqlpass.org


"statistical" <statistical (AT) discussions (DOT) microsoft.com> wrote

Quote:
I have a DTS package that downloads a large number of tables from a remote
database into SQL Server. Each download has its own source and destination
connection and a datapump. I am still experimenting with the number of
parallel tasks to use to get the optimal download time. What I need to is to
change the order in which the datapumps are processed in a manner that is
easier than copying the information from one datapump to another. I have
seen this done before but can't remember how to do it. Any help would be
appreciated.
Quote:
Example:

Currently processing datapump1, then 2 then 3 then 4 then 5

want to change it to
Datapump 4, then 3, then 1, then 5 then 2.



Reply With Quote
  #3  
Old   
Allan Mitchell
 
Posts: n/a

Default Re: Order of execution - 06-17-2004 , 08:37 AM



You could still use Workflow and have multiple ON SUCCESS constraints going
to 1 following DataPump.

You can also Disable/Enable steps using Active X Script

Multiple Paths in Workflow
(http://www.sqldts.com/default.aspx?218)

--

----------------------------

Allan Mitchell MCSE,MCDBA, (Microsoft SQL Server MVP)
www.SQLDTS.com - The site for all your DTS needs.
I support PASS - the definitive, global community
for SQL Server professionals - http://www.sqlpass.org


"statistical" <statistical (AT) discussions (DOT) microsoft.com> wrote

Quote:
Workflow constraints don't work in this case as the execution of each
datadump is not dependant on any previous one completing. With three
parallel tasks running the example would be
Quote:
Datapump 1, Datapump2, Datapump3

Datapump4 can execute when any of the previous datadumps have executed

Depending on the results we obtain we may want

Datadump35, Datapump1, Datapump2 to start

and then Datapump3 then Datapump4.

"Allan Mitchell" wrote:

You can do this using Workflow Constraints

Introduction to Workflow
(http://www.sqldts.com/default.aspx?287)

--

----------------------------

Allan Mitchell MCSE,MCDBA, (Microsoft SQL Server MVP)
www.SQLDTS.com - The site for all your DTS needs.
I support PASS - the definitive, global community
for SQL Server professionals - http://www.sqlpass.org


"statistical" <statistical (AT) discussions (DOT) microsoft.com> wrote in message
news:5B8CF680-C963-4525-A4D1-65A06A79E6C4 (AT) microsoft (DOT) com...
I have a DTS package that downloads a large number of tables from a
remote
database into SQL Server. Each download has its own source and
destination
connection and a datapump. I am still experimenting with the number of
parallel tasks to use to get the optimal download time. What I need to
is to
change the order in which the datapumps are processed in a manner that
is
easier than copying the information from one datapump to another. I have
seen this done before but can't remember how to do it. Any help would be
appreciated.

Example:

Currently processing datapump1, then 2 then 3 then 4 then 5

want to change it to
Datapump 4, then 3, then 1, then 5 then 2.






Reply With Quote
  #4  
Old   
statistical
 
Posts: n/a

Default Re: Order of execution - 06-17-2004 , 11:22 AM



Is there no simple way of just resequencing the execution order of the steps without resorting to workflow constraints which could turn out to be quite complex.

I realise that I could potentially dump the package into VB reorder it in VB and then recreate the package from the VB (which version of VB is it? I'm using SQL Server 2000) which seems a little excessive.

"Allan Mitchell" wrote:

Quote:
You could still use Workflow and have multiple ON SUCCESS constraints going
to 1 following DataPump.

You can also Disable/Enable steps using Active X Script

Multiple Paths in Workflow
(http://www.sqldts.com/default.aspx?218)

--

----------------------------

Allan Mitchell MCSE,MCDBA, (Microsoft SQL Server MVP)
www.SQLDTS.com - The site for all your DTS needs.
I support PASS - the definitive, global community
for SQL Server professionals - http://www.sqlpass.org


"statistical" <statistical (AT) discussions (DOT) microsoft.com> wrote in message
news:B17226AA-0679-4096-BD81-CC122A93E9D4 (AT) microsoft (DOT) com...
Workflow constraints don't work in this case as the execution of each
datadump is not dependant on any previous one completing. With three
parallel tasks running the example would be

Datapump 1, Datapump2, Datapump3

Datapump4 can execute when any of the previous datadumps have executed

Depending on the results we obtain we may want

Datadump35, Datapump1, Datapump2 to start

and then Datapump3 then Datapump4.

"Allan Mitchell" wrote:

You can do this using Workflow Constraints

Introduction to Workflow
(http://www.sqldts.com/default.aspx?287)

--

----------------------------

Allan Mitchell MCSE,MCDBA, (Microsoft SQL Server MVP)
www.SQLDTS.com - The site for all your DTS needs.
I support PASS - the definitive, global community
for SQL Server professionals - http://www.sqlpass.org


"statistical" <statistical (AT) discussions (DOT) microsoft.com> wrote in message
news:5B8CF680-C963-4525-A4D1-65A06A79E6C4 (AT) microsoft (DOT) com...
I have a DTS package that downloads a large number of tables from a
remote
database into SQL Server. Each download has its own source and
destination
connection and a datapump. I am still experimenting with the number of
parallel tasks to use to get the optimal download time. What I need to
is to
change the order in which the datapumps are processed in a manner that
is
easier than copying the information from one datapump to another. I have
seen this done before but can't remember how to do it. Any help would be
appreciated.

Example:

Currently processing datapump1, then 2 then 3 then 4 then 5

want to change it to
Datapump 4, then 3, then 1, then 5 then 2.







Reply With Quote
  #5  
Old   
Phill Carter
 
Posts: n/a

Default Re: Order of execution - 06-17-2004 , 05:37 PM



From your previous posts I presume you have all these Datapumps in one large
package?

If so, I'd suggest you break them out into individual packages. This will
allow a greater level of flexibility when trying to optimise the execution
order. I've done this on a couple of DTS projects. The largest was over 180
packages in a 4 level hierarchy.

Then create a master package that controls the order in which the packages
are executed. This can be done using ExecutePackage tasks and workflow as
Alan has suggested or via ActiveScript task.

For parallel execution take a look at setting up an SQL Agent job to run the
package and then calling sp_start_job to run it. This way you aren't waiting
for the package to complete before executing another package.

Hope this helps
Phill

"statistical" <statistical (AT) discussions (DOT) microsoft.com> wrote

Quote:
Is there no simple way of just resequencing the execution order of the
steps without resorting to workflow constraints which could turn out to be
quite complex.
Quote:
I realise that I could potentially dump the package into VB reorder it in
VB and then recreate the package from the VB (which version of VB is it? I'm
using SQL Server 2000) which seems a little excessive.
Quote:
"Allan Mitchell" wrote:

You could still use Workflow and have multiple ON SUCCESS constraints
going
to 1 following DataPump.

You can also Disable/Enable steps using Active X Script

Multiple Paths in Workflow
(http://www.sqldts.com/default.aspx?218)

--

----------------------------

Allan Mitchell MCSE,MCDBA, (Microsoft SQL Server MVP)
www.SQLDTS.com - The site for all your DTS needs.
I support PASS - the definitive, global community
for SQL Server professionals - http://www.sqlpass.org


"statistical" <statistical (AT) discussions (DOT) microsoft.com> wrote in message
news:B17226AA-0679-4096-BD81-CC122A93E9D4 (AT) microsoft (DOT) com...
Workflow constraints don't work in this case as the execution of each
datadump is not dependant on any previous one completing. With three
parallel tasks running the example would be

Datapump 1, Datapump2, Datapump3

Datapump4 can execute when any of the previous datadumps have executed

Depending on the results we obtain we may want

Datadump35, Datapump1, Datapump2 to start

and then Datapump3 then Datapump4.

"Allan Mitchell" wrote:

You can do this using Workflow Constraints

Introduction to Workflow
(http://www.sqldts.com/default.aspx?287)

--

----------------------------

Allan Mitchell MCSE,MCDBA, (Microsoft SQL Server MVP)
www.SQLDTS.com - The site for all your DTS needs.
I support PASS - the definitive, global community
for SQL Server professionals - http://www.sqlpass.org


"statistical" <statistical (AT) discussions (DOT) microsoft.com> wrote in
message
news:5B8CF680-C963-4525-A4D1-65A06A79E6C4 (AT) microsoft (DOT) com...
I have a DTS package that downloads a large number of tables from
a
remote
database into SQL Server. Each download has its own source and
destination
connection and a datapump. I am still experimenting with the number
of
parallel tasks to use to get the optimal download time. What I need
to
is to
change the order in which the datapumps are processed in a manner
that
is
easier than copying the information from one datapump to another. I
have
seen this done before but can't remember how to do it. Any help
would be
appreciated.

Example:

Currently processing datapump1, then 2 then 3 then 4 then 5

want to change it to
Datapump 4, then 3, then 1, then 5 then 2.









Reply With Quote
Reply




Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

vB code is On
Smilies are On
[IMG] code is On
HTML code is Off



Powered by vBulletin Version 3.5.3
Copyright ©2000 - 2012, Jelsoft Enterprises Ltd.