Comments on: SSIS – Why is my data flow so slow with an OLE DB Command component?

By: Forsythe

Forsythe — Fri, 11 Nov 2011 02:28:47 +0000

Can I do this in XML to SQL?

my SSIS package it takes 25mins for 6k rows.

By: Swetha

Swetha — Thu, 09 Jun 2011 03:41:45 +0000

I am able to solve my problem as in No 7.

I have used squence container which has
- Execute task – To empty intermediate table
- Data flow task to transfer data from ACCESS TO SQL INTERMEDIATE TABLE.
- Execute task – To update real table data with intermediate table’s. by using stored procedure

By: Lindsay Allgaier

Lindsay Allgaier — Sat, 21 May 2011 00:16:37 +0000

Your very own commitment to getting the message all-around turned out to be extraordinarily informative and has surely allowed some individuals just like me to get to their objectives.

By: Swetha

Swetha — Wed, 18 May 2011 03:26:10 +0000

Good Article.

Even my SSIS package takes around one hour to execute because of this problem.

But, I have the same question as Sujith.

And I need to Update two tables in Data Flow Task lIKE BELOW.

Best Regards,
Swetha

By: Sujith

Sujith — Mon, 29 Nov 2010 06:13:18 +0000

Thanks for the article.

Let’s say, if I don’t have access to create a table in my destination, can i go ahead with this option? Is there any other alternative ??

By: Phil Brammer

Phil Brammer — Mon, 02 Nov 2009 20:19:09 +0000

I’m only reading in 5,000 rows at the source once. From there for each row an UPDATE is issued (when using an OLE DB Command to perform the update).

Even with an index so that a seek occurs on the update, there is still a single update transaction that occurs for each row in the data flow. (In this case, that is 5000 updates)

The point of this post is to illustrate the use of batch updates rather than single-unit-of-work updates that are very costly to implement. Where possible, always choose a batch update rather than row-by-row.

By: Beth

Beth — Mon, 02 Nov 2009 17:44:06 +0000

That is a totally different issue. I couldn’t believe that OLE was that slow except that you are doing a sequential read of millions of rows 5000 times for the update. What is the timing if you put an index on number? Your join makes one pass through the data.

By: Nayan

Nayan — Sun, 01 Nov 2009 02:07:27 +0000

If anybody interested in high performance Upsert task then check TaskFactory (A collection of SSIS Tasks and Components)

They have really good set of tasks including Upsert Destination

http://www.pragmaticworks.com/Products/Business-Intelligence/TaskFactory/