Hi Guys,
We're setting up a shop that's integrated with NAV.
NAV delivers an XML file of about 4mb worth of data, and we're importing this via the NAV pipelines in Dynamicweb.
The XML contains about 8500 products, which are imported via the pipeline "NAV product import".
The problem is that when we run this rutine it seldom finishes with success. Most of the time is just hangs until it gets a time out, or it just never finishes, locking up the XML file.
Importing groups, debitors and so on works fine.
What can we do to make sure that the import of products complete every time?
Importing 8500 in one go should be possible. Can i do anything, or does Dynamicweb need to optimize their rutines?
I can't wait 1 year for DW8 and the new import engine to come out :-)
Regards
Martin
Developer forum
E-mail notifications
NAV import fails on product import
Posted on 13/04/2011 11:48:33
Replies
Posted on 13/04/2011 12:33:13
Hi guy! :-)
Which version of Dynamicweb are you running? With latest release (19.2.2.1) major performance gains are achieved.
You can download it from http://engage.dynamicweb-cms.com/Download-software-438.aspx (requires login).
If you are still stuck, please create a case at helpdesk and we will take a look at the solution.
Let us know how things went!
Regards
Morten Snedker
Posted on 13/04/2011 14:18:09
We're using a special build that fixes a bug with newsletter suscribers being deleted on import.
Is that fix included in 19.2.2.1?
// Martin
Is that fix included in 19.2.2.1?
// Martin
Posted on 13/04/2011 15:10:38
What is the nature of the timeout? .Net? SQL connection or command? You should be able to modify the timeout limits for all of these in their appropriate places.
If you're stuck with a custom assembly, there are two things you can do:
- Break up the XML in two or more files and import these separately.
- Set up an integration website running on the same database but with the new and improved assemblies and use this for importing.
As far as I remember, there are some "secret" commands that instruct dw to import full, partial and such. This might also be an option. Maybe Morten has an opinion on that?
BR.
Lars
If you're stuck with a custom assembly, there are two things you can do:
- Break up the XML in two or more files and import these separately.
- Set up an integration website running on the same database but with the new and improved assemblies and use this for importing.
As far as I remember, there are some "secret" commands that instruct dw to import full, partial and such. This might also be an option. Maybe Morten has an opinion on that?
BR.
Lars
Posted on 13/04/2011 15:40:12
I've setup the entire solution locally, and i get this error after 12-15 minutes.
3:35 PM Product destination Error restoring temporary tables: failed to delete rows from tempTable [dbo.ecomProductsTemp] that where not present in source
3:35 PM Product destination Error doing commit or rollback: Object reference not set to an instance of an object.
When i check the database the table EcomProductsTemp is there.
So maybe it isn't a timeout issue, as initially assumed.
// Martin
3:35 PM Product destination Error restoring temporary tables: failed to delete rows from tempTable [dbo.ecomProductsTemp] that where not present in source
3:35 PM Product destination Error doing commit or rollback: Object reference not set to an instance of an object.
When i check the database the table EcomProductsTemp is there.
So maybe it isn't a timeout issue, as initially assumed.
// Martin
Posted on 13/04/2011 15:45:39
Have you tried deleting (or renaming) the EcomProductsTemp and then running the import again?
BR.
Lars
BR.
Lars
Posted on 13/04/2011 15:46:28
The solution to that particular problem (Newsletter V3) is included as well in latest release.
The error you describe will be solved as well with latest release - I'm pretty confident! :-)
@Lars: the current import module does not support multiple files by standard. It will always import from most recent file.
Regards
Morten Snedker
Posted on 13/04/2011 15:46:52
Yes, i tried deleting all temp tables, but that didn't do much.
I'll try upgrading to 19.2.2.1 and see if that's better.
I'll try upgrading to 19.2.2.1 and see if that's better.
Posted on 13/04/2011 16:00:29
Hi Morten,
I'll try the 19.2.2.1 and report back :-)
I hope you're right.!
// Martin
I'll try the 19.2.2.1 and report back :-)
I hope you're right.!
// Martin
Posted on 13/04/2011 16:06:49
Hi Morten,
Just ran the import again whil on the new release, and i got this error again:
4:04 PM Product destination Error restoring temporary tables: failed to delete rows from tempTable [dbo.ecomProductsTemp] that where not present in source
4:04 PM Product destination Error doing commit or rollback: Object reference not set to an instance of an object.
I'm a sad panda at the moment
Regards
Martin
Just ran the import again whil on the new release, and i got this error again:
4:04 PM Product destination Error restoring temporary tables: failed to delete rows from tempTable [dbo.ecomProductsTemp] that where not present in source
4:04 PM Product destination Error doing commit or rollback: Object reference not set to an instance of an object.
I'm a sad panda at the moment
Regards
Martin
Posted on 13/04/2011 16:12:00
Importing user still works though, so the Newsletter v3 bugfix is in this release :-)
Posted on 13/04/2011 16:28:16
Hi Morten,
Made a tiny mistake before, so the new application wasn't in use on my last test.
Just testet with the correct version (19.2.2.1) and the import completed without error in les than 5 minuts.
Major improvement in performance, and an important bugfix!
I have to tweet about this ! :-D
Yihaa!! now i'm happy again.
Thank you both.
// Martin
Made a tiny mistake before, so the new application wasn't in use on my last test.
Just testet with the correct version (19.2.2.1) and the import completed without error in les than 5 minuts.
Major improvement in performance, and an important bugfix!
I have to tweet about this ! :-D
Yihaa!! now i'm happy again.
Thank you both.
// Martin
Posted on 14/04/2011 11:34:15
Good to hear, Martin. We like happy pandas! :-)
/Snedker
You must be logged in to post in the forum