Developer forum

Forum » Integration » Job failing when run as scheduled task

Job failing when run as scheduled task

Imar Spaanjaars Dynamicweb Employee
Imar Spaanjaars
Reply

Hi there,

I have an integration job that runs OK when run directly in DW10. However, when I run it from a scheduled task that uses paging from a remote ERP it fails with tons of errors like this (one for each source row I think):

2025-10-04 16:55:33.1767|DataIntegration|ERROR|Error stack:    at Dynamicweb.DataIntegration.Providers.EcomProvider.EcomDestinationWriter.FinishWriting()    at Dynamicweb.DataIntegration.Providers.EcomProvider.EcomProvider.RunJob(Job job)
2025-10-04 16:55:33.2050|DataIntegration|INFORMATION|Job Failed with the following message:
2025-10-04 16:55:33.2226|DataIntegration|INFORMATION|Bulk copy failures in the EcomProducts$1 table:
2025-10-04 16:46:22.4974|DataIntegration|INFORMATION|Error: One or more errors occurred. (Cannot access destination table 'EcomProductsTempTableForBulkImport1'.)
Row data:   [ProductNumber: ""] (System.String),  [AXVareTekst: ""] (System.String),  [ProductPrice: ""] (System.Double),  [ProductWeight: ""] 
(System.Double),  [ProductId: ""] (System.String),  [ProductVariantId: ""] (System.String),  [ProductLanguageId: ""] (System.String),  
[ProductVolumeItem: ""] (System.Boolean),  [ProductDangerousGoods: ""] (System.Boolean),  [ProductCreated: ""] (System.DateTime),  [ProductUpdated: ""] 
(System.DateTime),  [ProductErpSource: ""] (System.String),  [DropShipmentEnabledProduct: ""] (System.Boolean),  [ProductName: ""] (System.String),  
[ProductBasePrice: ""] (System.String),  [ProductUnitCounter: ""] (System.Int32),  [StandardLeadTime: ""] (System.String),  [ProductDefaultShopId: ""] 
(System.String),  [ProductVariantCounter: ""] (System.Int32)

For some reason, all column data is missing as everything looks empty to me.

The source file (the first page as far as I can tell) contains no empty products. And if I run the activity directly after the task (meaning it runs against the XML file saved by the scheduled task) it runs fine.

This looks similar to this issue: https://doc.dynamicweb.com/forum/integration/integration/job-fails-when-ran-as-scheduled-task We did upgrade to get that problem resolved. Running on 10.19.6 now.


Replies

 
Dmitriy Benyuk Dynamicweb Employee
Dmitriy Benyuk
Reply

Hi Imar,
will be fixed in #25833.
BR, Dmitrij

 
Imar Spaanjaars Dynamicweb Employee
Imar Spaanjaars
Reply

Great, thanks. That one related to log folders. Was that the issue here also or are you just grouping things?

Also, are you testing this against an ERP with the Import data activity? It would be nice if it worked after the next release :-) I can send you the site if you like? It runs on a DW10 Staging server.

Imar

 
Dmitriy Benyuk Dynamicweb Employee
Dmitriy Benyuk
Reply

It is just grouping, the issue is different. Yes, testing with import data with paging add-in. The issue is that the import data with paging addin was not moved into DW10 at start and only moved after some time while it also requires the changes in the providers for it to work as it was in DW9, so it was done for the Xml and DW providers but not for the Ecom.
You can try to run your failing job with this parameter un-checked/off:
Run Import Activity after all data is retrieved from the Web service
 

I was able to reproduce the issue when this option is ON
BR, Dmitrij

 
Imar Spaanjaars Dynamicweb Employee
Imar Spaanjaars
Reply

>> Yes, testing with import data with paging add-in.

I see. There may have been some confusion then. I am using the other one: "Import data with custom request add-in" which doesn't have the option "Run Import Activity after all data is retrieved from the Web service", but it still has some paging implemented with the ExportIsDone attribute on the outer <table> element in the XML. I guess I should have been more specific when I said "scheduled task that uses paging"

I can't switch to the "with paging add-in" as my endpoint doesn't return batch IDs nor implement certification. I just tried it but, as was to be expected, fails with the error "There is no batch id in the response"

Will your fixes apply to both providers?

Imar

 

 

You must be logged in to post in the forum