Developer forum

Forum » Ecommerce - Standard features » Index taking 8 hours to run

Index taking 8 hours to run

E-mail notifications
Nuno Aguiar
Reply
Posted on 17/06/2015 17:37:02

Hi,

 

We have a client with a bit under 35.000 products in the database, but indexing and even partial index of about 10 changes take hours to run, sometimes taking about 8h. Does anyone come across this?

 

Best Regards,

Nuno Aguiar


Replies

 
Nicolai Høeg Pedersen
Posted on 18/06/2015 09:35:47
Reply

DW Version?

What hosting?

That said, the old indexing is not the fastest animal around. But 8 hours for 35k products sound too slow.

BR Nicolai

 
Nuno Aguiar
Posted on 18/06/2015 10:00:58
Reply

Hi Nicolai,

 

Sorry, should have said that up front. It is using 8.6.1.6 and the client is sefl hosting.

http://rowlf.dw-demo.com/

 

It's running on a Windows 2012 server, SQL server in the same machine and on IIS8 (AFAIK) and basically seems to be meeting all of the necessary requirements.

 

Best Regards,

Nuno Aguiar

 
Nicolai Høeg Pedersen
Posted on 18/06/2015 10:57:58
Reply

Everything seems fine, so not much I can do.

But, it is a 8.6.1, and it has the new indexing. You could consider switching to that one. MUCH faster and easier to set up.

BR N

 
Nuno Aguiar
Posted on 18/06/2015 11:29:41
Reply

Hi Nicolai,

 

I'll test for that. We have the entire project built already and have little time to test around. Would be a lot more confortable doing with features we are experienced with and dealing with new features in newer projects or other phases.

 

We'll see what we can do.

 

Best Regards,

Nuno Aguiar

 
Imar Spaanjaars Dynamicweb Employee
Imar Spaanjaars
Posted on 19/06/2015 16:24:53
Reply

I did some research on this website on my local machine. As a direct copy, it takes around 300+ minutes to index; a bit faster than on the remote machine but I guess that's because of the machine specs (nothing else running, SSD drive etc).

Interestingly enough, when I delete all product-group relation records (DELETE FROM EcomGroupProductRelation), the indexing time goes down to 7 minutes (!!); the number you'd expect for an indexing like this.

I checked the database indexes and rebuilt them for the relevant tables but that didn't make any difference.

I can make the site available for download in case you want to take a look at it.

Imar

 
Kristian Kirkholt
Posted on 23/06/2015 08:29:47
Reply

Hi Imar

Yes we would like to get at copy of the files and database to debug in Dynamicweb. Could you make this available for me to download. thanks.

Kind Regards
Dynamicweb Support
Kristian Kirkholt
kki@Dynamicweb.dk

 
Imar Spaanjaars Dynamicweb Employee
Imar Spaanjaars
Posted on 24/06/2015 08:38:21
Reply

Hi Kristian,

I sent you an email with a link to download the site.

Thanks for looking into this.

Imar

 
Kristian Kirkholt
Posted on 24/06/2015 09:57:38
Reply

Hi Nuno and Imar

We have created an investigation #17687 about this slow indexing. You will be informed when finished debugging.

Kind Regards
Dynamicweb Support
Kristian Kirkholt

 

 
Kristian Kirkholt
Posted on 30/06/2015 15:21:08
Reply
This post has been marked as an answer

Hi Nuno and Imar

Problem regarding Improved querying for better indexing performance has now been resolved in Dynamicweb version 8.6.1.13

You are able to find this build in the download section:

http://developer.dynamicweb-cms.com/downloads/dynamicweb-8.aspx

Please contact Dynamicweb Support if you need any additional help regarding this.

Kind Regards
Dynamicweb Support
Kristian Kirkholt

Votes for this answer: 1
 
Nuno Aguiar
Posted on 15/07/2015 13:27:19
Reply

Hi Kristian,

 

(I was on vacation, hence the delayed feedback). We've upgraded and also removed some id-less products (results from bad/test imports) and it's running as expected now.

 

Thanks a lot.

Nuno

 

You must be logged in to post in the forum