Developer forum

Forum » Dynamicweb 10 » Dealing with a large number of products

Dealing with a large number of products

Justin Sjouw Dynamicweb Employee
Justin Sjouw
Reply

I'm working on a case where the potential customer has asked to show that DW stil runs smooth with around 4 million products.

I'did a little test with some bogus data, and imported almost 1 million products. 

I notice that the "All Products" overview is still quite snappy, but that browsing the channel group (into which I imported the products) is much slower.

Why is this, and can I do anything about it?

 


Replies

 
Nicolai Pedersen Dynamicweb Employee
Nicolai Pedersen
Reply

So you added 1mio products to one group?

 
Justin Sjouw Dynamicweb Employee
Justin Sjouw
Reply

Yes, since the use case is that they only have very basic information in the source data, and would like to use PIM to organize this into groups and connect data models.

But from your response I gather that is not a workable scenario :-) ?

 
Nicolai Pedersen Dynamicweb Employee
Nicolai Pedersen
Reply

Hi Justin

We have been looking at this - and we have made some local improvements so we can load 1mio products in a group fast. So we will be able to release some optimizations on product lists.

Having 4 mio in one group might still not be optimal - but feasable.

Indexing time is your next culprit - and optimizing which fields to index, which to store etc. will give you a lot - so not just indexing all fields as it is standard.

BR Nicolai

 
Steffen Færch Lunde Dynamicweb Employee
Steffen Færch Lunde
Reply

Work item created in DevOps. https://doc.dynamicweb.dev/documentation/fundamentals/dw10release/releasenotes/workItemInfo.html?workitemid=26003

 

You must be logged in to post in the forum