Hi,
We have a client with an eCommerce solution with around 287.980 products in a single category. The solution is syncing with an Image Catalogue System, but when upgrading to Dw7 or 8, we were told that we simply had to chop it up in chunks of 10.000 products. The client still wants to display the full products in a single Dynamicweb page with 16 products per page.
Does anyone had a similar problem and solution to help us?
Our biggest issue is how to fix this so the client doesn't have to pay a lot of new developmento (design, implementation and/or custom development) to get something that is working in DW<7 and does not work in DW>=7
Best Regards,
Nuno
Developer forum
E-mail notifications
Upgrade to Dw7/8
Nuno Aguiar
Posted on 22/02/2012 11:31:30
Replies
Nicolai Høeg Pedersen
Posted on 22/02/2012 13:18:31
What is the issue - why can't you just upgrade?
Nuno Aguiar
Posted on 23/02/2012 11:59:00
Hi Nicolai,
Here's the website in Production (DW<7)
http://www.espoliofotograficoportugues.pt/Default.aspx?ID=81
Here's the website in Test (DW>=7)
http://efp.dynamicweb.pt/Default.aspx?ID=81
And after consulting Dynamicweb's helpdesk we got this answer (Case #CAS-87884-FSH1J1)
"We do not support 100.000+ product view in Dynamicweb. Please limit you product view to max 10.000 Products.
This is not due to performance, but because the DynamicWeb has become more and more complex during the periode.
Any ideas?
Nuno
Remi Muller
Posted on 23/02/2012 13:05:51
I am not complete following the issue.
Are you saying that it is not possible to have more than 10.000 products in ecom with dw8?
I'd like to know more because we have clients with solutions with more than 10.000 products.
Are you saying that it is not possible to have more than 10.000 products in ecom with dw8?
I'd like to know more because we have clients with solutions with more than 10.000 products.
Nuno Aguiar
Posted on 23/02/2012 17:10:14
Hi Remi,
Sorry, but I was told that it was a final answer from you guys. Anyhow, you can see by the links the different behaviours between the Dynamicweb versions, with the same database.
The current version has almost 288.000 products in a single category, and each product has 3 variants (Photos and clients can buy them in 3 sizes)
We really need this fixed, since the client in paying update agrrement and not using any of te new features.
Nuno
Sorry, but I was told that it was a final answer from you guys. Anyhow, you can see by the links the different behaviours between the Dynamicweb versions, with the same database.
The current version has almost 288.000 products in a single category, and each product has 3 variants (Photos and clients can buy them in 3 sizes)
We really need this fixed, since the client in paying update agrrement and not using any of te new features.
Nuno
Remi Muller
Posted on 24/02/2012 12:34:44
First i want to make clear i'm not of Dynamicweb. Our company is a Dynamicweb partner. I'm interested in your issue because we have clients with large ecom databases.
If there are any issues when upgrading to dw8 i want to know.
If i understand correctly you already have 288000 products in one group. This results in an sql timeout on dw8.
Do you know if smaller groups(5000-10000) on 288000 product database does work?
Dynamicweb says it is not related to performance but it looks like it does.
Even if the problem is resolved it might not be a bad idea to group/filter the data. Not many users will be browsing all pages.
If there are any issues when upgrading to dw8 i want to know.
If i understand correctly you already have 288000 products in one group. This results in an sql timeout on dw8.
Do you know if smaller groups(5000-10000) on 288000 product database does work?
Dynamicweb says it is not related to performance but it looks like it does.
Even if the problem is resolved it might not be a bad idea to group/filter the data. Not many users will be browsing all pages.
Nuno Aguiar
Posted on 24/02/2012 13:07:04
Hi Remi,
Ok, sorry for the misunderstanding.
About the database, we seem to have run into a dead end.
- smaller amounts work - http://efp.dynamicweb.pt/Default.aspx?ID=5 (6411 photos)
- the client syncs it whenever new photograhps are available (they are restoring photographs and cataloging as soon as they finish)
- this was supposed to be a simple upgrade and not a rebuilt of the custom sync development and frontend templates
I understand the amount of pages are not great, but if we were to have a huge search result (eCom search) this problem would arise, hence the need to get a workaround. It becomes a limitation of the current Dynamicweb that DW<7 did not have :(
Nuno
Ok, sorry for the misunderstanding.
About the database, we seem to have run into a dead end.
- smaller amounts work - http://efp.dynamicweb.pt/Default.aspx?ID=5 (6411 photos)
- the client syncs it whenever new photograhps are available (they are restoring photographs and cataloging as soon as they finish)
- this was supposed to be a simple upgrade and not a rebuilt of the custom sync development and frontend templates
I understand the amount of pages are not great, but if we were to have a huge search result (eCom search) this problem would arise, hence the need to get a workaround. It becomes a limitation of the current Dynamicweb that DW<7 did not have :(
Nuno
Nicolai Høeg Pedersen
Posted on 24/02/2012 19:33:43
Hi Nuno
Will have someone look into it.
Of course you can have more than 10.000 products in the eCommerce. Having 300.000 in one category though is quite a lot.
But opbvously some kind of thing have changed and we need to figure out what it is.
Will have someone get back to you.
Will have someone look into it.
Of course you can have more than 10.000 products in the eCommerce. Having 300.000 in one category though is quite a lot.
But opbvously some kind of thing have changed and we need to figure out what it is.
Will have someone get back to you.
Nuno Aguiar
Posted on 27/02/2012 11:55:10
Looking forward to it, thanks
Kristian Kirkholt
Posted on 28/02/2012 13:47:18
Hi Nuno
There must have been some misunderstanding here. You can have an unlimited number of products in eCommerce, but we do have some recomendations:
The grand total products displayed by a single Product catalog module should not exceed 50.000, as you would have to Browse through 2000+ pages to show all products in frontend which makes no sense seen from a usability point of view...
Nuno Aguiar
Posted on 05/03/2012 11:02:00
Hi Kristian,
I understand your point of view, but unfortunatly there is no misunderstanding.
- We do not advise that many products
- There is an automatic sync between Dynamicweb and a software
- Everything is working in Dynamicweb 18.16.1.13
- Upgrading to Dynamicweb 7 breaks down
- The client has paid the Update Agreement
Even if we break the products into several categories, a search that returns too many results, timesout. The question is:
- Should the client get the impression that the newer version of Dynamicweb cannot handle the volume?
You can check the same database+templates with the 2 instalattions
- http://www.espoliofotograficoportugues.pt/Default.aspx?ID=81
- http://efp.dynamicweb.pt/Default.aspx?ID=81
Nuno
I understand your point of view, but unfortunatly there is no misunderstanding.
- We do not advise that many products
- There is an automatic sync between Dynamicweb and a software
- Everything is working in Dynamicweb 18.16.1.13
- Upgrading to Dynamicweb 7 breaks down
- The client has paid the Update Agreement
Even if we break the products into several categories, a search that returns too many results, timesout. The question is:
- Should the client get the impression that the newer version of Dynamicweb cannot handle the volume?
You can check the same database+templates with the 2 instalattions
- http://www.espoliofotograficoportugues.pt/Default.aspx?ID=81
- http://efp.dynamicweb.pt/Default.aspx?ID=81
Nuno
Nuno Aguiar
Posted on 22/05/2012 11:59:59
Hi,
Did anyone manage to get an answer as to why this happens?
Nuno
Did anyone manage to get an answer as to why this happens?
Nuno
Nuno Aguiar
Posted on 17/08/2012 10:36:57
Hi Guys,
I will let the client know Dynamicweb < 7 is more stable. I will then contact the sales department to reach an understanding with the client, since he has been paying for unnecessary update agreements.
Thanks,
Nuno
I will let the client know Dynamicweb < 7 is more stable. I will then contact the sales department to reach an understanding with the client, since he has been paying for unnecessary update agreements.
Thanks,
Nuno
Pavel Volgarev
Posted on 17/08/2012 11:01:19
Hi Nuno,
Are you using search filters? There has been some performance improvements made that specifically address the issues with big result sets. Please take a look at the following blog post (section "Performance improvements"): Latest improvements in product search.
In case you're not using search filters: is it possible (maybe as a temporary solution) to use them? I can see that you have four text fields on your search form that most likely correspond to custom product fields, am I right? In this case it will be relatively easy to setup four search filters of type "Product fields filter" that will point to the same product fields but inside your index.
You can also apply search filters automatically on the initial page load (using the "Delimit" filter). This will trigger the optimizations that we made not only when you actually perform a search but even when you hit the page first time.
Please let me know if all above makes any sense.
-- Pavel
Are you using search filters? There has been some performance improvements made that specifically address the issues with big result sets. Please take a look at the following blog post (section "Performance improvements"): Latest improvements in product search.
In case you're not using search filters: is it possible (maybe as a temporary solution) to use them? I can see that you have four text fields on your search form that most likely correspond to custom product fields, am I right? In this case it will be relatively easy to setup four search filters of type "Product fields filter" that will point to the same product fields but inside your index.
You can also apply search filters automatically on the initial page load (using the "Delimit" filter). This will trigger the optimizations that we made not only when you actually perform a search but even when you hit the page first time.
Please let me know if all above makes any sense.
-- Pavel
You must be logged in to post in the forum