I have a solution that is supposed to list a lot of products. So far we have 200k SKUs and I expect to have another 100k by the end of the year.
The challenge here is updating the index once something happens on any of the workflows.
We have set up PIM workflows on the staging solution (where the catalog is smaller) and we have had no issues making changes and moving over products from one workflow state to the other and from one query to the other based on the Shared queries.
On the Production site, once we make any change to any number of products, the index rebuilds entirely. Which, as you can imagine, would take about 15-20 minutes. And since we have multiple users making changes at the same time, the index keeps restarting.
I am pretty sure the way I have set up the index is not the most efficient way.
I have a PIM index with 2 builds:
- Full (HoursToUpdate = 24,BulkSize=500)
- Partial (HoursToUpdate=0.1,BulkSize=500)
I have tried adding a new Build - UpdateWithIds hoping that this would improve the update. But I still don't get the desired result.
Assuming what I have done is wrong, what would be the best setup of the Index to allow a fast update of the index once something is updated on the SharedQueries/Workflows?