Developer forum

Can you ellaborate what "products disappear" means? From frontend, from database?

From frontend

but as you can see there are 3670 products but completes with 3500?
only happens on one specific shop could it be data thats wrong?

is there another log file regarding indexing?

Hi Jannich

Yes, there is log. See my dump.

You might want to check the properties of your builder that it has not been limited to i.e. 3500 products. See dump 2

Hi Nicolai,

Below is from the log file:

2020-04-03 08:00:40.552: Running.
2020-04-03 08:00:40.552: Fetching build definition.
2020-04-03 08:00:40.552: Fetched build definition. 'Dynamicweb.Ecommerce.Indexing.ProductIndexBuilder'.
2020-04-03 08:00:40.552: Preparing schema.
2020-04-03 08:00:40.552: Prepared schema.
2020-04-03 08:00:40.552: Creating index writer.
2020-04-03 08:00:40.552: Created index writer: 'Dynamicweb.Indexing.Lucene.LuceneIndexWriter'.
2020-04-03 08:00:40.552: Instance availability (Products): False.
2020-04-03 08:00:40.552: Starting build process.
2020-04-03 08:00:40.552: Dynamicweb.Ecommerce.Indexing.ProductIndexBuilder building using Dynamicweb.Indexing.Lucene.LuceneIndexWriter... Action: 'Full', Resume: 'False'
2020-04-03 08:00:40.552: Opening index writer.
2020-04-03 08:00:40.552: Opened index writer to overwrite index
2020-04-03 08:00:40.677: Opening database connection.
2020-04-03 08:00:40.677: BulkSize: '500'
2020-04-03 08:00:40.677: MaxProductsToIndex: '2147483647'
2020-04-03 08:00:40.677: OnlyIndexActiveProducts: 'False'
2020-04-03 08:00:40.677: SkipGrouping: 'False'
2020-04-03 08:00:40.677: SkipRelatedProducts: 'False'
2020-04-03 08:00:40.677: SkipExtenders: 'False'
2020-04-03 08:00:40.677: SkipAllExtendedFields: 'False'
2020-04-03 08:00:40.677: SkipCategoryFields: 'False'
2020-04-03 08:00:40.677: HandleInheritedCategoryValues: 'False'
2020-04-03 08:00:40.677: DoNotStoreDefaultFields: 'False'
2020-04-03 08:00:40.677: DoNotAnalyzeDefaultFields: 'False'
2020-04-03 08:00:40.677: EmptyStringReplacement: ''
2020-04-03 08:00:40.677: SkipImages: 'False'
2020-04-03 08:00:40.677: ShopsToIndex: 'SHOP8'
2020-04-03 08:00:40.692: Loading product group relation information.
2020-04-03 08:00:40.708: Loaded product group relation information.
2020-04-03 08:00:40.708: Loading group relation information.
2020-04-03 08:00:40.708: Loaded group relation information.
2020-04-03 08:00:40.708: Loading product group relation information.
2020-04-03 08:00:40.708: Loaded product group relation information.
2020-04-03 08:00:40.708: Loading product groups.
2020-04-03 08:00:40.724: Loaded product groups.
2020-04-03 08:00:40.724: Loading campaign information.
2020-04-03 08:00:40.724: Loaded campaign information.
2020-04-03 08:00:40.724: Loading variant information.
2020-04-03 08:00:40.724: Loaded variant information.
2020-04-03 08:00:40.786: Loaded extended variant counts.
2020-04-03 08:00:40.802: Loaded manufacturers.
2020-04-03 08:00:40.896: Loaded assortments.
2020-04-03 08:00:40.896: Loaded customFields.
2020-04-03 08:00:40.911: Loaded CategoriesValues.
2020-04-03 08:00:40.911: Loaded StockLocations.
2020-04-03 08:00:40.911: Loaded StockLocationStockStatuses.
2020-04-03 08:00:40.911: Loaded shop and default images.
2020-04-03 08:00:40.911: Loaded Favorite Lists.
2020-04-03 08:00:40.911: Loading product relations information.
2020-04-03 08:00:40.958: Loaded product relations information.
2020-04-03 08:00:40.958: Loading translation information.
2020-04-03 08:00:41.036: Loaded translation information.
2020-04-03 08:00:41.036: Starting processing products.
2020-04-03 08:01:00.552: Running (2270 / 3670).
2020-04-03 08:01:13.381: Completed processing products.
2020-04-03 08:01:13.381: Closing index writer, just trying...
2020-04-03 08:01:13.678: Closed index writer successfully.
2020-04-03 08:01:13.678: Ended build process.
2020-04-03 08:01:13.678: Completed (3500 / 3500).

I tried removing the numbers in "MaxProductsToIndex" but still same issue.

We asked you're support already and they asked us to recreate the index and i think you guys did that to on the staging but without luck, its the same issue..
We also tried to recreate it but still same issue.

I posted this in the forum in hope if someone else has experienced it before.

You have this setting:

ShopsToIndex: 'SHOP8'

Could that be the issue?

Otherwise provide me with a link and I'll see what is going on.

Link to site: http://lhi-staging.nozebrahosting.dk/

we index the specific shop because we have multiple shops and if we just index the whole thing we can search products from the other shop.

Hi Jannich

Hm - this was a difficult one. I have changed the bulk size on the solution from 500 to 1000 and that seems to fix the issue - see dump. 

I think this id due to an error in indexer that handles the count of records that needs to be build and that is being build. It has been fixed in late 9.7 versions.

But right now it seems to work on this installation.

Sorry about the inconvenience - and have a happy easter!

BR Nicolai

Hi Nicolai,

Awesome!

I will test if products dont disapear from frontend and get back to you hope it works!

Happy easter to you to :)

Best regards Jannich

Hi Nicolai,

I took over the testing from Jannich, and am pleased to inform that this does indeed seem to fix the issue.

Thank you very much!

Best regards

Peter