Developer forum

Forum » Dynamicweb 9.0 Upgrade issues » Index product fails

Index product fails

Jannich Ariyanayagam
Jannich Ariyanayagam
Reply

Hi DynamicWeb Forum,

After upgrading to 9.7.2 we have issues publishing products to the Ecommerce when we do it works fine but after running the products index they disappear? 

Below is from \Files\System\Diagnostics:

2020-04-03 08:00:41.036: Starting processing products.
2020-04-03 08:01:00.552: Running (2270 / 3670).
2020-04-03 08:01:13.381: Completed processing products.
2020-04-03 08:01:13.381: Closing index writer, just trying...
2020-04-03 08:01:13.678: Closed index writer successfully.
2020-04-03 08:01:13.678: Ended build process.
2020-04-03 08:01:13.678: Completed (3500 / 3500).

no errors but still products disappear.


Replies

 
Nicolai Pedersen Dynamicweb Employee
Nicolai Pedersen
Reply

Can you ellaborate what "products disappear" means? From frontend, from database?

 
Jannich Ariyanayagam
Jannich Ariyanayagam
Reply

From frontend

 
Jannich Ariyanayagam
Jannich Ariyanayagam
Reply

but as you can see there are 3670 products but completes with 3500?
only happens on one specific shop could it be data thats wrong?

is there another log file regarding indexing?

 

 
Nicolai Pedersen Dynamicweb Employee
Nicolai Pedersen
Reply

Hi Jannich

Yes, there is log. See my dump.

You might want to check the properties of your builder that it has not been limited to i.e. 3500 products. See dump 2

Capture.JPG Capture2.JPG
 
Jannich Ariyanayagam
Jannich Ariyanayagam
Reply

Hi Nicolai,

Below is from the log file:

2020-04-03 08:00:40.552: Running.
2020-04-03 08:00:40.552: Fetching build definition.
2020-04-03 08:00:40.552: Fetched build definition. 'Dynamicweb.Ecommerce.Indexing.ProductIndexBuilder'.
2020-04-03 08:00:40.552: Preparing schema.
2020-04-03 08:00:40.552: Prepared schema.
2020-04-03 08:00:40.552: Creating index writer.
2020-04-03 08:00:40.552: Created index writer: 'Dynamicweb.Indexing.Lucene.LuceneIndexWriter'.
2020-04-03 08:00:40.552: Instance availability (Products): False.
2020-04-03 08:00:40.552: Starting build process.
2020-04-03 08:00:40.552: Dynamicweb.Ecommerce.Indexing.ProductIndexBuilder building using Dynamicweb.Indexing.Lucene.LuceneIndexWriter... Action: 'Full', Resume: 'False'
2020-04-03 08:00:40.552: Opening index writer.
2020-04-03 08:00:40.552: Opened index writer to overwrite index
2020-04-03 08:00:40.677: Opening database connection.
2020-04-03 08:00:40.677: BulkSize: '500'
2020-04-03 08:00:40.677: MaxProductsToIndex: '2147483647'
2020-04-03 08:00:40.677: OnlyIndexActiveProducts: 'False'
2020-04-03 08:00:40.677: SkipGrouping: 'False'
2020-04-03 08:00:40.677: SkipRelatedProducts: 'False'
2020-04-03 08:00:40.677: SkipExtenders: 'False'
2020-04-03 08:00:40.677: SkipAllExtendedFields: 'False'
2020-04-03 08:00:40.677: SkipCategoryFields: 'False'
2020-04-03 08:00:40.677: HandleInheritedCategoryValues: 'False'
2020-04-03 08:00:40.677: DoNotStoreDefaultFields: 'False'
2020-04-03 08:00:40.677: DoNotAnalyzeDefaultFields: 'False'
2020-04-03 08:00:40.677: EmptyStringReplacement: ''
2020-04-03 08:00:40.677: SkipImages: 'False'
2020-04-03 08:00:40.677: ShopsToIndex: 'SHOP8'
2020-04-03 08:00:40.692: Loading product group relation information.
2020-04-03 08:00:40.708: Loaded product group relation information.
2020-04-03 08:00:40.708: Loading group relation information.
2020-04-03 08:00:40.708: Loaded group relation information.
2020-04-03 08:00:40.708: Loading product group relation information.
2020-04-03 08:00:40.708: Loaded product group relation information.
2020-04-03 08:00:40.708: Loading product groups.
2020-04-03 08:00:40.724: Loaded product groups.
2020-04-03 08:00:40.724: Loading campaign information.
2020-04-03 08:00:40.724: Loaded campaign information.
2020-04-03 08:00:40.724: Loading variant information.
2020-04-03 08:00:40.724: Loaded variant information.
2020-04-03 08:00:40.786: Loaded extended variant counts.
2020-04-03 08:00:40.802: Loaded manufacturers.
2020-04-03 08:00:40.896: Loaded assortments.
2020-04-03 08:00:40.896: Loaded customFields.
2020-04-03 08:00:40.911: Loaded CategoriesValues.
2020-04-03 08:00:40.911: Loaded StockLocations.
2020-04-03 08:00:40.911: Loaded StockLocationStockStatuses.
2020-04-03 08:00:40.911: Loaded shop and default images.
2020-04-03 08:00:40.911: Loaded Favorite Lists.
2020-04-03 08:00:40.911: Loading product relations information.
2020-04-03 08:00:40.958: Loaded product relations information.
2020-04-03 08:00:40.958: Loading translation information.
2020-04-03 08:00:41.036: Loaded translation information.
2020-04-03 08:00:41.036: Starting processing products.
2020-04-03 08:01:00.552: Running (2270 / 3670).
2020-04-03 08:01:13.381: Completed processing products.
2020-04-03 08:01:13.381: Closing index writer, just trying...
2020-04-03 08:01:13.678: Closed index writer successfully.
2020-04-03 08:01:13.678: Ended build process.
2020-04-03 08:01:13.678: Completed (3500 / 3500).

I tried removing the numbers in "MaxProductsToIndex" but still same issue.

We asked you're support already and they asked us to recreate the index and i think you guys did that to on the staging but without luck, its the same issue..
We also tried to recreate it but still same issue.

I posted this in the forum in hope if someone else has experienced it before.

 

Anmærkning_2020-04-03_103628.png
 
Nicolai Pedersen Dynamicweb Employee
Nicolai Pedersen
Reply

You have this setting:

ShopsToIndex: 'SHOP8'

Could that be the issue?

Otherwise provide me with a link and I'll see what is going on.

 
Jannich Ariyanayagam
Jannich Ariyanayagam
Reply

Link to site: http://lhi-staging.nozebrahosting.dk/

we index the specific shop because we have multiple shops and if we just index the whole thing we can search products from the other shop.

 
Nicolai Pedersen Dynamicweb Employee
Nicolai Pedersen
Reply

Hi Jannich

Hm - this was a difficult one. I have changed the bulk size on the solution from 500 to 1000 and that seems to fix the issue - see dump. 

I think this id due to an error in indexer that handles the count of records that needs to be build and that is being build. It has been fixed in late 9.7 versions.

But right now it seems to work on this installation.

Sorry about the inconvenience - and have a happy easter!

BR Nicolai

Capture.JPG
 
Jannich Ariyanayagam
Jannich Ariyanayagam
Reply

Hi Nicolai,

Awesome!

I will test if products dont disapear from frontend and get back to you hope it works!

Happy easter to you to :)

Best regards Jannich

 
Peter Hansen
Reply

Hi Nicolai,

 

I took over the testing from Jannich, and am pleased to inform that this does indeed seem to fix the issue.

Thank you very much!

 

Best regards

Peter

 

You must be logged in to post in the forum