Developer forum

Forum » Dynamicweb 10 » sitemap.xml duplicated urls

sitemap.xml duplicated urls

E-mail notifications
Peter Krusell
Reply
Posted on 07/11/2025 12:58:54

Hi,

We noticed that https://webshop.unisport.com/sitemap.xml includes way to many URLs.

It seems URLs are duplicated 6 times, in this example the swedish site startpage:
Same thing with the contact page on the danish site, and a few other random checks:


6 times are as many as there are acive / published sites in the solution:

 

Searching for the swedish site locale prefix shows that the whole URL structure for the swedish site appears many times further down in the XML file, duplicated.

The main problem this creates is that there this an error in google search console saying that the sitemap.xml is to large for google to use.

Advice and help please.
 

Best regards
/Peter


Replies

 
Peter Krusell
Posted on 07/11/2025 13:02:04
Reply

Hi again,
I also see that there are URLs included from a site that is neigher active or published.

Best regards
/Peter

 
Peter Krusell
Posted on 07/11/2025 14:35:14
Reply

Hi again,

One more thing :-) 
A lot of Canonicalised URLs are also included in the sitemap.

 

Best regards,
/Peter

 
Nicolai Pedersen Dynamicweb Employee
Nicolai Pedersen
Posted on 07/11/2025 16:30:41
Reply

Hi Peter

I can confirm there is a bug that can cause duplicate URLs in sitemap.xml - I just made a pull request to fix the issue.

https://doc.dynamicweb.dev/documentation/fundamentals/dw10release/releasenotes/workiteminfo.html?workitemid=26256

I will look into the canonicalized urls - do you have the same products in multiple groups?

 
Peter Krusell
Posted on 07/11/2025 16:58:58
Reply

Hi Nicolai,

Thanks for quick action.

Yes the client has put some products in multiple groups. They have not explicitly set a Primary Group, at least in the random case I checked here. So I guess the system pick one location to use as canonical in this case?



Best Regards,
/Peter

 

You must be logged in to post in the forum