SDL Tridion sitemap/navigation rendering < 5s

By | November 24, 2008

Most websites use some form of sitemap xml for rendering the navigation blocks. In Tridion implementations this sitemap is usually rendered from the folder structure created by the content editors. The established way of doing this is by creating a component template which calls the Tridion API repeatedly and traverses the folder tree. Unfortunately opening a lot of folders and components through the Tridion API is a time and resource consuming activity.

Traffic jam in Tridion publishing queu

A traffic jam might occur in the Tridion publishing queue if you use the API for rendering the sitemap.

The method of traversing the tree will work fine if you have just one website in Tridion and not too many folders and components which need processing. Unfortunately most companies purchasing Tridion host more then one small website. Typical Tridion clients will manage the content of up to 50 websites in Tridion with thousands of components and folders per website. Most of these implementations suffer from a performance penalty in publishing content as a result of slow sitemap rendering.

In one implementation we needed to generate 13 sitemaps with a rendering time of 10-12 minutes each. With both a staging and live website (a typical tridion production setup) needing a new sitemap at least once an hour this meant the rendering of 26 sitemaps per hour. Needless to say that this would put a huge strain on rendering resources.

The solution to this problem is in NOT using the Tridion API for rendering the sitemap. In the case mentioned above I created a program which queried the filesystem of the presentation server. The program is capable of rendering the sitemap in well under 5 seconds. Which is roughly 100 times faster then the alternative. On the staging server the program runs every minute to give the content editors a near realtime experience. On the live server it is scheduled to run every 5 minutes.

The drawback of taking resources from the presentation server can be remedied by running the program on the lowest possible priority. When running in low priority the program will only use the idle time of the presentation server for rendering the sitemaps.

Other options:

  • Querying the Tridion broker DB. To do this you need to make sure that every component knows its parent. This option can be used for websites using a dynamic publishing strategy.
  • Maintaining the sitemap via the Tridion event system (not recommended, I will go into detail on the event system some other time).

3 thoughts on “SDL Tridion sitemap/navigation rendering < 5s

  1. Pingback: SDL Tridion Folder | Albert te Boekhorst

  2. Dominic Cronin

    I wouldn’t say that the “established way” of generating a site map in Tridion is to traverse the structure via large numbers of API calls. Far from it; there are various much more efficient approaches that are in widespread use. Mostly the technique involves a recursive GetListItems at publication level (i.e. a single API call), and then some XSLT. In practice you will probably use more than one API call, but a full traversal is way over the top.

    That’s not to say that there’s anything wrong with your technique, just that the comparison with CMS-side techniques isn’t fair.

  3. Pingback: My Technical Stuff

Leave a Reply

Your email address will not be published. Required fields are marked *