There are many ways to organize pages on a site. Unfortunately, some common techniques of organizing information can also harm your SEO strategy.

Sites organized by a hierarchy determined without reference to SEO might not be ideal because the site architecture is unlikely to emphasize links to information a searcher finds most relevant. An example would be burying high-value keyword pages deep within a sites structure, as opposed to hear the top, simply because those pages don’t fit easily within a “home”, “about us”, contact” hierarchy.

In this article, we’ll look at ways to align your site architecture with search visitor demand.

Start By Building A Lexicon

Optimal site architecture for SEO is architecture based around language visitors use. Begin with keyword research.

Before running a keyword mining tool, make a list of the top ten competitor sites that are currently ranking well in your niche and evaluate them in terms of language. What phrases are common? What questions are posed? What answers are given, and how are the answers phrased? What phrases/topics are given the most weighting? What phrases/topics are given the least weighting?

You’ll start to notice patterns, but for more detailed analysis, dump the phrases and concepts into a spreadsheet, which will help you determine frequency.

Once you’ve discovered key concepts, phrases and themes, run them through a keyword research tool to find synonyms and the related concepts your competitors may have missed.

One useful, free tool that can group keyword concepts is the Google Adwords Editor. User the grouper function – described here in “How To Organize Keywords” to “generate common terms” option to automatically create keyword groupings.

Another is the Google Contextual Targeting Tool.

Look at your own site logs for past search activity. Trawl through related news sites, Facebook groups, industry publications and forums. Build up a lexicon of phrases that your target visitors use.

Then use visitor language as the basis of your site hierarchy.

Site Structure Based On Visitor Language

Group the main concepts and keywords into thematic units.

For example, a site about fruit might be broken down into key thematic units such as “apple”, “pear”, “orange”, “banana” and so on.

Link each thematic unit down to sub themes i.e. for “oranges”, the next theme could include links to pages such as “health benefits of oranges”, “recipes using oranges”, etc, depending on the specific terms you’re targeting. In this way, you integrate keyword terms with your site architecture.

Here’s an example in the wild:

The product listing by category navigation down the left-hand side is likely based on keywords. If we click on, say, the “Medical Liability Insurance” link, we see a group of keyword-loaded navigation links that relate specifically to that category.

Evidence Based Navigation

A site might be about “cape cod real estate”. If I run this term through a keyword research tool, in this case Google Keywords, a few conceptual patterns present themselves i.e people search mainly by either geographic location i.e. Edgartown, Provincetown, Chatham, etc or accommodation type i.e. rentals, commercial, waterfront, etc.

Makes sense, of course.

But notice what isn’t there?

For one thing, real estate searches by price. Yet, some real estate sites give away valuable navigation linkage to a price-based navigation hierarchy.

This is not to say a search function ordered by house value isn’t important, but ordering site information by house value isn’t necessarily a good basis for seo-friendly site architecture. This functionality could be integrated into a search tool, instead.

A good idea, in terms of aligning site architecture with SEO imperatives, would be to organise such a site by geographic location and/or accommodation type as this matches the interests of search visitors. The site is made more relevant to search visitors than would otherwise be the case

Integrate Site Navigation Everywhere

Site navigation typically involves concepts such as “home”, “about”, “contact”, “products” i.e. a few high-level tabs or buttons that separate information by function.

There’s nothing wrong with this approach, but the navigation concept for SEO purposes can be significantly widened by playing to the webs core strengths. Tim Berners Lee placed links at the heart of the web as links were the means to navigate from one related document to another. Links are still the webs most common navigational tool.

“Navigational” links should appear throughout your copy. If people are reading your copy, and the topic is not quite what they want, they will either click back, or – if you’ve been paying close attention to previous visitor behaviour – will click on a link within your copy to another area of your site.

The body text on every page on your site is an opportunity to integrate specific, keyword-loaded navigation. As a bonus, this may encourage higher levels of click-thru, as opposed to click-back, pass link juice to sub-pages and ensure no page on your site is orphaned.

Using Site Architecture To Defeat Panda & Penguin

These two animals have a world of connotations, many of them unpleasant.

Update Panda was an update partly focused on user-experience. Google is likely using interaction metrics, and if Google isn’t seeing what they deem to be positive visitor interaction, then your pages, or site, will likely take a hit.

What metrics are Google likely to be looking at? Bounce backs, for one. This is why relevance is critical. The more you know about your customers, and the more relevant link options you can give them to click deeper into your site, rather than click-back to the search results, the more likely you are to avoid being Panda-ized.

If you’ve got pages in your hierarchy that users don’t consider to be particularly relevant, either beef them up or remove them.

Update Penguin was largely driven by anchor text. If you use similar anchor text keywords pointing to one page, Penquin is likely to cause you grief. This can even happen if you’re mixing up keywords i.e. “cape cod houses”, “cape cod real estate”, “cape cod accommodation”. That level of keyword diversity may have been acceptable in the past, but it’s not now.

Make links specific, and link it to specific, unique pages. Get rid of duplicate, or near duplicate pages. Each page should be unique, not just in terms of keywords used, but in terms of concept.

In a post-Panda/Penquin world, webmasters must have razor-sharp focus on what information searchers find most relevant. Being close, but not quite what the visitor wanted, is an invitation for Google to sink you.

Build relevance into your information architecture.

On Feb. 25, 2011, Google released Panda to wreak havoc on the web. While it may have been designed to take out content farms, it also took out scores of quality e-commerce sites. What do content farms and e-commerce sites have in common? Lots of pages. Many with zero or very few links. And on e-commerce sites with hundreds or thousands of products, the product pages may have a low quantity of content, making them appear as duplicate, low quality, or shallow to the Panda, thus a target for massive devaluation.

My e-commerce site was hit by Panda, causing a 60% drop in traffic overnight. But I was able to escape after many months of testing content and design changes. In this post, I’ll explain how we beat the Panda, and what you can do to get your site out if you’ve been hit.

The key to freeing your e-commerce site from Panda lies at the bottom of a post Google provided as guidance to Pandalized sites:

One other specific piece of guidance we’ve offered is that low-quality content on some parts of a website can impact the whole site’s rankings, and thus removing low quality pages, merging or improving the content of individual shallow pages into more useful pages, or moving low quality pages to a different domain could eventually help the rankings of your higher-quality content.

Panda doesn’t like what it thinks are “low quality” pages, and that includes “shallow pages”. Many larger e-commerce sites, and likely all of those that were hit by Panda, have a high number of product pages with either duplicate bits of descriptions or short descriptions, leading to the shallow pages label. In order to escape from the Panda devaluation, you’ll need to do something about that. Here are a few possible solutions:

Adding Content To Product Pages

If your site has a relatively small number of products, or if each product is unique enough to support entirely different descriptions and information, you may be able to thicken up the pages with unique, useful information. Product reviews can also serve the same purpose, but if your site is already hit by Panda you may not have the customers to leave enough reviews to make a difference. Additionally, some product types are such that customers are unlikely to leave reviews.

If you can add unique and useful information to each of your product pages, you should do so both to satisfy the Panda and your customers. It’s a win-win.

Using Variations To Decrease Product Pages

Some e-commerce sites have large numbers of products with slight variations. For example, if you’re selling t-shirts you may have one design in 5 different sizes and 10 different colors. If you’ve got 20 designs, you’ve got 1,000 unique products. However, it would be impossible to write 1,000 unique descriptions. At best, you’ll be able to write one for each design, or a total of 20. If your e-commerce site is set up so that each of the product variations has a single page, Panda isn’t going to like that. You’ve either got near 1,000 pages that look like duplicates, or you’ve got near 1,000 pages that look VERY shallow.

Many shopping carts allow for products to have variations, such that in the above situation you can have 20 product pages where a user can select size and color variations for each design. Switching to such a structure will probably cause the Panda to leave you alone and make shopping easier for your customers.

Removing Poor Performing Products

If your products aren’t sufficiently unique to add substantial content to each one, and they also don’t lend themselves to consolidation through selectable variations, you might consider deleting any that haven’t sold well historically. Panda doesn’t like too many pages. So if you’ve got pages that have never produced income, it’s time to remove them from your site.

Getting Rid of All Product Pages

This is a bold step, but the one we were forced to take in order to recover. A great many of our products are very similar. They’re variations of each other. But due to the limitations of our shopping cart combined with shipping issues, where each variation had different shipping costs that couldn’t be programed into the variations, it was the only viable choice we were left with.

In this option, you redesign your site so that products displayed on category pages are no longer clickable, removing links to all product pages. The information that was displayed on product pages gets moved to your category pages. Not only does this eliminate your product pages, which make up the vast majority of your site, but it also adds content to your category pages. Rather than having an “add to cart” or “buy now” button on the product page, it’s integrated into the category page right next to the product.

Making this move reduced our page count by nearly 90%. Our category pages became thicker, and we no longer had any shallow pages. A side benefit of this method is that customers have to make fewer clicks to purchase a product. And if your customers tend to purchase multiple products with each order, they avoid having to go from category page to product page, back to the category page, and into another product page. They can simply purchase a number of products with single clicks.

Noindexing Product Pages

If you do get rid of all links to your product pages but your cart is still generating them, you’ll want to add a “noindex, follow” tag to each of them. This can also be a solution for e-commerce sites where all traffic enters on category level pages rather than product pages. If you know your customers are searching for phrases that you target on your category pages, and not specifically searching for the products you sell, you can simply noindex all of your product pages with no loss in traffic.

If all of your products are in a specific folder, I’d recommend also disallowing that folder from Googlebot in your robots.txt file, and filing a removal request in Google Webmaster Tools, in order to make sure the pages are taken out of the index.

Other Considerations: Pagination & Search Results Pages

In addition to issues with singular product pages, your e-commerce site may have duplicate content issues or a very large number of similar pages in the index due to your on-site search and sorting features. Googlebot will fill in your search form and index your search results pages, potentially leading to thousands of similar pages in the index. Make sure your search results pages have a rel=”noindex, follow” tag or a rel=”canonical” tag to take care of this. Similarly, if your product pages have a variety of sorting options (price, best selling, etc.), you should make sure the rel=”canonical” tag points to the default page as the canonical version. Otherwise, each product page may exist in Google’s index in each variation.

Maxmoritz, a long time member of our SEO Community, has been working in SEO full time since 2005. He runs a variety of sites, including Hungry Piranha, where he blogs regularly.

(A case study in being PRE negatively seo’ed)

Well it has been a fun year in search. Having had various sites that I thought were quality, completely burnt by Google since they started with the Penguins and Pandas and other penalties, I thought i would try something that I KNEW Google would love….. Something dare I say would be “bulletproof.” Something I could go to bed, knowing it would be there the next day in Google’s loving arms. Something I could focus on and be proud of.

Enter www.buymycar.com, an idea I had wanted to do for some time, where people list a car and it gets sent to a network of dealers who bid on it from a secure area. A simple idea but FAR from simple to implement.

Notes I made prior to launch to please Google and to give it a fighting chance were:

1. To have an actual service and not to be an affiliate. Google crushed my affiliate sites and we know they are not fond of them as they want to be the only affiliate I think.
2. To make sure the content was of a high quality. I took this so seriously that we actually made a point of linking out to direct competition where it helped to do so. This was almost physically painful to do! But I thought I would start as I meant to go on. I remember paying the content guy that helps me, triple his normal fee to go above and beyond normal research for the articles in our “sell my car” and “value my car” sections.
3. To make the site socially likeable. I wanted something that people would share and as such to sacrifice profits in the short term to get it established.
4. To give Google the things it loves on-site. Speed testing, webmaster tools error checking (even got a little well done from Google for having no errors, bless), user testing, sitemaps for big G to find our content more easily, fast hosting, letting it have full access with analytics…
5. TO NEVER, EVER UNDER ANY CIRCUMSTANCES PAY FOR A LINK. Yes, I figured I would put all the investment into the site and content this time. If it went how I had hoped perhaps I could find the holy grail where site’s link to us willingly without a financial incentive! A grail I had been chasing for some years. Could people really link out without being paid? I had once heard a rumour it was possible and I wanted to investigate it……

Satisfied I had ticked all the boxes from hours of Matt Cutts video’s and Google guidelines documents, I went to work and stopped SEO on all my smaller sites that were out of favour. I was enjoying building what I had hoped would be a useful site and kicked myself for not having done so sooner. I also thanked Google mentally for being smart enough now to reward better sites.

Fast forward 4 months of testing and re testing and signing up car dealers across the country and I decided to do a cursory check to see if anyone had liked what I was building and linked to it. I put my site into ahrefs.com and to my surprise, 13,208 sites had!! What was also nice was that all of them had used the anchor text “Buy My Car Scam” and had been so kind as to give me worldwide exposure on .ru, .br and .fr sites in blog comments amongst others.

In seriousness, this was absolutely devastating to see.

A worried competitor had obviously decided I was a threat and to nip my site in the bud with Google and attack it before it had even fully started. The live launch date was scheduled for January 7th, 2013! I was aware of negative SEO from other sites I had lost but not in advance of actually having any traffic or rankings. Now I was faced with death by Google rankings to look forward to before it had any rankings, add to that my site being cited as a scam across the Internet before it launched!

My options were immediately as follows:

1. Go back and nuke the likely candidates in Google who had sabotaged me. Not really an option as I think it is the lowest of the low.
2. Start trying to contact 13,000+ link owners to ask for the links to be removed. When I am heavily invested in this project anyway and have a deadline to reach, this was not an option. Also, Xrummer, Scrapebox or other automated tools could send another 13,000 just as easily in hours for me to deal with.
3. Disavow links with Google. To download all the links, disavow them all and hope that Google would show me mercy in the few months Matt Cutts said it takes to get to them all removed.
4. Give up the project. Radical as this may sound, it did go through my mind as organic traffic was a big part of my business plan. Thankfully I was talked out of it and it would be “letting them win.”

I opted for number 3, the disavow method but wondered what would happen if I kept being sent 10’s of thousands more links and how a new site can actually have any protection from this? To set back a site months in its early stages is devastating to a new on-line business. To be in a climate where it is done prior to launch is ridiculous.

Had I fired back at future competitors as many suggested I did, there would be a knock on effect that makes me wonder if in the months to come, everyone will be doing it to each other as routine. Having been in SEO for years I always knew it was possible to sabotage sites but never thought it would become so common and before they even ranked!

Robert Prime is a self employed web developer based in East Sussex, England. You can follow him on Twitter at @RobertPrime.