Monthly Archives: June 2009

SEO Discovery Checklist – Initial Accessibility Assessment

What do you do if the number of pages indexed in the search engines drops by half? Is there a problem? Is it the typical, gyrating flux of the search engine’s algorithm or has the 900 pound gorilla just dumped a number of poor quality or duplicate pages from their index? These are important questions that will help you diagnosis the issue(s) quickly so you can move on to making great content and a more successful website.

To help answer these types of questions, former Google alumni, Vanessa Fox (best known for her work creating Google Webmaster Central and as a Google spokesperson) has put together a nifty little Discovery Checklist to help people work through their indexing crisis.

We’ve used a similar list for years, but find Vanessa’s version to be a bit more sexy for sharing (okay, we admit, it’s so much better than ours). However, we felt we could make it even more useful for our audience. So in the spirit of giving we’ve added some of the tools and techniques we use in practice to accomplish many of the items on her wonderful list.

Vanessa likes to say that “just because you have a traffic problem it doesn’t mean you have a ranking issue.” In fact, your problems could be closer to home and have everything to do with the way search engines crawl (or fail) to crawl your website.

Today I’ll cover the first three points under the Initial Accessibility Assessment:

  • Is the site indexed?
  • Are the URLs from the XML Sitemap indexed?
  • Are the right pages indexed (without duplicates)?

Is the site indexed?

The best place to start is with the search engines themselves. Search for site:www.yourdomain.com.au in Google, Yahoo and Bing. If your site is indexed you’ll see a list of pages from your website as shown below for janeandrobot.com:

janeandrobot-index

You can also use url:www.yourdomain.com.au/page/in Bing.com to identify whether an individual page is in the index.

Are the URLs from the XML Sitemap indexed?

For Google, take a look at your Webmaster Tools account to verify that the URLs in your XML sitemap are indexed. Under Site configuration you should find some detail on the number of URLs submitted via your sitemap and the number of pages indexed in Google as shown below. If everything is in order the two numbers should be within 10% of each other.

webmaster-tools-xml-page-verification

If you see a big discrepancy, then you clearly have a problem and need to dig deeper.

For a small website, you can also do a quick manual check. However, if you have tens of thousands of pages in your XML sitemap the process will be a bit more challenging. We fortunately have our own crawler that does this menial work for us and makes analyzing larger sites a piece of cake.

Are the right pages indexed (without duplicates)?

Here you need to check that the search engines are not seeing duplicate pages. This step is critical if you have a dynamic website that uses parameters in the URL (http://www.yourdomain.com.au/details.cfm?categoryid=27&subcategoryid=102). With dynamic websites, it’s possible to have a product reside in more than one category which means potential duplicate content issues and poor rankings for these pages.

In the following example, you can see that Google is seeing multiple versions of the Officeworks’ home page noted by the identical Title tag and URL as well as few other pages that should probably be excluded:

officeworks-index-listings

Not a great outcome for any business. To prevent this issue from happening, it’s important to identify and nominate the key page you want the search engines to focus on. You can use the canonical tag (i.e. <link rel=”canonical” href=”http://www.officeworks.com.au/retail/content/Home”/>) or if possible place a Meta NOINDEX tag (i.e. <meta name=”robots” content=”noindex” />) on the duplicate pages to keep them out of the index.

Stay tuned, for more insight into Vanessa’s Discovery Checklist on:

Posted in SEO | 1 Comment

Top Viral Video of the Week

Here’s our second installment of the “Top Viral Video of the Week” series.

Not sure if this can be considered “viral” just yet, as it’s only been viewed some 36,400 times, but it’ll defintely give you a laugh on this dreary Friday afternoon (although maybe not for those easily offended)!

Bud Light’s commercials always employ the same sense of humour that make them so popular online. I think this will soon become just as popular as the Bud Light Swear Jar ad.

One of the best things about online video campaigns is that advertisers have more creative freedom, unlike traditional television advertising, which can be more restrictive in terms of cost, reach and censorship. In the online space, brands are able to reach a much larger audience and engage users who typically are already interested in the product.

What do you think of the new Bud Light ad? Is it worthy of becoming viral?

Posted in Social Media, viral | Tagged , , , , | Leave a comment

What Does Microsoft’s Bing Mean to Search?

For those around who still care about the other search engines, Microsoft launched their highly anticipated new search engine called Bing. Touted as the Decision Engine, Microsoft has high hopes for Bing in challenging the Google juggernaut from increasing its market share.

Microsoft Bing's Home Page

At first glance, Bing provides offers up a simple search interface (a lot like Google). The search results display is clean (like Google) and of course the name is catchy (much like Google).

But what about relevancy?

Like most things in life, if you can’t give people what they want, they’ll go elsewhere or at the very least stay where they are.

From the few hundred searches we’ve done so far, the relevancy appears to be slightly better than the old Live results. However, Bing, like Live, places a lot of weight on the domain name, especially for generic terms. The end result: You get a lot more websites like www.car-rental-sydney.com showing up for queries like ‘Sydney car hire’ (see the second organic listing in the example below). On other words, many websites with keyword optimised URLs gain more awareness than they deserve, largely based on the domain name.

Search Results from Bing for "Sydney Car Hire"

Can Bing win market share from Google?

With Google’s growing market dominance there are plenty of people who’d like to see a more equitable split between Microsoft, Yahoo and Google, especially in Australia where we have more than enough de facto monopolies. More competition would be a win for all of us, even Google as it would help keep them honest and their egos from getting too big.

Unfortunately, Bing’s results are not ground breaking enough to supplant Google. In fact, I’d argue Microsoft still has a lot of work to do improve relevancy. We found a number of irrelevant results that left us scratching our heads.

A search in Australia for ‘amplify’ returns old pages no longer live on our site! Clearly an updated index is badly needed. Searches on ‘health insurance’ and ‘travel’ in Australia returns positively bizarre results. Try it for yourself and see how Bing’s results compare to Google’s. Like us you’ll likely agree Microsoft has a lot of work on its plate to challenge Google.

Even if Bing improves the relevancy of their search results though, one has to wonder whether it will be enough to make people switch. We are, after all, creatures of habit. If it’s not broken, there’s very little chance Bing will make much of a dent, even with the expected marketing weight of Microsoft behind it.

What does Bing mean for Search Engine Optimisation (SEO)?

The short answer is not much… at least not today. While, I’m certain the Microsoft engineers will be tweaking the algorithm to improve relevancy over the coming weeks, the pessimist in me doesn’t believe it will be much help. Google isn’t broken and unless you have something better – and better out of the gate when you’ve got max visibility –  it’s just not going to be enough to make us Bing.

However, if Bing does manage to wrestle some of Google’s search market share away, the entire search marketing industry may have to invent a new service called Decision Engine Optimisation (DEO)! We can only hope…

Posted in Search Engines | Tagged , , , , , , , , , | 7 Comments

Harvey Norman won’t play ball online… But you can!

So we all know Harvey Norman and other major retailers in Oz haven’t made a serious go of it online. And in the breach discount outfits have come in and made a killing while the giants slept…

Online Retail in Australia – Find your niche and go for it!

Joel Montgomery of Powerbuy, an online computer and server cashback outfit, highlights how anyone who can find a niche in the market place and with industry knowledge and a little SEO savvy to boot, can join in on the online retail revolution while major Aussie players like Harvey Norman are asleep at the wheel.

Ingram Micro – Opening the Flood Gates

Montgomery explains: “Major IT retailers are increasingly finding it difficult to compete with smaller (more nimble) online businesses who these days can set up online stores with minimal cost and hassle. Ingram Micro’s Techlink4U technology allows small IT computer suppliers to quickly establish a fully-functional, online presence capable of competing with the big stores from as little as a few hundred dollars per month.”

The Key – Online Retail with Low Overheads

Using Ingram Micro‘s technology, your small online store can  integrate into Ingram Micro’s logistic system (the largest I.T. distributor in Australia) which enables you to operate with extremely low overheads. You can  thus compete with minimal mark-ups on product cost.

Industry Knowledge + SEO Knowledge = $$$

According to Montgomery, many savvy consumers and businesses are now attracted to low-cost stores thanks to web robots such as StaticIce & ShopBot that rank online stores by product model and price. The evolution of the cookie-cutter online store and web robots is helping consumers save whilst taking significant share away from bigger players.

With a good grasp of what you want to sell and some solid SEO knowledge, there’s plenty of opportunity in the Australian market for smaller players to carve out their piece of the pie at the expense of the category leaders.

The Downside for Consumers

The trade-off for consumers, however, is that when they buy from low-cost stores and internet start ups the speed and predictability of delivery and (especially) the post-sales support is nowhere as good as what they’ve come to expect from Tier-1 retailers.

The Upside for Everyone Involved

But with role models like Amazon and local online retailers now showing the way, there’s little reason why a savvy retailer could not provide consumers with as good (if not better) an experience than Australia’s retail giants.

Start your Own Online Business

Know a bit about IT? Have some knowledge of SEO and how to get your site ranking on search engines? Maybe it’s time you took the plunge…

__________________________________

Thanks to young entrepreneur and online retail startup extraordinaire ,Joel Montgomery of Powerbuy.com.au, for sharing his thoughts on the online retail landscape in Australia.

Full disclosure: Amplify did some consulting work for Powerbuy this year.

Posted in Online Retail | Tagged , , , , , , , , , , , , | 1 Comment

New Officeworks Website Creates Havoc for Search Engines

A few weeks back, we used Officeworks’ as an example of what not to do when it came to launching a new website. Their clear lack of a migration plan led to a poor user experience (visitors who found an old listing in Google were shown a really poor 404 page) and unfortunately lost investment for the business (as thousands of previously optimised pages in Google were soon dumped from the index only to be replaced by inferior pages from the new website).

Of course, we’ve been keeping a close on Officeworks since they first launched their new website in late April 2009 to see how it all unfolds. From our hands on experience helping clients like Webjet, Carsguide and Truelocal we know that you cannot ignore the history of the old website. Doing so, especially for a large ecommerce business that already has strong existing placement in search engines can lead to hundreds of thousands of lost visitors, sales and millions of dollars in lost revenue over months and years if it is not corrected.

While we have noticed some improvements since our initial post (Officeworks is now using a 301 redirect to direct visitors to the new product pages), we are now seeing some other troubling issues, likely due to the implementation of the new SAP ecommerce system and lack of QA testing prior to launch. These issues, if left as is will likely cause unforeseen headaches for Officeworks in the search engines for some time to come.

So what did we find?

  1. Duplicate content – multiple instances of the same pages in the index as a result of session IDs
  2. Inferior content – automated pages created by the search engine crawlers

Duplicate Content

Shortly after launch we discovered that Google was indexing multiple versions of the home page due to the session ID used in the URL. A session ID is the most common method used by websites to collect data about a particular visitor as they use the website. Most websites only store a session ID using a cookie, so crawlers will ignore them. Officeworks however has decided to place the session ID in the URL when cookies are not accepted. Unfortunately, this is notoriously bad for search engines, often resulting in duplicate content issues.

For large sites, several spiders from the same search engine may visit at once. As a result each will be given their own session ID. While the content may be identical, the URLs are different each time, leading the crawlers to interpret the content as duplicate and thereby suppressing the content in the index.

In other words, Google is seeing the home page as a separate page each time it visits the website. This issue can be seen clearly in the following example:

sessionids-google

Here we can see three versions of the home page that Google has crawled and indexed, each with a different session ID appended to the URL. Even though it’s clear that Officeworks is not up to any dirty tricks, Google will still suppress the value of the home page in this case. We also found examples of multiple listings for many other category and product pages in the index. As we know from the previous post, duplicate content will make it more difficult for Officeworks to achieve top placement in the search engines, especially when it comes to some of the more generic terms around office gear.

The quick fix is to only use cookies to track session IDs. First party cookies (the ‘safe’ cookie used for tracking session IDs) are a requirement for using most websites today so Officeworks customers will experience no loss in usability. In addition, Officeworks should add the canonical link to all of the pages to ensure the search engines apply the value from the duplicate pages to a single source.

Note: To view these pages in person type in site:www.officeworks.com.au into Google and click through to some of the deeper pages (i.e. go past page 500 to see some of the more interesting findings).

Inferior Content

A further handicap from the use of session IDs is that Google is now indexing a high proportion of inferior pages that have little or no resemblance to the actual category or product pages represented on the site.

By following the links (with the session IDs appended) throughout the website Google is able to effectively add products to the shopping cart or wish list in effect creating additional and irrelevant pages of content for the index. We can see this result more clearly in the following example:

wishlist-in-google

Here we can see that Google’s crawler is able to add products to the Officeworks’ wish list thereby creating new pages. If you happen to click the third listing in the results shown (you need to turn cookies off in your browser) you’ll find the products below added to the wish list:

Example of Wishlist page in Google Index

Example of Wishlist page in Google Index

While most people will never see these pages (unless they specifically search for My Wish List) they are still problematic, especially when it comes to achieving strong search rankings. Unfortunately, as these types of pages are created and indexed they began to compete with other more valuable content on the website. The end result is that Officeworks will end up with thousands of pages with little or no actual content in the search indexes that pulls down the rankings for higher quality pages.

Since the launch of the website, Officeworks’ pages indexed in Google have increased from approximately 7200 pages to over 9500. While this increase would be beneficial if each of the pages indexed provided unique content, in this case, the inferior content will only complicate matters for Officeworks.

Conclusion

While I’m certain there’s been plenty of learning within Officeworks (especially as we’re beginning to see some of these issues like session IDs cleaned up), there are a few key points for the rest of us to learn from to avoid the same pain.

  1. A migration plan is essential when you’re redesigning a website, changing domain names or just reworking the information architecture. If you fail to plan, you plan to fail.
  2. Quality assurance is critical. Some of these issues could have been spotted prior to launch had Officeworks ran specific Q A scripts to test whether the bots are able to effectively crawl the website. At the very least, you need to monitor what the search engines pick up after launch to determine the best course of action.
  3. Do not trust the technology vendor to deliver a product that is search friendly. Do your homework and ensure the system does what you’re being sold.

Of course, there are no guarantees that you’ll have a smooth transition. But if you take the right steps, you can manage the big issues that cause havoc and react quickly to any surprises that pop up along the way. By doing so, you can avoid becoming the next casualty and lesson.

Posted in SEO, website migration | 9 Comments

All You Need to Know About Google Wave

The next big thing? How will it effect email and internet messaging?

Check out the latest creation from Lars (Google Maps) and the boys and girls at Google Sydney… Due out later this year!

Google Wave Demo

Posted in email | Tagged , , , , , | Leave a comment