Ever wonder how Google sees your site? Ever wish you could click a button and correct all of your site’s search engine woes? As it turns out, you can, at least to a certain extent. Webmaster Tools is a free product from Google that allows you to interact with the world’s most (in)famous search engine spider and indicate how your site should be indexed.
 |
Getting StartedHead over to Google Webmaster Tools (you’ll need a Google account to log in) and type your URL into the text input box. Make sure that you precede it with “www” if you intend to set that as your preference later on, because Google won’t allow you to upload a sitemap if your domain here doesn’t match your preferred domain later. Click the “Add Site” button once you’re sure. That’s enough to get you in. Before you can really use the console, though, you’ll need to verify your site. This is a very simple process if you have FTP access. Click the “Verify your site” link. On the next page, select “Upload an HTML file” from the “Choose verification method…” drop-down (you can use a Meta tag if you want, but I find the file method to be less of a hassle). You’ll be given a file name like “google#.html”, where the hash mark is a string of alphanumeric characters. Just open your favorite text editor, save a blank file by that name, and upload it to your site’s base directory. Click the “Verify” button and you should be ready to dig in. |
 |
OverviewOnce you’re in, you’ll immediately see when your site was last crawled and whether or not it is included in the index. Like a lot of Google’s Webmaster Tools, these are good indicators of possible problems. Obviously, a recent crawl date and proper inclusion are preferable. If you’re not included, Google will give you clues as to why. |
 |
DiagnosticsHere you’ll see any problems Googlebot has had trying to crawl your site. This includes pages that couldn’t be accessed for one reason or another, why they were inaccessible, and what sort of crawl (web or mobile) was attempted. Ideally, you don’t want anything to show up here, so be sure to review and, if possible, resolve every error that you see. |
 |
StatisticsEverything under Statistics is potentially interesting but not necessarily vital. You can see the top queries your site shows up for, which ones bring the clicks, what words are used in links to your site, what your PageRank distribution looks like, and how many subscribers you have. As Darren Rowse has pointed out, the subscription counts only include Google feed readers, and the numbers don’t often match up with FeedBurner, so be ready for some disparity. If you’re interested in more of this sort of data, I suggest checking out Google Analytics. |
 |
LinksThe Links tab shows you where your pages are linked, both externally and internally. It’s a far cry from Google’s “link:” operator, providing a breakdown of almost every page that links to your site. The important thing here is not to get overly excited about a large link count. For starters, link juice is about quality, not quantity. Secondly, Webmaster Tools doesn’t distinguish between followed and nofollowed links. So, by all means, scope out the pages that are linking to yours; just don’t expect all of them to be valuable. |
 |
SitemapsObviously, you won’t see much here until after you’ve added a sitemap. If you’ve got a WordPress blog, the sitemap generator plugin is a quick way to automate the process. Once you’ve added your sitemap, you can see when it was submitted, when it was downloaded, and whether or not there were any errors reading it. Don’t forget to add a sitemaps autodiscovery line to your robots.txt to make sure other search engines can find it also. |
 |
ToolsThe Tools section deserves its own special attention because it provides most of the features you can use to communicate with Google.
|
 |
Dashboard ToolsYou may have thought that was all there was, and you’d be partly correct. That’s all Google gives you on a site-specific level. If you click back out to the dashboard, however, you’ll notice several other menu options to the right of your site list.
|
More to Come…
Google’s way ahead of the game with Webmaster Tools, giving us the unprecedented ability to monitor how Googlebot interacts with our site. More importantly, they seem to come out with new Webmaster Tools on a regular basis. Learn it, love it, and check out the Google Webmaster Central Blog for regular updates.
About Gregory Ciotti
Hi, I'm Gregory Ciotti. I currently lead the content marketing team that manages Shopify's ecommerce and retail publications.
I just set the tools up for my site. I had been intimidated by the whole process. Wow, that was much easier than i had dreamed. And the amount of info, the jump start that you get fro using the tools is awesome. I know that i am just started with the tools but your descriptions are spot on. Thanks for the post and the help with some of the definitions.
Nice artticle. I bve been using their service and it help me to find thise dead links at my blog.
Interesting article. I’ve used the tool with a prior website, but the Google webmaster tools don’t seem to work with blogger. There is nowhere to upload the html file, and the meta tag is refused as soon as one tries to publish it. Google doesn’t seem to acknowledge the problem, but continues to promote the webmaster tools to its blogger community.
Thank you for this! very helpful!
very good article. useful and informative.
thanks for all the information you give
Brown
Thanks for that brief guide with Google’s Webmaster Tools, it helps alot especially for those online marketers and those who have PPC Campaigns
plz explane me every details,how can i paste google search box in my blog.my site is complete but not there googe search box.without google search box i do not creating extra incom.
thank u
Nice job!
That was pretty useful, thanks. I didn’t even know such tools existed.
There’s an error in Google Webmaster Tools, it isn’t accurate in the `pages that link to yours option
In this article explains it: Error in Google Webmaster Tools
Also there is a online tool to count and view the real amount of pages that links to any site: Who links to me
That’s a really nice tool. I’m itching to get my site index so I can play with all the features!
Thanks for the advice Stephen. I looked into this and only a small portion of my new content is showing up.
It looks like my old Drupal based site is still fully indexed but my new WordPress site has not been indexed properly. I have added a “Disallow: /drupal/” field to my robots.txt file to eliminate the old drupal website links but it doesn’t appear to be working correctly.
Any ideas on what may be causing this?
Thanks for the tutorial, useful and helps explain what needs to be done. Thanks again
There is something to be said for using robots exclusion to combat duplicate content issues. However, this is much better handled by good site architecture. I would never recommend removing your archive and category pages from the index. Rather, I’d say you’re better off using snippets or just links to minimize the problem while keeping those pages indexed.
As for duplication problems on blogs in general, my experience inclines me to believe that Google understands blogs. Unless your site has poor enough architecture that the same huge block of text is repeated more than a handful times across the site, I doubt Googlebot will take much notice.
great tools, i had a few ive no used, thanks for the tips!
Stephen, I will have to disagree with you here 🙂 .
Consider a WordPress blog that has full posts all over the places, like single post pages, yearly archives, categories and search results.
Each single post page could be receiving a penalty due to the duplicate content issue, and with a robots.txt file you could remove the categories and archives pages from indexation, improving the ranking from the single post page.
I agree robots.txt wont do miracles, but they might help to fix indexation problems and increase rankings in some extreme cases.
Hi Paula. I hate to be the bearer of bad news, but a robots.txt file will do nothing for your search engine rankings. Its only function is to tell search engines which pages they shouldn’t index. If your goal is higher rankings, I suggest checking out SEOmoz’s list of search engine ranking factors and/or listening to Matt Cutts.
Thanks, Daniel.
After reading your post I realized I had my robots.txt file in the wrong place on one site, and was missing it totally for 3 other sites!
I hope to God this improves my traffic.
Great post. Good insight. Nice work.
Paula
Keith, I wouldn’t be too concerned. If Googlebot is visiting your site, this is most likely a reporting issue rather than a crawling issue. To be sure, check to see if any of your most recent posts have made it into the Google index (query site:yoursite.com). If they have, you shouldn’t have anything to worry about.
I have been using these tools for some time now. However, for some reason Google shows that the last time GoogleBot accessed my homepage was almost a month ago. However, I can see via the Bot Tracker WordPress plugin that GoogleBot has still been accessing my homepage on a regular basis (at least a couple times a day).
Should I be concerned about this? I don’t see any obvious errors in the Google Webmaster tools that would lead me to believe that I have a site design problem.
Thanks in advance! – Keith
Brilliant article! This will be added to my Weekly Roundup links this week – thanks for sharing this with us. I use Google Webmaster Tools and many other webmaster tools that are offered by other companies. This should help me make the most of Google Webmaster Tools.
I believe it was Carnegie that said “Put all of your eggs in one basket and watch that basket”
He did ok for himself by watching that basket.
nice article, I did a similar one a few weeks ago as well
Haha Stephen, that was funny.
Nice artticle. I bve been using their service and it help me to find thise dead links at my blog.
Mike, you’re correct that it’s inadvisable to “put all your eggs in one basket” by optimizing solely for Google. However, it’s worth noting that good communication with search engines is pretty universal. If you use the feedback from Google Webmaster Tools, it can only help to improve your rankings overall, not just in Google.
As for me, I can’t help but feel like Google’s just about the best thing since sliced bread. Gmail, Google Talk, Google Docs, Google Webmaster Tools, Google Analytics, Google Reader, Google AdSense, Google AdWords, and, of course, Google Search are all a part of my everyday life. As I like to say, I’ll be at the head of the line the day Google starts indexing brains. 😉
Mike, you can’t argue with the fact that they provide excellent stuff though.
The search engine is the most accurate, AdSense-AdWords is the best online advertising model ever, and so on.
Yet I agree with you that it is not good for anyone except for Google if they solidify their monopolistic position.
It’s so tough to always hear about google. I wish there would be a better, more relevant search engine to battle them. Google has buried many good online businesses for no reason. I realize putting all your eggs in the google basket is not wise business, but I’ve heard of some horror stories of legit sites be obliterated by them.