× About Us Blog

Google Posts

Google Bot Crawl Budget Optimisation

Google Bot Crawl Budget Optimisation

Google Bot Crawling Websites

If you are new to search engine optimisation and not sure what spiders or Google bot crawlers are then research this before carrying on with this article. When carrying out a Google search you are not searching the world wide web. You are actually searching Google’s index of the web. Or at least as much of it as Google can physically find. This is carried out with software programs which are known as spiders.

Spiders start by fetching a few websites and then they follow the backlinks on those pages. Once hitting those pages they then follow the links on those webpages until it has indexed as much of the internet as possible. I can tell you one thing for sure that in any industry, crawl budget is something we can and certainly should be optimised for SEO success. Here is a great article that explains how to optimise your crawl budget but below will explain this also.

What is a Crawl Budget?

A Crawl budget is time spent on your website, or the number of pages Google allocates to crawl on the site. Google bot crawl budget is the number of pages Google will crawl on your site on any given day. This number varies slightly from day to day, but overall it’s relatively stable. The number of pages Google crawls, your “budget”, is generally determined by the size of your site, the “health” of your site (how many errors Google encounters) and the number of links to your site.

Indexing Pages

Google doesn’t always spider every page on a site instantly. In fact, sometimes it can take weeks. This might get in the way of your SEO efforts. Your newly optimised landing page might not get indexed. At that point, it becomes time to optimise your crawl budget. Indexing pages is certainly the most important part of SEO because without a page indexed means it cannot be seen anywhere in the search results. It might crawl 4 pages a day, it might crawl 8,000 pages, it might even crawl 5,000,000 pages every single day but this all depends on many factors to do with your site.

Google Bot Crawl Budget

How Does a Crawler Work?

A crawler like Googlebot gets a list of URLs to crawl on a site. It goes through that list systematically. It grabs your robots.txt file every once in a while to make sure it’s still allowed to crawl each URL and then crawls the URLs one by one. Once a spider has crawled a URL and it has parsed the contents, it adds new URLs it has found on that page that it has to crawl back on the to-do list.

Several events can make Google feel a URL has to be crawled. It might have found new links pointing at content, or someone has tweeted it, or it might have been updated in the XML sitemap, etc etc… There’s no way to make a list of all the reasons why Google would crawl a URL, but when it determines it has to, it adds it to the to-do list.

Crawl Budget Issue Checks?

To quickly determine whether your site has a crawl budget issue, follow the steps below. This will check whether the Google bot is taking too long to try and index all your pages:

  1. Determine how many pages you have on your site, the number of your URLs in your XML sitemaps might be a good start.
  2. Go into Google Search Console.
  3. Go to Crawl -> Crawl stats and take note of the average pages crawled per day.
  4. Divide the number of pages by the “Average crawled per day” number.
  5. If you end up with a number higher than 10 (so you have 10x more pages than what Google crawls each day), you should optimise your crawl budget. If you end up with a number lower than 3 this is perfect.

Every SEO specialist should be looking at these steps. If a client’s website or one of your own money sites has plenty of blog posts then perhaps re-purposing this and 301 redirecting to strengthen a money page is the option. This will remove any Content Cannibalization issues your site might have. But make sure you do not remove any pages which are ranking or bringing you traffic. Also you need to make sure you have plenty of supporting articles to theme the topic of your site.

Server Log Check

Depending on your type of hosting, you might not always be able to grab your log files. However, if you even so much as think you need to work on crawl budget optimisation because your site is big, you should get them. If your host doesn’t allow you to get them, change hosts.

You really should know which URLs Google is crawling on your site. The only “real” way of knowing that is looking at your site’s server logs. When you realise which pages constantly get crawled then start to open gateways to other pages with a real silo stucture strategy on your website to help the bots index the site more easily. As a rule of thumb I love to use the testing method that no matter what page the Googlebot lands on my site then within 4 clicks on contextual links they can land on any page on the website. This will pass link juice throughout the website and help with indexing it all.

Reduce Errors

Fixing your site’s crawl budget is a lot like fixing a car. You can’t fix it by looking at the outside, you’ll have to open up that engine. Looking at logs is going to be scary at first. You’ll quickly find that there is a lot of noise in logs. You’ll find a lot of commonly occurring 404s that you think are nonsense. But you have to fix them. You have to get through the noise and make sure your site is not drowned in tons of old 404s.

The more times these Googlebots come to a 404 error page the less likely all your webpages will be indexed. Use screaming frog to get check for any problems and then fix the issue as soon as possible. Make sure that the pages that are crawled return one of two possible return codes: 200 (for “OK”) or 301 (for “Go here instead”). All other return codes are not OK. To figure this out, you have to look at your site’s server logs or run a test. Get maintaining your website and giving a regular service.

Block Parts of The Site

If you have sections of your site that really don’t need to be in Google, block them using robots.txt. Only do this if you know what you’re doing, of course. But a common example of this is on your blog section having your tags and category pages indexed. These usually are lists of your articles with zero unique content and just start to add the amount of pages with title tags like “Blog Page 6” which means absolutely nothing. Simply no-index these pages to allow more time for the Googlebots to index your main articles you want to rank. Therefore you won’t be wasting your Crawl Budget on pages which don’t need to be crawled and don’t need to rank for anything.

Your .htaccess and robots.txt should not block the site’s important pages, and bots should be able to access CSS and Javascript files. At the same time, you can and should block content that you don’t want to show up in search. The best candidates for blocking are pages with duplicated content, ‘under construction’ areas of the website, dynamically generated URLs, and so on. The dynamically created pages like tags, image URLs and duplicated category pages need to all be no-index. This then will allow more time on site for the Googlebots to re-crawl your money pages. More crawls on a specific page = better rankings in the search engines. This is massively overlooked and you need to start looking at your CrawlRank more effectively.

Link Building to Inner Pages

Trying to get backlinks can be a difficult task. But if you can create multiple backlinks to inner pages this will certainly help. The reason for this is because you will be sending more Googlebots to the site and also get them starting in different areas of the area. Hopefully then with the silo of the site should index them all. The more links you can get which is quality of course the better. There is no point trying to build thousands of spammy links though because the crawlers do not even entertain the zero link juice backlinks so this would be irrelevant.

Freshness to Websites

Freshness of content on your website and freshness of links allows crawlers to keep returning. The more Googlebot spiders to reach your site the better your authority will be. Keep re-purposing old content, adding more value and then share these throughout your social profiles. Reach out to bloggers and reporters to see if they have any articles relevant to the website and if they can backlink to the website then happy days.

Keeping freshness of content sends the Google bots to your site. Pages that have been crawled recently typically get more visibility in the SERPs. In other words, if a page hasn’t been crawled in a while, it won’t rank well. Therefore, if your pages haven’t been updated in a while, they won’t get crawled, so they won’t rank as well. The SEO technique is to try and get the crawlers back to your site as many times as possible.

Important To Understand

It is really important to understand the importance on getting your site crawled as many times as possible. Therefore make sure with the silo you are making sure your money pages are certainly being linked to regularly. But also make sure you have a link building strategy to backlink to inner pages.

More crawls on a page = better rankings

Please leave a comment below if you have anything to add onto this article. We hope you enjoyed it and feel free to share it with others if you found it interesting.

Is Yellow Pages Business Advertising Value For Money?

Is Yellow Pages Business Advertising Value For Money?

If you are reading this article 10 years ago then the simple answer to the question is yes (congratulations your time machine works!). However, times have changed and now that you’re reading this in 2016 and beyond, probably on a touch screen device and not in a big heavy yellow book, then the answer is a resounding NO! Too many people are not moving with the times and keeping up with the new age of digital marketing when it comes to growing their business, no matter how large or small that business may be.

The Power of Google

Gone are the days of picking up that big yellow book and flicking through it to find the service you may need. Nowadays the majority of us go straight to Google to find what we’re looking for. In fact 80% of us have Google set as our internet browser’s homepage, so obviously that’s going to be the place that most of us look first.

Ask yourself how often you go to Yell.com to find a Coffee Shop in your local area for example. Most of us do that on Google, yet some businesses are continually paying way over the top to show up in the top results on Yell when a fraction of that could go towards getting their business on the first page of Google.

Where Does Yell Actually Rank?

I decided to put Yell.com to the test so I searched for ‘loft conversions in Manchester’ (because I am actually thinking about having my loft converted) and straight away I see 3 Premium Listings, one of them proudly displaying ‘15+ years with Yell’ on their ad. Hopefully they haven’t been paying for a premium listing all this time because I don’t even want to think about how much that might add up to. I put the same search to Google and find that Yell is ranking in the bottom half of the SECOND page on Google for the same search.

What that tells me is, even before clicking on the Yell result, there have been almost 20 other businesses that I could choose from before seeing the paid premium listings on Yell, and those businesses are likely spending much less compared to the top ones on Yell. In the digital age, strategies like SEO and organic search engine ranking are much more valuable to companies than these directory listings.

Boosting Enquiries for Your Business

The important thing to remember from this article though is that what we are trying to achieve is to get more enquiries and interest for our business to make them grow, not to count the pennies wasted on Yell. If you’re looking for a no risk supply of enquiries for your business, this is something we can assist you with through our unique service. We can set up a strategy which provides your company with enquiries, and you only pay us for the leads which turn into orders. Leave a comment below or get in touch with us to find out more about this opportunity, and what we can do to help you.

Don’t Rule Yell Out Completely

Yell Premium Listings might work well for some companies and that’s great for them, it certainly won’t hurt for small businesses to make a free ad on Yell and fill it with as much content as possible (URL, phone number, pictures etc.). There’s definitely no harm in having your business listed, as some people do still use it to find services. But the point I am making is that with SEO it’s about getting your company’s name out there for a much larger audience to see. That is how you will generate more enquiries and in turn generate more sales. You’ll find that using other methods of boosting enquiries can be much more cost effective, so definitely don’t waste money on a Premium Yell listing.

Yell online is an old way of doing things and is becoming about as useful as a Yellow Pages directory, and the only use for that which springs to mind is the young boy in the old TV advert using one as a step up to get a sneaky kiss under the mistletoe. Any business looking to grow needs to be out with the old and in with the new.

Tell Us Your Thoughts

Do you think using Yell listings is outdated? Or maybe you find that it works well for your company? Let us know your views on this topic and whether you have found other methods which get more traffic and enquiries for your business. If you’d be interested in receiving a no risk supply of enquiries for products or services you offer, please let us know.

Topical SEO – Create Supporting Articles

When people seem to ask the question ‘What is the future of ranking websites?’ the most common answer recently has been the buzz word ‘Topical SEO’. This is debatable but I am going to run through why topic related linked blogs is actually a huge part of the ranking factor now and will be for years to come.

What is Topical SEO?

Topical SEO is the strategy of trying to rank websites optimised for topics. Instead of optimising for keywords you start to build a huge network of niche relevant topic related articles. These are generally supporting articles internal linking to your money pages which are in turn targeting the money key-phrases.

Where this is clever in my opinion is that it gives you multiple pages to link build towards. Therefore you are less likely to over optimise on too many links, get penalties for anchor text and detect the penguin penalty alarm. However it also allows the supporting articles to rank for long tail variations of the keywords you are trying to go after.

Scientific Approach to Topical SEO

When trying to explain the basics of topical SEO I could not help but think of this like atoms, with a nucleus and electrons. The reason being is a nucleus always has electrons spinning around it. The electrons support the nucleus and this is exactly how you should treat your money pages. Create articles to support and surround your money page with topically relevant blogs. Look at this image and picture the nucleus as the way you need to organise the silo structure for your website:

Related Supporting Blogs

Topical SEO Example

Why Introduce Topical SEO

There are many reasons why SEO agencies need to integrate topical SEO into their strategy:

  1. Trying to rank a location which is not related to the topic of your website in any way
  2. Adding a new product you are starting to sell
  3. Adding a new service based item to your portfolio
  4. Trying to rank anything not related to your exact topic of the site

The issue with these above is simply that there is not enough pages on your site talking about that specific keyword. The root domain might never have mentioned anything to do with this before. Single landing pages can no longer rank anymore for micro niche sites, so supporting blogs are needed. These could be loosely related information about the location you are trying to rank, or tips on how to use your new product or why it is best to order a certain service for example.

Making New Topics Relevant

Imagine you have a website all about mountain biking activities, and you start selling a specialist chemical for cleaning bikes. If you add a page onto your website which talks about these cleaning chemicals, Google isn’t going to see your site as being relevant to this as you’ve probably never mentioned it on any other pages. It will be much more likely to rank pages from other sites who are more focused on cleaning and the specific chemicals you are talking about. By creating a few supporting articles which also talk about cleaning and special chemicals, you can link these to your main page and ensure that the website as a whole is relevant to this topic. Things like ‘The 5 Best Bike Cleaning Tips’ or ‘What to Use for Washing Bike Wheels’ are all relevant to your new product, but they fit in with the overall theme of the site as well.

Introducing the niche relevant articles is a great search engine optimisation strategy. Simply because you can go after the buying intent keywords like reviews, best, cheap and informative key-phrases like ‘how to’, ‘what is’ and ‘why use’ etc. Scaling this out is going to build a brand, a presence and most importantly traffic to your website. As traffic is a strong ranking factor then this will be strengthening the site. Can you see now why this is helping a number of ranking factors for the future of ranking sites?

The Knowledge Graph

The knowledge graph is a feature used by Google to create a better experience for users typing in a search query. It is a snippet of a page which shows up in a bigger and bolder box on the SERP, enticing more people to click onto it. This will usually be the page which Google thinks offers the best answer to whatever the user is searching for. This result usually comes from a knowledgeable site or a page which appears to have a good amount of authority on that particular subject. Pages which have headers like ‘What is…?’ or ‘How to…’ and then answer that question are often found in this section of the search results.

If you have well-written supporting articles for the page you are trying to rank, it is possible that these can start showing up in the knowledge graph. You could have a post called ‘How to Clean a Mountain Bike’ which includes lots of helpful advice on information about this topic. This is the sort of page which might be selected for the knowledge graph if someone is asking a question related to that subject. As the result will be shown in a larger and more eye-catching box, the user is more likely to click on it, visit your site and then possibly end up purchasing your products.

Key Facts About Creating Supporting Articles

One of the best SEO blogs I have read by a guy called Matt Diggity sums up the key facts about creating supporting articles nicely. The summary is below pulled from the article How to Get Unstuck by Establishing Topic Relevance.

Here are the two key takeaways that you must understand:

  • Google now prefers to rank domains that have multiple pages on a given topic.
  • When you try to rank a specific page on a particular topic, Google expects to see that there are other supporting articles on the same site using it as a reference (i.e. linking to it).

This is called ‘establishing relevance’ on a topic. Understanding this concept, you can know the bare-minimum page count requirement that you’ll need to rank plus you’ll have full control over which page ranks by using contextual inner-page linking.

How to Define a Topic

Speaking of great SEO individuals then another I strongly recommend following is a UK based chap named Charles Floate. He explains how topics are generated on this – Introduction To Topical SEO

A group or a cluster of keywords will be assigned relevancy to one another,  this “cluster” starts to define a topic.

Once a topic has become it’s own “entity” in the secondary index, further associations of relevancy will be made and cross-referenced to other topics / entities and even individual keywords from one topic to individual keywords in another topic.

This allows Google to provide us with more relevant results than ever before.

Now this doesn’t just extend to your content on the page, but it actually makes the same connections between web pages and link neighborhoods. Each web page, Google see’s as a node. The topical relevancy between each is worked out and this can even affect the total value a link may pass.

So, hopefully you agree with me that Topical SEO extends far beyond just our on-page content or how we go about performing our keyword research.

Utilise Hilltop Algorithm

Now you are starting to understand supporting articles help theme the topic of your domains and help your money pages then this is part of the hilltop algorithm. The hilltop algorithm needs volumes of themed content within a site to support your main pages. If you truly understand what is implied, you can tactfully add content using inherent language from a theme that acts as the thread that connects the documents to a topical body of information.

Search engines do search for any occurrence of two or more words the based on inverse document frequency assign weighting mechanisms based on proximity and occurrence to decide the degree of relevance the local and global page exhibit and then assign a score. Building your topical seo score is explained well in this article on Link Building Or Topical Content And Internal Links that shows the importance of supporting articles along with niche relevant backlinks.

This score is then used as an earmark / benchmark quota for relevancy in context to other documents within the index. Based on the “search” and the keyword or key phrase combination used, the search engine index is parsed and through a process of elimination removes eliminates pages with the least amount of significance, until it finds the nearest neighbour that squares the various metrics of the semantic and authoritative qualities of the combined search query.

How to Start Finding Blog Keywords

Starting to find blog keywords and titles through keyword research is probably the most important process in SEO. Understanding the best keywords to go after which is within the topic cluster, has search volume and the ability to internal link onto the money pages is key. There are a few tools I use like Long Tail Pro, Ahrefs Keyword Explorer and Google Keyword Planner which is great. But my main go-to tool has to be SEMrush and Ryan Stewart has a nice video on keyword research here:


The importance of topical SEO is undeniable, especially when adding new products or topics to an existing website. If Google doesn’t see the new pages as being relevant to your whole domain, it’s much less likely to rank them highly. By simply having a few supporting articles which establish relevance, you can boost that page and the site as a whole.

Bonus Tip

When looking to write supporting articles you should be focusing on the user. Get content, images and videos that are going to give a great user experience so they spend time on your site and reduce bounce rates. These don’t have to be promoting your business or the products that you sell. They can just focus on a relevant topic which will generate some interest and attract people to share the article. Here is my step by step guide to my in house team :-

  1. Create a supporting article that will get shared and people will enjoy reading (so don’t be sharing your money page selling a product straight from the off)
  2. In the supporting article fill it with amazing photos and videos on the topic and share these throughout social media
  3. Run Facebook ads to these pages targeting your demographic client base to leverage traffic to these pages
  4. Outreach with these informational, funny or intriguing articles to attract natural backlinks
  5. Internal link these articles to your money pages with defined call to actions to leverage traffic through to them

Why is this the best way to run your sites?

  1. Adds freshness of content to the site
  2. Adds content depth to support your keywords
  3. Gives topic relevancy at domain level
  4. Easier way to attract natural backlinks
  5. Generates way more social shares, likes and comments
  6. The big one is it generates traffic to your site improving bounce rates, time onsite and user metrics
  7. Content is King
  8. Backlinks are the Biggest Ranking Factors
  9. Traffic is the Holy Grail
  10. Gives your brand more personality and engagement

Let us know if you found this post interesting or if you have any more points to add. We’d love to hear from you so feel free to leave a comment below! The bonus tip was discussed in this meet up in Amsterdam with some of the biggest affiliates in the world.  Amsterdam SEO Q&A – Matt Diggity, Diggy Dirk, James Dooley, Adam O’Hern, Gareth Simpson, Mark Walker all discussing the future of SEO and great networking event.

Website Information Required

If you provide a niche that I like or agree to carry out because it is for a friend then there is certain Website Information Required to complete the site design and infrastructure. Without giving me this information will simply mean the site cannot be built out so it is essential you are able to provide this information. The more details you provide the better effective frequency strategy we will be able to create.


Providing a minimum of 15-20 images is very important. Ideally these pictures and photos you provide are high quality because will be used on the galleries and also on the pic sliders to the website. The reason these images are very important is because it makes the actual design of the website look nice and appealing to potential customers.

Also the pictures are very important because it creates the page to be media rich which google absolutely loves. Having these images alt tagged and properly optimised for the focus keyphrases enhances the chances to rank in the SERPs. Without the content being perfectly written by our inhouse content writers then having images to support the topic of the page is a great search engine optimisation technique that should always be used.

Also the reason the images are an essential part is because of social media sharing. By having these images on the webpages allows our link building team to share these to social profiles like flickr, pinterest and many other web 2.0 properties. Image link building offers diversity and is nice to have a mix of contextual links but also image sharing backlinks to the pages.


As part of the website information required then videos is another thing we certainly need. If you are able to send me a video for each product or service this is ideal. So if you are in the car dealership niche then a video for audi, ferrari, ford, bmw and other brands would be perfect. The reason being is because I need to embed a topic related video to each page and you cannot have a ford video showing on an audi webpage because it does not make sense.

If you are struggling to create any videos for each page then simply put together a quick slideshare of a few images. On the video have some wording on there saying ‘best audi car dealer’ with some pictures of audi cars. This would be perfect and the videos will then be optimised with the title being the same as the focus keyphrase you want that webpage to rank for. It will be topic relevant and again like the images will create the pages to be media rich which google loves.

The videos you supply also will be uploaded to youtube. On this social profile we can search engine optimize the videos to rank well in the youtube search but also to rank in google. With nice unique long descriptions, tags and titles then these videos will certainly drive traffic which will lead to more enquiries.

My link building team can utilise these YouTube videos to share throughout web 2.0 properties. By embedding this onto the branded social trust fortress profiles then this gives fresh content, backlinks and branded media shares. Having this syndicated throughout your branded accounts spreads the network and footprint to generate more traffic, trust, authority and social.


Providing me with keywords is without doubt the most important part of this process. You need to remember you are the experts in this niche and I might not know anything about it. The more keywords you can give to me the better because you would be surprised just how many variation of keywords people type into google to find the same product or service.

If you ever want an example of this then read this article here which shows an 86 year old nan typing into google using “please” and “thank you” into the search bar. I mean SEO companies would need to try to optimise those keywords in the content to rank for this and it just shows what people type into the search bar is incredible. As an example then if a headteacher wanted playground flooring for his school then I know first hand that some type in ‘rubber school flooring’, ‘rubberised safety surfacing’, ‘spongy coloured floor to my school’, ‘safety wetpour surfaces’, ‘school playground surface’, ‘schools play area floor material’ and the list goes on and on and on.

The examples of the playground flooring is great because all these wording means the same product required but there is a million and one ways to put this into google. Therefore the more variations you can give to me the better. Think outside the box and ask your mum, nan, friends, partners to see what they would type in and give me the biggest list you can because the more variations we can rank for the more chance you have of getting leads which lead onto more orders. The keyword research strategies we use will be so much better if we you can send plenty over.


Giving me competitors in your niche is vital. Again the more you can provide me with the better because I can start to reverse engineer what they rank for. Using specialist SEO tools and techniques we can see what drives your competitors traffic to their sites. Once we know this then can look to create our websites bigger and better than theres to outrank them and steal your competitions traffic.

Keyword research is in my opinion the most important part to SEO. Looking to find money intent keywords that convert, have good search volume and relatively easy to rank is where big money can be earned. Simply going after payday loans is not the option because although might have high search volume the competition to get #1 is very tough. We would be better looking into low hanging fruit and scooping up hundreds of variations which is easier and actually collectively get you more traffic added together.

We can also reverse engineer where they are linking out to and where they are receiving backlinks from. This is important in checking the authority sites in the niche because if we can leverage some backlinks from these niche relevant and topic related pages then it would help massively. Again the more competitors websites you can provide the more ammo I have to get you more enquiries.


Ideally if you can provide content which has got to be 100% unique written by yourselves this will be amazing. My content writers can then add onto this content you provide to create the Skyscraper Approach and also optimize so the keyword density is spot on and meta tags used correctly. The meta tags will consist of LSI keyword variations so instead of just using costs, we can use pricing, prices, price, costings and many more keywords which are clustered together under thesaurus.

By you providing the content then as you are the experts in the industry you will know that you are getting the main reasons why you are the best. Are you the cheapest, are you buying the most expensive premium products, do you have all the main certificates or anything to upsell why you guys are the best companies to use. Try to use unique selling points on why they should use yourself because remember this is your shop window so get them to enquire with you to get prices or buy your products.

Website Name

Supplying some options you would like for a website name would be great. You might want something branded or an EMD which stands for exact match domain. The EMDs are great because gets the point across in the SERPs to the clients on what exactly you do. There if you have something like www.bestlifeinsuranceuk.co.uk then at least when the customer is clicking on your website they understand exactly what you do and the traffic will become more targeted. To find out why this service works best for everyone, check out this post and see how this can work for your company.

Giving myself several options on website names will be good and I can look through whats available and decide which one I think will work best without it over optimising the keywords you want to rank for. Sometimes it is good to use an LSI variation or even a PMD which stands for partial match domains like www.bobs-driveways.co.uk etc.


If you want to know more about myself the author of this article then click through to this link. You will realise I have been in the internet marketing industry a while now and understand exactly Website Information Required for these websites to work. Not providing all this information will affect how well you can rank in google so you really need to go the extra mile in getting this information together.

With regards to the no risk supply of enquiries offer I am doing then this link explains it all in detail. I need to accept the niche and only around 50% of applications actually get accepted because many just do not have the ROI for this to work for both parties. It needs to be a niche nationwide in the UK and not just a local contractor. But when you are a nationwide company in the United Kingdom this agreement is an absolute no brainer and I can show you dozens of case studies where transformed peoples businesses.

Anyone new to SEO and wanting to get into it then here is a nice intro to SEO you can read. I am happy to assist and help anyone wanting to do this because have a passion for the industry. I network so much with like minded people throughout the world and in our private whatsapp groups we have affiliate guys making millions each month which is just unreal. As in the group we have over two million websites at our disposal then data is great and we know the algorithm updates way before it is actually released and it becomes easy for us to test what works and what doesn’t in the SERPs because of the amount of data between us we can experiment on.

OnPage Content Latent Semantic Indexing


If you are unaware of OnPage Content Latent Semantic Indexing then you really need to read this article and become an expert in how to properly optimise your content.

Latent Semantic Indexing (LSI) is an indexing and retrieval method that uses a mathematical technique called singular value decomposition (SVD) to identify patterns in the relationships between the terms and concepts contained in an unstructured collection of text. For an exact analysis on what LSI is visit wikipedia page here.

There are a number of reasons why search engines use LSI to return results to the user, and why it’s good to include this in your strategy:

  • It helps Google get the meaning of the written content. It also deals with search relevancy.
  • Including LSI keywords with main keywords is SEO friendly.
  • In earlier days, search engines used exact search query to get results. With this, search engines were not giving accurate results.
  • Now, search engines analyze the meanings of the search queries. The content synonymically linked to the search query, are also returned.
  • Google mainly carried out this to fight spammers trying to cheat the search engine by using keyword stuffing.

Find out more about implementing LSI keywords into your on page strategy by checking out this post – http://www.gobloggingtips.com/lsi-keywords/

Lexical Analysis

Lexical analysis is the first phase of a compiler. It takes the modified source code from language preprocessors that are written in the form of sentences. The lexical analyzer breaks these syntaxes into a series of tokens, by removing any whitespace or comments in the source code. The lexical analysis is the term for LSI which google uses to cluster words together which means the same thing.

Why do I personally feel that this onpage method of grouping keywords is vital in the future of search engine optimisation? This is simply because over optimisation penalties are applied to millions of websites from Google and many of you will not even know you are being hit with this penalty which could just be a drop of several rankings in the SERPs. However in some circumstances this could mean millions of pounds of revenue lost. In order to improve your on page SEO strategy, you should be swapping some of your most used keywords for LSI words instead. This prevents Google Hummingbird from penalising you for keyword stuffing, and shows Google that your site’s page should be displayed as a quality result for the user. However, be sure that you don’t completely remove your target keyword from the page as this will have a negative effect, simply use other synonyms to bring your keyword density down.

Keyword Density is a term which refers to the percentage of times a certain word or phrase appears on a page when compared with the total number of words on the page. This metric has changed drastically in the past 6 years from what has been taught. 6 years ago I clearly remember being told just place your focus keywords into the content 5-7 times and this will be great for helping your rankings because as this is repeated Google will understand what this page is talking about. Year on year the suggested amount for repeating the keywords has dropped from 5% to 3% and now many big influencers in the SEO world are saying your keyword density should be around 1%. This seems insane but it is very true and from plenty of testing I have to agree.

So how the hell can you keep your keyword density percentage down to 1%? This is where LSI variations of key phrases come into play. If you want to rank for a key phrase which contains the word ‘NEW’ then use variations within the content like newest, latest. Even try when possible to get wording in like untouched, just out, modern, current because these are all within the grouped key phrases that Google is setting up.

Use http://www.thesaurus.com/browse/new and edit the keyword to your niche and check the densities of your pages and whenever above the 1% try to look to see whether other synonyms of that word can be used because this will certainly help you with the ranking factors and keep you away from the partial google penalties carried out by Panda.

If you want to check the keyword density of a certain page or piece of content, enter it into this tool – http://tools.seobook.com/general/keyword-density/. This will help you see where you may be over optimised on certain keywords, and where you could swap them for LSI words which have the same meaning.

As well as thinking about which keywords and phrases to target with your on page content, you also need to think about the types of words and phrases that you want to include. This means you need to decide one what the purpose of that particular page is, and what it does for the user. Is it purely there to provide information about a topic? Or is it there to get people to enquire and buy a product or service. Take a look at this post which explains the three main types of keywords for on page SEO and how to use them.

Be one step ahead and make sure your OnPage Content Latent Semantic Indexing strategy is put into practice so that you can benefit from the best rankings possible in the SERPs.