5 Ways to Get Better Log File Insights for Crawl Budget Optimization via @rachellcostello

Channel:
United Kingdom Colin Boyd SEO
Subscribers:
4,200
Published on ● Video Link: https://www.youtube.com/watch?v=U7mdL6YwPnY


Category:
Vlog
Duration: 3:09
7 views
0

Reported today on Search Engine Journal

For the full article visit: http://tracking.feedpress.it/link/13962/13246439

5 Ways to Get Better Log File Insights for Crawl Budget Optimization

Crawl budget optimization is crucial for focusing the attention of search engine crawlers onto your website's most important pages each time they visit.

Some of the key benefits of improving crawl budget include:

Googlebot is well-equipped to be able to crawl through the majority of pages on smaller sites with each visit, so that explains why Googlers like John Mueller don't want website owners to waste time worrying about sites that will be crawled just fine.

IMO crawl-budget is over-rated. Most sites never need to worry about this. It's an interesting topic, and if you're crawling the web or running a multi-billion-URL site, it's important, but for the average site owner less so.

- 🍌 John 🍌 (@JohnMu) May 30, 2018

However, crawl budget analysis isn't just about seeing what Googlebot is or isn't crawling.

There is a lot of value to be gained from analyzing search engine bot behavior in more detail, and that's why every SEO should incorporate it into their day-to-day work.

What Log Files Can Reveal About Search Engine Behavior

By delving into log files, you are able to see how search engines crawl, not just what they crawl.

You can piece together a valuable picture of what search engines find important and what they struggle with, by mapping out the journey of each crawler with log file data.

Here are five key ways to filter your log file data to get the most impactful insights into search engine behavior:

To try out the following methods yourself, you'll need access to:

1. Status Code

You can assess how crawl budget is being distributed across the different pages on your site through grouping your log file data by status code.

This gives you a top-level overview of how much of a search engine's cr



Other Videos By Colin Boyd SEO


2020-02-12Kia Sorento teasers show off a chiseled SUV - Roadshow
2020-02-12FBI says theses state were hit with the most cybercrimes last year - CNET
2020-02-12WhatsApp now has 2 billion users
2020-02-12Dell’s XPS 13 with a 10th Gen Intel Core i5 processor is $400 off
2020-02-12Tweeten, the best Windows Twitter app, is now available on Surface Pro X
2020-02-12Netflix offers a free movie to try to get people to subscribe for the sequel
2020-02-12Pokémon Home is out now on the Switch, iPhone, and Android
2020-02-12Recording 8K videos on the Galaxy S20 uses 600MB per minute
2020-02-12New Zealand’s first AI police officer reports for duty
2020-02-12YouTube continues to mirror Twitch, tests new clap feature that lets fans donate to creators
2020-02-125 Ways to Get Better Log File Insights for Crawl Budget Optimization via @rachellcostello
2020-02-121 in 10 Americans uses stalkerware to track partners and exes, poll says - CNET
2020-02-12Put Samsung's 1TB T5 SSD in your pocket for $158 - CNET
2020-02-12China launches coronavirus "close contact detection" app
2020-02-12Naughty Dog is putting finishing touches to The Last of Us Part II
2020-02-12Social media is a recruitment channel — don’t neglect it
2020-02-12Apple Pay accounts for 5% of global card transactions, growing to rival PayPal
2020-02-128 Things That Are Wrong with Google Search Today via @searchmastergen
2020-02-12Coronavirus data from outside the outbreak epicenter is just as valuable as from the inside
2020-02-12Samsung learned some tough lessons from the Galaxy Fold debacle
2020-02-12Google brings emoji mashup stickers to Gboard on Android