Screaming Frog already had several features to help with internal linking such as crawl depth, number of internal links etc… Internal linking is an important, but often overlooked, aspect of SEO. To save you from having to switch to ‘list mode when you want to crawl the XML Sitemap, you can also now typed the location of the Sitemap in the top bar and the SEO Spider will crawl it. There is also a new Sitemaps tab in the crawl report which allows you to filter through any issues with your XML Sitemap, such as non-indexable URLs, orphan pages etc. Under ‘Configuration > Spider’ you can select to crawl XML Sitemaps and either tell Screaming Frog where the file is, or it will fetch the location from the robots.txt file.
Tools like screaming frog seo spider update#
Screaming Frog has always allowed users to crawl XML Sitemaps within the list mode of the SEO Spider, but with this update you can now crawl and integrate your XML Sitemap as part of a site crawl. This should make it easier to spot problems at a glance, rather than having to run formulas in a spreadsheet and look at multiple columns when reviewing the ‘indexability’ of a long list of URLs.
Tools like screaming frog seo spider code#
While the concept of ‘indexable’ can be a loose one – search engines may index URLs that can’t be crawled if there are links pointing to them – this new feature simplifies things a bit, showing users all pages that return a 200 status code and is permitted to be indexed as ‘indexable’. Indexability statusĮvery URL within a Screaming Frog crawl report is now classed as either ‘indexable’ or ‘non-indexable’ You can also now automatically save the crawl file and export it whole or choose any of the tabs, filters or reports to export to you chosen location.įor anyone who runs regular crawls on Screaming Frog, this new feature promises to be a massive time-saver. When scheduling a crawl you are able to choose between the two different modes – spider or list – and select the different APIs you also want to pull data from (Google Analytics, Search Console, Ahrefs, Moz, Majestic etc.) One of the most useful new features is the ability to schedule crawls to run automatically – and you can choose to run them at chosen intervals or as a one-off crawl. See a quick run-down of the new features below, and read our Screaming Frog SEO Spider review for more information. The Screaming Frog SEO Spider – one of the most popular technical SEO tools around – has updated to version 10.0, and introduced a range of new features. The popular crawling tool has been updated, and now boasts a host of new features including scheduled crawls, XML Sitemap crawl integration and Internal Link Score.
0 kommentar(er)
