<!DOCTYPE html PUBLIC ”-//W3C//DTD XHTML 1.0 Transitional//EN” “http://www.w3.org/TR/xhtml1/DTD/xhtml1-transitional.dtd”>
<html xmlns=”http://www.w3.org/1999/xhtml”>
<head>
<meta http-equiv=”Content-Type” content=”text/html; charset=utf-8” />
<title>WP Crawler – By Pluginology.Space</title>
</head>
WP Crawler
It’s a crawler/bot/spider application, which crawls the specified URL, and creates the table of contents with the findings. The findings include:
- Generator
The version of the WordPress that the site is running. - WordPress Theme
All the information about the theme: name, description, author, etc. - Links
All the internal and external links on the page. - Images
All the images on the page, with the actual image and the URL to it. - Post Content
The entire content of the post/page is retrieved and displayed using the style of your active theme. - Post Content as Plain Text
The content with the tags removed. That’s how Google and other search spiders see your page. - Top 25 Keywords
The software analyses the page SEO to identify what the page is all about, and displays the top 25 keywords identified.
Here’s the sample output (only the Generator and WordPress Theme are shown):
Using the Plugin
The plugin adds the spider icon to the WordPress Visual Editor, which inserts the shortcode with the URL to crawl:
Another way to use the plugin is to provide the crawl form on a page:
