Tag: scraper

Scraper – Automatic Content Crawl and Post Plugin for WordPress (Utilities)

Scraper is a WordPress plugin that copies content and posts automatically from any web site. With tons of useful and unique features, Scraper takes content creating process to another level.

Offer : Use A.I. Spinning Power on Scraping

Get A.I. Spinner on Codecanyon and use it as spinner on Scraper. Your posts will be unique on web with A.I. Spinner’s results. Scraper supports A.I. Spinner and you could enable it easily.

Get A.I. Spinner Now!

F.A.Q.

Yes, it works. We both have functions for web login or form fill and authentication function that can be used with cookies. So you could easily get data from any website that has login.

+ Is there any feature to translate content?

Yes, it translates any content with Google Translate API. It supports all languages that supported by Google.

+ Is it possible to update prices on product?

Yes, with transform function, you could apply some regex expressions or mathematical functions for numbers. With this way, you could update numbers with yours or change the values with math functions.

+ Is it possible to scrape meta tags?

Yes, that’s possible. You could scrap HTML tags, meta tags, attributes or even JSON parts of page with visual editor.

+ Is it possible to get meta tags or JSON values on page?

Yes, that’s possible. You could scrap HTML tags, meta tags, attributes or even JSON parts of page with visual editor.

Visit Frequenly Asked Questions

Changelog

08/17/2018 (v1.0.0)

        + Cron issues fixed
        + Image download feature added
        + JSON Parsing Method Added
        + A.I. Spinner Service Enabled
        + Translation Service Enabled
        + First Release

Purchase $27.00

September 4, 2018

Crawlomatic Multisite Scraper Submit Generator Plugin for WordPress (Miscellaneous)
Purchase $19.00

What Can You Do With This Plugin?

Crawlomatic Multisite Scraper Post Generator Plugin for WordPress is a breaking edge (made in 2017) website crawling and scraping, post generator autoblogging plugin that uses website crawling and scraping to turn your website into a autoblogging or even a money making machine!
Get content from almost any webpage! You no longer need API’s which requires registration and provides limited access, also you can retrieve data from non API providing websites. Schedule it for once and let it autopilot your posts 7/24 for you like a master!

You can scrape content from almost every web site that you open in your browser. Just be sure that the content is not generated dynamically by javascript, such as load more buttons or lazy loading content by scrolling down.

Also, you can automatically generate unlimited number of custom website crawling and scraping.

Other plugin features:
- Google Translate support – select the language in which you want to post your articles
- Text Spinner support – automatically modify generated text, changing words with their synonyms – great SEO value!
- customizable generated post status (published, draft, pending, private, trash)
- shortcode to list all posts generated by this plugin: [crawlomatic-list-posts type => ‘any’, order => ‘ASC’, ‘orderby’ => ‘date’, ‘posts’ => 50, ‘category’ => ’’, ‘ruleid’ => ’’]
- automatically generate post categories or tags from marketplace items
- manually add post categories or tags to items
- choose if you want to update post if it is already posted
- send custom cookies with the request to the crawled webpage (authentification)
- generate post or page or any custom post type
- embeds videos from YouTube, Vimeo, Flickr, IGN, Ustream.tv and DailyMotion using website crawling and scraping
- define publishing constrains: do not publish posts that do not have images, posts with short/long title/content
- automatically generate a featured image for the post
- enable/disable comments, pingbacks or trackbacks for the generated post
- customize post title and content (with the included wide variety of relevant post shortcodes)
- ‘Keyword Replacer Tool’ – It’s purpose is to define keywords that are substituted automatically with your affiliate links, anywhere they appear in the content of your site. For example, you can define a keyword ‘codecanyon’ and have it substituted by a link to http://www.codecanyon.net/?ref=user_name anywhere it appears in your site’s content.
- ‘Random Sentence Generator Tool’ (relevant sentences – as you define them)
- option to automatically delete generated posts after a period of time
- detailed plugin activity logging
- scheduled rule runs
- custom field support for generated posts
- option to copy or not images locally
- Maximum/minimum title length post limitation
- Maximum/minimum content length post limitation
- Add post only if predefined required keywords found in title/content
- Add post only if predefined banned keywords are not found in the title/content
- Save and restore plugin rule list from file
Testing this plugin
- You can test the plugin’s functionality using the ‘Test Site Generator’. Here you can try the plugin’s full functionality. Note that the generated testing blog will be deleted automatically after 24 hours.
- This blog is dedicated fully to this plugin! Try it out now!
Plugin Requirements
- PHP DOM -> how to install it (if you don’t have it, but probably you already have it): http://php.net/manual/en/dom.setup.php
- PHP 5.0 or higher
- dom, mbstring, iconv and json extensions (enabled by default)
Need support?

Just email me at kisded@yahoo.com and I will respond as soon as I can.

Changelog:

Version 1.0 Release Date 2017-08-20
```
First version released!
```
Are you already a customer?

If you already bought this and you have tried it out, please contact me in the item’s comment section and give me feedback, so I can make it a better WordPress plugin!

WordPress 4.8 Tested!

Disclaimer
Through this plugin you are able to grab content from various websites that does not necessary belong to you or which are not under your control. If you grab copyrighted material without the author’s permission, the plugin’s developer does not assume any responsibility for your actions. Also, the plugin’s developer has no control over the nature, content and availability of those sites.

Do you like our work and want more of it?
Check out this MEGA plugin bundle.

Purchase $19.00
August 16, 2017
Scrapes – Net scraper plugin for WordPress (Utilities)
Purchase $25.00

Features

Ready to go.
It is designed to use without any coding. Upload it to your WordPress site, activate and use, that’s all.

Multiple tasks.
Run multiple tasks which have different scraping features simultaneously and without limitation.

Native content.
Scraped content supports all WordPress inputs like title, excerpt, content, date, author one by one.

Featured image.
Choose featured image of the content from the gallery or use the source content image automatically.

Custom fields.
Scrape the required custom field values for your needs from the source content except WordPress default inputs.

Generated categories.
Add the scraped content to your existing categories or create the same category to your web site from the source.

Custom post types.
It supports custom post types and custom taxonomies which are created by your plugins or themes, adjusts the content to your structure.

HTML support.
Scrape cleaned text content from the source or whole HTML area with all the tags.

Unique check.
If you wish, prevent duplicate content entry and only update the existing content.

Plan B.
If anything goes wrong because of an error, plugin may stop the current process and skips next if you want.

Detailed logs.
Every action from the plugin is logged in details and ready whenever you want to view.

High performance.
Coded neatly, aims to achieve the high performance with the minimum system requirements.

3 Easy steps
- Enter source URL that you would like to scrape content from.
- Select the scraper type and set the options as needs
- Save and go!
Use case ideas
- Track and archive any single web page.
- Scrape latest currency information inside your post.
- Scrape current weather forecast.
- Scrape live scores to any of your posts.
- Scrape job listings and bulletin boards.
- Create an affiliate site by scraping products.
- Create an e-commerce site by scraping products as WooCommerce products
- Create an image gallery by scraping images.
- Create a blog or magazine site by scraping blog posts from different sources.
- Create a music, video or movie site by scraping embed codes from services.
- Create a news site by scraping RSS or Atom feeds form feed URLs
- And much more up to your imagination.
Can I scrape from any web site?

You can scrape content from almost every web site that you open in your browser. Just be sure that the content is not generated dynamically by javascript (Such as load more buttons or with lazy load by scrolling down).

You can check your website that you would like to scrape by disabling javascript from your browser settings and check if your content is still visible to you. Besides for serial type scraping make sure that a next page button is available and the content is not loading automatically on the current page.

Purchase $25.00
November 22, 2016
Net Grabber – WordPress HTML Scraping Plugin (Utilities)

Purchase $9.00

Web Grabber is a WordPress plugin that helps you automatically get HTML from a web page and display it on your blog post/page. The main benefit of using this plugin is that it directly retrieves HTML from the page you specify, so the data always remains up-to-date. This is especially useful for grabbing frequently updated data like news, prices, stock quotes, rankings, etc.

For example, to get the latest Football scores from a website, all you need to do is give the URL of that page and a CSS selector to the plugin. Then when your page is visited, it shows the latest Football scores retrieved from the original source.

FAQ

Can I use CSS to style the grabbed HTML?

Yes you can. Simply add your own style by using a plugin like Custom CSS.

Can I use jQuery/JavaScript to modify the grabbed HTML?

Unfortunately not.

Is the grabbed HTML automatically updated without refreshing the page?

No, the HTML is updated only when the user visits or refreshes the page.

In which format will I receive the data?

You’ll receive HTML in the same format as the source, but it won’t have any CSS applied to it.

Can I use this plugin to automatically clone webpages?

No, that’s not the purpose of this plugin. This plugin is designed to scrape frequently updated data like prices, rankings, etc.

Can I grab HTML from multiple sites and display them on one blog post?

Yes you can. You can also grab multiple HTML elements from the same page by defining multiple CSS selectors: #id , .class , p (divide selectors with a comma)

Can I replace the loading image?

Yes. The image is located at wp-web-grabber/images/spinner.gif. Simply replace it with you own image.

Limitations

Please try the plugin before buying it, because it might not be able to scrape data from some sites. Web Grabber cannot grab the following types of content:

Videos: YouTube, Vimeo, and most other video sharing websites.

Flash: The contents of flash files (the flash file itself can be retrieved).

Content Visible Only to Registered Users: Profile page, inbox, etc.

JavaScript Generated HTML: Content that is generated using AJAX, Angular.js, or other JavaScript techniques can’t be retrieved. You can check if a page uses these techniques by disabling JavaScript in your browser. If you can still see the content then you can probably grab that page.

Note that if the HTML you want to grab contains images with relative paths, they won’t show up on your page.

Note

If you decide to use this software product, do it with responsibility and make sure that you are allowed to display the grabbed HTML contents from the web page by checking its terms of usage. We assumes no responsibility for any abusive use of this software product and/or violation of any terms of usage of the grabbed web pages. This software product is sold exclusively on codecanyon.net.

Web grabbing is also known as web ripping, web scraping, and html extracting.

Purchase $9.00

June 13, 2016
WebGrabber – WordPress HTML Scraping Plugin (Utilities)

Purchase $19.00

WebGrabber is a WordPress plugin that helps you automatically get HTML from a web page and display it on your blog post/page. The main benefit of using this plugin is that it grabs fresh data from the source whenever you open your page so your data always remains up-to-date. It’s especially useful when your source is frequently updated like stock quotes, news, prices, rankings, etc.

Limitations

WebGrabber cannot grab the following types of content:

Videos: YouTube, Vimeo, and most other video sharing websites.

Flash: The contents of flash files (the flash file itself can be retrieved).

Content Visible Only to Registered Users: Profile page, inbox, etc.

JavaScript Generated HTML: Content that is generated using AJAX, Angular.js, or other JavaScript techniques can’t be retrieved. You can check if a page uses these techniques by disabling JavaScript in your browser. If you can still see the content then you can scrape that page.

Note that if the html you want to grab contains images with relative paths, they won’t show up on your page.

Note

We assumes no responsibility for any abusive use of this software product and/or violation of any terms of usage of the grabbed web pages. If you decide to use this software product, do it with responsibility and make sure that you are allowed to display the grabbed HTML contents from the web page by checking its terms of usage. This software product is sold exclusively on codecanyon.net.

Purchase $19.00

October 30, 2015
iWantThis – the modern content material grabber (Utilities)
Purchase $25.00

iWantThis Overview

iWantThis is a WordPress plugin capable of downloading rich HTML pages with images, styles and fonts and creating editable blocks in WordPress for later use in posts and pages with shortcodes.

Features

The key differences to other solutions:
- Content you add is much more SEO-friendly and user-friendly than screenshots
- The plugin allows you to put rich content from other web page with just a few clicks and it doesn’t require any knowledge of HTML, CSS or XPath.
- Content you add is hosted on your website and is always available unlike embedded iframes that depend on third-party server
- Content is partially editable
Add new block

Select content block

Edit content

Disclaimer

Please be aware, the plugin is based on new technologies that were not used that way before so it has some limitations that depend on browsers and third-party servers. This means that it may not work well with all the pages or blocks you would want to insert and at the moment it may not be possible to fix it for every website existing on the web. We recommend you to try it in different browsers for better results and try different options if it doesn’t work with defaults. We are working hard on making it better, so please feel free to ask questions and provide URLs for us to try.

Purchase $25.00
September 17, 2015