Crawler Crawler

Developer Tools
Version: 1.4
Last Update: 2014-01-13

Overview

Crawler is a Chrome extension developed by Dollar. According to the data from Chrome web store, current version of Crawler is 1.4, updated on 2014-01-13.
1,000+ users have installed this extension. 12 users have rated this extension with an average rating of .

This extension could be used to crawl all images of a website

This extension could be used to browse all images of a website recursively.
As technical limitation, we can't automatically download all images into your local file system. So we choose to provide a good UI for these images within browser. In its future version, we will add functions to export data into other formats.

Version 1.1 change list:
1. category the images we got by its domain
2. add URL input box so that user can change crawl site in the manager page.
3. performance enhancement --> use lazy loading so that the image will load only when you scroll to it.

Rating

12 ratings

Total Installs

1,000+

Information

Last Update

2014-01-13

Current Version

1.4

Size

235KiB

Author

Dollar

Website

None

Category

Developer Tools

Latest Reviews

See More

avatar Matt C
2018-03-22

Only gives images, no addresses

avatar Mark Sandland
2018-03-15

Gets stuck crawling my test site.

avatar Johannes Schneider
2014-09-21

Got stuck... Still no results after 10min of waiting though site has only few images.

avatar Ferrum Noricum
2014-03-28

This extension has serious problems in getting the right site. Especially when running with multiple windows open, it takes the last active tab from (as it seems) the first chrome window but not the one invoked from. Does not show errors, does not traverse folders, does not retrieve anything else, does not allow filtering, dows not allow saving ALL images at once, etc.
Basically it just does what you already have in the developer window under resources/images.
Long way to go.

avatar Michael Reiche
2013-08-21

Does not find all images on my testsite. Console window reveals that it tries to traverse mailto: urls from href="mailto:....". Which happens to be the last message on each run. But also tries to fetch some images from urls of the form "chrome-extension://pdhedahnmicgeobhejclpbogemgkfpdo/sch-base-portlet/resize?w=100&h=100&img=36115003763.jpg", where /sch-base.... is the real image url.