Crawling downloads |
|
|
|
|
| Trellian SiteSpider is a powerful, yet simple to use program which is loaded with sophisticated search, web crawling and site mapping functions.
What does SiteSpider do?
SiteSpider can be used simply as a web browser, which works cooperatively with Internet Explorer to allow importing and utilization of your favorites directory.
Trellian SiteSpider can help you to extract valuable data from any website. The data is then cleanly organized
|
Type: Shareware; Released: 05/28/2004; Filesize: 1.7 MB; Price: USD $29.95;
Platforms: Windows 95, Windows, Windows 98, Windows Me, Windows NT, Windows 2000, Windows XP
Tags:
Seo,
Site Map,
Sitemapper,
Sitespider,
Trellian,
Web Browser |
 |
|
|
|
| A tool for automating Internet search jobs. Combines web crawler functionality with advanced keywords text search and logical analysis of the document layout. Can be used for deep web searches. Sekhol Finder is a tool for deep Internet searches. It allows to create unlimited and fully customisable list of search engines with possibility of adding user defined sites and setting search site parameters. The pages referenced in the replies that
|
Type: Shareware; Released: 11/02/2004; Filesize: 2 B; Price: USD $39.00;
Platforms: Windows XP, Windows, Windows 2000
Tags:
Automation,
Bot,
Crawler,
Keywords,
Marketing,
Search |
 |
|
|
|
| The Gplex Database Crawler retrieves all your tables, packages, procedures, triggers, views, functions, *.cpp, *.h, *.aspx, *.cb, *.js, and any other source code files and then indexes them so you can have Google-like searching for your databases for SQL, Oracle and DB2. Similar to Google Desktop Search except this is for your databases and source code
|
Type: Shareware; Released: 09/20/2005; Filesize: 516.0 KB; Price: USD $5.00;
Platforms: Windows XP, Windows, Windows 2000, Windows 2003
Tags:
Databse Crawling,
Search Database,
Search Source Code,
Source Code Crawling |
 |
|
|
|
| XML Sitemap for CRE Loaded - CRE Loaded module Generates XML Sitemap, REQUIRED for search engine optimization for Google, MSN, Yahoo - all at once! 4 Step very easy installation, start using in 5 minutes! Generates XML Sitemap, REQUIRED for search engine optimization for Google, MSN, Yahoo - all at once!
Search engine rivals Google, Yahoo and Microsoft are teaming up to make it easier for Web site owners to make sure their sites get included in the
|
Released: 11/29/2006; Filesize: 29.3 KB; Price: USD $39.00;
Platforms: Windows 98, Windows, Windows Me, Windows NT, Windows 2000, Windows XP
Tags:
Cre Loaded Sitemap,
Cre Loaded Xml Sitemap,
Xml Sitemap For Cre Loaded |
 |
|
|
|
| Crawl the web with this free ActiveX web bot component. Advanced features include caching, "avoid" patterns, and robots.txt compliance.
|
Type: Freeware; Released: 08/22/2005; Filesize: 536.1 KB; Price: USD $0.00;
Platforms: Windows XP, Windows, Windows 2000, Windows 2003
Tags:
Activex,
Agent,
Bot,
Bots,
Component,
Crawler,
Crawling,
Data Mining,
Download,
Intelligence |
 |
|
|
|
| Websitemirror downloads complete websites to the local disk. Websitemirror is a small program to download complete websites to your local disk. The program downloads one file and then searches the file for links. Then the program downloads the other files and so on. The site-structure is shown in the left part
|
Type: Freeware; Released: 03/25/2006; Price: USD $0.00;
Platforms: Windows 98, Windows, Windows Me, Windows XP, Windows 2000, Windows 2003
Tags:
Download,
Internet Grabber,
Offline Browser,
Web Mirror Utility,
Website Crawling,
Websitemirror |
 |
|
|
|
| ETagFix is an ISAPI plugin which integrates directly into IIS and other web servers to alter the etag that IIS produces so that web crawlers will not check your web site so often. ETagFix is an add-on for Microsoft Internet Information Server (IIS) or any web server that supports ISAPI filters, that cuts off part of the etag that IIS produces so that is does not change every time your computer is rebooted. Etag is an HTTP header
|
Type: Freeware; Released: 04/23/2004; Filesize: 696.0 KB; Price: USD $0.00;
Platforms: Windows NT, Windows, Windows XP, Windows 2000
Tags:
Cache,
Etag,
Expired,
Http Headers,
Iis,
Isapi,
Page,
Reboot,
Restart,
Server |
 |
|
|
|
| Web Automator is a powerful tool for extracting content from Web sites ant testing them. Features:
Powerful, quick engine;
User friendly, Vista-style modern user interface;
Visual process execution scheme designer;
Easy to read and modify XML project files;
Extensible logging system;
Macros support;
Regular expression (RegEx) support;
Web actions (macro) recorder;
Loops and conditions;
CAPTCHA support;
E-mail support
|
Type: Demo; Released: 06/21/2008; Filesize: 621.0 KB; Price: USD $0.00, USD 20;
Platforms: Windows 2000, Windows 2003, Windows Vista, Windows XP
Tags:
Automation,
Crawl,
Macro,
Promotion,
Seo,
Site,
Testing,
Web Internet |
 |
|
|
|
| The Website Utility examines websites for errors and other issues using a built in web crawling engine. Errors checked for include broken or moved hyperlinks, missing page titles and missing meta tags. It also generates HTML for use in creating website site maps. The Website Utility also builds client-side JavaScript and server-side ASP Search Engines from any website. Includes sophisticated word ranking capabilities. The search form and results pages
|
Released: 04/17/2006; Filesize: 2.9 MB; Price: USD $12.95;
Platforms: Windows 98, Windows, Windows Me, Windows NT, Windows XP, Windows 2000
Tags:
Asp,
Broken,
Content,
Engine,
Error,
Errors,
Facility,
Hyperlinks,
Issues,
Javascript |
 |
|
|
|
| Bird Hunting may appear to be a very simple game from the start. With so many birds flying left and right, it is really rather difficult to miss. But the objective of the game is not just to shoot birds, but to shoot as many birds as you can. Bird Hunting is a simple game that challenges your speed and accuracy as you shoot at birds. Bird Hunting may appear to be a very simple game from the start. With so many birds flying left and right, it is really rather difficult to miss. But the objective
|
Type: Freeware; Released: 12/09/2006; Filesize: 2.0 MB; Price: USD $0.00;
Platforms: Windows 98, Windows, Windows Me, Windows NT, Windows 2000, Windows XP
Tags:
Action,
Arcade,
Birds,
Cartoon,
Shooting |
 |
|
|
|
| ECrawl is an email harvester that swiftly crawls the web and extracts all the emails it can find. It has the ability to reach speeds in excess of 2 million emails per hour. This is the successor of the very popular email extractor MailCrawl with several new functions and fixes. The major difference between ECrawl and other harvesters is the speed and quality of the emails. There is no other program out there that has been able to go faster than 500
|
Type: Shareware; Released: 01/01/2005; Filesize: 2.0 MB; Price: USD $395.00;
Platforms: Windows 95, Windows, Windows 98, Windows Me, Windows NT, Windows XP, Windows 2000
Tags:
Email Address Extractor,
Email Address Finder,
Email Bot,
Email Extractor,
Email Harvester,
Email Spider |
 |
|
|
|
| By placing a Sitemap-formatted file on your webserver, you enable the Google crawlers to find out what pages are present and which have recently changed, and to crawl your site accordingly. Using Sitemaps to inform and direct the Google crawlers, they hope to expand their coverage of the web and improve the time of inclusion in their index. Google Sitemaps are an easy way for you to help improve your coverage in the Google index. It's a collaborative
|
Type: Shareware; Released: 02/28/2007; Filesize: 2.9 MB; Price: USD $29.00;
Platforms: Windows XP, Windows
Tags:
Applets,
Dhtml,
Download,
Editor,
Flash,
Free,
Ftp,
Gif Animator,
Google,
Html |
 |
|
|
|
| A tool for automating Internet surfing. Combines web crawler functionality with advanced keywords text search, logical analysis of the document layout and offline browsing. Free software. Auto Web Browser saves a lot of time when you are looking for something on the Internet. No need for numerous clicking, waiting for pages download and closing annoying pop-ups. Just enter the words describing what you want to find. The Auto Web Browser
|
Type: Freeware; Released: 10/28/2004; Filesize: 2 B; Price: USD $0.00;
Platforms: Windows XP, Windows, Windows 2000
Tags:
Automation,
Browsing,
Crawler,
Keywords,
Offline,
Search |
 |
|
|
|
| Falcove gives you the opportunity of auditing your web site(s) as they are already audited by external hackers on your behalf. But this time, you will be the only master of your website... SELF HACKING? WHY?
Self Hacking is the efforts of a web-site owner(personal or corporate) in order to audit and penetrate into his/her web site.
By using Falcove, web-site owners can see whether their web site(s) are hackable or vulnerable to attacks
|
Type: Shareware; Released: 02/28/2007; Filesize: 4.2 MB; Price: USD $100.00;
Platforms: Windows 98, Windows, Windows NT, Windows 2000, Windows XP, Windows 2003
Tags:
Allesta,
Application,
Buy Server,
Buy Server(S),
Buy Servers,
Buyserver,
Buyserver(S),
Buyservers,
Computer Security,
Falcove |
 |
|
|
|
| Using Maui Security Scanner, web-site admins and IT-professionals can see whether their web site(s) are hackable or vulnerable to attacks. Identifying vulnerabilities such as SQL Injection and Cross-Site Scripting (XSS). Maui is a automated next-generation web application vulnerability scanner.
Able to quickly scan and analyze large complex web sites/applications, Maui identifies application vulnerabilities ( e.g. Cross Site Scripting (XSS), SQL injection, Code Inclusion
|
Type: Shareware; Released: 01/22/2008; Filesize: 21.1 MB; Price: USD $499.00;
Platforms: Windows 2000, Windows 2003, Windows Vista, Windows XP
Tags:
Cross Site Scripting,
Sql Injection,
Vulnerability Scanner,
Web Application Security,
Web Site Security,
Web Vulnerability Scanner,
Website Scanner,
Website Security |
 |
|
|
| |