Parsing Utility

  • Thread starter Thread starter Alexander Fischer
  • Start date Start date
A

Alexander Fischer

Hello,
I'm looking for a utility, running on Windows, which can perform this
task: take a given URL (plus possibly some filters/restrictions), crawl
it until a certain limit (e.g., 3 levels deep) and create a simple text
or html file which lists all the files which exist on this site.

E.g., input: http://cnn.com
Output:
http://cnn.com/images/index.htm
http://cnn.com/images/logo1.gif
http://cnn.com/images/logo2.gif
http://cnn.com/images/logo3.gif
http://cnn.com/images/information.zip

etc.

This must be easy - however I'm not finding anything. Can anybody help
me?

To clarify: I do NOT want a tool like httrack which will DOWNLOAD all
these files - I only want to see which files exist.

Thank you!

Alex
 
Hello,
I'm looking for a utility, running on Windows, which can perform this
task: take a given URL (plus possibly some filters/restrictions), crawl
it until a certain limit (e.g., 3 levels deep) and create a simple text
or html file which lists all the files which exist on this site.

E.g., input: http://cnn.com
Output:
http://cnn.com/images/index.htm
http://cnn.com/images/logo1.gif
http://cnn.com/images/logo2.gif
http://cnn.com/images/logo3.gif
http://cnn.com/images/information.zip

etc.

This must be easy - however I'm not finding anything. Can anybody help
me?

To clarify: I do NOT want a tool like httrack which will DOWNLOAD all
these files - I only want to see which files exist.

Thank you!

Alex
Click to expand...
It's very important to have a Site Map so search engines can find all of
your pages.

Also many of your visitors use Site Maps to navigate your Website to get
where they need to go instead of looking for links.

It's free so have fun with it and don't forget about our other Web
Design software and services like Search Engine Submission and Web
Hosting.

Just point CoffeeCup SiteMapper to where your Website is located at on
your hard drive and it will create a nice page you can use for a Site
Map.

All of your Web pages will be listed and linked in order and the page
will match your existing colors, backgrounds, etc...

http://www.coffeecup.com/sitemapper/

Just point CoffeeCup SiteMapper to where your Website is located at on
your hard drive and it will create a nice page you can use for a Site
Map. All of your Web pages will be listed and linked in order and the
page will match your existing colors, backgrounds, etc....

Some Features of CoffeeCup Free SiteMapper:
- Create a sitemap for your website with just a few clicks.
- Searches through your folders and creates a site map in seconds.
- Include or Exclude certain files and folders by adding them to the
list.
- Auto generates names from title tags.
- Change the look of the output page with point and click color pallet.
- Easily copy and paste the output into a current document.
- Save your sitemap so you can add to it at a later time.
- Add images to your output files for a bit more flare.
- Browse, Next Next, Finish and you are done.
- Multiple output formats for variety.
- Super easy output page link editor.
- View output file with default browser.
- Quick copy button (oh so simple).
- Mistakenly add a file, no problem right-click and ignore it.
- Make a sitemap, your search engine rank will thank you.
- Have a Question? Check out our Online Help
 
Free?????
Mel said:
It's very important to have a Site Map so search engines can find all of
your pages.

Also many of your visitors use Site Maps to navigate your Website to get
where they need to go instead of looking for links.

It's free so have fun with it and don't forget about our other Web
Design software and services like Search Engine Submission and Web
Hosting.

Just point CoffeeCup SiteMapper to where your Website is located at on
your hard drive and it will create a nice page you can use for a Site
Map.

All of your Web pages will be listed and linked in order and the page
will match your existing colors, backgrounds, etc...

http://www.coffeecup.com/sitemapper/

Just point CoffeeCup SiteMapper to where your Website is located at on
your hard drive and it will create a nice page you can use for a Site
Map. All of your Web pages will be listed and linked in order and the
page will match your existing colors, backgrounds, etc....

Some Features of CoffeeCup Free SiteMapper:
- Create a sitemap for your website with just a few clicks.
- Searches through your folders and creates a site map in seconds.
- Include or Exclude certain files and folders by adding them to the
list.
- Auto generates names from title tags.
- Change the look of the output page with point and click color pallet.
- Easily copy and paste the output into a current document.
- Save your sitemap so you can add to it at a later time.
- Add images to your output files for a bit more flare.
- Browse, Next Next, Finish and you are done.
- Multiple output formats for variety.
- Super easy output page link editor.
- View output file with default browser.
- Quick copy button (oh so simple).
- Mistakenly add a file, no problem right-click and ignore it.
- Make a sitemap, your search engine rank will thank you.
- Have a Question? Check out our Online Help
Click to expand...
 
Take a look at my GSiteCrawler: http://johannesmueller.com/gs/ (free,
at least for the moment) :-)

Forget about toys like the Coffee-Cup thing, if you're serious about
crawling a site, and you're serious about a working sitemap-file, you
need heavy-duty software... A bad sitemap file will get your page
delisted on Google within 6-24 hrs.

Cheers
john
 
It's very important to have a Site Map so search engines can find all of
your pages.

Also many of your visitors use Site Maps to navigate your Website to get
where they need to go instead of looking for links.

It's free so have fun with it and don't forget about our other Web
Design software and services like Search Engine Submission and Web
Hosting.

Just point CoffeeCup SiteMapper to where your Website is located at on
your hard drive and it will create a nice page you can use for a Site
Map.

All of your Web pages will be listed and linked in order and the page
will match your existing colors, backgrounds, etc...

http://www.coffeecup.com/sitemapper/

Just point CoffeeCup SiteMapper to where your Website is located at on
your hard drive and it will create a nice page you can use for a Site
Map. All of your Web pages will be listed and linked in order and the
page will match your existing colors, backgrounds, etc....

Some Features of CoffeeCup Free SiteMapper:
- Create a sitemap for your website with just a few clicks.
- Searches through your folders and creates a site map in seconds.
- Include or Exclude certain files and folders by adding them to the
list.
- Auto generates names from title tags.
- Change the look of the output page with point and click color pallet.
- Easily copy and paste the output into a current document.
- Save your sitemap so you can add to it at a later time.
- Add images to your output files for a bit more flare.
- Browse, Next Next, Finish and you are done.
- Multiple output formats for variety.
- Super easy output page link editor.
- View output file with default browser.
- Quick copy button (oh so simple).
- Mistakenly add a file, no problem right-click and ignore it.
- Make a sitemap, your search engine rank will thank you.
- Have a Question? Check out our Online Help
Click to expand...

Want to download it?

1. Get a site on Blue Domino and you can have it free.
No!
2. Supply your e-mail address so that they can SPAM you first. Then
download the trial version.
 
perhaps:

Program: SpiderMonki
Author: (r a i - n e r)
http://spidermonki.netfirms.com/

If you start here and scoll down through the next several subcategories you'll find more apps that
can spider web sites. Many of them can also download files. . .

http://www.pricelesswarehome.org/acf/P_INTERNET.php#7.00DownloadSearcher

-----------
Want to download it?

1. Get a site on Blue Domino and you can have it free.
No!
2. Supply your e-mail address so that they can SPAM you first. Then
download the trial version.
Click to expand...

Perhaps just use a different site mapper. ;)

http://www.pricelesswarehome.org/acf/P_WEBDESIGN.php#2.01MakeSiteIndex

Susan
--
Posted to alt.comp.freeware
Search alt.comp.freeware (or read it online):
http://www.google.com/advanced_group_search?q=+group:alt.comp.freeware
Pricelessware & ACF: http://www.pricelesswarehome.org
Pricelessware: http://www.pricelessware.org (not maintained)
 
Want to download it?

1. Get a site on Blue Domino and you can have it free.
No!
2. Supply your e-mail address so that they can SPAM you first. Then
download the trial version.
Click to expand...
Zipped and posted to ABF.
 
Back
Top