How can i save a page content from a http address? (just like a Search Engine Robot)

  • Thread starter Thread starter gonzal kamikadze
  • Start date Start date
G

gonzal kamikadze

Hi



I was just wondering if it is hard to write a small engine that will only
read/index a page from the internet that will be accessible only thru
http://...

(You could say it's like a search engine robot...)



Any examples?

code in ASP or ASP.NET (vb)





Regards

Gonzalez
 
Hi gonzal,

You can use HttpWebRequest to get content of a web page
from internet.

HTH

Elton Wang
(e-mail address removed)
 
gonzal said:
Hi



I was just wondering if it is hard to write a small engine that will
only read/index a page from the internet that will be accessible only
thru http://...

(You could say it's like a search engine robot...)



Any examples?

code in ASP or ASP.NET (vb)
Click to expand...

The easiest way to do that in .NET is:

string url = "http://host/path/to/page.html";
WebClient wc = new WebClient(); // That is System.Net.WebClient
byte[] data = wc.DownloadData(url);

Cheers,
 
Back
Top