Web crawler

[Tim Gaunt]

Hi,

Firstly, happy new year to you all.

I'm just wondering if anyone is able to help me develop a small crawler
to extract information from a directory (ie www.kellysearch.co.uk), this
is just for a personal project to expand my .NET knowledge but I don't
seem to be getting anywhere fast, I would be most grateful of any help
people can offer.

I look forward to your advice.

Tim

 

[W.G. Ryan eMVP]

Although I don't have the time to help out building it - this
http://www.users.bigpond.com/conceptdevelopment/Search/SearcharooV1/ may be
helpful to the project.

 

[Tim Gaunt]

Ah yes I saw that but from what I could see it was using physical paths,
I'll look into the code a little further to see if I can use something
from it

Thanks again.

Tim

 

[Cor Ligthert]

Tim,

Did you see what Nick (Nak) have set free on Internet
http://www.members.lycos.co.uk/nickpatemanpwp/soft-wtr2.htm

Nick is British too.

Maybe this helps?

Cor

 

[Tim Gaunt]

Hi Cor,

Nah I hadn't seen that but it looks great, getting it now...

thanks

Tim