DNS Caching?

[Justin Weinberg]

I'm in the process of writing a multithreaded web spider. Everything is
great, but I'm putting an unecessary load on the DNS server at work.

I need to figure out a way to implement some form of DNS caching for
subsequent web requests.

I can get the IP address on the first request and save it along with the
URL, but dotnet doesn't want to allow me to set the pieces in the header I
need to in order to indicate which site to get from the given IP.

Thoughts?

Thanks!

 

[feroze]

The OS already implements some sort of DNS caching. Before you go
implementing your own, you should evaluate whether it really makes sense to
do so.

Also, I am not sure about your comment

"I can get the IP address on the first request and save it along with the
URL, but dotnet doesn't want to allow me to set the pieces in the header I
need to in order to indicate which site to get from the given IP"

can you clarify what you mean ?

thanks

feroze
===============
this posting is provided as is and confers no rights.