ad.doubleclick.net blocks IE's Back button

  • Thread starter Thread starter _dee
  • Start date Start date
D

_dee

I've added the accursed ad.doubleclick.net and variations into my
hosts file, and also added the many doubleclick domains into IE's
Restricted Sites. I've also run a couple different spyware checkers
(adaware, spybot, etc).

IE's Back button is still rendered useless on many sites. The dropdown
menu to the right of the Back button (that shows previously visited
sites) registers at least one entry on the top for ad.doublelick.net.

This is even happening on Amazon.com!

Is there any sure-fire way from nailing that plague once and for all?
 
_dee said:
I've added the accursed ad.doubleclick.net and variations into my
hosts file, and also added the many doubleclick domains into IE's
Restricted Sites. I've also run a couple different spyware checkers
(adaware, spybot, etc).

IE's Back button is still rendered useless on many sites. The dropdown
menu to the right of the Back button (that shows previously visited
sites) registers at least one entry on the top for ad.doublelick.net.

This is even happening on Amazon.com!

Is there any sure-fire way from nailing that plague once and for all?


Try Tools>Internet Options>Privacy>Advanced. Check "Override automatic
cookie handling", check accept first party cookies, block third party
cookies, always allow session cookies.
 
_dee schrieb am Sat, 24 Feb 2007 06:34:12 -0500:
IE's Back button is still rendered useless on many sites. The dropdown
menu to the right of the Back button (that shows previously visited
sites) registers at least one entry on the top for ad.doublelick.net.

Please give exact repro steps to reproduce this. I guess this stuff that
you are talking about is in iframes and moving to Restricted Sites won't
help with this at all. Hosts should help. But since you just complain and
give no real information ...

Kai
 
JimR said:
Try Tools>Internet Options>Privacy>Advanced. Check "Override automatic
cookie handling", check accept first party cookies, block third party
cookies, always allow session cookies.

Thanks for that tip Jim.
 
_dee schrieb am Sat, 24 Feb 2007 06:34:12 -0500:


Please give exact repro steps to reproduce this. I guess this stuff that
you are talking about is in iframes and moving to Restricted Sites won't
help with this at all. Hosts should help. But since you just complain and
give no real information ...

Kai

What? Kai, maybe syntax is a problem but that sounded like a scolding.
I thought that I had included relevant info, but you snipped it.

Again:

[I've added the accursed ad.doubleclick.net and variations into my
[hosts file, and also added the many doubleclick domains into IE's
[Restricted Sites. I've also run a couple different spyware checkers
[(adaware, spybot, etc).
[
[IE's Back button is still rendered useless on many sites. The
[ dropdown
[menu to the right of the Back button (that shows previously visited
[sites) registers at least one entry on the top for ad.doublelick.net.
[
[This is even happening on Amazon.com!

So, to summarize:
1: Host file covered
2: 'Restricted Sites' covered
3: Spyware testers turn up nothing

Also, I've had cookie handling overridden for quite a while now.
Both First-party and Third-party cookies are blocked. Session cookies
are allowed.

In 'Manage Add-ons', everything is disabled except for:
Adobe PDF
Adobe PDF Reader Link
Google
Google Toolbar Helper

What other info is needed?

I assumed, maybe incorrectly, that this would be a chronic problem
with many users. Does it not turn up often?
 
Try Tools>Internet Options>Privacy>Advanced. Check "Override automatic
cookie handling", check accept first party cookies, block third party
cookies, always allow session cookies.

Hi Jim,

I've always had both First-party and Third-party cookies disabled.
Session cookies are enabled. So that shouldn't be a problem.

I'm curious about that--how would cookies affect what gets into the
Back button?

(Some other info posted in separate message to Kai)
 
_dee schrieb am Mon, 26 Feb 2007 05:03:00 -0500:
What other info is needed?

You jump over the most important part. Still, the repro steps are missing.
How can I see your problem? Where should I go, what should I do? Simply
going to www.amazon.com doesn't give me your alleged result, there is
nothing in the history.

Kai
 
_dee schrieb am Mon, 26 Feb 2007 05:05:47 -0500:
I've always had both First-party

You shouldn't block first-party cookies unless you want to have problems
with sites that use cookies for login and remembering preferences.

Kai
 
_dee schrieb am Mon, 26 Feb 2007 05:03:00 -0500:


You jump over the most important part. Still, the repro steps are missing.
How can I see your problem? Where should I go, what should I do? Simply
going to www.amazon.com doesn't give me your alleged result, there is
nothing in the history.

Kai

How about IMDB? This link causes the servedby.advertising site to
appear in the Back button's history every time. (Amazon is not as
consistent)

http://www.imdb.com/title/tt0114369/

If that doesn't work, please try clicking a couple links on the IMDB
site.

Again, servedby.advertising is already in my hosts file. It is also
blocked in IE's Restricted Sites.

Does anyone know what the servedby.advertising site is about? It
appears to be specifically linked by IMDB (and others) so I'm guessing
that it is some kind of monitoring/counter service. Is that correct?
 
_dee schrieb am Tue, 27 Feb 2007 22:24:28 -0500:
http://www.imdb.com/title/tt0114369/

If that doesn't work, please try clicking a couple links on the IMDB
site.

Still not getting anything and I ended up at Kenneth Branagh after six
clicks or so. Maybe they use GeoIP targetting? There's also an iframe for
Kanoodle ads in the page, but this doesn't appear in the history either.
Again, servedby.advertising is already in my hosts file. It is also
blocked in IE's Restricted Sites.

servedby.advertising is not a valid domain.
*What* did you put in the hosts file and *what* did you put in Restricted
sites?

If you want to block something, View Source and then search for "iframe"
and for "advertising". Write down the URLs you find with "advertising" and
look in the iframes you find for the URLs (src=) they come from and write
these down as well. You should at least find "i.imdb.com" in an iframe as
this is where the Kanoodle ads come from.
Then search the whole source for script tags and write down the URLs they
retrieve a script from. They appear like this:
document.write('<scr'+'ipt
src="http://fe.lea.lycos.de/ats/adfunction.js"></scr'+'ipt>')
As you see they obfuscate their source by splitting the "script" tag in
two parts, so ad blockers may get confused.
If you want to block this you have to put
127.0.0.1 fe.lea.lycos.de
in your hosts file (the full hostname!).
If you want to stop executing a script from there you can add
fe.lea.lycos.de
lea.lycos.de
lycos.de
to your restricted sites. The more general the hostname the more you
block.

You may try adding "imdb.com" to your Restricted Sites. This would stop
executing all of their owns scripts and may also stop the pollution of
your history.

As a general help for theses cases:
[IE's Back button is still rendered useless on many sites. The
[ dropdown
[menu to the right of the Back button (that shows previously visited
[sites) registers at least one entry on the top for ad.doublelick.net.

When this occurs and you cannot go back with the back button either click
it twice very fast or click the entry right below that advertising site.
That will make you "jump" over the offending page.
Does anyone know what the servedby.advertising site is about?

A site that serves banners, what else? ;-)

Kai
 
_dee schrieb am Tue, 27 Feb 2007 22:24:28 -0500:


Still not getting anything and I ended up at Kenneth Branagh after six
clicks or so. Maybe they use GeoIP targetting? There's also an iframe for
Kanoodle ads in the page, but this doesn't appear in the history either.

I'm not sure what's going on then. I just went directly to the Branagh
page and it registered http://servedby.advertising.com/site=71 in the
Back button history.
servedby.advertising is not a valid domain.
*What* did you put in the hosts file and *what* did you put in Restricted
sites?

The hosts file was derived from a sample hosts file with lots of
anti-spam/anti-popup entries in place. That included these entries:

# [Advertising.com][IE-SpyAd]
127.0.0.1 opera1-servedby.advertising.com
127.0.0.1 servedby.advertising.com

(along with lots of other problematic domains like Cool Web Search)

Restricted Sites:
I had originally added the site verbatim, as:

servedby.advertising.com

Later added IE-SpyAd's registry entries, which includes:

*.advertising.com
*.advertising.cz
....
If you want to block something, View Source and then search for "iframe"
and for "advertising". Write down the URLs you find with "advertising" and
look in the iframes you find for the URLs (src=) they come from and write
these down as well. You should at least find "i.imdb.com" in an iframe as
this is where the Kanoodle ads come from.

When an IMDB page loads, the source includes:

<!-- sid : 7833 -->
<div align="center">
<iframe
src="http://servedby.advertising.com/site=710882/bnum=565386/size=728090/tags=1/optn=1"
scrolling="no" width="728" height="090" frameborder="0"
marginheight="0" marginwidth="0"></iframe>
Then search the whole source for script tags and write down the URLs they
retrieve a script from. They appear like this:
document.write('<scr'+'ipt
src="http://fe.lea.lycos.de/ats/adfunction.js"></scr'+'ipt>')
As you see they obfuscate their source by splitting the "script" tag in
two parts, so ad blockers may get confused.

Those sneaky bastards! <g> Here's what I see:

if (document.cookie.indexOf('AdComPop712651')==-1) {
setCookie('AdComPop712651','yes',24);
var bnum=new Number(Math.floor(99999999 * Math.random())+1);
document.write('<SCR'+'IPT LANGUAGE="JavaScript" ');
If you want to block this you have to put
127.0.0.1 fe.lea.lycos.de
in your hosts file (the full hostname!).
If you want to stop executing a script from there you can add
fe.lea.lycos.de
lea.lycos.de
lycos.de
to your restricted sites. The more general the hostname the more you
block.

Given that, I'm not sure why my current hosts entries are not working.
You may try adding "imdb.com" to your Restricted Sites. This would stop
executing all of their owns scripts and may also stop the pollution of
your history.

I suppose that's next. I will probably not be able to access some of
the features of IMDB afterward.
As a general help for theses cases:
[IE's Back button is still rendered useless on many sites. The
[ dropdown
[menu to the right of the Back button (that shows previously visited
[sites) registers at least one entry on the top for ad.doublelick.net.

When this occurs and you cannot go back with the back button either click
it twice very fast or click the entry right below that advertising site.
That will make you "jump" over the offending page.

I'll try the fast double-click trick. I have been dropping down the
history list and going to the entry underneath.
A site that serves banners, what else? ;-)

Thanks, Kai. It sounds like you took spent some effort in figuring
this out. I appreciate that. Given that the entries are already in
hosts and Restricted Sites, do you see any reason why that is still
getting into IE's history?
 
_dee schrieb am Thu, 01 Mar 2007 01:18:55 -0500:
When an IMDB page loads, the source includes:

That's obviously your equivalent of Kanoodle because you are visiting
from a different part of the world ;-) And you get that extra
"if (document.cookie.indexOf('AdComPop712651')" that I don't get at all.
There must be something in the iframe page that pushes it in the history.
The Kanoodle ad does not push itself there, so it doesn't look like a
general problem with iframes, but only with specific ones. We discussed
this about a month ago or so here, concerning ads in NYT I think. *There*
I was able to repro it and thought it might be a general bug in IE7, but
now I think it's related to the code they push into this iframe.
Thanks, Kai. It sounds like you took spent some effort in figuring
this out. I appreciate that. Given that the entries are already in
hosts and Restricted Sites, do you see any reason why that is still
getting into IE's history?

To make a long thing short: no.
Yes, your hosts entries seem to be okay. For hosts you have to always use
the full hostname since it doesn't support wildcards. Restricted sites
supports wildcards, but it doesn't block requests it just stops certain
actions like execution of script.

Ahm, what happens when you go straight to
http://servedby.advertising.com/site=710882/bnum=565386/size=728090/tags=1/optn=1
?

Also, you may want to clean out your Cookies and then set to block all
third-party cookies. (allow all first-party and session cookies.) and
maybe stop imdb.com from setting cookies at all as they seem to keep
track of ads with cookies.

Kai
 
_dee schrieb am Thu, 01 Mar 2007 01:18:55 -0500:


That's obviously your equivalent of Kanoodle because you are visiting
from a different part of the world ;-) And you get that extra
"if (document.cookie.indexOf('AdComPop712651')" that I don't get at all.
There must be something in the iframe page that pushes it in the history.
The Kanoodle ad does not push itself there, so it doesn't look like a
general problem with iframes, but only with specific ones. We discussed
this about a month ago or so here, concerning ads in NYT I think. *There*
I was able to repro it and thought it might be a general bug in IE7, but
now I think it's related to the code they push into this iframe.

It seems odd that there are no direct workarounds short of practiaclly
disabling the site. I did follow up on the suggestion about placing
IMDB in Restricted Sites, and it did keep the ads.. url out of the
back button. But now I can't get to extended pages on IMDB.

Also, that would seem to require adding tons of URLs to Restricted
Sites. You'd think there would be a generalized solution to this.

Got a 404 at that exact URL. Trying the root site gave a signin
screen.
Also, you may want to clean out your Cookies and then set to block all
third-party cookies. (allow all first-party and session cookies.) and

I had done that.
maybe stop imdb.com from setting cookies at all as they seem to keep
track of ads with cookies.

I have cookies disabled by default, but initially had cookies enabled
for IMDB so I could access their 'member-specific' pages without
having to sign in.
 
_dee schrieb am Tue, 06 Mar 2007 00:47:25 -0500:
It seems odd that there are no direct workarounds short of practiaclly
disabling the site. I did follow up on the suggestion about placing
IMDB in Restricted Sites, and it did keep the ads.. url out of the
back button. But now  I can't get to extended pages on IMDB.

Well, it disables all Javascript ...
Also, that would seem to require adding tons of URLs to Restricted
Sites. You'd think there would be a generalized solution to this.


Got a 404 at that exact URL. Trying the root site gave a signin
screen.

A 404 from who? IE? The site?
What is it that you mean by "root site"?
http://servedby.advertising.com/
or just
http://advertising.com/
?

I'm trying to find out if the entry in your hosts file is *really* used.
Try navigating to the sites you put in your hosts file. Can you access these are do
they time-out/"cannot display"?

Kai
 
FYI, I've noticed this same behaviour (ads being added to the back button)
ever since I changed my hosts file to an ad-blocking hosts file from
http://mvps.org/winhelp2002/hosts.htm. It redirects most common ad sites to
127.0.0.1, effectively preventing them from ever loading. It seems to be a
bit of a trade-off...if they're in my Restricted Sites AND in my hosts file,
they're not added to the history, but in XP SP2, I get a message popping up
for every single time one of them is on a web page...which gets damned
annoying when it's two or three ads on every page load, every refresh, every
everything. If they're only in my hosts file, on the other hand, there's no
error, but the site gets added to my history, even though the IFrame didn't
actually load anything. And finally, if they're only in my Restricted
Sites, because they're in an IFrame, the Restricted Sites rules seem to be
ignored, and the ad comes through just fine, which is obviously undesirable.

Interestingly enough, with the ad sites only in the hosts file and not in
your Restricted Sites, when you scroll through pages on a web site, they get
added to your history in sequential order WITHOUT the ads in-between. The
ad sites always seem to be bumped to the top of the list. Since the IFrames
aren't actually loading anything, my impression is that this is indeed an
IE7 bug and has nothing to do with any code contained in the IFrame.

This behaviour is also documented in the FAQ file for the Hosts file I
downloaded...see: http://mvps.org/winhelp2002/hostsfaq.htm#Button

So it seems to be a matter of picking your poison. Which problem do you
find least annoying? Personally, I've opted for hosts file only and I'll
cope with the back button listing the additional sites.



Rob
 
Robert Morley schrieb am Tue, 6 Mar 2007 11:04:21 -0500:

Hi Robert,

thanks for that interesting extra information.
FYI, I've noticed this same behaviour (ads being added to the back button) 
ever since I changed my hosts file to an ad-blocking hosts file from 
http://mvps.org/winhelp2002/hosts.htm.  It redirects most common ad sites to 
127.0.0.1, effectively preventing them from ever loading.  It seems to be a 
bit of a trade-off...if they're in my Restricted Sites AND in my hosts file, 
they're not added to the history, but in XP SP2, I get a message popping up 
for every single time one of them is on a web page...

This is also mentioned on the winhelp2002 site. That probably happens because
the page cannot be fetched. In this case IE would generate it's own "cannot
display" page (which resides in shdocvw.dll in IE6) and thus prompts you
because it navigates to a different security zone. Which means if you can
avoid the "cannot display" page this should stop to happen. (see below)

That this stops from happening when you add the site to Restricted Sites might
indicate that it is actually a script in there that produces this undesired
history addition effect. iframes are not shut off in Restricted Sites. But
"programs and files" in iframes are disabled by default in this zone.

which gets damned 
annoying when it's two or three ads on every page load, every refresh, every 
everything.  If they're only in my hosts file, on the other hand, there's no 
error, but the site gets added to my history, even though the IFrame didn't 
actually load anything.

But I think you can click this undesired entry and IE goes to this "page" and
displays the "cannot display" page. Does it do this?

 And finally, if they're only in my Restricted 
Sites, because they're in an IFrame, the Restricted Sites rules seem to be 
ignored, and the ad comes through just fine, which is obviously undesirable.

They don't get ignored. Restricted Sites restricts only script execution and
such, not iframes. An iframe is just an inline frame and more or less the same
as a "normal" frame, it's a viewing area where a ressource, typically a website
can be loaded. If you look at the source code you will also see that they
usually take care that the ad gets shown, anyway. Which means they load the ad
by iframe, an alternative script, a noscript portion and maybe yet another
means. Just so, if one option is blocked still the other is carried out. In
case the options are mutually exclusive they use a cookie that prevents the
second method from firing. Of course, this can also backfire. For instance
because of the extra ad blocking the cookie may not get set and only this
somehow produces the undesired extra entry. (This is speculation.)
This behaviour is also documented in the FAQ file for the Hosts file I 
downloaded...see:  http://mvps.org/winhelp2002/hostsfaq.htm#Button

Yes, they describe it there, thanks. But this means, it's *not* specific to
IE7, but happens with IE6 SP2 as well when an iframe cannot be fetched or at
least it's connected to that somehow.
So it seems to be a matter of picking your poison.  Which problem do you 
find least annoying?  Personally, I've opted for hosts file only and I'll 
cope with the back button listing the additional sites.

Well, as I mentioned above, there may be a cure for this, but not for everyone.
You need to do a little bit for this.
I do extensive ad blocking myself, but I don't use a local hosts file. And I do
not see this problem at all. I use a proxy in my network and on *that* machine
I use a hosts file for blocking. And I have a web server running on it that
answers with a red one-pixel gif image to every request to 127.0.0.1.
So, each time an ad is blocked I either get a tiny red pixel inserted (if the
image or ressource doesn't tell the size) or the complete banner area is
painted in red (in case the HTML code tells an image size). I originally did
this because scripts fetching such a non-existent resource can keep a web page
from rendering until it finally times out after quite a while. If I serve an
image for those requests this doesn't happen.

This same method seems to avoid those extra iframe entries in the history.
So, if you have a network you could do the same as I did. Or if you want or
have to keep the solution on the same machine as IE you can install a web
server and serve a red-pixel.gif from there. I suggest using Apache for this.
It has small footprint, runs as a service (so once it's configured you just
forget about it) and is easily installed and configured (at least for a simple
serving from 127.0.0.1).
If you have a webserver somewhere else that has its own IP number you could
also reuse that. Serve a red-pixel.gif from the raw IP number and point the
hosts file to that IP number instead of 127.0.0.1.

Hope this helps. If you or someone else tries this, tell me if you history
pollution went away.

Kai
 
annoying when it's two or three ads on every page load, every refresh,
But I think you can click this undesired entry and IE goes to this "page"
and
displays the "cannot display" page. Does it do this?

If I click on the entry in the history, it simply refreshes it (with the
"cannot display" page) in the IFrame.
Yes, they describe it there, thanks. But this means, it's *not* specific
to
IE7, but happens with IE6 SP2 as well when an iframe cannot be fetched or
at
least it's connected to that somehow.

Quite likely, yes. I wouldn't know, since I haven't tried using a hosts
file to block ads until just now.
I use a hosts file for blocking. And I have a web server running on it
that
answers with a red one-pixel gif image to every request to 127.0.0.1.

They do mention a small utility called Homer on the website I mentioned,
which basically intercepts calls to 127.0.0.1 on the local machine, so maybe
I'll give that a try and see if it prevents the problem.

I'm not entirely sure how you serve red-pixel.gif in place of the ad, but
one problem at a time: first I'll download and install Homer (or if it's
unsuitable for some reason, I'll try Apache), then I'll go from there.



Rob
 
FYI, I installed and ran Homer, and voila, problem is gone. And talk about
a small footprint: 283K exe! (Peak memory usage after only browsing a few
pages was 5600K; current memory usage is just under 3800K.)


Rob
 
Robert Morley schrieb am Wed, 7 Mar 2007 12:20:54 -0500:
FYI, I installed and ran Homer, and voila, problem is gone.

Perfect. I had a look at the funkytoad site and there's other software
that fits in this area as well, in case you didn't already notice.

Kai
 
Robert Morley schrieb am Wed, 7 Mar 2007 12:12:42 -0500:
If I click on the entry in the history, it simply refreshes it (with the 
"cannot display" page) in the IFrame.

So, where the iframe would show in the page there's the "cannot display"
page then? I see. I didn't imagine this. I thought it would be on a "page
of its own". But it makes sense that it shows there.

Kai
 
Back
Top