Is SiteMeter Wrong?
In the good old days we used Hitbox to measure WinCustomize.com's traffic. And it was good. But then one day they stopped providing it for free and in fact made it bloody difficult to even pay for the service. Which is ironic because we would be willing to pay for a reliable, accurate and reasonably detailed site traffic monitoring service (withing reason).
But everyone we try out seems insist on us contacting some sales guy. Um no, I want to enter in a company credit card number, enter the monthly service plan choice and have some HTML provided to put it on the site. But oh well. So we found Site Meter.
Site Meter gives us results that we like but we're not sure how accurate they are. Hitbox used to report that we got around 70,000 unique visitors per day and that came out to being around 1 point something million per month when they discontinued the service over a year ago. Siter Meter, by contrast, claims we get around 500,000 visitors per day. But that's not "unique" visitors.
And that's okay. All we're interested in knowing is whether overall traffic is good or bad on a given day relative to other days. Which is where Sitemeter has been giving us problems this week. Our peek hours are between 9am and 4pm EST. But in the past 3 days, according to SiteMeter, traffic just collapses between those hours and then picks up later in the day (if you're looking at the graph, the part of the day we haven't been to is 0, just know that hours 9 through 16 should be the peek hours).
It's as if the system freaks out at having that many hits and shuts down or something. Which is annoying. We noticed that the page hits it records stays the same and what it instead says is that the average visit time on WC is 20 minutes which is absurd. It's more like 5 minutes for the average user (yes, plenty of people spend hours on the site but that's not the norm when you're talking about tens of thousands of people on in a given hour). So during our peek hours, our hourly visitor level according to SiteMeter drops from 25,000 visitors at 8am to under 9,000 by 2pm). That makes no sense at all.
Our first concern was that maybe WinCustomize basically crashes for most people when the site gets really busy. That it gets overloaded and nobody is actually able to do anything and so the hit counter isn't being accessed. But on our IRC channel (irc.stardock.com #stardock) I asked there and no one had any problems at all. So that's not it.
Late this afternoon we took the Sitemeter counter off one of the servers to see what affect that would have. None. Which makes us more suspicious that perhaps WC's traffic reaches a level that Sitemeter can't handle it. I'm not aware of any sites as popular as WC that uses Site Meter. The only site I know of that's quite popular that uses it is Instapundit which isn't anywhere near the same level (very popular for a blog site of course).
My personal theory is that maybe Site Meter gets overflow errors if the page view count exceeds 32,535. I say that because even as traffic plummets during the day (according to the graph) the page view counter seems to max out at around 32,500. And when the peek time passes, the page views stays still very high but miraculously, the visitors per hour jumps back up (18,000 last hour and that's with the site meter button only on one server).
Anywya, I wonder if anyone else has run into this sort of thing?