someone feed the hamsters....
someone feed the hamsters....
Author
Discussion

Castrolcraig

Original Poster:

18,073 posts

235 months

Wednesday 17th June 2009
quotequote all
whats appertaining with the site today? proper proper slow and loads of oops not quite right screens appearing.

Mr Will

13,719 posts

235 months

Wednesday 17th June 2009
quotequote all
Tea break is over, should be back to normal now!

thumbup

Brabus Jord

1,589 posts

236 months

Wednesday 17th June 2009
quotequote all
ive just had about 5 mins of opps'

just thought i would let you know smile

Snoggledog

9,258 posts

246 months

Wednesday 17th June 2009
quotequote all
Idle curiosity but what is actually happening? I've read (repeatedly) "we're getting new servers" and "we're looking at that section of code" and a whole load of other somewhat ambiguous comments, but from what I can see no one has ever said "The root cause is this...". Followed by "and this is what we're planning to do to fix it."

Feeding the hamsters is all well and good for a laugh but what's going on chaps?

eta.. Happy to do testing and etc (as I'm unemployed at the moment) if you want someone to abuse any fixes you plan to put in place.

My rates are very good


Edited by Snoggledog on Wednesday 17th June 14:26

Mr Will

13,719 posts

235 months

Wednesday 17th June 2009
quotequote all
Pete said it best on a recent thread:

RacingPete said:
Hi guys... really sorry about the problems recently.

Reason: We made a change a few weeks back to the forums that meant the "Logged in as someone else" problem was fixed. This resulted in the problem being fixed but having a reaction of adding 30 million more page impressions in one go. This has resulted in our database servers becoming overloaded and not able to keep up with the demand.

Solution: We start a major server upgrade plan tomorrow which through testing has shown we will solve all these recent problems and hope to have an improving service throughout the week as we put the servers in.

I wish we had all the money in the world to solve these problems but running a top 160 UK website on a small budget is always going to be hard, especially in this economic climate. We are still a bit like Grommit putting out the train track in front of the train to keep up with demand... unfortunately this week we ran out of track!
Hope that explains things!

Snoggledog

9,258 posts

246 months

Wednesday 17th June 2009
quotequote all
Mr Will said:
Pete said it best on a recent thread:

RacingPete said:
Hi guys... really sorry about the problems recently.

Reason: We made a change a few weeks back to the forums that meant the "Logged in as someone else" problem was fixed. This resulted in the problem being fixed but having a reaction of adding 30 million more page impressions in one go. This has resulted in our database servers becoming overloaded and not able to keep up with the demand.

Solution: We start a major server upgrade plan tomorrow which through testing has shown we will solve all these recent problems and hope to have an improving service throughout the week as we put the servers in.

I wish we had all the money in the world to solve these problems but running a top 160 UK website on a small budget is always going to be hard, especially in this economic climate. We are still a bit like Grommit putting out the train track in front of the train to keep up with demand... unfortunately this week we ran out of track!
Hope that explains things!
Ah.. thumbup Thanks.

Silly question, but why has it taken so long for the indexing of 30 million impressions to catch up? Come to that why 30 million impressions? Seems rather huge. Surely once the impressions have taken place the data is (semi) static and shouldn't impact on hardware performance.

I'm not trying to second guess you, just puzzled is all.

Mr Will

13,719 posts

235 months

Wednesday 17th June 2009
quotequote all
Basically, people were seeing a saved version of the page so the databases were not having to do any work.

As soon as we turned off the caching the databases had to deal with a lot more load (not a backlog, just things which they weren't doing before) which has caused the overloading problems we are seeing

Snoggledog

9,258 posts

246 months

Wednesday 17th June 2009
quotequote all
Mr Will said:
Basically, people were seeing a saved version of the page so the databases were not having to do any work.

As soon as we turned off the caching the databases had to deal with a lot more load (not a backlog, just things which they weren't doing before) which has caused the overloading problems we are seeing
Makes perfect sense now. Thanks.


Sorry. I'm used to grilling developers

Rich7se

121 posts

209 months

Thursday 18th June 2009
quotequote all
Mr Will said:
Pete said it best on a recent thread:

RacingPete said:
I wish we had all the money in the world to solve these problems but running a top 160 UK website on a small budget is always going to be hard!
Forgive my lack of knowledge, but dont Haymarket contribute to your server costs?

Rich