The Flat Earth Society

The Flat Earth Society => Announcements => Topic started by: Daniel on January 01, 2010, 04:37:09 AM

Title: Sorry about the downtime!
Post by: Daniel on January 01, 2010, 04:37:09 AM
We ran over our bandwidth limit last night thanks largely to the extraordinary efforts of the search spider from MSN which ate up 9+ gigs of bandwidth in December.  I've put some blocks in place to hopefully prevent that from happening again this time.  Anyway, things are back to normal now and we shouldn't have any issues like that in the future.

Happy New Year!
Title: Re: Sorry about the downtime!
Post by: theonlydann on January 01, 2010, 05:31:28 AM
I was scared Daniel. I figured it was the conspiracies NY Resolution to stop the spread of information.

FIGHT THE GOOD FIGHT!!! Happy New Year!
Title: Re: Sorry about the downtime!
Post by: Taters343 on January 01, 2010, 06:47:42 AM
Did you hear about that vault 101 spider that happened upon a the Flat Earth Village and ate up 9 gigs of their supplies and left them with nothing for the new year? With all your wasteland news this is Threedog, aahhooooooooooooooooo, and that's all for now.


That is what I thought of when I read "FIGHT THE GOOD FIGHT!!!" Also, hooray for being back up!
Title: Re: Sorry about the downtime!
Post by: Dino on January 01, 2010, 09:32:56 AM
This was a good test run. Eventually the fed I mean goldman sachs i mean the fed will shut us down for good and we will have to find another means to communicate. Perhaps we should build a giant network of pneumatic tubes?
Title: Re: Sorry about the downtime!
Post by: Daniel on January 01, 2010, 10:13:51 AM
This was a good test run. Eventually the fed I mean goldman sachs i mean the fed will shut us down for good and we will have to find another means to communicate. Perhaps we should build a giant network of pneumatic tubes?


There's always IRC.  It's similar, from what I've read.
Title: Re: Sorry about the downtime!
Post by: markjo on January 01, 2010, 10:44:23 AM
This was a good test run. Eventually the fed I mean goldman sachs i mean the fed will shut us down for good and we will have to find another means to communicate. Perhaps we should build a giant network of pneumatic tubes?


There's always IRC.  It's similar, from what I've read.

I believe that you're thinking about Usenet news groups.  Usenet has a similar board/thread structure that was most likely the direct predecessor of forums like this.
Title: Re: Sorry about the downtime!
Post by: Daniel on January 01, 2010, 01:17:33 PM
This was a good test run. Eventually the fed I mean goldman sachs i mean the fed will shut us down for good and we will have to find another means to communicate. Perhaps we should build a giant network of pneumatic tubes?


There's always IRC.  It's similar, from what I've read.

I believe that you're thinking about Usenet news groups.  Usenet has a similar board/thread structure that was most likely the direct predecessor of forums like this.

True, but it lacks pneumatic tubes.
Title: Re: Sorry about the downtime!
Post by: markjo on January 01, 2010, 01:50:14 PM
This was a good test run. Eventually the fed I mean goldman sachs i mean the fed will shut us down for good and we will have to find another means to communicate. Perhaps we should build a giant network of pneumatic tubes?


There's always IRC.  It's similar, from what I've read.

I believe that you're thinking about Usenet news groups.  Usenet has a similar board/thread structure that was most likely the direct predecessor of forums like this.

True, but it lacks pneumatic tubes.

But it does have an ample supply of carrier pigeons.
Title: Re: Sorry about the downtime!
Post by: Raist on January 01, 2010, 02:21:32 PM
Do we really want people that use MSN for searches to find this place?
Title: Re: Sorry about the downtime!
Post by: Taters343 on January 02, 2010, 01:01:58 PM
Do we really want people that use MSN for searches to find this place?

Definitely not.
Title: Re: Sorry about the downtime!
Post by: frostee on January 03, 2010, 02:39:37 AM
I love Bing!!!
Title: Re: Sorry about the downtime!
Post by: Daniel on January 03, 2010, 06:47:36 AM
I added something to my robots.txt telling msnbot to slow down a bit. It seems to be working so far. It's only eating about 1/3 of what it used to.  I don't anticipate any more bandwidth issues in the near future.
Title: Re: Sorry about the downtime!
Post by: Taters343 on January 03, 2010, 07:25:41 AM
Tell it to do a dance!
Title: Re: Sorry about the downtime!
Post by: frostee on August 12, 2010, 01:28:12 AM
Its Ok.
THANKS BRO
Title: Re: Sorry about the downtime!
Post by: SupahLovah on August 12, 2010, 08:27:02 AM
Its Ok.
THANKS BRO
LOL REPLYING TO SPAMBOT IS COOL.
Title: Re: Sorry about the downtime!
Post by: Parsifal on August 12, 2010, 08:54:22 AM
LOL REPLYING TO SPAMBOT IS COOL.

Frostee isn't a spam bot, you idiot.
Title: Re: Sorry about the downtime!
Post by: SupahLovah on August 12, 2010, 09:14:01 AM
LOL REPLYING TO SPAMBOT IS COOL.

Frostee isn't a spam bot, you idiot.
How sure are you?
Title: Re: Sorry about the downtime!
Post by: John Davis on August 12, 2010, 01:46:20 PM
LOL REPLYING TO SPAMBOT IS COOL.

Frostee isn't a spam bot, you idiot.
Jason8099 is
Title: Re: Sorry about the downtime!
Post by: PizzaPlanet on August 12, 2010, 02:40:18 PM
LOL REPLYING TO SPAMBOT IS COOL.

Frostee isn't a spam bot, you idiot.
Jason8099 is still an account and his post, along with his sig, are still there
Why?
Title: Re: Sorry about the downtime!
Post by: John Davis on August 12, 2010, 02:49:40 PM
LOL REPLYING TO SPAMBOT IS COOL.

Frostee isn't a spam bot, you idiot.
Jason8099 is still an account and his post, along with his sig, are still there
Why?
I can't delete accounts and bannign it would be a waste of time as far as I can tell as he likely will never be back.
Title: Re: Sorry about the downtime!
Post by: PizzaPlanet on August 12, 2010, 02:53:53 PM
I think it's possible to either delete the sig or the post, though.
Title: Re: Sorry about the downtime!
Post by: Space Cowgirl on August 12, 2010, 04:58:22 PM
LOL REPLYING TO SPAMBOT IS COOL.

Frostee isn't a spam bot, you idiot.
Jason8099 is still an account and his post, along with his sig, are still there
Why?
I can't delete accounts and bannign it would be a waste of time as far as I can tell as he likely will never be back.

You can move the post to the dump forum, or just delete it. 
Title: Re: Sorry about the downtime!
Post by: John Davis on August 13, 2010, 09:10:21 AM
LOL REPLYING TO SPAMBOT IS COOL.

Frostee isn't a spam bot, you idiot.
Jason8099 is still an account and his post, along with his sig, are still there
Why?
I can't delete accounts and bannign it would be a waste of time as far as I can tell as he likely will never be back.

You can move the post to the dump forum, or just delete it. 
I had already deleted one and thought I got this one too.  Thanks guys.
Title: Re: Sorry about the downtime!
Post by: Daniel on November 24, 2010, 03:27:51 PM
Instead of creating a new thread, I'll just bump this one.  Sorry about the site going down today.  I had some bandwidth issues out of the blue.  It's resolved now and I don't expect any more problems in the near future.
Title: Re: Sorry about the downtime!
Post by: Horatio on November 24, 2010, 10:04:05 PM
Instead of creating a new thread, I'll just bump this one.  Sorry about the site going down today.  I had some bandwidth issues out of the blue.  It's resolved now and I don't expect any more problems in the near future.

You actually just needed to bump it, without this message. I didn't even notice the dates on the replies when I reading it.
Title: Re: Sorry about the downtime!
Post by: Pongo on November 25, 2010, 12:23:58 AM
Instead of creating a new thread, I'll just bump this one.  Sorry about the site going down today.  I had some bandwidth issues out of the blue.  It's resolved now and I don't expect any more problems in the near future.

You actually just needed to bump it, without this message. I didn't even notice the dates on the replies when I reading it.

Sit down Horatio, I have something to tell you that you may have trouble accepting.  Are you ready?  Okay.  Sometimes, things aren't about you. 

Once you've digested and accepted that, we can move on to realizing that, in fact, things that happen in this world will almost never be about you in any way whatsoever.  I know it's a lot to take in right now.  Give it some time.
Title: Re: Sorry about the downtime!
Post by: Horatio on November 25, 2010, 12:39:13 AM
Instead of creating a new thread, I'll just bump this one.  Sorry about the site going down today.  I had some bandwidth issues out of the blue.  It's resolved now and I don't expect any more problems in the near future.

You actually just needed to bump it, without this message. I didn't even notice the dates on the replies when I reading it.

Sit down Horatio, I have something to tell you that you may have trouble accepting.  Are you ready?  Okay.  Sometimes, things aren't about you. 

Once you've digested and accepted that, we can move on to realizing that, in fact, things that happen in this world will almost never be about you in any way whatsoever.  I know it's a lot to take in right now.  Give it some time.

Hey, Pongo, don't be a dick.
Title: Re: Sorry about the downtime!
Post by: Colonel Gaydafi on November 25, 2010, 12:55:10 AM
Instead of creating a new thread, I'll just bump this one.  Sorry about the site going down today.  I had some bandwidth issues out of the blue.  It's resolved now and I don't expect any more problems in the near future.

I forgive you.
Title: Re: Sorry about the downtime!
Post by: markjo on November 25, 2010, 10:43:26 AM
Instead of creating a new thread, I'll just bump this one.  Sorry about the site going down today.  I had some bandwidth issues out of the blue.  It's resolved now and I don't expect any more problems in the near future.

I forgive you.

To err is human.  To forgive is not company policy.
Title: Re: Sorry about the downtime!
Post by: Saddam Hussein on May 01, 2011, 10:57:23 AM
Daniel    01:52:55 PM    Viewing the topic Sorry about the downtime!.

>:(
Title: Re: Sorry about the downtime!
Post by: Daniel on May 01, 2011, 11:10:06 AM
Hi.  Sorry (again) about the downtime!  I'll give everyone a quick explanation of what happened.

Earlier this month, we went down for a day or so because someone downloaded the same PDF file over and over again until my bandwidth allowance was completely used up.  My hosting company was very helpful and reset the quota for me.  Things were running fine until a few days ago when someone (probably the same person) did exactly the same thing again.  The hosting company was, understandably, not willing to reset me quota a second time, so over the limit we stayed.  Everything reset itself today so we're back to normal now.

I'm working on ways to avoid having this happen again in the future.  I have put a couple changes in place now to make it more difficult to take the site down like that and I'm hoping that will be enough.  I'm not going to detail exactly what I've done in case there are bad people reading this.  In any event, my fixes aren't exactly perfect.  So if there are any sysadmin types here with ideas, I'm happy to hear them.  Ideally, I'd like an automated way of preventing the same IP address from downloading excessive amounts of data in a short period of time.  I'm not sure how to go about doing that via cpanel, though, so I'm open to suggestions.

In tangentially-related news, I now own earthnotaglobe.com as well, so if anyone has ideas about what to do with that domain, I'm all ears.
Title: Re: Sorry about the downtime!
Post by: theonlydann on May 01, 2011, 11:13:23 AM
I have an idea of what to do with that website.

Put a picture of the not so globe shaped earth there making a smiley face and sticking its tongue out.

Title: Re: Sorry about the downtime!
Post by: PizzaPlanet on May 01, 2011, 11:23:48 AM
I'm not sure how to go about doing that via cpanel, though, so I'm open to suggestions.
While I'm far from being an expert on the matter, I can say this with confidence: cpanel won't do the trick. What you want to do is play around with Apache's configuration. I don't have a solution at the ready, but if there is one, it's definitely to be found there.
Title: Re: Sorry about the downtime!
Post by: EnglshGentleman on May 01, 2011, 11:35:16 AM
We should probably also consult Parsifal and John on this matter.
Title: Re: Sorry about the downtime!
Post by: PizzaPlanet on May 01, 2011, 12:32:18 PM
We should probably also consult Parsifal
No.

John
Yes.
Title: Re: Sorry about the downtime!
Post by: Mrs. Peach on May 01, 2011, 12:40:43 PM
Do away with unlogged-on downloading and 'hidden status' and we can all check on just what the hell people are up to.  Transparency is all the rage now.

Someone will now reply that I am a techno-know-nothing which is a given anyway.  :)
Title: Re: Sorry about the downtime!
Post by: Crustinator on May 01, 2011, 01:16:29 PM
PDF file

consult Parsifal

The PDF file format is proprietary. I suggest we publish all materials in postscript format.
Title: Re: Sorry about the downtime!
Post by: Trekky0623 on May 01, 2011, 03:38:22 PM
Hi.  Sorry (again) about the downtime!  I'll give everyone a quick explanation of what happened.

Earlier this month, we went down for a day or so because someone downloaded the same PDF file over and over again until my bandwidth allowance was completely used up.  My hosting company was very helpful and reset the quota for me.  Things were running fine until a few days ago when someone (probably the same person) did exactly the same thing again.  The hosting company was, understandably, not willing to reset me quota a second time, so over the limit we stayed.  Everything reset itself today so we're back to normal now.

I'm working on ways to avoid having this happen again in the future.  I have put a couple changes in place now to make it more difficult to take the site down like that and I'm hoping that will be enough.  I'm not going to detail exactly what I've done in case there are bad people reading this.  In any event, my fixes aren't exactly perfect.  So if there are any sysadmin types here with ideas, I'm happy to hear them.  Ideally, I'd like an automated way of preventing the same IP address from downloading excessive amounts of data in a short period of time.  I'm not sure how to go about doing that via cpanel, though, so I'm open to suggestions.

In tangentially-related news, I now own earthnotaglobe.com as well, so if anyone has ideas about what to do with that domain, I'm all ears.

Why not host PDFs on Google docs?
Title: Re: Sorry about the downtime!
Post by: markjo on May 01, 2011, 04:17:29 PM
The PDF file format is proprietary.

Nope.
Quote from: http://en.wikipedia.org/wiki/Portable_Document_Format
Originally a proprietary format, PDF was officially released as an open standard on July 1, 2008, and published by the International Organization for Standardization as ISO 32000-1:2008.
Title: Re: Sorry about the downtime!
Post by: Parsifal on May 02, 2011, 12:49:01 AM
I feel that a word needs to be said about the alternative FES that I set up recently. I won't link it here, as I don't want it to be misconstrued as attempting to steal people away from this site; however, I would like to summarise what is the result of a couple of years of (mostly ignored) suggestions and complaints regarding the forum from myself and others.

In general, from a technical (as opposed to community) perspective, this forum accumulates problems without fixing them. The slow searching and the recent bandwidth troubles are just the tip of the iceberg, and I don't have much confidence that any action will be taken to prevent future outages of this sort. That said, I see the future of the FES as taking one of three directions:


That said, I am glad to see the site back up, and I hope we can see some degree of progress towards improving its uptime and reliability.
Title: Re: Sorry about the downtime!
Post by: Daniel on May 02, 2011, 04:33:46 AM
That said, I see the future of the FES as taking one of three directions:

  • The forum that I have set up becomes official. I have tried to keep it fairly close in design to this one, and would be very open to discussing a possible merger whereby I host the forum, with Daniel continuing to make administrative decisions regarding the rules, and the CMS part of the site remains here.
  • The upgrade talked about in the past, which would hopefully remedy most or all of the technical issues this forum has been experiencing, is realised directly by Daniel. This would have more or less the same outcome as the above, and if sufficient steps are taken in this direction, I will gladly close down my own forum and set up a redirect back to this one.
  • This forum continues to be full of empty promises, aging software and badly managed hosting. I do hope this will not be the case, but if it is, I will continue to operate my own board as an alternative place for those who want a properly managed discussion forum.

I'm leaning toward a combination of the second and third options.  The delay in upgrading forum software isn't my doing.  We've been waiting on a new version of SMF for ages now.  The 2.0RC versions have been out for literally years but there hasn't been a final release yet.  As soon as that comes out, we'll upgrade and hopefully a lot of the current issues will go away.  We actually tried to upgrade to phpBB3 a year or so ago but that didn't work out.  I'm not 100% sure what caused the conversion to break every time, but I think it was something to do with the fact that we were originally phpBB when the site first started in 2004 and then converted to SMF, possibly muddying up the mySQL database in the process.  It doesn't help, either, that the forums database is pretty huge now.  So moving to phpBB3 doesn't look like an option at the moment.  That leaves us with SMF2.0 which is apparently held up for legal reasons but should be available soon.  I'm hoping that I mean "soon" in the normal sense of the word rather than the geological sense.

As for the downtime this month.. well, that had nothing to do with faulty software or inept admins.  That was a malicious attack which didn't take advantage of software flaws or anything as clever as that.  We're working to prevent that from happening in the future.  I've passed on relevant logging data to the correct people and we're put measures in place to (hopefully) stop it from happening again.  We'll see how it goes.
Title: Re: Sorry about the downtime!
Post by: frostee on May 02, 2011, 05:38:05 AM
But SMF isn't free software BAWWW BAWWW BAWWW
Title: Re: Sorry about the downtime!
Post by: markjo on May 02, 2011, 06:09:54 AM
But SMF isn't free software BAWWW BAWWW BAWWW

Take your bawwing to RM.
Title: Re: Sorry about the downtime!
Post by: frostee on May 02, 2011, 07:14:13 AM
But SMF isn't free software BAWWW BAWWW BAWWW

Take your bawwing to RM.
Are you going to tell Parsifal that too?
Title: Re: Sorry about the downtime!
Post by: Parsifal on May 02, 2011, 07:24:05 AM
I'm leaning toward a combination of the second and third options.  The delay in upgrading forum software isn't my doing.  We've been waiting on a new version of SMF for ages now.  The 2.0RC versions have been out for literally years but there hasn't been a final release yet.  As soon as that comes out, we'll upgrade and hopefully a lot of the current issues will go away.  We actually tried to upgrade to phpBB3 a year or so ago but that didn't work out.  I'm not 100% sure what caused the conversion to break every time, but I think it was something to do with the fact that we were originally phpBB when the site first started in 2004 and then converted to SMF, possibly muddying up the mySQL database in the process.  It doesn't help, either, that the forums database is pretty huge now.  So moving to phpBB3 doesn't look like an option at the moment.  That leaves us with SMF2.0 which is apparently held up for legal reasons but should be available soon.  I'm hoping that I mean "soon" in the normal sense of the word rather than the geological sense.

I'm very glad to hear it. Have you considered the possibility of starting with a clean forum and archiving this one, which may help to keep the database tidy (which I suspect to be a contributing factor to the laggy performance created by searching) in any event?

As for the downtime this month.. well, that had nothing to do with faulty software or inept admins.  That was a malicious attack which didn't take advantage of software flaws or anything as clever as that.  We're working to prevent that from happening in the future.  I've passed on relevant logging data to the correct people and we're put measures in place to (hopefully) stop it from happening again.  We'll see how it goes.

It did, however, take advantage of the fact that the hosting provider cuts us off when our bandwidth limit is reached, rather than handling it gracefully -- for example, I would get notified when I reach 80% of my bandwidth allowance, and if I go over I simply get charged for the excess usage. Simply cutting off the website appears to be a "feature" of CPanel which doesn't really help anybody, and I would consider making use of it to be symptomatic of incompetence on the part of the hosting provider.
Title: Re: Sorry about the downtime!
Post by: Daniel on May 02, 2011, 08:02:17 AM
It did, however, take advantage of the fact that the hosting provider cuts us off when our bandwidth limit is reached, rather than handling it gracefully -- for example, I would get notified when I reach 80% of my bandwidth allowance, and if I go over I simply get charged for the excess usage. Simply cutting off the website appears to be a "feature" of CPanel which doesn't really help anybody, and I would consider making use of it to be symptomatic of incompetence on the part of the hosting provider.

I do get notified of bandwidth usage.  That's not very useful, though, when someone is running a script that eats up 40gigs in the span of about 2 hours. 
Title: Re: Sorry about the downtime!
Post by: markjo on May 02, 2011, 09:05:35 AM
But SMF isn't free software BAWWW BAWWW BAWWW

Take your bawwing to RM.
Are you going to tell Parsifal that too?
Parsifal is discussing the issue at hand.  You are not.
Title: Re: Sorry about the downtime!
Post by: Horatio on May 02, 2011, 09:08:00 AM
It did, however, take advantage of the fact that the hosting provider cuts us off when our bandwidth limit is reached, rather than handling it gracefully -- for example, I would get notified when I reach 80% of my bandwidth allowance, and if I go over I simply get charged for the excess usage. Simply cutting off the website appears to be a "feature" of CPanel which doesn't really help anybody, and I would consider making use of it to be symptomatic of incompetence on the part of the hosting provider.

I do get notified of bandwidth usage.  That's not very useful, though, when someone is running a script that eats up 40gigs in the span of about 2 hours. 

Shouldn't the hosting provider red flag such a bizarrely large amount of bandwidth usage in such a short period of time?
Title: Re: Sorry about the downtime!
Post by: Lord Wilmore on May 02, 2011, 09:12:48 AM
I think Daniel's point is that such a warning may be informative, but is not especially helpful.
Title: Re: Sorry about the downtime!
Post by: Horatio on May 02, 2011, 09:15:22 AM
I think Daniel's point is that such a warning may be informative, but is not especially helpful.

And my point is that a hosting company with common sense would red flag such nonsense.
Title: Re: Sorry about the downtime!
Post by: Lord Wilmore on May 02, 2011, 09:29:53 AM
And my point is that a hosting company with common sense would red flag such nonsense.


But they did...


I do get notified of bandwidth usage.  That's not very useful, though, when someone is running a script that eats up 40gigs in the span of about 2 hours. 
Title: Re: Sorry about the downtime!
Post by: PizzaPlanet on May 02, 2011, 09:36:58 AM
It did, however, take advantage of the fact that the hosting provider cuts us off when our bandwidth limit is reached, rather than handling it gracefully -- for example, I would get notified when I reach 80% of my bandwidth allowance, and if I go over I simply get charged for the excess usage.
Good idea. Next time someone decides to download a million billion PDFs, Daniel will just go bankrupt. Yep, sounds viable.

Also, a much better idea than moving the relatively low-bandwidth forum to your server (which is a shit idea, by the way) would be moving the PDFs and other potentially large files somewhere (preferably to a place you can't wipe the next time you get drunk/angry).

EDIT: Daniel, what are the bad guys' IP addresses? Just out of curiosity.
Title: Re: Sorry about the downtime!
Post by: Parsifal on May 03, 2011, 02:51:25 AM
I do get notified of bandwidth usage.  That's not very useful, though, when someone is running a script that eats up 40gigs in the span of about 2 hours.

That's fair enough, I suppose. I still think that hard caps on bandwidth is a dated concept.
Title: Re: Sorry about the downtime!
Post by: PizzaPlanet on May 03, 2011, 09:21:03 AM
I still think that hard caps on bandwidth is a dated concept.
And that is why you're the tech support and someone else is the boss. It's okay, you'll learn in due time.
Title: Re: Sorry about the downtime!
Post by: Chris Spaghetti on May 03, 2011, 04:09:27 PM
Damn bandwidth-stealers.
Title: Re: Sorry about the downtime!
Post by: Crustinator on May 05, 2011, 03:31:33 PM
I want more powaz

You can't have them.
Title: Re: Sorry about the downtime!
Post by: Mrs. Peach on May 31, 2011, 05:41:58 PM
Has Daniel solved the bandwidth thief mystery or did the moron (the thief, not Daniel) forget the day of the month?
Title: Re: Sorry about the downtime!
Post by: Daniel on June 01, 2011, 02:49:55 AM
I think it's a combination of the two.