The Planet

This was posted by someone on Hostgators forums.

Re: 4/6/2009 Networking Issues
I just got off the phone meeting with them. Here's is the latest official response....

"Between 10:15pm CDT on April 6 and 1:15am CDT on April 7, The Planet's
authoritative name servers (ns1.theplanet.com, ns2.theplanet.com) were
flooded with a very large and brute force Distributed Denial of Service
(DDoS) attack. Given the volume of the attack, our network operations
team rerouted all traffic to our name servers through our DDoS
mitigation capabilities so we could isolate and clean the attack traffic
. This mitigation permitted us to resume normal operations by routing
legitimate DNS traffic through our name servers. The Planet's network
and DNS performance have been restored and the attack originator has
ceased actions. Any lingering issues may be indicative of a different
problem that may have been exacerbated by the attack and should be
resolved quickly."

There still seems to be a few issues lingering. If anyone is having a problem still related to this, please post your ticket number so that I can work with The Planet's guy in charge of networking.
__________________

Yeah, it's just one of money issues that have come up recently.

We have been in contact contact with them to try to get things resolved.

Quote:

---

Originally Posted by VOIPoTim

Yeah, it's just one of money issues that have come up recently.

We have been in contact contact with them to try to get things resolved.

---

Oh, well I just thought it might help if folks saw that it was not just VOIPo having issues with "The Planet".

This bit me in the *ss this afternoon.

What I couldn't figure was why inbound calls were fine.

Outbound calls could be dialed, but went 'dead air' - no 'ring sound' no nothing.

In doing things to help support narrow down the cause - I dialed from my handset to my own number. XLite showed <my number>@east01.voipwelcome.com as the incoming number - and audio was perfect both directions. That tipped me off that the problem was somewhere else in the network.

Tim - as an aside - you might want to get the support folks to stop using "forward ports 35000-65000" as a first line of defense. When a customer has had a working line for some period of time, and suddenly goes "bad" - it's not likely to be a port forwarding issue....

No offense intended - hope none is taken.

Check out my latest update here and I think it'll make sense: http://forums.voipo.com/showthread.php?t=1357

There are inbound edge and outbound edge servers. Those all sit between our SIP servers and the outside networks, so if the latency was only impacting the outbound ones, that explains it.

Thanks for the updates Tim.

BTW, this The Planet stuff is getting out of control pretty quick.

Everyone is trying to figure out why there's been a constant meltdown: http://forums.theplanet.com/index.php?showtopic=91453

Their DNS servers were down for 3 hours on top of all the random latency. We're happy we'd already started migrating or there would have been a more serious outage last night.

Keep in mind we have over 10K servers there (HostGator) and we're their largest customer by far. We've never seen any major ongoing issues with TP at all until recently in the 5 years or so we've used them that was not resolved very quickly.

They did a switch upgrade a while back and since then, their network issues have been never ending. The switch upgrade in question was this one ( http://forums.voipo.com/showthread.php?t=1226 ). They upgraded ALL their switches with this upgrade a few at a time, but we can't convince them that's when it started.

Don't know if this has to do with The Planet's problems (they do host a lot of web sites), but I found the internet, in general, very sluggish today.

Quote:

---

Originally Posted by VOIPoTim

BTW, this The Planet stuff is getting out of control pretty quick.

Everyone is trying to figure out why there's been a constant meltdown: http://forums.theplanet.com/index.php?showtopic=91453

Their DNS servers were down for 3 hours on top of all the random latency. We're happy we'd already started migrating or there would have been a more serious outage last night.

Keep in mind we have over 10K servers there (HostGator) and we're their largest customer by far. We've never seen any major ongoing issues with TP at all until recently in the 5 years or so we've used them that was not resolved very quickly.

They did a switch upgrade a while back and since then, their network issues have been never ending. The switch upgrade in question was this one ( http://forums.voipo.com/showthread.php?t=1226 ). They upgraded ALL their switches with this upgrade a few at a time, but we can't convince them that's when it started.

---

Hostgator is large enough they should consider building their own NOC. In the mean time http://www.serverbeach.com/ . I have done business with them and they are great. Just tossing ideas out.

Quote:

---

Originally Posted by Xponder1

Hostgator is large enough they should consider building their own NOC. In the mean time http://www.serverbeach.com/ . I have done business with them and they are great. Just tossing ideas out.

---

Well for that matter, this company has it all sewn up:

http://www.mindshift.com


disclosure: I work there