Outage on 9th Aug?
We experienced complete loss of service yesterday for an hour or two around mid-day – no access to anything under xp-dev.com at all. I tried from two different locations using two different ISPs. I just wondered if this was experienced by others, and what the cause was? It was embarrassing for me as I was trying to demonstrate to my biggest client the integration of Subversion and Trac and our custom Trac workflow built especially for him...
Forum Topic and Comments
You do not have sufficient permissions to comment
12 years ago
View full history
rs on Wed 10 Aug, 2011
There was an outage.
We run load balancers configured in HA mode that handles all our traffic. There is a bug in the network driver that causes the kernel to panic, and we got hit on all load balancers in one go.
We did see this problem about 2-3 weeks ago, but didn’t have enough logging in the kernel to diagnose the problem, and upon recovery turned on kernel logging to be a bit more verbose. Due to the logging changes, we’ve narrowed down the suspect to the network driver. We will be patching the kernels this weekend to fix this.