As many of you know, there was recently a fire located in an OVH Datacenter in France. The result is that of a bit of chaos.
Here’s the headline:
Fire at an OVH Data Center in Europe takes down millions of sites…All the news sites
That’s about all that matters. But why does it matter to QuickBox?
Well, QuickBox itself is not effected as we are not associated with that DC in particular and we have numerous levels of redundancy and backups in place should such an event occur, however, a great deal of the Software used and supported within QuickBox is currently being effected. This does not apply to those Software that we build from source via GitHub Repositories and does not effect all apt sources for dependencies, however, a great deal of them are currently effected.
As such, we are working hard to mitigate as much as possible with the Software that provide alternative sources for apt. Anyone on Debian 9 and 10 should run a
qb fix version to grab some of the updated apt sources. Though
ftp.de. is coming back online, we have moved over to standard
ftp. for the time being in the event that the source is unstable due to migrations etc.
We appreciate everyone’s patience and are reviewing all sources and testing testing testing as we have time. This is an unfortunate event that is completely out of our own hands and all we can do for some is wait.
Unrelated Netdata issue with apt builds
You may see errors with Netdata on apt as well as openssl dependencies. If so, you can try running an
apt -y upgrade --allow-downgrades to resolve those, however, at the time of this post Netdata is still having issues with its apt build. So running things like
qb fix version will post an error such as the following:
Setting up netdata (1.29.3125) ... fatal error: Invalid argument usage: setcap [-q] [-v] (-r|-|<caps>) <filename> [ ... (-r|-|<capsN>) <filenameN> ] Note <filename> must be a regular (non-symlink) file. dpkg: error processing package netdata (--configure): installed netdata package post-installation script subprocess returned error exit status 1 Processing triggers for libc-bin (2.28-10) ... Errors were encountered while processing: netdata E: Sub-process /usr/bin/dpkg returned an error code (1)
Should your Netdata not be accessible and/or your System Dashboard shows as blank widget spaces you can run the following:
sudo su - qb reinstall netdata YOUR_USERNAME apt-mark hold netdata
apt-mark hold netdata ensures that you can continue to do your normal
apt -y update && apt -y upgrade without Netdata interrupting the process and generally failing your current build.
Another (and probably the best at the moment) fix is to fix the issue directly on their build file from apt:
sudo su - apt -y upgrade --allow-downgrades sed -i -e "s/setcap cap_dac_read_search+ep/chmod 4750/g" -e "s/setcap cap_perfmon+ep/chmod 4750/g" /var/lib/dpkg/info/netdata.postinst && apt install netdata -y
You will now be able to run a
qb fix version without any errors.
Due to this issue we are considering moving back to building Netdata from source rather than relying on its apt source building. Should this issue continue into tomorrow then we will begin taking action to restore builds form source following a fix upstream.
This is certainly an annoyance and we’re keeping a close eye on things during this time.
We’ll keep everyone posted. 💖