Page History

1) Gluster sync issues continue from yesterday's Nebula incident.
2) At approximately 16:10, a major network Nebula networking issue (unrelated to the Gluster issues) occurred resulting in host network drops within the Nebula infrastructure. This network internal networking incident resulted in additional gluster and iscsi issues.
Many instances are broken because iSCSI is broken from the Nebula network outageissues. And any instances that were broken because of gluster are still broken.

Update 2017-10-09 15:30 - One of the storage servers in Nebula will be rebooted October 9, 2017 at 22:00 CDT to resolve iSCSI connections to it. Approximately 100 instances will be shutdown before the storage server is rebooted and restarted afterwards.