Conversation

Notices

1. :btrfly: anime graf mays 🛰️🪐 (graf@poa.st)'s status on Thursday, 13-Jul-2023 00:04:27 JST :btrfly: anime graf mays 🛰️🪐

   >fix the bots yesterday

   >offline today

   apparently the entire datacenter is offline due to a fire lmao

   Update: Current Status update from Evocative: After reviewing the site, the fire Marshall is requiring that we extensively clean the UPS devices and rooms before they will allow us to re-energize the site. We have a vendor at the site currently who will be performing that cleanup. We will provide an update at 8:00AM EDT unless something significant changes overnight.

   Secaucus/EWR1 datacenter btw

   • スカイラー🎄🇷🇺 :z: (skylar@misskey.yandere.love)'s status on Thursday, 13-Jul-2023 00:04:26 JST スカイラー🎄🇷🇺 :z:

     in reply to

     • Ron Paul
     @itsover @graf
     >design and build redundant power systems
     >some dumb fuck turns them off
     :gura_sus: 1e+6 litres :flag_china: likes this.
   • Ron Paul (itsover@poa.st)'s status on Thursday, 13-Jul-2023 00:04:27 JST Ron Paul

     in reply to
     @graf 🛑 **Unexpected Fire at NY/NJ Facility; Indefinitely offline.** @here
     
     It appears a fire occurred in an electrical room (caused by a UPS issue) at our NY/NJ facility Monday Evening. Best case scenario is systems slowly being brought back online tomorrow evening for our NY Servers.
     
     *"We have had an electrical failure with one of our redundant UPS' that started to smoke and then had a small fire in the UPS room. The fire department was dispatched and the fire was extinguished quickly. The fire department subsequently cut power to the entire data center and disabled our generators while they and the utility verify electrical system. We have been working with both the fire department and the utility to expedite this process.
     
     The EWR Secaucus data center remains powered down at this time per the fire marshal. We are continuing with our cleanup efforts into the evening and working overnight as we make progress towards our 9AM EDT meeting time with the fire marshal and electrical inspectors in order to reinstate power at the site."*
     
     <https://hudsontv.com/update-monday-fire-at-evocative-data-center-facility-in-secaucus-under-investigation/?amp=1>
     
     *We will keep you all updated.*
     
     Seems like this is affecting a lot of server hosts