Yesterday, Cloudflare’s dashboard and related API services went down. Hard.
Cloudflare is assessing a loss of power impacting data centres while simultaneously failing over services. We are working to resolve this problem.
The following products are currently impacted at the data plane / edge level, meaning that the full product functionality is either partially or fully affected: Logpush, WARP / Zero Trust device posture, Cloudflare dashboard, Cloudflare API, Stream API, Workers API, Alert Notification System.
The core CDN services were unaffected.
This is the second outage this week. Back on October 30, a failed rollout of their key-value storage database (Workers KV), took down all of Cloudflare’s services for a little over a half hour.
As of the time of this writing, CF is still “working to restore impacted services” (last update 15:44 UTC).
The core issue is apparently an outage at Flexential’s PDX02 datacenter. They identified the issue as “a loss of power impacting data centres while simultaneously failing over services.” That tallies with an update that one of Flexential’s other hosts (huge shared hosting provider Dreamhost) posted:
Looks like they lost utility, switched to generator, and then generator failed (not clear on scope of Gen failure yet). Some utility power is back, so recovery is in progress for some portion of the site. I still have ~70 racks without power….but things are coming back to life slowly.
Stay tuned to cloudflarestatus.com for updates.
Related Posts:
I also enjoy using LEBs! I have an empire of little guys for VPNs, larger guys for apps, and big guys for databases and storage. When I'm not in front a screen I'm into German Shepherd dogs, quality knives, target shooting, theology, tabletop roleplaying games, and forest hiking.
I enjoy writing technical articles here on LowEndBox to help people get more out of their systems. You can find me on LowEndTalk @raindog308
Leave a Reply