I always love it when some massive piece of web infrastructure goes down but most websites I use are self-hosted so the only real effect is I see lots of news stories that cloudflare is down.

  • iii@mander.xyz
    link
    fedilink
    English
    arrow-up
    57
    ·
    18 days ago

    Is there any meta analysis on these major outages?

    They seem to be occuring more and more regularly.

      • Subscript5676@lemmy.ca
        link
        fedilink
        English
        arrow-up
        4
        ·
        18 days ago

        Please don’t remind me. Had a colleague with a senior title who just vibecoded on our CI pipeline and it ended up blocking deployments for half a day.

      • pinball_wizard@lemmy.zip
        link
        fedilink
        English
        arrow-up
        1
        ·
        17 days ago

        It would be funny if it was because of some AI coding

        It is. Sometimes the big secret turns out to just be what we all thought was happening.

    • irmadlad@lemmy.world
      link
      fedilink
      English
      arrow-up
      3
      ·
      18 days ago

      As far as major outages, I can only think of around 10 going back 5 years. Sure there have been minor hiccups and glitches, but gosh, that’s life on the internet.

      • BremboTheFourth@piefed.ca
        link
        fedilink
        English
        arrow-up
        4
        ·
        edit-2
        18 days ago

        Yeah I have issues with my home setup at least that often. I can only think of two occasions where the solution took more effort than a reboot. Maybe we’re all just old enough for “every 6 months” to feel like every 5 mins

        To clarify, by “issues” I mean “system stoppages not precipitated by me fucking with something.” I screw up my own system way more often than that lol

        • irmadlad@lemmy.world
          link
          fedilink
          English
          arrow-up
          3
          ·
          18 days ago

          I don’t know how old you are brother, but it feels like I’m in one of those Star Trek warps where all the stars are just whizzing by.

      • pinball_wizard@lemmy.zip
        link
        fedilink
        English
        arrow-up
        2
        ·
        17 days ago

        It does feel like the major outages are growing closer together.

        I want to blame plugging AI where it doesn’t belong, but I suppose that putting everything into the same couple of server closets could be the primary root cause.

  • mesa@piefed.social
    link
    fedilink
    English
    arrow-up
    43
    ·
    18 days ago

    So far this year its been:

    1. AWS was massively down
    2. Azure was down a week later
    3. Cloudflare down multiple times this year

    Thats the ones that affect stuff at work. Fun times.

      • viking@infosec.pub
        link
        fedilink
        English
        arrow-up
        2
        ·
        17 days ago

        If you’re stuck with Windows at work, you might have. I couldn’t log on to our domain remotely and was unable to open some documents and emails that were signed as “internal use only”.

      • mesa@piefed.social
        link
        fedilink
        English
        arrow-up
        1
        ·
        18 days ago

        Starbucks payments sure did.

        Mostly at work. All our stuff was on Azure, so when it went down…I kinda just stood around for the day. It was up/down the entire day. So I went for a coffee lol.

    • pinball_wizard@lemmy.zip
      link
      fedilink
      English
      arrow-up
      3
      ·
      17 days ago

      Dang. I had to look it up, but CrowdStike taking down a huge percentage of Windows PCs was so last year, I guess.

    • Possibly linux@lemmy.zip
      link
      fedilink
      English
      arrow-up
      3
      ·
      17 days ago

      My services have a higher uptime than AWS, Azure and Cloudflare despite the fact that they are running on 10 year old hardware

    • mesa@piefed.social
      link
      fedilink
      English
      arrow-up
      18
      ·
      18 days ago

      Cache-ing is a hard problem to solve. For MANY years cloudflare was the cheapest and easiest way to solve the issue.

      But the same people that started cloudflare have moved on or passed away. Now its just another corp. So yeah we are going to get downtime. In the corporate world, its the standard so no one is going to move off it.

      …unless it keeps going down consistently.

      For those who are in the know, does memcache work with lemmy/piefed? What is a good Cache for modern day systems?

    • Matt The Horwood@lemmy.horwood.cloud
      link
      fedilink
      English
      arrow-up
      12
      ·
      18 days ago

      I dont use cloudflare at all, so I didnt notice. I do see a lot of recommendation’s to host behind Cloudflare, so if they have a problem you do too

      • irmadlad@lemmy.world
        link
        fedilink
        English
        arrow-up
        7
        arrow-down
        1
        ·
        18 days ago

        I do see a lot of recommendation’s to host behind Cloudflare, so if they have a problem you do too

        Fallback to Tailscale, or any number of ways to skin the cat. At the very least, everything is accessible locally. I’m not running anything mission critical, so it was more of a minor inconvenience to me.

  • -RJ-@lemmy.world
    link
    fedilink
    English
    arrow-up
    29
    ·
    18 days ago

    “Further details will be made available when we’ve worked out how the AI screwed us this time”

    • adb@jlai.lu
      link
      fedilink
      English
      arrow-up
      7
      ·
      18 days ago

      This really should read: further details will be made available when our AI api is back up and can self-report on how it fucked up

      • TeddE@lemmy.world
        link
        fedilink
        English
        arrow-up
        3
        ·
        18 days ago

        AI: taking another hit of acid in preparation to research the reason why the last thing it did after taking acid didn’t work out.

  • SwizzleStick@lemmy.zip
    link
    fedilink
    English
    arrow-up
    20
    ·
    18 days ago

    Eggs, baskets, and lessons being taught about how it’s not a good idea to heavily skew their ratio.

  • db0@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    12
    ·
    18 days ago

    took much of lemmy.world down. I wonder how come I’m seeing some posts from lemmy.worlders though

    • lazynooblet@lazysoci.al
      link
      fedilink
      English
      arrow-up
      2
      ·
      18 days ago

      Cloudflare have a large international network. Perhaps some users could access sites when coming from another region

  • Confining@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    8
    ·
    18 days ago

    I don’t use cloudflare but the only reason I noticed is a lot of websites I go on use cloudflare captcha due to me using a vpn. Now I can’t even get on those website due to the captcha being down 😭

    • quick_snail@feddit.nl
      link
      fedilink
      English
      arrow-up
      1
      ·
      18 days ago

      PSH, I can’t even pass those shitty captchas when their online. Its just an infinite loop.

      As soon as I see s site is behind a cf captcha, I close the tab and go to a different site

  • Aertbei@discuss.tchncs.de
    link
    fedilink
    English
    arrow-up
    5
    ·
    18 days ago

    I was having DNS issues yesterday using cloudflare’s DoH, so I’m curious if it is going to be related.

  • yxp@lemmy.radio
    link
    fedilink
    English
    arrow-up
    3
    ·
    18 days ago

    TIL that Xitter depends on Cloudflare (I don’t have account, I just wanted to check a specific tweet). They don’t afford their own infrastructure…

    sh.itjust.work is down, but lemmy.radio is up. I need to tip them.