Have any of you been affected by the CrowdStrike debacle?

Have any of you been affected by the CrowdStrike debacle?

So far, I have not been.  I’m glad I’m not travelling today and I really feel for those who are.  I read that hospitals have been affected.  May God protect the patients.

Meanwhile, one of the guys in a nerdy signal group I am in posted:

What could go wrong?

Perhaps the one who failed to check the update could get a placement with a detail for Pres. Trump.

Meanwhile….

FEDERATED!

UPDATE:

I priest friend wrote via Signal…

About Fr. John Zuhlsdorf

Fr. Z is the guy who runs this blog. o{]:¬)
This entry was posted in Global Killer Asteroid Questions. Bookmark the permalink.

23 Comments

  1. GHP says:

    Received a notice from the Chief Information Officer
    Subject: Microsoft Issue

    What’s Happening: Due to a global Microsoft issue, some users may be unable to access various Microsoft 365 apps and services.

    Impacted services include Microsoft 365 suite, Power BI, Microsoft Teams, Windows 365, and Microsoft Purview.

    The Tier 2 Service Desk is unable to receive a call transfer from Tier 1 or contact users via telephone. Tier 2 agents are able to contact users via Teams.

    Microsoft is aware of the issue and applying mitigations. An update will be sent when additional information is available.

    Action Needed: No action required. This is for notification only.

    Who is Affected? … personnel using Microsoft 365 suite, Power BI, Microsoft Teams, Windows 365, and Microsoft Purview.

  2. VForr says:

    The debacle shutdown the courts across the state of Maryland. We were sent home for the day. Hospitals in Maryland are also impacted.

  3. BeatifyStickler says:

    What a time to be alive!!

  4. HyacinthClare says:

    Arizona Department of Revenue appears to be down. So does a local water company. IRS doesn’t appear to be affected. I’m a CPA in the Phoenix area.

  5. tgarcia2 says:

    Walked into the office (for one of the big airlines affected). No issues but I absolutely feel for my coworkers who have to work the cancellations/delays/recrews (very upset Flight Attendants and some pilots), from today and ESPECIALLY the airport employees who gent the brunt of angry customers

  6. SeelDad says:

    Yes I have. Our IT teams have been working around the clock to remediate.
    @GHP – The issue you’re referencing was actually an earlier MS Azure issue which began around 6:30 pm est last evening. Within an hour or so of that issue being resolved, the Crowdstrike issue slammed us. I’m in IT and it’s been fun :)

  7. hwriggles4 says:

    Well…looks like someone won’t have a job on Monday (then again some places the only way to get canned is to not show up for a week).

    Anyway, I have to admit that the times I have flown on an airplane since February 2020, I have been going ahead and paying the extra money for a refundable ticket. Today, we don’t know what the day will bring.

  8. monstrance says:

    Word on the street is that the Traditional Mass Suppression doc was deleted.

    [I’m pretty sure it is very much in existence, just unsigned. Pray and fast.]

  9. DavidJ says:

    My company has a ton of machines impacted, but for the products I support, we were supposed to go live with Crowdstrike next week. Very thankful that the feet-dragging worked in our favor.

  10. SeelDad says:

    Two people who need to be fired immediately…. The guy Crowdstrike who made this change and the head of the Secret Service. Wanna bet who gets the axe first?

  11. moon1234 says:

    Work for a billion dollar medical company. We were unaffected, but then we don’t use any CrowdStrike products.

    This is NOT a Microsoft issue. Crowdstrike is an endpoint security product that companies install on their servers/workstations/etc. It provides security related services on the device.

    The CROWDSTRIKE software is what is disabling devices it is installed on. Essentially a definition update (similar to the old antivirus definition updates) instructed the CROWDSTRIKE software to identify core Windows operating system files are malicious. This causes Windows to cash and fail to reboot properly.

    Again this is NOT a Microsoft issue. It is third party software that a lot of companies use to try and avoid security breaches.

    The “fix” was CrowdStrike rolling back their faulty definition update. This “fix” requires an affected computer to download the updated definition to be effective. That is sort of hard to do when the affected computer is stuck in boot loop/crash.

    What is required is to boot the computer either in safe mode or using an alternate boot disk/flash drive/etc and then delete the CrowdStrike definition file. This will then allow the computer to boot properly and the “fixed” definition file will then download once the computer boots up.

    Imagine the daunting task to have to do this to millions of computers. Some/many of these computers may have encrypted hard disks and this will be a huge amount of time to retrieve encryption keys (if even possible) to access the internal hard drive in order to do the remediation.

    Microsoft deserves zero blame in this whole fiasco. They sell their own endpoint security products and to date have not killed their users computers.

  12. PostCatholic says:

    Not sure I understand how a diverse and inclusive workforce has anything to do with this.

  13. jhogan says:

    I was unaffected; however, back in the 2000’s, I grew tired of the blue screen of death and switched to Mac.

  14. mercy2013 says:

    The electronic charts / medical record at our hospital was not affected, but unfortunately the dictation software was, so it took my physician husband twice as long to type notes today.

  15. Charivari Rob says:

    My work sent email alert early this morning and updated it a few times through the day. Biggest effect seemed to be on folks in a workstation environment. Fortuitously, today was one of my work-from-home days. Everything I needed to access via the work laptop was unaffected (or had already been corrected between the wee small hours and the beginning of my shift).

    In the immediate area, besides travel, the biggest (or “most reported”) impacts seemed to be systems (particularly appointments/scheduling) at Motor Vehicles and at some hospitals.

    PostCatholic, no shortcoming on your part – DEI indeed does not have anything to do with it.

  16. TheCavalierHatherly says:

    In their defence, identifying MS Windows as malicious…

    …is an honest mistake.

  17. Sue in soCal says:

    I spent the morning browsing at the stores at a nearby Amish community. No technological glitches were apparent. I’ll keep you updated.

  18. DavidJ says:

    SeelDad, unless this was done maliciously, there is no way the person who made this change should be fired. At an enterprise level software company (I’ve worked for several) you have processes in place to prevent exactly this kind of scenario. Following the processes should protect that person (again, barring maliciousness). Those processes include peer reviews, testing, all kinds of checks to prevent this. CLEARLY something went sideways here. You look at the process, figure out the gap, fix it, and move along. Firing people for mistakes is a _horrible_ way to run a business.

    Will someone’s head roll? Probably. Probably several, and probably several who don’t deserve it.

  19. majuscule says:

    I was not affected but then I’m kind of a recluse. I do spend time online…but I only heard about the problem.

    Until this morning. I got an email invoice from a company I have never gotten one from (but I do business with). At first I wondered why a scammer would be using this rather small business to be sending a fake invoice (I have been getting those lately and am very aware of them). Then I noticed in small print in the “special instructions” box it was noted that they were unable to invoice yesterday due to the Microsoft outage.

    I am going on a pilgrimage in late September. I purchased my airline tickets the other day and something nudged my brain to pay a bit more for a refundable ticket. You never know what’s coming. Just before the Covid shut down I had put down some money for a pilgrimage to the same destination and the pilgrimage was cancelled due to Covid. (I did get my money back for that—I had not purchased my airline ticket yet.)

    Be prepared. You never know.

  20. Mac in Calgary says:

    Linux user here. And I’m retired anyway.

  21. EAW says:

    @PostCatholic: Nothing, unless DEI is valued higher than actual job qualifications. Let’s hope that isn’t the case.

  22. PostCatholic says:

    @EAW In other words, it’s probably not worth mentioning.

  23. EAW says:

    @PostCatholic: These days, one can only hope it isn’t. Hope for the best, be prepared for the worst.

Comments are closed.