cmld. - Notice history

Sosanie Ebla Premium (api.sosanie-ebla-bot-premium.vapronva.pw) experiencing partial outage

Cumlord DNS (dns.cumlord.ru) - Operational

Cumlord Mail (mail.cumlord.ru) - Operational

Cumlord SSO (sso.cumlord.ru) - Operational

Appwrite API (api.cumlord.ru) - Operational

GitLab Instance (gl.vprw.ru) - Operational

LanguageTool Server (languagetool.supplemental-services.vapronva.pw) - Operational

Linx (ln.vprw.ru) - Operational

Mastodon (mastodon.vapronva.pw) - Operational

Matrix (matrix.vapronva.pw) - Operational

PeerTube (peertube.vapronva.pw) - Operational

Pixelfed (pixelfed.vapronva.pw) - Operational

Mozilla Send (send.vapronva.pw) - Operational

Shlink (shlink.vapronva.pw) - Operational

Umami (analytics.vapronva.pw) - Operational

Bitwarden (bitwarden.cumlord.ru) - Operational

Wakapi (wakapi.vapronva.pw) - Operational

Obsidian Sync Database - Operational

Paperless (paperless.vapronva.pw) - Operational

WriteFreely (wf.vprw.ru) - Operational

Cumlord Certificate Authority (ca.cumlord.ru) - Operational

Infrared Minecraft Proxy (bebracraft.net) - Operational

Sentry (sentry.cumlord.ru) - Operational

Privateering Archival Storage (privateering.vapronva.pw) - Operational

Planka (pl.vprw.ru) - Operational

ISU Calendar Schedule (schedule.university.vapronva.pw) - Operational

Outline (wiki.cumlord.ru) - Operational

genji.likes-sniffing-f.art - Operational

ChatGPT UI (chatgpt.vapronva.pw) - Operational

Nextcloud (nc.vprw.ru) - Operational

Nextcloud (nf.vprw.ru) - Operational

Weblate (wb.vprw.ru) - Operational

Flagsmith (feature.api.cumlord.ru) - Operational

ILLA Builder (illa.vapronva.pw) - Operational

BetterScan (scanmycode.vapronva.pw) - Operational

Sonarqube (sonarqube.vapronva.pw) - Operational

Vikunja (vi.vprw.ru) - Operational

Mattermost (mm.vprw.ru) - Operational

AIBooru (ab.vprw.ru) - Operational

BeatTogether (bt.vprw.ru) - Operational

Immich (im.vprw.ru) - Operational

Immich for VR (vrc.vprw.ru) - Operational

Jitsi (ji.vprw.ru) - Operational

Zoom Recording Service - Operational

PhotoPrism Instance - Operational

thats-a-nice-argument-unfortunately.com - Operational

Sosanie Ebla Premium (api.sosanie-ebla-bot-premium.vapronva.pw) - Partial outage

фредж.рф - Operational

Personal Seedbox - Operational

HedgeDoc (hd.vprw.ru) - Operational

Notice history

Mar 2023

Updating and Optimizing PeerTube Instance
  • Completed
    04/03/2023 at 8:37 PM
    Completed
    04/03/2023 at 8:37 PM

    Maintenance has completed successfully: the instance has been updated, and all the migration issues have been resolved.

  • Update
    04/03/2023 at 8:17 PM
    In progress
    04/03/2023 at 8:17 PM

    A few deep configuration changes are required for the new version.
    Additionally, assets regeneration is required.

  • Update
    04/03/2023 at 8:07 PM
    In progress
    04/03/2023 at 8:07 PM

    The instance has been successfully deployed and updated to a new version.

  • In progress
    04/03/2023 at 8:02 PM
    In progress
    04/03/2023 at 8:02 PM

    Maintenance is now in progress.

  • Planned
    04/03/2023 at 8:00 PM
    Planned
    04/03/2023 at 8:00 PM

    I am planning for a scheduled maintenance on the PeerTube.

    The plans are:

    • move to a new deployment strategy;
    • update to the latest 5.1.0-rc1 version;
    • optimize instance for livestreaming.

Feb 2023

Updating Firmware on Nodes at RU-OMS-CHRNSH
  • Completed
    14/02/2023 at 8:31 AM
    Completed
    14/02/2023 at 8:31 AM

    Maintenance has completed successfully.

  • In progress
    14/02/2023 at 8:19 AM
    In progress
    14/02/2023 at 8:19 AM

    Maintenance is now in progress.

  • Planned
    14/02/2023 at 8:15 AM
    Planned
    14/02/2023 at 8:15 AM

    Packages and other firmware will be updated on BHO Core, Should Be Fine DOVH and Vapor Scaler are going to be updated.

Major Outage on RU-OMS-CHRNSH Location
  • Resolved
    Resolved

    All routes are being announced correctly, routing is done without any issues (tested from several looking glasses).

  • Monitoring
    Monitoring

    The AS' prefixes are being announced correctly.
    A few regional ISPs are routing successfully but via incredibly long routes.

  • Update
    Update

    According to several looking glasses, the AS completely lost its upstreams.
    I am staying in communication with the ISP.

  • Identified
    Identified

    The provider (JSC Smartkom; AS42676) is experiencing problems with their BGP prefix announcement.

  • Investigating
    Investigating

    We are currently investigating this incident. The location is completely unavilable.

Jan 2023

Partial Outage of the “Waterfall” Node
  • Resolved
    Resolved

    The issue has been resolved — the node is replying to requests normally.

    To remove any potential future occurrence of that issue, a notification system for anomalies has been added and tested to the infrastructure stack.

  • Monitoring
    Monitoring

    The fix has been implemented (reloading the node stack).

  • Identified
    Identified

    The abnormal CPU and disk usage has been identified at the Waterfall node.

    The root cause is declared to be a MariaDB process that leaked memory bit-by-bit over the past days leading to no RAM being left for other processes.

  • Investigating
    Investigating

    We are currently investigating this incident.
    As of now, seems like the Waterfall node is unresponsive to some requests.

Jan 2023 to Mar 2023

Next