Alerts

Incident Report for Email & Office

Jan 9, 17:28 EST
Resolved - The issue has been resolved. Our apologies for the inconvenience caused.

Jan 9, 17:15 EST
Identified - Access to E-Mail & Office in the Control Panel may be temporarily restricted.

Incident Report

Jan 3, 04:41 EST
Resolved - The issue has been resolved. Thank you for your patience and understanding.

Jan 3, 04:23 EST
Update - We have eliminated the disruption for almost everyone affected.

Jan 3, 03:07 EST
Update - Our team is continuing to work on this issue. We will post an update as soon as new information becomes available.

Jan 2, 17:03 EST
Update - We are still working on resolving the technical issue. Thank you for your patience.

[Resolved] Ongoing DDoS of git.sr.ht and hg.sr.ht

Mitigations completed: We believe that we have the attack under control and that there is no need for end-user impacting mitigations to remain in place. (09:00 UTC — Jan 3)

Attack still ongoing, but under control: Good morning. The attack is still ongoing, but we have been refining our mitigations this morning. We addressed some cases which were causing git and hg to crash under load, and narrowed our mitigations to better characterize the load. All of our mitigations have now been disabled for logged-in users, reducing the impact on legitimate traffic – if you hit an error page, log in and try again.

Disruption in some Control Panel sections

Dec 17, 16:32 EST
Resolved - The issue has been resolved.

Dec 17, 16:15 EST
Update - We are still working on resolving the technical issue. Thank you for your patience.

Dec 17, 14:48 EST
Identified - Our technicians are currently working on resolving this issue.

Dec 17, 13:46 EST
Investigating - Access to the following areas in the Control Panel are temporarily restricted :
Websites & Shops
Hosting

[Resolved] Ongoing DDoS of git.sr.ht

Mitigations complete. We have finished mitigating the attack and have removed user-impacting mitigations. (17:00 UTC — Dec 4)

Attack partially mitigated. We have partially mitigated the attack to restore service to git.sr.ht, but many features of the web UI are currently disabled to reduce load. (12:53 UTC — Dec 4)

A distributed denial of service (DDoS) attack on git.sr.ht is underway: A denial of service attack against git.sr.ht is currently underway. We are working on deploying a mitigation. (12:42 UTC — Dec 4)

[Resolved] Planned maintenance on Monday

Maintenance work is completed. All services should be operating normally. Please let us know if you notice any lingering problems. (13:26 UTC — Nov 25)

The maintenance window is now open. (13:00 UTC — Nov 25)

Maintenance window rescheduled for 13:00 UTC. We have advanced the schedule by one hour to 13:00 UTC. (08:00 UTC — Nov 25)

Planned maintenance is scheduled for Monday, November 25th. On Monday at 13:00 UTC we will be rolling out some changes which will cause spurious errors and issues across services for the duration of the roll-out. Notably, chat.sr.ht will be rebooted, causing everyone to be disconnected from the bouncer. Most clients will reconnect automatically. The maintenance is expected to take no more than an hour.

Maintenance on Database Systems

Nov 17, 09:00 EST
Completed - The scheduled maintenance has been completed.

Nov 17, 04:30 EST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.

Nov 15, 10:53 EST
Scheduled - Please be aware that we will be performing maintenance on our database systems.

The following services and functions may be unavailable:

- Purchased products maybe delayed during setup
- Updating customer data in the Control Panel and communication email for some Control Panel actions may not be sent out
- Some customers may be unable to view their invoice in the Control Panel

Additionally, our Customer Service Team may not be able to answer all questions related to your account.

All systems will be available to you as usual when the maintenance is completed, however temporary downtime is possible.

We apologize for any inconvenience this may cause.

SAP system maintenance

Nov 3, 04:00 EST
Completed - The scheduled maintenance has been completed.

Nov 3, 02:00 EST
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.

Nov 1, 09:14 EDT
Scheduled - In order to assure that you can always safely use our services, we regularly perform system maintenance work.

During this time, you will not be able to access your billing information through your Control Panel. Furthermore, our Customer Service might also not be able to answer all questions related to your account. We apologize for any inconvenience this may cause you.

Of course, we will try to keep downtime to a minimum and once the upgrade is complete, all services will be restored.

Thank you for your understanding.

[Resolved] Upstream network outage

Upstream network issues appear resolved. We still know little of the cause but we know it broadly affected numerous providers in our service area. (14:00 UTC — Oct 30)

Upstream network issues are causing intermittent availability problems for SourceHut. An issue with our upstream network provider has affected user access to SourceHut. We do not have any further details or an ETA on a solution at this time. We expect the network to be intermittent until the upstream issue is resolved. (11:30 UTC — Oct 30)

SAP system maintenance

Oct 13, 08:00 EDT
Completed - The scheduled maintenance has been completed.

Oct 13, 02:00 EDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.

Oct 11, 10:20 EDT
Scheduled - In order to assure that you can always safely use our services, we regularly perform system maintenance work.

During this time, you will not be able to access your billing information through your Control Panel. Furthermore, our Customer Service might also not be able to answer all questions related to your account. We apologize for any inconvenience this may cause you.

Of course, we will try to keep downtime to a minimum and once the upgrade is complete, all services will be restored.

Thank you for your understanding.