All Systems Operational

About This Site

This page provides information about unplanned downtimes and scheduled maintenance for services offered by the Center for High Throughput Computing

Uptime over the past 90 days. View historical uptime.
High Throughput Computing (HTC) System Operational
90 days ago
99.94 % uptime
Today
Access Points Operational
90 days ago
100.0 % uptime
Today
CHTC Pool Operational
90 days ago
100.0 % uptime
Today
External Pools (OSPool, Campus HTCondor Pools) Operational
90 days ago
100.0 % uptime
Today
Staging and Projects Space Operational
90 days ago
100.0 % uptime
Today
File Transfers Operational
90 days ago
99.71 % uptime
Today
High Performance Computing (HPC) System Operational
90 days ago
100.0 % uptime
Today
Login Nodes Operational
90 days ago
100.0 % uptime
Today
Cluster Nodes and Jobs Operational
90 days ago
100.0 % uptime
Today
Central Software Installations Operational
90 days ago
100.0 % uptime
Today
Home and Scratch File Systems Operational
90 days ago
100.0 % uptime
Today
Data Transfer Tools Operational
90 days ago
100.0 % uptime
Today
Globus Endpoint Operational
90 days ago
100.0 % uptime
Today
CHTC Internal Infrastructure Operational
90 days ago
100.0 % uptime
Today
Tiger Cluster ? Operational
90 days ago
100.0 % uptime
Today
RT Email/Ticket Support System Operational
90 days ago
100.0 % uptime
Today
Operational
Degraded Performance
Partial Outage
Major Outage
Maintenance
Major outage
Partial outage
No downtime recorded on this day.
No data exists for this day.
had a major outage.
had a partial outage.

No incidents or maintenance related to this downtime.

Scheduled Maintenance

[HPC] Outage, maintenance of the HPC system Oct 29, 2025 07:00-15:00 CDT

Maintenance of the datacenter requires that the HPC system is powered off.
We may take the opportunity to install some system updates after it is powered back on.

No jobs will run or be accepted during this time. Queued jobs should continue once the maintenance downtime has completed. Jobs submitted with a runtime that intersects with the maintenance window will not start, with the reason "ReqNodeNotAvail, Reserved for maintenance".
Posted on Oct 10, 2025 - 13:42 CDT
Oct 11, 2025

No incidents reported today.

Oct 10, 2025

No incidents reported.

Oct 9, 2025

No incidents reported.

Oct 8, 2025

No incidents reported.

Oct 7, 2025
Rebooting APs on Tuesday Oct. 7th
Completed - The scheduled maintenance has been completed.
Oct 7, 10:15 CDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Oct 7, 07:00 CDT
Scheduled - All CHTC managed APs (AP2001, AP2002, and Researcher Owned APs) will be rebooting to apply new patches on Tuesday Oct. 7th, 2025. We expect the reboot to be resolved within the day and will update the StatusPage as soon as it’s back up.

During this time:
- You will not be able to log in.
- You will not be able to access your /home directory.
- You will not be able to submit new jobs.
- Your running jobs may be interrupted (but remain in the queue).
- Your SSH session may be briefly interrupted during the reboot process (if logged in).

We will post updates about the maintenance to this status page.

Please direct any questions or concerns to chtc@cs.wisc.edu.

Regards,
Your CHTC Team
Oct 3, 12:42 CDT
Oct 6, 2025

No incidents reported.

Oct 5, 2025

No incidents reported.

Oct 4, 2025

No incidents reported.

Oct 3, 2025

No incidents reported.

Oct 2, 2025
[HTC] Issues accessing/ssh-ing into transfer.chtc.wisc.edu
Resolved - No reports of issues since the last update.
Email us at chtc@cs.wisc.edu if you continue to have issues.
Oct 2, 16:56 CDT
Monitoring - We have upgraded the underlying server to address the recent issues. Users should be able to log in again to "transfer.chtc.wisc.edu" as usual.

Though unlikely, you may receive an SSH warning about a change in server; however, you should still be able to log in.

Let us know at chtc@cs.wisc.edu if you are still having issues using the transfer server.
Oct 2, 11:00 CDT
Investigating - Users of the HTC system have reported issues accessing transfer.chtc.wisc.edu via ssh or SCP client. We are currently investigating the issue and attempting to implement permanent fixes. We recommend that users use their assigned Access Points (i.e., ap2001, ap2002, etc.) to transfer files in the meantime.
Oct 1, 14:42 CDT
Oct 1, 2025
Sep 30, 2025
[HTC] Mismatch on ap2002 in actual usage vs quota report usage
Resolved - This issue has been addressed during the downtime today. Please report any other issues to chtc@cs.wisc.edu
Sep 30, 13:58 CDT
Investigating - Confirmed user reports that the "Used" value for /home quota report on login (or using the "get_quotas" command) does not match their actual disk usage, as reported by the "du" or "ncdu" commands.

We are investigating the issue. To fix it, we may need to do maintenance on ap2002. More info will be forthcoming.

If this issue is an impacting your work, let us know at chtc@cs.wisc.edu. You can also request a quota increase on our website.
Sep 15, 15:04 CDT
CHTC-wide AP downtime for maintenance Sep 30
Completed - The scheduled maintenance has been completed.
Sep 30, 13:57 CDT
In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Sep 30, 04:00 CDT
Scheduled - We will be scheduling a maintenance downtime for all CHTC APs in order to upgrade the servers for a security patch. The APs will undergo maintenance Tuesday Sept. 30, 2025. We expect the downtime to be resolved by the end of the day.

During this time, you will not able to 1) login to the APs, 2) submit new jobs, 3) access your /home or /staging directories, or 4) have new jobs start from Idle.

Your jobs may be interrupted during this downtime but they should remain in the queue after the downtime has completed.

We will maintain this StatusPage entry up-to-date throughout the maintenance window with any updates on the progress necessary.

Please direct any questions or concerns to the CHTC support email.

Regards,
Your CHTC Team
Sep 23, 10:04 CDT
Sep 29, 2025

No incidents reported.

Sep 28, 2025

No incidents reported.

Sep 27, 2025

No incidents reported.

← Incident History Powered by Atlassian Statuspage