In progress - Scheduled maintenance is currently in progress. We will provide updates as necessary.
Mar 06, 2026 - 06:00 CST
Scheduled - We will be shutting down mrudolphgpu4001 to repair a faulty GPU. The machine will be brought back up with 7 GPUs while we get the GPU replaced.
Mar 6, 202606:00 - Mar 13, 202607:00 CDT
Resolved -
This incident has been resolved.
Mar 6, 09:36 CST
Monitoring -
We've implemented a fix for the CUDA_VISIBLE_DEVICES issues on various GPU machines. Please resubmit jobs and email chtc@cs.wisc.edu if you are still experiencing issues with it.
Feb 6, 10:18 CST
Update -
We are continuing to investigate this issue.
Feb 4, 16:38 CST
Investigating -
We have received reports of issues with the CUDA_VISIBLE_DEVICES environment variable being set incorrectly on certain GPU jobs. We are investigating the issue and will update this page once more information is known.
Feb 2, 13:57 CST
Resolved -
This incident has been resolved.
Mar 6, 09:36 CST
Investigating -
We have received some reports of issues with file transfers from ResearchDrive in HTCondor jobs for folks with the ResearchDrive/CHTC integration.
*** Please report any issues with file transfer between CHTC and ResearchDrive to chtc@cs.wisc.edu as we are investigating the cause ***
Feb 13, 17:06 CST
Resolved -
This incident has been resolved.
Mar 6, 08:58 CST
Identified -
OSDF file transfers are currently not working. Users may see a hold message like, "Details: failed to get namespace information for remote URL ... error while querying the director". This is due to an unexpected issue with an upgrade. We are working to resolve the issue.
Mar 5, 16:31 CST