Identified - The Gurobi license for CHTC has expired. We are working with campus IT to renew the license. In the meantime, user jobs attempting to use the Gurobi license will likely fail due to a "license expired" error.
Apr 02, 2026 - 15:13 CDT
Resolved -
This incident has been resolved.
Apr 6, 13:19 CDT
Investigating -
Jobs using the osdf:// file transfer plugin may go on hold with the message "Details: failed to get namespace information for remote URL ... error while querying the director... Error code 3001: 404: No sources found for the requested path: no origins found for the requested namespace". We are currently investigating.
Apr 6, 12:05 CDT
Resolved -
This incident has been resolved.
Apr 2, 10:37 CDT
Monitoring -
We identified the cause of the problem and have applied a fix. Initial tests appear successful. Let us know at chtc@cs.wisc.edu if you continue to encounter problems.
Apr 2, 09:28 CDT
Investigating -
Confirmed user reports that job submission on ap2002.chtc.wisc.edu is failing. We are investigating the issue and will provide updates as they become available.
Apr 2, 09:09 CDT
Completed -
The scheduled maintenance has been completed.
Mar 31, 17:45 CDT
In progress -
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Mar 31, 13:45 CDT
Scheduled -
Network infrastructure is being updated in one of our server rooms. Jobs will be much slower to match, due to reduced capacity during this time. Jobs already running on hosts in this server room may fail due to timeouts. Any ongoing filetransfer or interactive sessions to these nodes will also be disrupted. Nodes impacted: E40XX, build4001, cxiaogpu4000, xhuangpgu4000
Mar 31, 13:37 CDT
Completed -
The scheduled maintenance has been completed.
Mar 31, 13:00 CDT
In progress -
Scheduled maintenance is currently in progress. We will provide updates as necessary.
Mar 31, 07:00 CDT
Scheduled -
Network infrastructure is being updated in one of our server rooms. Jobs will be much slower to match, due to reduced capacity during this time. Jobs already running on hosts in this server room may fail due to timeouts. Any ongoing filetransfer or interactive sessions to these nodes will also be disrupted. Nodes impacted: E40XX, build4001, cxiaogpu4000, xhuangpgu4000
Mar 27, 10:41 CDT
Resolved -
This incident has been resolved.
Mar 31, 11:38 CDT
Monitoring -
A fix has been implemented and we are monitoring the results.
Mar 31, 10:26 CDT
Investigating -
Users reported being unable to access or log in to spark-login.chtc.wisc.edu since 7 PM on 3/30/2026. We are currently investigating.
Mar 31, 09:23 CDT