Repository navigation
ExternalLinksTest is broken #48788
Description
Before reporting an issue
- I have read and understood the above terms for submitting issues, and I understand that my issue may be closed without action if I do not follow them.
Area
docs
Describe the bug
When the documentation CI job is executed, the ExternalLinksTest is very unstable/broken:
- https://github.com/keycloak/keycloak/actions/runs/25486746936
- https://github.com/keycloak/keycloak/actions/runs/25485535521
- https://github.com/keycloak/keycloak/actions/runs/25477180297/job/74753074668
- https://github.com/keycloak/keycloak/actions/runs/25437444215
Error: Tests run: 5, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 42.10 s <<< FAILURE! -- in org.keycloak.documentation.test.ExternalLinksTest
Error: org.keycloak.documentation.test.ExternalLinksTest.checkExternalLinks(String)[3] -- Time elapsed: 18.25 s <<< FAILURE!
org.opentest4j.AssertionFailedError:
Broken links (1) in guide 'server_admin':
- https://www.oasis-open.org/standard/saml/ (invalid status code 403)
at org.junit.jupiter.api.AssertionUtils.fail(AssertionUtils.java:42)
at org.junit.jupiter.api.Assertions.fail(Assertions.java:143)
at org.keycloak.documentation.test.ExternalLinksTest.checkExternalLinks(ExternalLinksTest.java:41)
I've also noticed it in some other PRs for other links, so maybe they have some kind of additional protection for non-human interaction? Meaning that the HTTP client cannot access it?
Or it's some kind of unintented behavior on their side?
Version
main
Regression
- The issue is a regression
Expected behavior
The test pass
Actual behavior
The test fails
How to Reproduce?
Execute the test
Anything else?
We might try to retry requests even for 4xx HTTP response codes. EDIT: Not helped. Ignoring the website.
Metadata
Metadata
Assignees
Labels
Type
Fields
No fields configured for bug.
Activity
[-]ExternalLinksTest is unstable[/-][+]ExternalLinksTest is broken[/+]rmartinc commentedon May 7, 2026
It's a duplicate @mabartos. The PR is already sent is already merged. Thanks!