You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Client network socket disconnected before secure TLS connection was established #496
We often see our CI fail on this action with the seemingly ephemeral error:
Client network socket disconnected before secure TLS connection was established
Expected behavior
The action to be able to reliably authenticate with Google even in the presence of network errors.
Observed behavior
The action fails seemingly randomly.
Action YAML
Here is how we use the action: https://github.com/firezone/firezone/blob/main/.github/actions/gcp-docker-login/action.ymlIt is used by many workflows, for example: https://github.com/firezone/firezone/blob/main/.github/workflows/_integration_tests.yml
Thank you for opening an issue. Our team will triage this as soon as we can. Please take a moment to review the troubleshooting steps which lists common error messages and their resolution steps.
Hi @thomaseizinger - thanks for opening an issue. This is definitely a new one for me. Are you by chance running on self-hosted runners (I'm not sure if ubuntu-22.04-xlarge is a GitHub-managed image or a custom one). I did some digging, and the most common cause appears to be a misbehaving proxy.
How often is this happening? If it only happened once, it also could have been a temporary issue the upstream API.
@thomaseizinger - thanks for opening an issue. This is definitely a new one for me. Are you by chance running on self-hosted runners (I'm not sure if ubuntu-22.04-xlarge is a GitHub-managed image or a custom one). I did some digging, and the most common cause appears to be a misbehaving proxy.
They are GitHub hosted runners but I believe I've seen this issue before too. Can't say for sure though.
How often is this happening? If it only happened once, it also could have been a temporary issue the upstream API.
We run a lot of CI jobs but I'd say at least 10 times in the last couple of days. Enough that it didn't seem like a once-off issue to me.
Ah this is super helpful - that error is actually occurring before anything in our action runs:
This error message is coming from actions/toolkit, which is actually owned by GitHub. I could add some retry logic to attempt to try and fetch the ID token again, but there's not enough data to know if the error is even retryable. Can you open an issue upstream?
I could add some retry logic to attempt to try and fetch the ID token again, but there's not enough data to know if the error is even retryable.
It is a GET request so it should be safe to retry? It is embedded in a larger function call that appears to first create this URL though so I think it is hard to retry this from the outside.
I'll see if I can create a patch with a retry loop there and submit it as an upstream PR.
Activity
github-actions commentedon Jun 27, 2025
Hi there @thomaseizinger 👋!
Thank you for opening an issue. Our team will triage this as soon as we can. Please take a moment to review the troubleshooting steps which lists common error messages and their resolution steps.
sethvargo commentedon Jun 27, 2025
Hi @thomaseizinger - thanks for opening an issue. This is definitely a new one for me. Are you by chance running on self-hosted runners (I'm not sure if
ubuntu-22.04-xlargeis a GitHub-managed image or a custom one). I did some digging, and the most common cause appears to be a misbehaving proxy.How often is this happening? If it only happened once, it also could have been a temporary issue the upstream API.
thomaseizinger commentedon Jun 27, 2025
They are GitHub hosted runners but I believe I've seen this issue before too. Can't say for sure though.
We run a lot of CI jobs but I'd say at least 10 times in the last couple of days. Enough that it didn't seem like a once-off issue to me.
sethvargo commentedon Jun 27, 2025
Could you enable debug output for the workflow for a few days and capture one of the failures with the debug logs on?
thomaseizinger commentedon Jun 30, 2025
Just hit this again but it appears the debug logs don't contain much:
thomaseizinger commentedon Jun 30, 2025
I think I enabled the wrong debug logging ...
thomaseizinger commentedon Jul 1, 2025
Here is a failed run with debug logs: https://github.com/firezone/firezone/actions/runs/15990853670/job/45103970949?pr=9735
sethvargo commentedon Jul 1, 2025
Ah this is super helpful - that error is actually occurring before anything in our action runs:
This error message is coming from actions/toolkit, which is actually owned by GitHub. I could add some retry logic to attempt to try and fetch the ID token again, but there's not enough data to know if the error is even retryable. Can you open an issue upstream?
thomaseizinger commentedon Jul 1, 2025
Thank you for diagnosing! Opened an upstream issue: actions/toolkit#2098
thomaseizinger commentedon Jul 2, 2025
It is a GET request so it should be safe to retry? It is embedded in a larger function call that appears to first create this URL though so I think it is hard to retry this from the outside.
I'll see if I can create a patch with a retry loop there and submit it as an upstream PR.
Add retries for getIDToken
Add retries for getIDToken (#502)
thomaseizinger commentedon Aug 1, 2025
Thank you for fixing this!