Skip to content

feat(service): configure gateway proxy read timeout - #4242

Closed
mikemikimike wants to merge 1 commit into
dstackai:masterfrom
mikemikimike:mikemikimike/fix/configurable-proxy-read-timeout
Closed

feat(service): configure gateway proxy read timeout#4242
mikemikimike wants to merge 1 commit into
dstackai:masterfrom
mikemikimike:mikemikimike/fix/configurable-proxy-read-timeout

Conversation

@mikemikimike

Copy link
Copy Markdown

Summary

  • Make the gateway proxy_read_timeout configurable per service.
  • Preserve the existing 300-second default and add a server-level default override.
  • Render the configured timeout for both normal HTTP and WebSocket proxy locations.

Validation

  • uv run pytest src/tests -q — 356 passed, 4891 skipped on Windows (POSIX-only tests skipped by repository configuration)
  • uv run ruff check .
  • uv run ruff format --check .
  • uv run pyright -p .
  • git diff --check

Closes #4239

Signed-off-by: mikemikimike <13286568797@163.com>
@r4victor r4victor closed this Sep 1, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug]: Gateway proxy_read_timeout is hardcoded to 300s, truncating slow long-context streaming responses

2 participants