[perf, fix] Pool and reuse ZMQ request sockets - #167

Open

OutstanderWang wants to merge 27 commits into

Ascend:mainfrom

OutstanderWang:feat_socket_pool

Commits on Sep 7, 2026

[perf, fix] Pool and reuse ZMQ request sockets instead of one per request
OutstanderWang
committed
6d415f6
[fix] Keep supporting a standalone zmq_context in StorageManager
OutstanderWang
committed
3d2f930
[fix] Key pooled sockets by endpoint and reject pool sizes below 1
OutstanderWang
committed
430254a
[fix] Discard late socket returns from a superseded endpoint
OutstanderWang
committed
483ee97
[fix] Retire superseded endpoints in every pool owner, and stop leaking the context
OutstanderWang
committed
7466e0c
[refactor] Give each request scenario its own socket pool
OutstanderWang
committed
e9b0e9f
[fix] Retire only the moved peer's own former address
OutstanderWang
committed
4d4883a
[fix] Do not park a socket the lease body already closed
OutstanderWang
committed
6be3fcb
[fix] Keep close() working when the base constructor raised
OutstanderWang
committed
a670711
[fix] Let close() tolerate a subclass that raised before super().__init__()
OutstanderWang
committed
fcacc5a
[refactor] Drop endpoint-migration tracking, which nothing can reach
OutstanderWang
committed
6599c33
[refactor] Borrow the controller's ZMQ context in the metrics exporter
OutstanderWang
committed
b36a76f
[perf] Raise the default pooled-socket cap from 8 to 64
OutstanderWang
committed
12a7f50
[fix] Narrow max_sockets by identity rather than by a parallel flag
OutstanderWang
committed
6707683
[fix] Scope the pooled-socket knob to the pool it configures
OutstanderWang
committed
8a98dd3
[docs] Show the async client awaiting on one loop, not asyncio.run per call
OutstanderWang
committed
29e40a2
[test] Assert socket reuse from the peer, not from the pool's internals
OutstanderWang
committed
4ffa0a7

Commits on Sep 8, 2026

[test] Assert each role's socket reuse where that role is tested
OutstanderWang
committed
a71af50

Navigation Menu

Uh oh!

[perf, fix] Pool and reuse ZMQ request sockets - #167

[perf, fix] Pool and reuse ZMQ request sockets#167
OutstanderWang wants to merge 27 commits into
Ascend:mainfrom
OutstanderWang:feat_socket_pool

Commits on Sep 7, 2026

[perf, fix] Pool and reuse ZMQ request sockets instead of one per request

[fix] Keep supporting a standalone zmq_context in StorageManager

[fix] Key pooled sockets by endpoint and reject pool sizes below 1

[fix] Discard late socket returns from a superseded endpoint

[fix] Retire superseded endpoints in every pool owner, and stop leaking the context

[refactor] Give each request scenario its own socket pool

[fix] Retire only the moved peer's own former address

[fix] Do not park a socket the lease body already closed

[fix] Keep close() working when the base constructor raised

[fix] Let close() tolerate a subclass that raised before super().init()

[refactor] Drop endpoint-migration tracking, which nothing can reach

[refactor] Borrow the controller's ZMQ context in the metrics exporter

[perf] Raise the default pooled-socket cap from 8 to 64

[fix] Narrow max_sockets by identity rather than by a parallel flag

[fix] Scope the pooled-socket knob to the pool it configures

[docs] Show the async client awaiting on one loop, not asyncio.run per call

[test] Assert socket reuse from the peer, not from the pool's internals

Commits on Sep 8, 2026

[test] Assert each role's socket reuse where that role is tested

Commits on Sep 9, 2026

[test, docs] Make the poisoned-lease test real, and trim example noise

[refactor] Trim the comments this branch added

[feat] Size every role's socket pool from TQ_SOCKET_POOL_SIZE

[fix] Default the socket pool to 8 and warn when it can exhaust the context

[fix] Stop the metrics collector accumulating one socket per storage unit

[perf, fix] Wait for a pooled socket instead of opening one past the cap

[fix] Raise the controller context's socket ceiling above libzmq's default

[fix] Lower the default socket pool size to 4

[refactor] Trim the comments added since the last pass