Jan Leon
|
f879a394f4
|
feat(routing): add prompt-cache affinity (#8008)
* Add prompt cache locality routing
* fix: preserve weighted cache-affinity routing
* feat(routing): add cache-optimized combos
* fix(routing): preserve normal ordering on cache misses
* fix(routing): bind cache affinity to concrete accounts
* feat(routing): add prompt-cache affinity + align combo-auto-config test with new defaults
Co-authored-by: diegosouzapw <8016841+diegosouzapw@users.noreply.github.com>
---------
Co-authored-by: Diego Rodrigues de Sa e Souza <diegosouza.pw@gmail.com>
Co-authored-by: JxnLexn <JxnLexn@users.noreply.github.com>
Co-authored-by: diegosouzapw <8016841+diegosouzapw@users.noreply.github.com>
|
2026-07-22 06:43:31 -03:00 |
|