Skip to content

Conversation

@domsolutions
Copy link
Contributor

Motivation

mlserver has deprecated env var MLSERVER_MODEL_PARALLEL_WORKERS to set the number of parallel workers, if this is set, mlserver will ignore and set to default of 1. This was causing customers to have performance issues as the configured parallel workers was not being set.

Summary of changes

  • changed to new env var MLSERVER_PARALLEL_WORKERS in helm charts
  • allow to be configurable via helm, previously was fixed to 1

Checklist

  • Added/updated unit tests
  • Added/updated documentation
  • Checked for typos in variable names, comments, etc.
  • Added licences for new files

Testing

@domsolutions domsolutions requested a review from lc525 as a code owner December 8, 2025 11:13
Copy link
Member

@lc525 lc525 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

@domsolutions domsolutions merged commit e9e5105 into v2 Dec 9, 2025
5 checks passed
@domsolutions domsolutions deleted the fix/mlserver-parallel-workers branch December 9, 2025 13:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants