Skip to content

Commit d2be18c

Browse files
committed
Update pdm dependencies
Updates pdm dependencies, infernece-perf version, and adds tiktoken for kimi k2.5 support.
1 parent 4f57a0b commit d2be18c

File tree

3 files changed

+233
-184
lines changed

3 files changed

+233
-184
lines changed

inference_perf/utils/distribution.py

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -13,6 +13,7 @@
1313
# limitations under the License.
1414
import numpy as np
1515
from numpy.typing import NDArray
16+
from typing import cast
1617

1718

1819
def generate_distribution(min: int, max: int, mean: float, std_dev: float, total_count: int) -> NDArray[np.int_]:
@@ -57,4 +58,4 @@ def generate_distribution(min: int, max: int, mean: float, std_dev: float, total
5758
# (e.g., rounding 4.6 when max is 4 could result in 5 without this)
5859
generated_lengths = np.clip(generated_lengths, min, max)
5960

60-
return generated_lengths
61+
return cast(NDArray[np.int_], generated_lengths)

0 commit comments

Comments
 (0)