pkg_resources is deprecated and will be removed on 2025-11-30

[shivanraptor]

When using the current version 0.42.1, Python reports that pkg_resources is going to be deprecated by 30 November 2025. Is there any updates on this? Thanks.

jieba/jieba/_compat.py

Line 18 in 67fa2e3

import pkg_resources

[ROBERT-MCDOWELL]

seems this repo is dead :(((
so many pull requests and no one approved it.
if anyone knows a good replacement of jieba thanks to tell me which pkg.

[manother]

邮件已收到~

[shivanraptor]

seems this repo is dead :((( so many pull requests and no one approved it. if anyone knows a good replacement of jieba thanks to tell me which pkg.

This package is still widely used for Chinese tokenization, sadly it's no longer maintained. If you want something similar, you can try PyCantonese (https://pycantonese.org/), available via pip.

[ROBERT-MCDOWELL]

ok so it would be very nice to fix pkg_resources:

jieba/_compat.py:18: UserWarning: pkg_resources is deprecated as an API. See https://setuptools.pypa.io/en/latest/pkg_resources.html. The pkg_resources package is slated for removal as early as 2025-11-30. Refrain from using this package or pin to Setuptools<81.

and I will be happy to see less user of our repo complaining about it thanks! :D

[ROBERT-MCDOWELL]

seems this repo is dead :((( so many pull requests and no one approved it. if anyone knows a good replacement of jieba thanks to tell me which pkg.

This package is still widely used for Chinese tokenization, sadly it's no longer maintained. If you want something similar, you can try PyCantonese (https://pycantonese.org/), available via pip.

thanks Ithink I will use this pkg.

[ROBERT-MCDOWELL]

@shivanraptor is pycantonese pkg manage also zho (mandarin) ??

[shivanraptor]

@shivanraptor is pycantonese pkg manage also zho (mandarin) ??

It can segment formal written Chinese sentences (p.s. Mandarin is a spoken language, written version is usually referred as "standard/formal written Chinese")

[shivanraptor]

@ROBERT-MCDOWELL there are more newer & better packages for you:

1. Jieba-fast: Fast implementation of this library (https://github.com/deepcs233/jieba_fast)
2. R Jieba: Python binding of the Rust implementation of Jieba (https://github.com/messense/rjieba-py)

[ROBERT-MCDOWELL]

thanks!

[shivanraptor]

Additionally, a PR (#1045) has been made to resolve the deprecation issue.

[cuba3]

try:
    import importlib.resources
    get_module_res = lambda *res: importlib.resources.open_binary(__name__, os.path.join(*res))
except ImportError:
    get_module_res = lambda *res: open(os.path.normpath(os.path.join(
        os.getcwd(), os.path.dirname(__file__), *res)), 'rb')

@fxsjy