Skip to content

Releases: skhynix/hmsdk

hmsdk v4.0

03 Nov 04:08
@honggyukim honggyukim
hmsdk-v4.0
affcf9e

Choose a tag to compare

View all tags
hmsdk v4.0 Latest
Latest

This is a new release for hmsdk v4.0, which supports enhanced bandwidth and capacity expansion as well as bwprof, which is a bandwidth profiling tool.

What's Changed

The changes from hmsdk v3.0 to v4.0 are as follows.

Bandwidth expansion enhancement

  • support multi-socket weighted interleave
    • with socket-aware weighted interleave
    • with this feature, users don't have to use -N/--cpunodebind nodes option to numactl to avoid UPI overhead between sockets
      • instead, numactl -w all is all you need now
  • support weighted interleave APIs in libnuma (contributed by @hygoni)
    • the following APIs for weighted interleave is added to libnuma
      • numa_alloc_weighted_interleaved_subset()
      • numa_alloc_weighted_interleaved()
      • numa_weighted_interleave_memory()
  • hmctl supports -w/--weighted-interleave option
    • to support object level weighted interleave (e.g. malloc level)
      • libnuma APIs are page level weighted interleave (e.g. mmap level)

Capacity expansion enhancement

  • support multi-threaded monitoring and migration
    • to enhance monitoring accuracy and migration speed
    • by multiple kdamonds covering split ranges of whole address

bwprof tool for system memory profiling

  • system-wide bandwidth profiling tool for both DRAM and CXL memory
  • it supports top, record, report, dump, and info commands for monitor, record and analyze the result offline

notable submodule and tools update

  • linux kernel: upgrade from v6.12 to v6.17
    • with socket-aware weighted interleave feature on top of v6.17
  • damo: upgrade from 2.4.7 to 3.0.0
  • numactl: upgrade to 548e9ea for new libnuma APIs
  • move damo and numactl submodules into tools directory
  • mlc: upgrade from v3.11 to v3.12
  • remove tools/gen_config.py symbolic link to tools/gen_migpol.py

Contributors

Signed-off-by: Honggyu Kim honggyu.kim@sk.com
Signed-off-by: Rakie Kim rakie.kim@sk.com
Signed-off-by: Yunjeong Mun yunjeong.mun@sk.com

Full Changelog: hmsdk-v3.0...hmsdk-v4.0

Contributors

hygoni
Assets 2
Loading

hmsdk v3.0

16 Sep 09:58
@honggyukim honggyukim
hmsdk-v3.0
3ef865b

Choose a tag to compare

View all tags
hmsdk v3.0

This is a new release for hmsdk v3.0, which is fully aligned its features with various other open source projects including Linux kernel, numactl, damo, etc.

What's Changed

The changes from hmsdk v2.0 to v3.0 are as follows.

Bandwidth Expansion

  • Apply interface changes of weighted interleaving from upstream
    • drop task level weight setting
    • drop set_mempolicy_node_weight and mrange_node_weight syscalls
    • drop local changes of numactl, then use upstream numactl with -w/--weighted-interleave option.
    • thanks to Gregory Price (formerly at MemVerge)

Capacity Expansion

  • Apply interface changes of DAMON based tiered memory management
    • DAMOS_{PROMOTE,DEMOTE} are renamed to DAMOS_MIGRATE_{HOT,COLD}
    • set the migration target with target_nid in sysfs instead of use memory tiering info builtin kernel.
    • rename gen_config.py to gen_migpol.py for clear meaning
    • change --{dram,cxl}_nodes options of gen_config.py to --{demote,promote} options in gen_migpol.py along with its usage.
    • drop local changes of damo, then use upstream damo as all of hmsdk's features are upstreamed.
      • use target_nid in migrate_{hot,cold} actions
      • use json format output to yaml format
    • thanks to SeongJae Park (formerly at Amazon)

Custom Allocator

  • Replace cemalloc to hmalloc
    • reimplented hmalloc from scratch for cemalloc replacement.
    • cemalloc supports many features but only explicit mode is implemented in hmalloc after renaming of cxl_ prefixed APIs to
      h prefixed APIs. For example, cxl_malloc is renamed to hmalloc.
    • drop unused features to reduce complexity.
      • such as implicit mode and Java/Python APIs
    • drop jemalloc submodule as hmalloc can use it from official packages without recompilation.
    • introduce hmctl tool to avoid environment variable exposure.

Since hmsdk v3.0 is fully aligned with various open source projects, its usage and interface won't be changed any time soon and it will no longer require back porting its local features to the upgraded versions.

Contributors

Signed-off-by: Honggyu Kim honggyu.kim@sk.com
Signed-off-by: Yunjeong Mun yunjeong.mun@sk.com
Signed-off-by: Hyeongtak Ji hyeongtak.ji@sk.com
Signed-off-by: Rakie Kim rakie.kim@sk.com

Full Changelog: hmsdk-v2.0...hmsdk-v3.0

Loading