Skip to content

Refactoring for new models and new kernels #216

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 56 commits into from
Mar 25, 2025
Merged

Refactoring for new models and new kernels #216

merged 56 commits into from
Mar 25, 2025

Conversation

bab2min
Copy link
Owner

@bab2min bab2min commented Mar 23, 2025

No description provided.

bab2min added 30 commits January 10, 2025 01:11
@bab2min
make KnLM builder general (uint16_t & uint32_t)
ca6d09b
@bab2min
Implement PoC of KnLM transposed & PcLM
cb1ebc0
@bab2min
Refactor PathEvaluator.hpp
8c02638
@bab2min
implemented PoC of softmax window token mixing
01fe634
@bab2min
Add exclusiveWindow arg to HSDataset
dd87771
@bab2min
Add constructor for pclmLocal mode LM
f5eccd4
@bab2min
Refactor LangModel implementations
ad74c55
@bab2min
Refactor PathEvaluator more
fd173dc
@bab2min
Refactor evaluator-cli
6d21f08
@bab2min
add ArchType::avx_vnni & ArchType::avx512vnni
a0058b3
@bab2min
Implement quantized PcLM
3fbbbfa
@bab2min
Update evaluator & pclm_builder
ac5a78a
@bab2min
Optimize memory layout of PcLMState::history
5281c43
@bab2min
Optimize QGemm kernel more
f592908
@bab2min
Fixed wrong initialization of pclm-local model
108c4fd
@bab2min
implement VLE for context Trie & optimize nst search
aa29ff5
@bab2min
Add max-length argument for pclm context
a2ff10a
@bab2min
Add an option for useVLE
9285d05
@bab2min
Add caching nextState & optimize nextState
30ec39b
@bab2min
Optimize BestPathContainer for small and medium sizes
7affd86
@bab2min
Optimize hashes for PcLM
1fa906d
@bab2min
rename PcLM to CoNgram(cong)
d2e2b9b
@bab2min
Add automatic model type detection
1734e67
@bab2min
Implement dispatcher of CoNgramModel
37e0469
@bab2min
Implement tools
5e4eb30
@bab2min
Update CMakeLists.txt
6a9b329
@bab2min
Implement nounAugmentingProb of HSDataset
af4f116
@bab2min
Fix compilation errors on Arm NEON
5954788
@bab2min
Remove qgemm.cpp
4637786
@bab2min
Fix missing form filtering logic of CoNgramModel
db1329a
bab2min added 26 commits March 21, 2025 01:07
@bab2min
Implement generateUnlikelihoods
ad17bfb
@bab2min
Fix wrong calculation of dataset's vocab size
2a4e9d7
@bab2min
Fix a bug related to diff_tokens' showSame option
d1e570e
@bab2min
Update test cases to fit recent Kiwi API
16f07a6
@bab2min
Update code base to C++17 and remove nonstd::string_view
94d85b3
@bab2min
Fix deprecated std::result_of
743f362
@bab2min
remove submodule mapbox/variant
c24364f
@bab2min
replace mapbox/variant to std::variant
6560ccc
@bab2min
Update evaluator to c++17
6155ab0
@bab2min
Fix C API to support kiwi::ModelType
cb936f7
@bab2min
Merge branch 'main' into dev/pclm
121d2d2
@bab2min
Fix compilation errors
3457d37
@bab2min
Merge branch 'dev/pclm' of https://github.com/bab2min/Kiwi into dev/pclm
0ad9387
@bab2min
Fix compilation errors
c31bda1
@bab2min
Fix compilation errors
dbb7582
@bab2min
Fix compilation errors
dbd90bc
@bab2min
Fix compilation errors
00d7a2e
@bab2min
Update KiwiJava binding to 0.21.0
51dfac4
@bab2min
Fix compilation errors
6543a1f
@bab2min
Add support for AVX-VNNI and update SIMD implementation
5969058
@bab2min
Merge branch 'dev/pclm' of https://github.com/bab2min/Kiwi into dev/pclm
6ecb998
@bab2min
Fix workflows
221ff59
@bab2min
Fix CMakeLists.txt
5a5e076
@bab2min
Fix CMakeLists.txt
8be959b
@bab2min
Add 64-bit mode check for Issue205 test
dcd7516
@bab2min
Remove warnings
3d586d3
@bab2min bab2min merged commit 5d88229 into main Mar 25, 2025
10 of 11 checks passed
@bab2min bab2min deleted the dev/pclm branch March 25, 2025 04:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@bab2min