Releases · IBM/gguf · GitHub

16 Jan 21:33

mrutkows

r3.0a Latest

Latest

2B, 8B - all quantizations

Signed-off-by: Matt Rutkowski <[email protected]>

Assets 13

granite-3.0-2b-instruct-Q5_1.gguf

1.85 GB 2025-01-16T21:37:24Z
granite-3.0-2b-instruct-Q5_K_M.gguf

1.75 GB 2025-01-16T21:37:29Z
granite-3.0-2b-instruct-Q5_K_S.gguf

1.7 GB 2025-01-16T21:37:39Z
granite-3.0-2b-instruct-Q3_K_L.gguf

1.3 GB 2025-01-16T22:01:24Z
granite-3.0-2b-instruct-Q3_K_M.gguf

1.21 GB 2025-01-16T22:03:47Z
granite-3.0-2b-instruct-Q4_0.gguf

1.41 GB 2025-01-16T22:05:40Z
granite-3.0-2b-instruct-Q3_K_S.gguf

1.09 GB 2025-01-16T22:07:19Z
granite-3.0-2b-instruct-Q4_1.gguf

1.55 GB 2025-01-16T22:09:23Z
granite-3.0-2b-instruct-Q4_K_M.gguf

1.49 GB 2025-01-16T22:10:04Z
granite-3.0-2b-instruct-Q5_0.gguf

1.7 GB 2025-01-16T22:10:44Z
Source code (zip)

2025-01-16T21:32:33Z
Source code (tar.gz)

2025-01-16T21:32:33Z

17 Jan 19:51

mrutkows

r3.0c

2B, 8B - all quantizations

Signed-off-by: Matt Rutkowski <[email protected]>

Assets 2

16 Jan 22:59

mrutkows

r3.0b

2B, 8B - all quantizations

Signed-off-by: Matt Rutkowski <[email protected]>

Assets 2

15 Jan 16:32

mrutkows

Release q6 q8

Test Q6_0, Q8_0 quantizations

Signed-off-by: Matt Rutkowski <[email protected]>

Assets 2

16 Dec 16:02

mrutkows

Release test-h

H

Assets 5

16 Dec 15:12

mrutkows

Release test-f

Release f

Assets 5