Code

Release v2.0.1#172

Code

Merged

amakropoulos merged 121 commits intomainundreamai/LLMUnity:mainfrom

release/v2.0.1undreamai/LLMUnity:release/v2.0.1Copy head branch name to clipboard

Jun 25, 2024

Commits

Commits on Jun 12, 2024

• add slot_id to request, remove old vars from result

  amakropoulos

  committed
  945bfcd

  Copy full SHA for 945bfcd

• implement dll-based client/server, separate remote and local functionality, separate server from client in LLM

  amakropoulos

  committed
  3fed83b

  Copy full SHA for 3fed83b

• remove unnecessary stuff

  amakropoulos

  committed
  eaf25c2

  Copy full SHA for eaf25c2

• add cancel functionality

  amakropoulos

  committed
  b4d9d03

  Copy full SHA for b4d9d03

• register client

  amakropoulos

  committed
  fb8a359

  Copy full SHA for fb8a359

• handle await warning

  amakropoulos

  committed
  80a965d

  Copy full SHA for 80a965d

• throw error on non implemented functions

  amakropoulos

  committed
  ba7e008

  Copy full SHA for ba7e008

• MVP

  amakropoulos

  committed
  848e26b

  Copy full SHA for 848e26b

• allow to load different dlls

  amakropoulos

  committed
  da6c1b2

  Copy full SHA for da6c1b2

• add all architecture functions

  amakropoulos

  committed
  5d6ee72

  Copy full SHA for 5d6ee72

• architecture fallback implementation

  amakropoulos

  committed
  2527df7

  Copy full SHA for 2527df7

• add LLMLib logging functionality

  amakropoulos

  committed
  1836f9f

  Copy full SHA for 1836f9f

• use thread, cleanup

  amakropoulos

  committed
  e18ce31

  Copy full SHA for e18ce31

• add start/stop functions

  amakropoulos

  committed
  87194dc

  Copy full SHA for 87194dc

• UnityMainThreadDispatcher to separate class, unify LLM and LLM remote

  amakropoulos

  committed
  6e44cf8

  Copy full SHA for 6e44cf8

• separate server setup from init

  amakropoulos

  committed
  768beef

  Copy full SHA for 768beef

• formatting

  amakropoulos

  committed
  cb43910

  Copy full SHA for cb43910

• unify remote and local client

  amakropoulos

  committed
  5825d88

  Copy full SHA for 5825d88

• template request functionality

  amakropoulos

  committed
  1a9ad17

  Copy full SHA for 1a9ad17

• nkeep = tokenized system prompt + template

  amakropoulos

  committed
  f604606

  Copy full SHA for f604606

• small modifications

  amakropoulos

  committed
  e7b7dc2

  Copy full SHA for e7b7dc2

• add safeguards, fix destroy function

  amakropoulos

  committed
  09a32b9

  Copy full SHA for 09a32b9

• stop server functionality

  amakropoulos

  committed
  69c5ad6

  Copy full SHA for 69c5ad6

• streamwrapper-based functionality instead of callbacks

  amakropoulos

  committed
  20a594a

  Copy full SHA for 20a594a

• move StreamWrapper to LLMLib

  amakropoulos

  committed
  322453f

  Copy full SHA for 322453f

• add LLM Delete function to LLMLib

  amakropoulos

  committed
  4032240

  Copy full SHA for 4032240

• delete LLM object after thread exits

  amakropoulos

  committed
  992aece

  Copy full SHA for 992aece

• remove debug message

  amakropoulos

  committed
  216e013

  Copy full SHA for 216e013

• download library

  amakropoulos

  committed
  f609f53

  Copy full SHA for f609f53

• rename attributes, add local/remote attributes

  amakropoulos

  committed
  bab460b

  Copy full SHA for bab460b

• overwrite and delete library zip

  amakropoulos

  committed
  88c94ca

  Copy full SHA for 88c94ca

• test SimpleInteraction

  amakropoulos

  committed
  c2c1937

  Copy full SHA for c2c1937

• bump LlamaLib version to 1.1.1

  amakropoulos

  committed
  d784193

  Copy full SHA for d784193

• Update LLMLib.cs

  Show description for 2bc1bbd
  amakropoulos

  committed
  2bc1bbd

  Copy full SHA for 2bc1bbd

• implement architecture with interop

  amakropoulos

  committed
  3de1946

  Copy full SHA for 3de1946

• remove process-specific code

  amakropoulos

  committed
  61e14b0

  Copy full SHA for 61e14b0

• download CUDA functionality

  amakropoulos

  committed
  eca3c92

  Copy full SHA for eca3c92

• centralise setup in LLMUnitySetup

  amakropoulos

  committed
  54f12cd

  Copy full SHA for 54f12cd

• dont start server if arguments are null

  amakropoulos

  committed
  11b344d

  Copy full SHA for 11b344d

• avoid multiple cuda downloads

  amakropoulos

  committed
  0b9695f

  Copy full SHA for 0b9695f

• move editor variables in if block

  amakropoulos

  committed
  5240813

  Copy full SHA for 5240813

• check callback null before await

  amakropoulos

  committed
  81f1cb7

  Copy full SHA for 81f1cb7

• escape spaces directly

  amakropoulos

  committed
  2809476

  Copy full SHA for 2809476

• awake LLM/LLMClient only if enabled

  amakropoulos

  committed
  22e3238

  Copy full SHA for 22e3238

• adapt unit tests

  amakropoulos

  committed
  d0d4bbb

  Copy full SHA for d0d4bbb

• invoke callback if not null

  amakropoulos

  committed
  f733246

  Copy full SHA for f733246

• make chat list public

  amakropoulos

  committed
  f3cfcf0

  Copy full SHA for f3cfcf0

• wait for server start before request

  amakropoulos

  committed
  2c74a0d

  Copy full SHA for 2c74a0d

• adapt samples

  amakropoulos

  committed
  26584e9

  Copy full SHA for 26584e9

• remove debug messages

  amakropoulos

  committed
  28a2c9b

  Copy full SHA for 28a2c9b

• remove cuda dll

  amakropoulos

  committed
  8239d43

  Copy full SHA for 8239d43

• bump LlamaLib to v1.1.2

  amakropoulos

  committed
  f107108

  Copy full SHA for f107108

• move LLMClient to separate GameObject

  amakropoulos

  committed
  373894f

  Copy full SHA for 373894f

• rename LLMClient to LLMCharacter

  amakropoulos

  committed
  3f2d4f6

  Copy full SHA for 3f2d4f6

• simplify tests

  amakropoulos

  committed
  32cf008

  Copy full SHA for 32cf008

• remove async sample, rename serverclient

  amakropoulos

  committed
  c2f3c88

  Copy full SHA for c2f3c88

• rewrite LLMLib with dynamic library loading

  amakropoulos

  committed
  b9c1fa6

  Copy full SHA for b9c1fa6

• thread only for start loop, cleanup, delete lib

  amakropoulos

  committed
  fdbca43

  Copy full SHA for fdbca43

• use LLMCharacter instead of LLMClient

  amakropoulos

  committed
  7506022

  Copy full SHA for 7506022

• remove unused imports

  amakropoulos

  committed
  cb3dc36

  Copy full SHA for cb3dc36

• bump LlamaLib to v1.1.3

  amakropoulos

  committed
  4865d31

  Copy full SHA for 4865d31

• add llama3 chat template

  amakropoulos

  committed
  b9f71c5

  Copy full SHA for b9f71c5

• update VERSION

  amakropoulos

  committed
  6af62bc

  Copy full SHA for 6af62bc

• use the context size of the model by default for longer history

  amakropoulos

  committed
  6580842

  Copy full SHA for 6580842

• update changelogs

  amakropoulos

  committed
  58c0378

  Copy full SHA for 58c0378

• update changelogs

  amakropoulos

  committed
  bcbcbf1

  Copy full SHA for bcbcbf1

• replace phi-2 with phi-3

  amakropoulos

  committed
  0968167

  Copy full SHA for 0968167

• update VERSION

  amakropoulos

  committed
  a00a307

  Copy full SHA for a00a307

• fix ComputePrompt signature

  amakropoulos

  committed
  61328e0

  Copy full SHA for 61328e0

• remove deprecated api

  amakropoulos

  committed
  ab9a84d

  Copy full SHA for ab9a84d

• add slot method

  amakropoulos

  committed
  389bb3c

  Copy full SHA for 389bb3c

• modify slot signature

  amakropoulos

  committed
  e740863

  Copy full SHA for e740863

• add slot interface

  amakropoulos

  committed
  3e4143c

  Copy full SHA for 3e4143c

• implement save and load functionality

  amakropoulos

  committed
  b7bd35a

  Copy full SHA for b7bd35a

• set the save directory as temp

  amakropoulos

  committed
  70ccd83

  Copy full SHA for 70ccd83

• add saving mechanism for character

  amakropoulos

  committed
  0a6760d

  Copy full SHA for 0a6760d

• update LLM, set context size to 0

  amakropoulos

  committed
  0ce447c

  Copy full SHA for 0ce447c

• add option to debug the prompt

  amakropoulos

  committed
  670634d

  Copy full SHA for 670634d

• update LLMCharacter in Samples

  amakropoulos

  committed
  1f90cb9

  Copy full SHA for 1f90cb9

• update Readme

  amakropoulos

  committed
  f279484

  Copy full SHA for f279484

• modify section namings

  amakropoulos

  committed
  c7e76a3

  Copy full SHA for c7e76a3

• search plugins to allow detection in build

  amakropoulos

  committed
  0c627c7

  Copy full SHA for 0c627c7

• implement chat lock with semaphore

  amakropoulos

  committed
  c0095c9

  Copy full SHA for c0095c9

• remove duplicate template

  amakropoulos

  committed
  1b2a42e

  Copy full SHA for 1b2a42e

• update changelogs

  amakropoulos

  committed
  9a9c6c9

  Copy full SHA for 9a9c6c9

• Merge 9a9c6c97089b593cabcde166f89d86b7ff698f43 into 1de4572ffa75d5de0644308a7438677b0536a467

  amakropoulos

  authored
  a7f04d8

  Copy full SHA for a7f04d8

• update VERSION

  amakropoulos

  committed
  4d01630

  Copy full SHA for 4d01630

Commits on Jun 13, 2024

• Fix spelling and improve readability of the README.md file.

  amakropoulos

  committed
  e21ec4d

  Copy full SHA for e21ec4d

• add DontDestroyOnLoad option enabled by default

  amakropoulos

  committed
  0da53a3

  Copy full SHA for 0da53a3

• remove spacing if prompt is empty in phi3

  amakropoulos

  committed
  22f5bb0

  Copy full SHA for 22f5bb0

• update changelogs

  amakropoulos

  committed
  a16965e

  Copy full SHA for a16965e

• add note on context size RAM/VRAM usage

  amakropoulos

  committed
  2bec579

  Copy full SHA for 2bec579

Commits on Jun 14, 2024

• add KnowledgeBaseGame integrating RAG+LLM

  amakropoulos

  committed
  149c322

  Copy full SHA for 149c322

• update guids

  amakropoulos

  committed
  23c7a82

  Copy full SHA for 23c7a82

• show warning if model not set, small fixes

  amakropoulos

  committed
  43e6833

  Copy full SHA for 43e6833

• show warnings if models not selected

  amakropoulos

  committed
  292d545

  Copy full SHA for 292d545

• fix guids

  amakropoulos

  committed
  66404db

  Copy full SHA for 66404db

• reset models

  amakropoulos

  committed
  b86fc51

  Copy full SHA for b86fc51

• show warning only once

  amakropoulos

  committed
  150fa10

  Copy full SHA for 150fa10

• update changelogs

  amakropoulos

  committed
  1f22eb5

  Copy full SHA for 1f22eb5

Commits on Jun 17, 2024

• add async startup

  amakropoulos

  committed
  f25b05e

  Copy full SHA for f25b05e

• fix save/load relative dir

  amakropoulos

  committed
  1457bb4

  Copy full SHA for 1457bb4

Commits on Jun 19, 2024

• bump LlamaLib to v1.1.4

  amakropoulos

  committed
  04b7316

  Copy full SHA for 04b7316

• replace clblast with vulkan

  amakropoulos

  committed
  3ef5f66

  Copy full SHA for 3ef5f66

Commits on Jun 20, 2024

• add explicit failed parameter, throw assert error on fail

  amakropoulos

  committed
  7dc9b01

  Copy full SHA for 7dc9b01

• wait only when not failed

  amakropoulos

  committed
  57de88e

  Copy full SHA for 57de88e

• move plugins to streaming assets

  amakropoulos

  committed
  78ba77e

  Copy full SHA for 78ba77e

• remove MonoBehaviour

  amakropoulos

  committed
  541f6e7

  Copy full SHA for 541f6e7

Commits on Jun 25, 2024

• build processor to keep only relevant platform

  amakropoulos

  committed
  e1d727f

  Copy full SHA for e1d727f

• remove debug message

  amakropoulos

  committed
  05938ac

  Copy full SHA for 05938ac

• bump LlamaLib to v1.1.5

  amakropoulos

  committed
  3f1cf73

  Copy full SHA for 3f1cf73

• add hip blas

  amakropoulos

  committed
  d9261bc

  Copy full SHA for d9261bc

• add function documentation

  amakropoulos

  committed
  dc1abd9

  Copy full SHA for dc1abd9

• option to separately save cache, allow save/load on remote

  amakropoulos

  committed
  96307c4

  Copy full SHA for 96307c4

• reorder arguments

  amakropoulos

  committed
  abbb630

  Copy full SHA for abbb630

• update pngs

  amakropoulos

  committed
  7c13cb3

  Copy full SHA for 7c13cb3

• separate part of the code that does the asset copying

  amakropoulos

  committed
  124ef54

  Copy full SHA for 124ef54

• add more details for programmatic setup

  amakropoulos

  committed
  f41ed78

  Copy full SHA for f41ed78

• Merge f41ed78bbdb051590aa082279da422a4f4e965a7 into 1de4572ffa75d5de0644308a7438677b0536a467

  amakropoulos

  authored
  392a28e

  Copy full SHA for 392a28e

• update VERSION

  amakropoulos

  committed
  ef13e50

  Copy full SHA for ef13e50

• update changelogs

  amakropoulos

  committed
  96d82f2

  Copy full SHA for 96d82f2