Code

DLL integration#162

Code

Closed

amakropoulos wants to merge 84 commits intomainundreamai/LLMUnity:mainfrom

feature/use_llamacppundreamai/LLMUnity:feature/use_llamacppCopy head branch name to clipboard

Commits

Commits on Jun 12, 2024

• add slot_id to request, remove old vars from result

  amakropoulos

  committed
  fd1414a

  Copy full SHA for fd1414a

• implement dll-based client/server, separate remote and local functionality, separate server from client in LLM

  amakropoulos

  committed
  c4da4f2

  Copy full SHA for c4da4f2

• remove unnecessary stuff

  amakropoulos

  committed
  0f11fe8

  Copy full SHA for 0f11fe8

• add cancel functionality

  amakropoulos

  committed
  be24bb5

  Copy full SHA for be24bb5

• register client

  amakropoulos

  committed
  34e828d

  Copy full SHA for 34e828d

• handle await warning

  amakropoulos

  committed
  2e444de

  Copy full SHA for 2e444de

• throw error on non implemented functions

  amakropoulos

  committed
  616f243

  Copy full SHA for 616f243

• MVP

  amakropoulos

  committed
  bf3aa46

  Copy full SHA for bf3aa46

• allow to load different dlls

  amakropoulos

  committed
  53c3211

  Copy full SHA for 53c3211

• add all architecture functions

  amakropoulos

  committed
  e4128df

  Copy full SHA for e4128df

• architecture fallback implementation

  amakropoulos

  committed
  62c9910

  Copy full SHA for 62c9910

• add LLMLib logging functionality

  amakropoulos

  committed
  7c37522

  Copy full SHA for 7c37522

• use thread, cleanup

  amakropoulos

  committed
  a754eb9

  Copy full SHA for a754eb9

• add start/stop functions

  amakropoulos

  committed
  19fb68a

  Copy full SHA for 19fb68a

• UnityMainThreadDispatcher to separate class, unify LLM and LLM remote

  amakropoulos

  committed
  9b48fec

  Copy full SHA for 9b48fec

• separate server setup from init

  amakropoulos

  committed
  dce8810

  Copy full SHA for dce8810

• formatting

  amakropoulos

  committed
  eb70cb2

  Copy full SHA for eb70cb2

• unify remote and local client

  amakropoulos

  committed
  e09ca0e

  Copy full SHA for e09ca0e

• template request functionality

  amakropoulos

  committed
  51ce47f

  Copy full SHA for 51ce47f

• nkeep = tokenized system prompt + template

  amakropoulos

  committed
  0b34d8e

  Copy full SHA for 0b34d8e

• small modifications

  amakropoulos

  committed
  ed76b41

  Copy full SHA for ed76b41

• add safeguards, fix destroy function

  amakropoulos

  committed
  215d38c

  Copy full SHA for 215d38c

• stop server functionality

  amakropoulos

  committed
  df52d54

  Copy full SHA for df52d54

• streamwrapper-based functionality instead of callbacks

  amakropoulos

  committed
  a51e4cd

  Copy full SHA for a51e4cd

• move StreamWrapper to LLMLib

  amakropoulos

  committed
  85a4e40

  Copy full SHA for 85a4e40

• add LLM Delete function to LLMLib

  amakropoulos

  committed
  f6ba424

  Copy full SHA for f6ba424

• delete LLM object after thread exits

  amakropoulos

  committed
  0ad4b05

  Copy full SHA for 0ad4b05

• remove debug message

  amakropoulos

  committed
  1f5ef46

  Copy full SHA for 1f5ef46

• download library

  amakropoulos

  committed
  a4b187d

  Copy full SHA for a4b187d

• rename attributes, add local/remote attributes

  amakropoulos

  committed
  64fcdbb

  Copy full SHA for 64fcdbb

• overwrite and delete library zip

  amakropoulos

  committed
  2c12e51

  Copy full SHA for 2c12e51

• test SimpleInteraction

  amakropoulos

  committed
  bff6bfa

  Copy full SHA for bff6bfa

• bump LlamaLib version to 1.1.1

  amakropoulos

  committed
  91257e5

  Copy full SHA for 91257e5

• Update LLMLib.cs

  Show description for de3940f
  amakropoulos

  committed
  de3940f

  Copy full SHA for de3940f

• implement architecture with interop

  amakropoulos

  committed
  77586c2

  Copy full SHA for 77586c2

• remove process-specific code

  amakropoulos

  committed
  7e25f99

  Copy full SHA for 7e25f99

• download CUDA functionality

  amakropoulos

  committed
  425e03e

  Copy full SHA for 425e03e

• centralise setup in LLMUnitySetup

  amakropoulos

  committed
  3f06b50

  Copy full SHA for 3f06b50

• dont start server if arguments are null

  amakropoulos

  committed
  c88c19c

  Copy full SHA for c88c19c

• avoid multiple cuda downloads

  amakropoulos

  committed
  a2421ee

  Copy full SHA for a2421ee

• move editor variables in if block

  amakropoulos

  committed
  ef5d41b

  Copy full SHA for ef5d41b

• check callback null before await

  amakropoulos

  committed
  19c384e

  Copy full SHA for 19c384e

• escape spaces directly

  amakropoulos

  committed
  c02026f

  Copy full SHA for c02026f

• awake LLM/LLMClient only if enabled

  amakropoulos

  committed
  f3e50c4

  Copy full SHA for f3e50c4

• adapt unit tests

  amakropoulos

  committed
  b412821

  Copy full SHA for b412821

• invoke callback if not null

  amakropoulos

  committed
  6b7bb6b

  Copy full SHA for 6b7bb6b

• make chat list public

  amakropoulos

  committed
  01ddd8e

  Copy full SHA for 01ddd8e

• wait for server start before request

  amakropoulos

  committed
  2c439ba

  Copy full SHA for 2c439ba

• adapt samples

  amakropoulos

  committed
  f2cc048

  Copy full SHA for f2cc048

• remove debug messages

  amakropoulos

  committed
  856e6ca

  Copy full SHA for 856e6ca

• remove cuda dll

  amakropoulos

  committed
  2057156

  Copy full SHA for 2057156

• bump LlamaLib to v1.1.2

  amakropoulos

  committed
  795e16c

  Copy full SHA for 795e16c

• move LLMClient to separate GameObject

  amakropoulos

  committed
  d83a83b

  Copy full SHA for d83a83b

• rename LLMClient to LLMCharacter

  amakropoulos

  committed
  43939a5

  Copy full SHA for 43939a5

• simplify tests

  amakropoulos

  committed
  720be19

  Copy full SHA for 720be19

• remove async sample, rename serverclient

  amakropoulos

  committed
  3ca1bbb

  Copy full SHA for 3ca1bbb

• rewrite LLMLib with dynamic library loading

  amakropoulos

  committed
  d75f798

  Copy full SHA for d75f798

• thread only for start loop, cleanup, delete lib

  amakropoulos

  committed
  3a4ef29

  Copy full SHA for 3a4ef29

• use LLMCharacter instead of LLMClient

  amakropoulos

  committed
  785b5db

  Copy full SHA for 785b5db

• remove unused imports

  amakropoulos

  committed
  ee226bf

  Copy full SHA for ee226bf

• bump LlamaLib to v1.1.3

  amakropoulos

  committed
  abe94c6

  Copy full SHA for abe94c6

• add llama3 chat template

  amakropoulos

  committed
  5adca18

  Copy full SHA for 5adca18

• update VERSION

  amakropoulos

  committed
  83c6f77

  Copy full SHA for 83c6f77

• use the context size of the model by default for longer history

  amakropoulos

  committed
  59f57de

  Copy full SHA for 59f57de

• update changelogs

  amakropoulos

  committed
  0754ddd

  Copy full SHA for 0754ddd

• update changelogs

  amakropoulos

  committed
  d380e52

  Copy full SHA for d380e52

• replace phi-2 with phi-3

  amakropoulos

  committed
  4a89cb8

  Copy full SHA for 4a89cb8

• update VERSION

  amakropoulos

  committed
  832b69e

  Copy full SHA for 832b69e

• fix ComputePrompt signature

  amakropoulos

  committed
  af27a39

  Copy full SHA for af27a39

• remove deprecated api

  amakropoulos

  committed
  fbf932b

  Copy full SHA for fbf932b

• add slot method

  amakropoulos

  committed
  0eb2269

  Copy full SHA for 0eb2269

• modify slot signature

  amakropoulos

  committed
  1507c14

  Copy full SHA for 1507c14

• add slot interface

  amakropoulos

  committed
  9eca13d

  Copy full SHA for 9eca13d

• implement save and load functionality

  amakropoulos

  committed
  d4cbb26

  Copy full SHA for d4cbb26

• set the save directory as temp

  amakropoulos

  committed
  d23ae09

  Copy full SHA for d23ae09

• add saving mechanism for character

  amakropoulos

  committed
  5c41632

  Copy full SHA for 5c41632

• update LLM, set context size to 0

  amakropoulos

  committed
  aa205c3

  Copy full SHA for aa205c3

• add option to debug the prompt

  amakropoulos

  committed
  a661d63

  Copy full SHA for a661d63

• update LLMCharacter in Samples

  amakropoulos

  committed
  ad271bc

  Copy full SHA for ad271bc

• update Readme

  amakropoulos

  committed
  cfe4b07

  Copy full SHA for cfe4b07

• modify section namings

  amakropoulos

  committed
  34e0d2a

  Copy full SHA for 34e0d2a

• search plugins to allow detection in build

  amakropoulos

  committed
  ac2c933

  Copy full SHA for ac2c933

• implement chat lock with semaphore

  amakropoulos

  committed
  572d63c

  Copy full SHA for 572d63c

• remove duplicate template

  amakropoulos

  committed
  4586974

  Copy full SHA for 4586974