Search results

About Experiences in Section 4.2 (Performance on Synthetic Long Context Tasks) in the paper

Status: Open.

#49 In datamllab/LongLM;

· zhlgg opened on Dec 28, 2024

Memory usage

Status: Open.

#48 In datamllab/LongLM;

· scar-on opened on Dec 13, 2024

How to select params for self extend? (llama3.1 and gemma2)

Status: Open.

#47 In datamllab/LongLM;

· hahmad2008 opened on Nov 20, 2024

About GPU memory usage

Status: Open.

#45 In datamllab/LongLM;

· zhongsanqiang opened on Jul 26, 2024

LongLM really has great potential.

Status: Open.

#44 In datamllab/LongLM;

· lh0x00 opened on Jul 15, 2024

TypeError: 'NoneType' object is not subscriptable

Status: Open.

#43 In datamllab/LongLM;

· Lilly-25 opened on Jul 3, 2024

Cohere command r

Status: Open.

#42 In datamllab/LongLM;

· flaviusburca opened on Jun 4, 2024

Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! when resuming training

Status: Open.

#37 In datamllab/LongLM;

· humza-sami opened on May 14, 2024

llama3 is not working.

Status: Open.

#36 In datamllab/LongLM;

· rayjang opened on Apr 26, 2024

Question | Has anyone tried this with GGUF models?

Status: Open.

#32 In datamllab/LongLM;

· Cognitus-Stuti opened on Apr 11, 2024

What effect on qwen1.5 will be if i use self-extend trick?

Status: Open.

#30 In datamllab/LongLM;

· WeixuanXiong opened on Mar 28, 2024

FlashAttention does not work for Batch size > 1

bugSomething isn't workingSomething isn't working

Status: Open.

#29 In datamllab/LongLM;

· Mooler0410 opened on Mar 28, 2024