Search results

Compared to RAG techniques

Status: Open.

#25 In CStanKonrad/long_llama;

· leezythu opened on Jan 8, 2024

It's questionable whether the context window has truly been expanded？

Status: Open.

#24 In CStanKonrad/long_llama;

· HarryYuan007 opened on Jan 3, 2024

Need clarification on token limit of input used for fine tuning

Status: Open.

#20 In CStanKonrad/long_llama;

· lokesh-iterate opened on Oct 11, 2023

0-shot long-context summarization / QA inference

Status: Open.

#19 In CStanKonrad/long_llama;

· shi-kejian opened on Oct 10, 2023

utilizing Long Llama with Mojo Framework and applying 4-bit quantization and is it possible to use flash attention 2 and your thoughts about Speculative execution for LLM

Status: Open.

#17 In CStanKonrad/long_llama;

· myname36 opened on Oct 9, 2023

I have some questions

Status: Open.

#16 In CStanKonrad/long_llama;

· dziulatex opened on Oct 6, 2023

How much vram needed to finetune 3b model? Is 12gb enough?

Status: Open.

#15 In CStanKonrad/long_llama;

· universewill opened on Sep 28, 2023

FoT can only be used for pre-training, can't it be used for instruction fine-tuning?

Status: Open.

#13 In CStanKonrad/long_llama;

· wujiekd opened on Sep 1, 2023

How is the contrastive data pipeline implemented?

Status: Open.

#12 In CStanKonrad/long_llama;

· MarkYangjiayi opened on Aug 27, 2023

Code for zero-shot arxiv evaluation

Status: Open.

#10 In CStanKonrad/long_llama;

· bronyayang opened on Jul 17, 2023

Support for gradient_checkpointing

Status: Open.

#9 In CStanKonrad/long_llama;

· Richar-Du opened on Jul 13, 2023

About the use of rotary position coding.

Status: Open.

#8 In CStanKonrad/long_llama;

· tianyabanbu opened on Jul 13, 2023