Collection by nizata: Self Hosting LLMs - Upcarta

Collection

nizata @ata · Dec 19, 2023

Collection

Self Hosting LLMs

exploring options for hosting llms locally

4 likes

nizata @ata · Dec 19, 2023

Curated in Self Hosting LLMs

LLaMA and Llama-2 Hardware Requirements for Local Use (GPU, CPU, RAM)

1 mention

nizata @ata · Dec 19, 2023

Curated in Self Hosting LLMs

How is LLaMa.cpp possible?

1 mention

nizata @ata · Dec 19, 2023

Curated in Self Hosting LLMs

GitHub - jmorganca/ollama: Get up and running with Llama 2 and other large language models locally

1 mention

nizata @ata · Dec 19, 2023

Curated in Self Hosting LLMs

GitHub - oobabooga/text-generation-webui: A Gradio web UI for Large Language Models. Supports transformers, GPTQ, AWQ, EXL2, llama.cpp (GGUF), Llama models.

1 mention

nizata @ata · Dec 19, 2023

Subcollection in Self Hosting LLMs

llm prompting

nizata @ata · Dec 20, 2023

Curated in Self Hosting LLMs

Uncensored Models

1 mention

nizata @ata · Dec 23, 2023

Curated in Self Hosting LLMs

How to make LLMs go fast

1 mention