Skip to content

Latest commit

 

History

History
45 lines (34 loc) · 2.34 KB

File metadata and controls

45 lines (34 loc) · 2.34 KB

LLM_Suite

Table of Contents

1. Overview

LLM Suite refers to a collection of tools, interfaces, and runtimes that work together to enable the local deployment, management, and interaction with large language models (LLMs).

2.LM Studio

Welcome to the LM Studio! This platform is designed for developing applications with large language models locally ,offering privacy-first AI capabilities, model browsing, and developer-friendly SDKs for building custom AI solutions.

2.1. Introduction to LM Studio.

The LM Studio is a powerful platform for developing applications with large language models locally, It offers privacy-first AI capabilities, model browsing, and developer-friendly SDKs for building custom AI solutions.

2.2. System requirements.

The LM Studio requires specific hardware and software configurations to ensure optimal performance and functionality. Ensure your system meets the following requirements:

  • Operating System: Windows 11 or later
  • Processor: x64/ARM64 Windows & x64 Linux PCs.

Qualcomm® Snapdragon™ chipsets are at the heart of the LM Studio, providing high-performance AI capabilities for local model development.

2.3. Installation.

To install the LM Studio, follow these steps:

  1. Download the LM Studio installer from the official website Download.
  2. Download an installer for your operating system.
  3. Run the installer and follow the on-screen instructions.
  4. Once the installation is complete, launch the LM Studio application.

2.4. Getting Started.

You can use openly available Large Language Models (LLMs) like Llama 3.1, Phi-3, and Gemma 2 locally in LM Studio, leveraging your computer's computing units. To get started, follow these steps to Running LLMs Locally:Getting Started

  1. Download an LLM to your computer.
  2. Load a model to memory.
  3. Chat.

2.5. Documentation.

For detailed information on using the LM Studio, refer to the official documentation available at Documentation