r/LocalLLM

Community Overview

About r/LocalLLM

Subreddit to discuss locally run large language models.

The community at a glance

r/LocalLLM is a Subreddit for NLP Developers with roughly 185K members. It has been around since 2023. It uses a forum format for communication. On the Hive Index it ranks #9 in the NLP communities list.

Roughly 111K members have joined in the past year. Popular discussion topics include Llm, Local, and Ai. Common discussion themes are Advice Requests and Solution Requests. Product recommendations often mention model, llm, and gpu.

On Reddit
Established 2023
185K Members

Community Features

This community has a forum

Subreddit Analysis

via GummySearch
Yearly: +111K members
Growth: +151.0% / year

Member growth over time

All time (yearly)

  • 2024: 13K members
  • 2025: 86K members
  • 2026: 82K members

Past year (monthly)

  • Aug: 7K members
  • Sep: 4K members
  • Oct: 3K members
  • Nov: 6K members
  • Dec: 5K members
  • Jan: 7K members
  • Feb: 10K members
  • Mar: 11K members
  • Apr: 17K members
  • May: 17K members
  • Jun: 16K members
  • Jul: 5K members

Themes

  • Advice Requests
    5 posts in the past month
    1. Complete noob here, the prospect of local LLMs and doing other fun things with it exhilarates me but I don't know where to get started.
    2. Which book you can recommend to learn LLM creation?
    3. I trained a 200M Mixture-of-Experts language model (90M active) from scratch on 8B tokens at 15. I'd love some feedback.
    #1
    Advice Requests
    Complete noob here, the prospect of local LLMs and doing other fun things with it exhilarates me but I don't know where to get started. · Which book you can recommend to learn LLM creation? · I trained a 200M Mixture-of-Experts language model (90M active) from scratch on 8B tokens at 15. I'd love some feedback.
    5
  • Solution Requests
    2 posts in the past month
    1. Looking for the best LLMOps platforms, what do you actually use?
    2. Recommendations on model
    #2
    Solution Requests
    Looking for the best LLMOps platforms, what do you actually use? · Recommendations on model
    2

Topics

  • Llm
    24 posts in the past month
    #1
    Llm
    24
  • Local
    20 posts in the past month
    #2
    Local
    20
  • Ai
    18 posts in the past month
    #3
    Ai
    18
  • Looking For
    16 posts in the past month
    #4
    Looking For
    16
  • Model
    13 posts in the past month
    #5
    Model
    13

Flair

  • Question
    33 posts in the past month
    1. Best home assistant model
    2. M5 Pro 24GB vs 48GB RAM for AI Engineering - Advice needed
    3. Recommendations on model
    #1
    Question
    Best home assistant model · M5 Pro 24GB vs 48GB RAM for AI Engineering - Advice needed · Recommendations on model
    33
  • Discussion
    25 posts in the past month
    1. GUYS
    2. I use Ollama on a DGX Spark. Roast me.
    3. 48GB MacBook + Local LLMs: Am I doing something fundamentally wrong?
    #2
    Discussion
    GUYS · I use Ollama on a DGX Spark. Roast me. · 48GB MacBook + Local LLMs: Am I doing something fundamentally wrong?
    25
  • Project
    9 posts in the past month
    1. Mutant MPC server
    2. Built a local LLM inference framework as a 2nd year CS student
    3. created my own custom model at the age of 17
    #3
    Project
    Mutant MPC server · Built a local LLM inference framework as a 2nd year CS student · created my own custom model at the age of 17
    9
  • News
    7 posts in the past month
    1. Claude Code costs up to $200 a month. Goose does the same thing for free.
    2. Qué opinan ustedes
    3. Launching an open-source benchmark for Neutrality
    #4
    News
    Claude Code costs up to $200 a month. Goose does the same thing for free. · Qué opinan ustedes · Launching an open-source benchmark for Neutrality
    7
  • Research
    4 posts in the past month
    1. 100+ rig owners on r/LocalLLM told me why they'd buy again — break-even barely came up. I turned the discussion into a video
    2. Literature Review: Understanding Large Language Models in Your Pockets: Performance Study on COTS Mobile Devices | Benchmarking LLMs on Phones
    3. New oMLX 0.5.0 gives real boost on newer hardware
    #5
    Research
    100+ rig owners on r/LocalLLM told me why they'd buy again — break-even barely came up. I turned the discussion into a video · Literature Review: Understanding Large Language Models in Your Pockets: Performance Study on COTS Mobile Devices | Benchmarking LLMs on Phones · New oMLX 0.5.0 gives real boost on newer hardware
    4

Product recommendations

  • model
    16 posts in the past month
    1. Best models for 8x3090
    2. What the best model to run on m1 pro, 16gb ram for coders?
    3. best model for laptop and ram?
    #1
    model
    Best models for 8x3090 · What the best model to run on m1 pro, 16gb ram for coders? · best model for laptop and ram?
    16
  • llm
    9 posts in the past month
    1. Best ultra low budget GPU for 70B and best LLM for my purpose
    2. Best LocalLLM for scientific theories and conversations?
    3. Best LLM to run locally on LM Studio (4GB VRAM) for extracting credit card statement PDFs into CSV/Excel?
    #2
    llm
    Best ultra low budget GPU for 70B and best LLM for my purpose · Best LocalLLM for scientific theories and conversations? · Best LLM to run locally on LM Studio (4GB VRAM) for extracting credit card statement PDFs into CSV/Excel?
    9
  • gpu
    4 posts in the past month
    1. Best ultra low budget GPU for 70B and best LLM for my purpose
    2. GPU recommendation for best possible LLM/AI/VR with 3000+€ budget
    3. Best Used Card For Running LLMS
    #3
    gpu
    Best ultra low budget GPU for 70B and best LLM for my purpose · GPU recommendation for best possible LLM/AI/VR with 3000+€ budget · Best Used Card For Running LLMS
    4

Frequently asked questions

Who is r/LocalLLM for?
Best for NLP Developers enthusiasts looking for a Reddit-based community with forum discussion.
Is r/LocalLLM free to join?
This listing is not marked as paid-only. Access rules and any fees are decided by the community.
How many members does r/LocalLLM have?
Roughly 185K members, based on figures reported by the community or its host. Member counts are approximate and change over time.
What platform is r/LocalLLM on?
r/LocalLLM runs on Reddit. Reddit communities (or "subreddits") are forum-based groups on the popular social news aggregation, web content rating, and discussion website Reddit. Reddit is commonly known as "the front page of the internet". Users submit content to the site such as links, text posts, and images, which are then voted up or down and discussed by other members. From investing Reddit communities, to professional ones, to ones just for laughs, you're likely to find a community for you on Reddit.
What topics does r/LocalLLM cover?
On the Hive Index, r/LocalLLM is organized under NLP Developers.
How do I join r/LocalLLM?
You can join r/LocalLLM by clicking this link, or pressing the "Go to community" button above.
What are the NLP communities like?
Join NLP communities online to discuss and learn about the latest developments in language learning technology. You'll be able to chat with like-minded engineers and data scientists about the newest machine learning methods, from NLP to neural networks.