About r/LocalLLM
Subreddit to discuss locally run large language models.
The community at a glance
r/LocalLLM is a Subreddit for NLP Developers with roughly 185K members. It has been around since 2023. It uses a forum format for communication. On the Hive Index it ranks #9 in the NLP communities list.
Roughly 111K members have joined in the past year. Popular discussion topics include Llm, Local, and Ai. Common discussion themes are Advice Requests and Solution Requests. Product recommendations often mention model, llm, and gpu.
Community Topics
Community Features
This community has a forum
Subreddit Analysis
via GummySearchMember growth over time
All time (yearly)
- 2024: 13K members
- 2025: 86K members
- 2026: 82K members
Past year (monthly)
- Aug: 7K members
- Sep: 4K members
- Oct: 3K members
- Nov: 6K members
- Dec: 5K members
- Jan: 7K members
- Feb: 10K members
- Mar: 11K members
- Apr: 17K members
- May: 17K members
- Jun: 16K members
- Jul: 5K members
Themes
- Advice Requests5 posts in the past month
- Complete noob here, the prospect of local LLMs and doing other fun things with it exhilarates me but I don't know where to get started.
- Which book you can recommend to learn LLM creation?
- I trained a 200M Mixture-of-Experts language model (90M active) from scratch on 8B tokens at 15. I'd love some feedback.
#15Advice RequestsComplete noob here, the prospect of local LLMs and doing other fun things with it exhilarates me but I don't know where to get started. · Which book you can recommend to learn LLM creation? · I trained a 200M Mixture-of-Experts language model (90M active) from scratch on 8B tokens at 15. I'd love some feedback. - Solution Requests2 posts in the past month
- Looking for the best LLMOps platforms, what do you actually use?
- Recommendations on model
#22Solution RequestsLooking for the best LLMOps platforms, what do you actually use? · Recommendations on model
Topics
- Llm24 posts in the past month#124Llm
- Local20 posts in the past month#220Local
- Ai18 posts in the past month#318Ai
- Looking For16 posts in the past month#416Looking For
- Model13 posts in the past month#513Model
Flair
- Question33 posts in the past month
- Best home assistant model
- M5 Pro 24GB vs 48GB RAM for AI Engineering - Advice needed
- Recommendations on model
#133QuestionBest home assistant model · M5 Pro 24GB vs 48GB RAM for AI Engineering - Advice needed · Recommendations on model - Discussion25 posts in the past month
- GUYS
- I use Ollama on a DGX Spark. Roast me.
- 48GB MacBook + Local LLMs: Am I doing something fundamentally wrong?
#225DiscussionGUYS · I use Ollama on a DGX Spark. Roast me. · 48GB MacBook + Local LLMs: Am I doing something fundamentally wrong? - Project9 posts in the past month
- Mutant MPC server
- Built a local LLM inference framework as a 2nd year CS student
- created my own custom model at the age of 17
#39ProjectMutant MPC server · Built a local LLM inference framework as a 2nd year CS student · created my own custom model at the age of 17 - News7 posts in the past month
- Claude Code costs up to $200 a month. Goose does the same thing for free.
- Qué opinan ustedes
- Launching an open-source benchmark for Neutrality
#47NewsClaude Code costs up to $200 a month. Goose does the same thing for free. · Qué opinan ustedes · Launching an open-source benchmark for Neutrality - Research4 posts in the past month
- 100+ rig owners on r/LocalLLM told me why they'd buy again — break-even barely came up. I turned the discussion into a video
- Literature Review: Understanding Large Language Models in Your Pockets: Performance Study on COTS Mobile Devices | Benchmarking LLMs on Phones
- New oMLX 0.5.0 gives real boost on newer hardware
#54Research100+ rig owners on r/LocalLLM told me why they'd buy again — break-even barely came up. I turned the discussion into a video · Literature Review: Understanding Large Language Models in Your Pockets: Performance Study on COTS Mobile Devices | Benchmarking LLMs on Phones · New oMLX 0.5.0 gives real boost on newer hardware
Product recommendations
- model16 posts in the past month
- Best models for 8x3090
- What the best model to run on m1 pro, 16gb ram for coders?
- best model for laptop and ram?
#116modelBest models for 8x3090 · What the best model to run on m1 pro, 16gb ram for coders? · best model for laptop and ram? - llm9 posts in the past month
- Best ultra low budget GPU for 70B and best LLM for my purpose
- Best LocalLLM for scientific theories and conversations?
- Best LLM to run locally on LM Studio (4GB VRAM) for extracting credit card statement PDFs into CSV/Excel?
#29llmBest ultra low budget GPU for 70B and best LLM for my purpose · Best LocalLLM for scientific theories and conversations? · Best LLM to run locally on LM Studio (4GB VRAM) for extracting credit card statement PDFs into CSV/Excel? - gpu4 posts in the past month
- Best ultra low budget GPU for 70B and best LLM for my purpose
- GPU recommendation for best possible LLM/AI/VR with 3000+€ budget
- Best Used Card For Running LLMS
#34gpuBest ultra low budget GPU for 70B and best LLM for my purpose · GPU recommendation for best possible LLM/AI/VR with 3000+€ budget · Best Used Card For Running LLMS
Community Reviews
Frequently asked questions
- Who is r/LocalLLM for?
- Best for NLP Developers enthusiasts looking for a Reddit-based community with forum discussion.
- Is r/LocalLLM free to join?
- This listing is not marked as paid-only. Access rules and any fees are decided by the community.
- How many members does r/LocalLLM have?
- Roughly 185K members, based on figures reported by the community or its host. Member counts are approximate and change over time.
- What platform is r/LocalLLM on?
- r/LocalLLM runs on Reddit. Reddit communities (or "subreddits") are forum-based groups on the popular social news aggregation, web content rating, and discussion website Reddit. Reddit is commonly known as "the front page of the internet". Users submit content to the site such as links, text posts, and images, which are then voted up or down and discussed by other members. From investing Reddit communities, to professional ones, to ones just for laughs, you're likely to find a community for you on Reddit.
- What topics does r/LocalLLM cover?
- On the Hive Index, r/LocalLLM is organized under NLP Developers.
- How do I join r/LocalLLM?
- You can join r/LocalLLM by clicking this link, or pressing the "Go to community" button above.
- What are the NLP communities like?
- Join NLP communities online to discuss and learn about the latest developments in language learning technology. You'll be able to chat with like-minded engineers and data scientists about the newest machine learning methods, from NLP to neural networks.
Monthly Stats
- 9
- Views /mo (+80%)
- 8
- Visitors /mo (+60%)
- 0
- Referrals /mo (-100%)
Similar Communities
8r/LanguageTechnology
This sub will focus on theory, careers, and applications of NLP (Natural Language Processing), which includes anything from Regex & Text Analytics to Transformers & LLMs. Language learning & copy/pasted ChatGPT conversations are outside the scope of the sub - please read the rules for more clarification.
OneAI
OneAI provides APIs to apply AI to text. Summarize conversations, categorize articles and detect user emotions. Join the AI dev community on discord!
Merlinn Community
Merlinn Community is a Slack community that exists around our open-source product, Merlinn. The project is an AI on-call developer helping to investigate production incidents.
Hugging Face Discuss
Official community for discussion of Hugging Face transformers, datasets, and NLP models
r/NLP
Neuro-Linguistic Programming (NLP) is an approach to communication, personal development, and psychotherapy created by Richard Bandler and John Grinder.
fast.ai Forum
Community for fast.ai courses, practical deep learning, and NLP applications