/wsr/ - Worksafe Requests » Thread #1518506

[3 / 1 / ?]

157KiB, 870x579, Salient-features-process-of-creative-writing.png

Anonymous Thu 06 Mar 2025 18:32:41 No.1518506 View View Reply Original Report

I need an LLLM that I can run locally on my computer to help me write all kinds of stuff. But I've only got 6 GB of laptop GPU.
Any help will be appreciated. I've heard Meta's llama is good but I'm worried it'll censor my work.
I really appreciate any help you can provide.

Anonymous

Anonymous Thu 06 Mar 2025 19:25:20 No.1518507 Report

Quoted By: >>1518508

>>1518506
>6 GB of VRAM
You should be able to run Llama3-8B-Q3_K_M or Llama-3.2-3B-Q8.0.

>I've heard Meta's llama is good but I'm worried it'll censor my work.
There are uncensored models like Dolphin.
https://huggingface.co/QuantFactory/dolphin-2.9-llama3-8b-GGUF
https://huggingface.co/bartowski/Dolphin3.0-Llama3.2-3B-GGUF

Use LM Studio for an EZPZ just werks solution.
To save on VRAM, you should disable GPU acceleration in any chromium-based programs (notably Chrome and Electron apps).
That includes LM studio's UI.
If there's no way to switch it off in the settings, you can usually run the program with the "--disable-gpu" switch.

Anonymous

Anonymous Thu 06 Mar 2025 19:29:53 No.1518508 Report

Quoted By:

>>1518507
Thanks
can I make it write racist stuff and sexual stuff?

Capcode	All Only User Posts Only Verified Posts Only Moderator Posts Only Manager Posts Only Admin Posts Only Developer Posts Only Founder Posts
Show Posts	All Only With Images Only Without Images Only Spoiler Images Only Non-Spoiler Images
Deleted Posts	All Only Deleted Posts Only Non-Deleted Posts
Ghost Posts	All Only Ghost Posts Only Non-Ghost Posts
Post Type	All Only Sticky Threads Only Opening Posts Only Reply Posts
Results	All Grouped By Threads
Order	Latest Posts First Oldest Posts First

On these archives

Your latest searches