>>74209754Huggingface has a calculator that will show you the total amount of memory needed, you can get a rough idea with that of how much ram you'll need after you've offloaded as much as you can to your GPU.
https://huggingface.co/spaces/NyxKrage/LLM-Model-VRAM-Calculator