GPU advice on 5080

True. GPU prices are skyrocketing all over the world, though the extent varies by country. The surge in prices for VRAM and RAM, plus HDDs, SSDs is really painful…

It’s gotten to the point where they’re actually remanufacturing older-generation GPUs (like the 3060 Ti)… Even Moore would be surprised.

That aside, the reason Copilot treats the RTX 5080 like a landmine is that, until about halfway…

Read more →
Buying advice local llm

The actual questions would probably look something like this:

  • While the best-supported backend (the software that runs the LLM) varies depending on the OS and GPU manufacturer, which OS should you choose?
  • VRAM might be faster than unified memory, but systems with unified memory are overwhelmingly better suited for running large LLMs. Do you prioritize model throughput or model size?
    *…
Read more →
Buying advice local llm

The actual questions would probably look something like this:

  • While the best-supported backend (the software that runs the LLM) varies depending on the OS and GPU manufacturer, which OS should you choose?
  • VRAM might be faster than unified memory, but systems with unified memory are overwhelmingly better suited for running large LLMs. Do you prioritize model throughput or model size?
    *…
Read more →
Buying advice local llm

The actual questions would probably look something like this:

  • While the best-supported backend (the software that runs the LLM) varies depending on the OS and GPU manufacturer, which OS should you choose?
  • VRAM might be faster than unified memory, but systems with unified memory are overwhelmingly better suited for running large LLMs. Do you prioritize model throughput or model size?
    *…
Read more →
Need help getting started with image generation

Im surprised this all is so much work, given how popular ai appears to be how are there no scripts or easy single click setups?

Yeah. Currently, AI generation-related projects (especially OSS) change so rapidly that the situation can shift within days. Because of this, I think Python (with only the core parts written in high-speed C++, C, or Rust) is often used, prioritizing maintainability…

Read more →
Need help getting started with image generation

Im surprised this all is so much work, given how popular ai appears to be how are there no scripts or easy single click setups?

Yeah. Currently, AI generation-related projects (especially OSS) change so rapidly that the situation can shift within days. Because of this, I think Python (with only the core parts written in high-speed C++, C, or Rust) is often used, prioritizing maintainability…

Read more →
Need help getting started with image generation

Im surprised this all is so much work, given how popular ai appears to be how are there no scripts or easy single click setups?

Yeah. Currently, AI generation-related projects (especially OSS) change so rapidly that the situation can shift within days. Because of this, I think Python (with only the core parts written in high-speed C++, C, or Rust) is often used, prioritizing maintainability…

Read more →
Need help getting started with image generation

Im surprised this all is so much work, given how popular ai appears to be how are there no scripts or easy single click setups?

Yeah. Currently, AI generation-related projects (especially OSS) change so rapidly that the situation can shift within days. Because of this, I think Python (with only the core parts written in high-speed C++, C, or Rust) is often used, prioritizing maintainability…

Read more →
Need help getting started with image generation

Im surprised this all is so much work, given how popular ai appears to be how are there no scripts or easy single click setups?

Yeah. Currently, AI generation-related projects (especially OSS) change so rapidly that the situation can shift within days. Because of this, I think Python (with only the core parts written in high-speed C++, C, or Rust) is often used, prioritizing maintainability…

Read more →
Need help getting started with image generation

Im surprised this all is so much work, given how popular ai appears to be how are there no scripts or easy single click setups?

Yeah. Currently, AI generation-related projects (especially OSS) change so rapidly that the situation can shift within days. Because of this, I think Python (with only the core parts written in high-speed C++, C, or Rust) is often used, prioritizing maintainability…

Read more →
Need help getting started with image generation

If you can get PyTorch installed appropriately once, the rest isn’t too difficult, but that’s the tough part.
For example, how to install WSL2, ComfyUI, and FLUX.1:


Overview: what “FLUX.1 (GGUF) in ComfyUI” actually means

  • ComfyUI is the node-based image generation UI/server. You run it locally and open it in a browser. (ComfyUI Official Document)
  • FLUX.1 GGUF files…
Read more →
Need help getting started with image generation

If you can get PyTorch installed appropriately once, the rest isn’t too difficult, but that’s the tough part.
For example, how to install WSL2, ComfyUI, and FLUX.1:


Overview: what “FLUX.1 (GGUF) in ComfyUI” actually means

  • ComfyUI is the node-based image generation UI/server. You run it locally and open it in a browser. (ComfyUI Official Document)
  • FLUX.1 GGUF files…
Read more →
Need help getting started with image generation

If you can get PyTorch installed appropriately once, the rest isn’t too difficult, but that’s the tough part.
For example, how to install WSL2, ComfyUI, and FLUX.1:


Overview: what “FLUX.1 (GGUF) in ComfyUI” actually means

  • ComfyUI is the node-based image generation UI/server. You run it locally and open it in a browser. (ComfyUI Official Document)
  • FLUX.1 GGUF files…
Read more →
Need help getting started with image generation

If you can get PyTorch installed appropriately once, the rest isn’t too difficult, but that’s the tough part.
For example, how to install WSL2, ComfyUI, and FLUX.1:


Overview: what “FLUX.1 (GGUF) in ComfyUI” actually means

  • ComfyUI is the node-based image generation UI/server. You run it locally and open it in a browser. (ComfyUI Official Document)
  • FLUX.1 GGUF files…
Read more →
Need help getting started with image generation

If you can get PyTorch installed appropriately once, the rest isn’t too difficult, but that’s the tough part.
For example, how to install WSL2, ComfyUI, and FLUX.1:


Overview: what “FLUX.1 (GGUF) in ComfyUI” actually means

  • ComfyUI is the node-based image generation UI/server. You run it locally and open it in a browser. (ComfyUI Official Document)
  • FLUX.1 GGUF files…
Read more →
Page 1