xentr_theme_editor

  • Please do not post any links until you have 3 posts as they will automatically be rejected to prevent SPAM. Many words are also blocked due to being used in SPAM Messages. Thanks!

Crappy Used Computer Parts Ads

300 is high but not to the point of obscurity when they are getting low 200s. Not so far out of touch compared to other listings being shared. Not a lot of cheap GPUs with that much vram so they are fetching some LLM usage/buyers.
 
xentr_thread_starter
300 is high but not to the point of obscurity when they are getting low 200s. Not so far out of touch compared to other listings being shared. Not a lot of cheap GPUs with that much vram so they are fetching some LLM usage/buyers.
I'm using one under an EK block for LLM and AI image generation for fun, it's too slow and not enough VRAM. You can still load larger-ish models but anything more complex like using Skyvern to automate web navigation or image generation is too slow. Sage Attention doesn't work on something that old, you need at least RTX 3xxx for it. For $300, go for a 3060 12GB. If Intel B60 24GB is under $600, that may be worth saving money for and stick with VULCAN as the backend.
 
I'm using one under an EK block for LLM and AI image generation for fun, it's too slow and not enough VRAM. You can still load larger-ish models but anything more complex like using Skyvern to automate web navigation or image generation is too slow. Sage Attention doesn't work on something that old, you need at least RTX 3xxx for it. For $300, go for a 3060 12GB. If Intel B60 24GB is under $600, that may be worth saving money for and stick with VULCAN as the backend.
b50 pro is the goal card for the homelab atm. With the low profile and slot power I can fit 1 in the server without any kind of modifications. With single slot coolers (mod kits exist) I could fit two and split the responsibilities. Anything physically larger or requiring more power will require heavy customization.
 

Latest posts

Back
Top