Thunder 57
Diamond Member
- Aug 19, 2007
- 4,024
- 6,740
- 136
The easiest is LM Studio.
If you have at least a 5800X with 32GB DDR4-3200 (though 3600 or 3733 would be best), try it with the model gpt-oss-20b. May work with 16GB RAM but you will get very close to running out of RAM. It could work fine with slower CPUs but the wait time will be harder to deal with.
Ask it questions you are curious about. Give it a text or PDF document and ask questions about that. You will be surprised how useful it can be.
Interesting. 5700X (though I run it at +100 max boost compared to a 5800X) and 32GB 3600 MT/s. I figured It'd want a high end video card which I do not have. I haven't really dabbled in AI other than Stable Diffusion and it is something I should try to keep up with.