Garlic LLM runs a 9B-parameter Qwen model offline on a hacked PS4
The open-source app talks to the console's 2013 GPU directly and reaches up to 43 tokens per second, its author says.
goldhen պիտակով նյութեր
The open-source app talks to the console's 2013 GPU directly and reaches up to 43 tokens per second, its author says.