Questo articolo non è ancora tradotto nella tua lingua. Viene mostrato in inglese. Leggi l'originale in inglese

AI3 min di lettura0 commenti

Garlic LLM runs a 9B-parameter Qwen model offline on a hacked PS4

The open-source app talks to the console's 2013 GPU directly and reaches up to 43 tokens per second, its author says.

Pubblicato
AI · PLAYSTATION 4: 9B

In sintesi

  • Developer Leonardo Alegría released Garlic LLM, an open-source app that runs Qwen3.5-9B on a PlayStation 4.
  • The app works fully offline on the console's GPU and needs a hacked PS4 with GoldHEN installed.
  • The author reports 31 to 39 tokens per second in text chat and up to 43 when generating code.
  • The model is quantized to about 4.5 GiB so it fits in the console's 8 GB of shared memory.
  • Voice mode reads answers aloud in seven languages and drops speed to about 22 tokens per second.

A 2013 console as a local chatbot

Developer Leonardo Alegría has published Garlic LLM, an open-source application that runs the Qwen3.5-9B language model from Alibaba on a PlayStation 4. The model has 9 billion parameters and runs entirely offline on the console's GPU, with no Linux, external computer or internet connection required, according to Shazoo.

The app needs a hacked PS4 with GoldHEN, a tool for launching homebrew software, installed. Garlic LLM itself contains no exploits and does not jailbreak the console, Shazoo reported. It is free, comes as a single 5.66 GB package on Hugging Face and installs through the console's standard Package Installer.

How it fits in 8 GB

The main problem was memory: a 9-billion-parameter model at 8 bits per weight needs at least 9 GB, and the PS4's CPU and GPU share 8 GB. The author quantized the weights to 4 bits, and the two largest matrices in each layer to about 3.5 bits, bringing the model to roughly 4.5 GiB, Shazoo wrote. The attention cache is also stored at 4 bits, so a context of 16,000 tokens fits, against the model's native 256,000.

The application bypasses the console's drivers and talks to the video chip directly. Its compute kernels are written in OpenCL C and compiled by LLVM for AMD's Graphics Core Next architecture, the design the PS4's GPU is built on, while the tokenizer, interface, text rendering and audio run in plain C on the CPU. The project name refers to the memory type the console's GPU reads directly, called Garlic in the PS4 architecture.

Speed and voice

Alegría reports 31 to 39 tokens per second in text chat, and up to 43 when generating code, helped by a multi-token prediction feature built into Qwen3.5 that drafts up to two tokens ahead for the full model to check. Shazoo noted that the author does not publish the prompt or the testing method behind those figures.

Garlic LLM also handles spoken dialogue. Answers are read aloud in seven languages through the Chatterbox speech model, which brings the language model down to about 22 tokens per second, and holding a controller button starts dictation handled by Nvidia's Parakeet TDT 0.6B v3, which supports 25 European languages. Temperature, which controls how varied the answers are, defaults to 0.7; Alibaba recommends that value for general tasks with reasoning mode off and 1.0 with it on.

How it compares

The closest equivalent is PS5LM, a fork for the PlayStation 5 that runs llama.cpp as a native app and reaches the AMD GPU through a port of the RADV driver. The PS4 has no such driver layer for homebrew, so Garlic LLM appears to solve the task with its own code instead of llama.cpp or a Vulkan port, according to Shazoo.

On a hacked PS5, the larger Qwen3.8-27B ran at about 20 tokens per second, while the smaller Gemma 4 E4B and Llama 3.2 3B reached 61 and 124 tokens per second respectively. Installing GoldHEN is done at the user's own risk, Shazoo noted.

Fonti

3 fonti
  1. GoHa.Ru NewsPlayStation 4 научили локально запускать нейросеть Qwen 3.5 на 9 миллиардов параметров
  2. VGTimes NewsНа PS4 запустили ИИ-модель с 9 млрд параметров без ПК и Linux
  3. ShazooВзломанная PS4 запустила ИИ-модель на 9 миллиардов параметров со скоростью до 43 токенов в секунду

Questo articolo è stato preparato da BattleTown Newsroom a partire dai rapporti elencati sopra.

Domande frequenti

Does Garlic LLM need an internet connection?

No. According to Shazoo, the model runs entirely offline on the PlayStation 4's GPU.

What does the PS4 need for Garlic LLM to work?

A hacked console with GoldHEN installed, plus about 6 GB of free space, or 12 GB if the package is first copied to the internal drive.

Questo articolo ha solo scopo informativo. Non costituisce consulenza finanziaria, di investimento o legale. Avvertenze

Commenti: 0 commenti

BattleTown: battaglie di carri nel browser

Nuovi minigiochi, «Assalto» e «Sfondamento», sono già su BattleTown

Torna al feed

Leggi anche

Digita almeno 2 caratteri