Tech blog
  • Blog
  • Github
  • Twitter
  • luigi@grigio.org

llamacpp

A collection of 3 posts
llamacpp

llama.cpp 1.0 + Qwen3.8-27B: Vulkan vs SYCL on Intel Arc B390

llama.cpp version: a956a852c (commit: "Fix ctz64 on 32bit (#32273)", build 1386) Model: Qwen3.8-27B-thinkingcap-abliterated-mtp-Q4_K_M (15.65 GiB, 27.32B params) Hardware: Xiaomi Book Pro 14 — Intel Core Ultra X7 358H + Intel Arc B390 GPU (96 compute units, 30.7 GB
15 Nov 2026 4 min read
llamacpp

llama.cpp 0.9.x Vulkan vs SYCL Benchmark on Intel B390 with Qwen3-35B-A3B-MTP-UD-Q4_K_M

llama.cpp test updated on Intel Panther lake with Vulkan and SYCL backend. llama.cpp version: 0.9.0-dev (build 1138, commit 9c9074e14) Hardware: Intel Core Ultra X7 358H (16c/16t, no HT), Intel Arc B390 (23.7 GiB VRAM / 28.8 GiB SYCL) OS: CachyOS (Arch-based, rolling)
05 Nov 2026 7 min read
llama

How I got 2.2x more tokens per second from llama.cpp on Intel Arc

I spent a weekend benchmarking llama.cpp on my Xiaomi Book Pro 14. The machine has Intel's Core Ultra X7 358H and Arc B390 integrated graphics, with 30 GiB of unified memory. That last part matters. It means the GPU can address most of system RAM, which changes
28 Sep 2026 5 min read
Page 1 of 1
Tech blog © 2026
  • Sign up
Powered by Ghost