Tagged software
3 entries
2026-07-08
Brief · 8 July 2026ZML unveiled LLMD, a free inference‑acceleration stack that claims up to 2× speedup on a range of AI accelerators—including NVIDIA Blackwell, AMD MI300X, Intel Gaudi and custom ASICs—making inference cheaper across the board. (TechCrunch)
2026-07-04
Brief · 4 July 2026DeepSeek announced DSpark, an acceleration layer for its V4 model, promising dramatically higher inference speed and lower serving costs. The claim appeared in a short video posted on July 3 – July 4. (https://www.youtube.com/watch?v=V7GBRPf7Zy8)
2026-06-09
Brief · 9 June 2026NVIDIA added support for the new NVFP4 numeric format on Blackwell GPUs, letting JAX‑MaxText pipelines run up to 1.8× faster, and the Linux 7.2 kernel now includes ACPI CPPC v4 code contributed by an NVIDIA engineer, easing power‑management integration for Blackwell servers. [source]