Skip to content

Open systems / 03

Open-source releases worth evaluating.

Find new AI tools and meaningful releases with source links, adoption context, and practical tradeoffs.

  1. ggml-org/llama.cpp b11030

    <details open> ci : bump android-actions/setup-android to 4.0.4 (#29065) </details> **Website:** - <https://llama.app> **Attestations:** - <https://github.com/ggml-org/llama.cpp/attestations/48395907> **macOS/iOS:** - [macOS Apple Silicon (arm64)](https://github.com/ggml-org/lla…

    github.com1 hour agoView details

  2. ggml-org/llama.cpp b11029

    <details open> vulkan: raise the hoisted row-id limit for mul_mat_id from 256 to 1024 experts (#28501) * vulkan: raise the hoisted row-id limit for mul_mat_id to 512 experts The expert-count shader (count_experts.comp) sizes its shared arrays with BLOCK_SIZE, which is 256. Becau…

    github.com2 hours agoView details

  3. openai/openai-python v3.15.0

    ## [3.15.0](https://github.com/openai/openai-python/compare/v3.14.1...v3.15.0) (2026-09-18) ### Features * **api:** add agent session model settings ([#3882](https://github.com/openai/openai-python/issues/3882)) ([4b15817](https://github.com/openai/openai-python/commit/4b1581771…

    github.com9 hours agoView details

  4. langchain-ai/langchain langchain-typesafe==0.0.1a2

    Initial release release(typesafe): bump to 0.0.1a2 (#40576) feat(typesafe): experimental `AutoModeMiddleware` (#40545) feat(typesafe): experimental `ModelRouterMiddleware` (#40543) fix(typesafe): trace usage metadata (#40570) feat(typesafe): `TypeSafeClassifier` (#40542)

    github.com11 hours agoView details

  5. langchain-ai/langchain langchain-typesafe==0.0.1a1

    Initial release feat(typesafe): `TypeSafeClassifier` (#40542)

    github.com15 hours agoView details

  6. ggml-org/llama.cpp b11028

    <details open> ci : add missing evict-old-files (#29041) </details> **Website:** - <https://llama.app> **Attestations:** - <https://github.com/ggml-org/llama.cpp/attestations/48252257> **macOS/iOS:** - [macOS Apple Silicon (arm64)](https://github.com/ggml-org/llama.cpp/releases/…

    github.com16 hours agoView details

  7. ggml-org/llama.cpp b11015

    <details open> opencl: fix various warnings (#28984) * opencl: fix warnings * opencl: fix warnings for non adreno </details> **Website:** - <https://llama.app> **Attestations:** - <https://github.com/ggml-org/llama.cpp/attestations/48132480> **macOS/iOS:** - [macOS Apple Silicon…

    github.com1 day agoView details

  8. ggml-org/llama.cpp b11013

    <details open> vulkan: fix buffer_reference alignment in im2col shaders (#28996) Both im2col.comp and im2col_3d.comp declare D_ptr without an explicit buffer_reference_align, so glslang emits writes through it as Aligned 16. The shaders advance the pointer by D_SIZE, a per-varia…

    github.com1 day agoView details

  9. ggml-org/llama.cpp b11012

    <details open> vulkan: support qwen4exp hc ops (#28988) * vulkan: support qwen4exp hc ops * fix stale comment [no-ci] </details> **Website:** - <https://llama.app> **Attestations:** - <https://github.com/ggml-org/llama.cpp/attestations/48109146> **macOS/iOS:** - [macOS Apple Sil…

    github.com1 day agoView details

  10. langchain-ai/langchain langchain==1.4.1

    Changes since langchain==1.4.0 release(langchain): 1.4.1 (#40498) fix(langchain): preserve open MCP object arguments (#40414) fix(langchain): correct `InterruptOnConfig` documentation (#40140)

    github.com1 day agoView details

  11. ggml-org/llama.cpp b10996

    <details open> chat : force `\n</think>` on reasoning budget end for qwen3-coder (#28869) </details> **Website:** - <https://llama.app> **Attestations:** - <https://github.com/ggml-org/llama.cpp/attestations/47858837> **macOS/iOS:** - [macOS Apple Silicon (arm64)](https://github…

    github.com2 days agoView details

  12. ggml-org/llama.cpp b10995

    <details open> vulkan: make MUL_MAT_ID BN/2 tail unconditional (#28923) Use BN/2 as the default for BNover2 and as the disabled fallback for BNover4, and remove the enable gate from the MUL_MAT_ID BN/2 branch. The BN/4 branch remains gated by enable_smaller_matrices, while the p…

    github.com2 days agoView details

  13. ggml-org/llama.cpp b10994

    <details open> metal: fix NaN in mul_mm_id when activations exceed f16 range (#26223) * test-backend-ops: reproduce MUL_MAT_ID NaN for activations beyond f16 The Metal mul_mm_id path narrows src1 to `half` for the simdgroup MMA (`S1 = half` in every instantiation; ggml-metal.met…

    github.com2 days agoView details

  14. vllm-project/vllm v0.28.0

    # v0.28.0 ## Highlights This release features 584 commits from 270 contributors (76 new)! * **Kimi-K3 performance push**: a major optimization effort for Kimi-K3 across the stack — Decode Context Parallel (DCP) support (#50484), fused FlashKDA decode and prefill kernels (#50654,…

    github.com23 days ago108 ptsView details

  15. openai/openai-python v3.14.1

    ## [3.14.1](https://github.com/openai/openai-python/compare/v3.14.0...v3.14.1) (2026-09-15) ### Bug Fixes * **client:** validate retry limits and preserve application errors ([#3867](https://github.com/openai/openai-python/issues/3867)) ([f86c721](https://github.com/openai/opena…

    github.com2 days agoView details

  16. anthropics/anthropic-sdk-python v1.6.0

    ## 1.6.0 (2026-09-15) Full Changelog: [v1.5.0...v1.6.0](https://github.com/anthropics/anthropic-sdk-python/compare/v1.5.0...v1.6.0) ### Features * **api:** add auto mode tool permissions for Managed Agents ([909d92f](https://github.com/anthropics/anthropic-sdk-python/commit/909d…

    github.com2 days agoView details

  17. ggml-org/llama.cpp b10976

    <details open> ci : fix android release (#28936) </details> **Website:** - <https://llama.app> **Attestations:** - <https://github.com/ggml-org/llama.cpp/attestations/47548995> **macOS/iOS:** - [macOS Apple Silicon (arm64)](https://github.com/ggml-org/llama.cpp/releases/download…

    github.com3 days agoView details

  18. shadcn-ui/lint

    An agent-first linter for Tailwind design systems. Write design system rules that agents can verify.

    github.com15 days ago33 ptsView details

  19. openai/openai-python v3.14.0

    ## [3.14.0](https://github.com/openai/openai-python/compare/v3.13.0...v3.14.0) (2026-09-14) ### Features * **streaming:** normalize errors raised while reading streams ([#3827](https://github.com/openai/openai-python/issues/3827)) ([d7c41ef](https://github.com/openai/openai-pyth…

    github.com3 days agoView details

  20. ggml-org/llama.cpp b10970

    <details open> HIP: fattn-mma: use fp32 accumulation on MFMA devices (#28576) use fp32 accumulators in fattn-mma on CDNA </details> **Website:** - <https://llama.app> **Attestations:** - <https://github.com/ggml-org/llama.cpp/attestations/47450174> **macOS/iOS:** - [macOS Apple…

    github.com3 days agoView details

  21. ggml-org/llama.cpp v0.4.1

    ## Overview llama.cpp 0.4.1 adds Maple 20B-A1B, Tencent Hy 4, and Spark2.5 support, improves JSON schema handling, chat parsing, logging, and server child-process management, and updates ggml to v0.24.0. ### API changes - Changed `llama_sampler_chain_n()` to return `int32_t` ins…

    github.com3 days agoView details

  22. XiaoDuoYa/codex-with-chatgpt

    ChatGPT thinks. Codex works. Use ChatGPT as the planning brain while keeping the Codex harness.

    github.com20 days ago37 ptsView details

  23. ggml-org/llama.cpp b10952

    <details open> sycl : fix oneDNN scratchpad breaking the pool free order (#28704) </details> **Website:** - <https://llama.app> **Attestations:** - <https://github.com/ggml-org/llama.cpp/attestations/47287268> **macOS/iOS:** - [macOS Apple Silicon (arm64)](https://github.com/ggm…

    github.com4 days agoView details

  24. ggml-org/llama.cpp b10951

    <details open> common : move llama_n_rs_seq to before llama_decode (#28749) This commit moves the llama_n_rs_seq function call to before the llama_decode call and returns directly if the check is true, removing the setting of res and the goto statement. The motivation for this c…

    github.com4 days agoView details

  25. ggml-org/llama.cpp b10950

    <details open> ggml-cuda: fallback to F32 on device without BF16 hardware acceleration (#28846) * ggml-cuda: fallback to F32 on device without BF16 hardware acceleration: (Nvidia >= AMPERE, AMD >= RDNA3 or = CDNA) * apply logic to NVIDIA as well --------- Co-authored-by: Johanne…

    github.com4 days agoView details

  26. shtjww/llm-inference-capacity-handbook

    大模型推理案头手册(开源版):给定 GPU 算力,一个模型能扛多少 QPS?三层模型 × 三面墙 × 排队论 × 开环压测

    github.com16 days ago20 ptsView details

  27. ggml-org/llama.cpp b10938

    <details open> vulkan: workaround NV queuesubmit driver bug (#28830) There is a driver bug where two queues on the same VkDevice simultaneously submitting can break some internal synchronization. Until it's fixed, add a mutex around queuesubmit. </details> **Website:** - <https:…

    github.com5 days agoView details

  28. ggml-org/llama.cpp b10937

    <details open> opencl: apply the noshuffle row-alignment rule to q4_K, q5_K and q8_0, not just q6_K (#28575) </details> **Website:** - <https://llama.app> **Attestations:** - <https://github.com/ggml-org/llama.cpp/attestations/47132459> **macOS/iOS:** - [macOS Apple Silicon (arm…

    github.com5 days agoView details

  29. ggml-org/llama.cpp b10936

    <details open> chat : improve parsing of complex types in qwen3-coder (#28742) * chat : improve schema support in qwen3 parser * cont : clean up grammar a bit </details> **Website:** - <https://llama.app> **Attestations:** - <https://github.com/ggml-org/llama.cpp/attestations/47…

    github.com5 days agoView details

  30. ggml-org/llama.cpp b10922

    <details open> opencl: add bin kernel `kernel_gemm_noshuffle_q4_k_f32_32b_trans_ila_a8_bin` (#28677) * opencl: add A8 Q4_K non-MoE binary kernel * opencl: fix layout compatibility * opencl: rename binary kernel selection helpers --------- Co-authored-by: Li He <lih@qti.qualcomm.…

    github.com6 days agoView details

  31. ggml-org/llama.cpp b10921

    <details open> webgpu: align tensor bindings to the type block size (#28382) Walk the binding offset back until the distance to the tensor is a whole number of blocks, so block quantized views get a valid element offset in the shader. </details> **Website:** - <https://llama.app…

    github.com6 days agoView details

  32. ggml-org/llama.cpp b10920

    <details open> hexagon: support for multi-device model split (aka row-split) (#28589) * hex-row-split: add support for multi-device row spliting Co-authored-by: Max Krasnyansky <maxk@qti.qualcomm.com> * hex-mdev: add work splitting to fused kernels * hex-mdev: use mdev_ prefix f…

    github.com6 days agoView details

  33. CopilotKit/OpenBot

    Open-source AI coworkers that each get a computer of their own: a browser, files and tools, with every action decided before it happens and recorded after. Bring any AG-UI agent.

    github.com1 month ago37 ptsView details

  34. langchain-ai/langchain langchain-core==1.6.3

    Changes since langchain-core==1.6.2 release(core): 1.6.3 (#40407) feat(core): Allow model name and provider tracing metadata override based on gateway response (#40406) test(core): cover the deprecated `.text()` access path (#40243) docs(core): remove stale Args/Raises entries f…

    github.com6 days agoView details

  35. ggml-org/llama.cpp b10903

    <details open> vulkan: fix data race and OOB access in argsort(large) (#28705) argsort had a data race in the inner loop, which VVL caught. But I don't think this was causing failures in practice. argsort_large has OOB accesses which might explain the failures in CI, but I could…

    github.com7 days agoView details

  36. ggml-org/llama.cpp b10902

    <details open> opencl: add A8 Q4_0 mm binary kernel support (#28268) </details> **Website:** - <https://llama.app> **Attestations:** - <https://github.com/ggml-org/llama.cpp/attestations/46774832> **macOS/iOS:** - [macOS Apple Silicon (arm64)](https://github.com/ggml-org/llama.c…

    github.com7 days agoView details

  37. ggml-org/llama.cpp b10901

    <details open> vulkan: use CPU writes in ggml_backend_vk_cpy_tensor_async if the context is idle (#28618) </details> **Website:** - <https://llama.app> **Attestations:** - <https://github.com/ggml-org/llama.cpp/attestations/46709648> **macOS/iOS:** - [macOS Apple Silicon (arm64)…

    github.com7 days agoView details

  38. openai/openai-python v3.13.0

    ## [3.13.0](https://github.com/openai/openai-python/compare/v3.12.0...v3.13.0) (2026-09-10) ### Features * **api:** add Agents API ([1c4284a](https://github.com/openai/openai-python/commit/1c4284a08294f734d57047585ab82e2e09d3a5bc))

    github.com7 days agoView details

  39. langchain-ai/langchain langchain-anthropic==1.7.2

    Changes since langchain-anthropic==1.7.1 release(anthropic): 1.7.2 (#40387) fix(anthropic): preserve invalid tool use blocks (#40372)

    github.com7 days agoView details

  40. anthropics/anthropic-sdk-python v1.5.0

    ## 1.5.0 (2026-09-10) Full Changelog: [v1.4.0...v1.5.0](https://github.com/anthropics/anthropic-sdk-python/compare/v1.4.0...v1.5.0) ### Features * **api:** add auto mode tool permissions for Managed Agents ([62aa21b](https://github.com/anthropics/anthropic-sdk-python/commit/62aa…

    github.com7 days agoView details

  41. openai/openai-python v3.12.0

    ## [3.12.0](https://github.com/openai/openai-python/compare/v3.11.0...v3.12.0) (2026-09-10) ### Features * **api:** Add Live API ([0e4bfef](https://github.com/openai/openai-python/commit/0e4bfef9c79251fcf4926fd732129627bde050f1)) ### Bug Fixes * add aclose() to AsyncStream for s…

    github.com7 days agoView details

  42. deeplethe/utopia

    World's first open-source enterprise world model.

    github.com1 month ago39 ptsView details

  43. ggml-org/llama.cpp b10886

    <details open> ggml-cpu(s390x): add Q1_0 vector intrinsic support (#28606) * ggml-cpu: add `ggml_vec_dot_q1_0_q8_0` support Signed-off-by: Aaron Teo <aaron.teo1@ibm.com> * ggml-cpu: clean up variable naming for understanding Signed-off-by: Aaron Teo <aaron.teo1@ibm.com> * docs:…

    github.com8 days agoView details

  44. ggml-org/llama.cpp b10885

    <details open> model: fix all granite family parameter counts (#28643) * model: fix all granite family parameter counts Signed-off-by: Aaron Teo <aaron.teo1@ibm.com> * model: fix additional include, add missing `A` prefix for active experts Signed-off-by: Aaron Teo <aaron.teo1@i…

    github.com8 days agoView details

  45. ant-research/4DAnyone

    [SIGGRAPH Asia 2026] 4DAnyone: Create Anyone in 4D from a Casual Monocular Video

    github.com1 month ago31 ptsView details

  46. jochi2018/Soup

    Fine-tune and post-train LLMs with one command—no SSH, no config hell.

    github.com1 month ago22 ptsView details

  47. langchain-ai/langchain langchain-openai==1.6.2

    Changes since langchain-openai==1.6.1 release(openai): 1.6.2 (#40339) fix(openai): add GPT-6 Astra reasoning efforts (#40330) chore(deps): bump httpx2 from 2.10.0 to 2.12.0 in /libs/partners/openai (#40309)

    github.com8 days agoView details

  48. Carasibana/ComfyUI-H3-FaceRefine

    Refine and improve the quality of small faces in MiniMax H3 video. Per-frame face tracking, crop, refine with H3, stitch back.

    github.com1 month ago26 ptsView details

  49. ggml-org/llama.cpp b10883

    <details open> vulkan: use spec constant for matrix matrix multiplication A-type (#25773) * vulkan: use spec constant for mul mat type_a vulkan: use map for mul_mm shapes cleanup fix indentation fix cm2 and shmem init fix cm2 spec constants fix cm2 bindings consolidate shmem tab…

    github.com8 days agoView details

  50. huggingface/transformers v5.17.0

    # Release v5.17.0 ## New Model additions ### HYV4 <img width="1503" height="827" alt="image" src="https://github.com/user-attachments/assets/e6ed85ee-eb1d-40eb-a0d4-c649f6337ca9" /> Hy4-Preview is a 780B-parameter mixture-of-experts language model that activates 49B parameters p…

    github.com8 days agoView details

Newsletter

Get practical AI engineering notes

Receive source-checked analysis of models, agents, evaluation, retrieval, and production reliability. Sent only when there is useful work to share.