Neural Nova – GPU optimization benchmarks for LLM workloads (www.neural-nova.com via hn)
model roundup
Qwen 3
-
Performance Benchmarks Explore Optimized AI models recipes across GPUs, frameworks, and deployment configurations. BENCHMARKED MODELS REASONING vLLM · 8× NVIDIA H100-80GB Qwen3-235B-A22B +138.7% token/s +58% Cost Savings Qwen3-235B-A22B ·…
-
Show HN: News observability site tracks coverage by party lean/distraction/etc. (pressaudit.org via hn)
Heya HN! I'm helping launch this site which uses Qwen 3-32b to process thousands of news articles and analyze them by region, public interest, partisan lean, etc.
-
Continuation control 40/40 GO→EOS 40/40 EOS→GO 640/640 controls unchanged Prompt, weights, and generated reasoning prefix held fixed during intervention. Rayan Pal getswiftapi.com Independent Researcher Thinking-enabled PCCG-Qwen3-4B with…
-
In this study, we identify depth-dependent prefix redundancy in final-readout LLM embedding models, notably across representative backbones including Qwen3-Embedding and Qwen3-VL-Embedding. We find that removing prefix states is substantia…
-
Show HN: Zero downtime embedding model upgrades (github.com via hn)
People use embedding models all the time for rag/semantic retrieval. However, when a newer, more desireable model comes out, there is an expensive (both in time and computational) cost of re-embedding every document in the database.