hackernews

Ask HN: Is there a Moore's Law equivalent for compute/energy use?. Rather than transistor density per chip we are now scaling datacenters by energy use per N compute cycles.<p>Is there a relevant statement similar to the form of Moore’s Law?


Show HN: CrossingBench – Modeling when data movement dominates compute energy. I built a small reproducible microbenchmark exploring when system energy becomes dominated by boundary crossings rather than intra-domain compute.
The model decomposes total energy into:
C = C_intra + Σ V_b · c_b
Includes:
CLI sweeps
Elasticity metric (ε) as a dominance indicator
CSV outputs
Working draft paper
*DOI
Looking for critique, counter-examples, or prior related work I may have missed.


Ask HN: Where can I track training cost trend for AI models?. I'm curious how the cost of training AI models (compute, energy, data, etc) has changed over time.
Are there any public resources or datasets tracking training costs for open-weight models (I'm guessing this data is hard to get for closed models, but happy to be proved wrong.)
I'm especially interested in understanding which architectural changes (e.g., attention variants, parameter sharing, mixture-of-experts) have led to major cost optimizations, and NOT just from the companies behind these models, but from anyone who has trained or replicated them.


Show HN: I Made an API for Persistent KV-Caching (Cache Augmented Generation). Hi HN!
I wanted to demonstrate an easy to use API for Cache Augment Generation. For any open source LLM available on Llama cpp, we can store the KV-cache and model state after it has processed a large corpus of documents, and then load that state in every time we query the document.
This leads to a drastic reduction in latency as well as compute/energy used by the model.
This demo is part of a larger system that I'm building called DataBridge[0] - with a focus on implementing new and useful techniques for knowledge retrieval - allowing developers to use the latest research in production.
I'd love to hear your feedback on DataBridge, and the CAG feature. If you have papers or particular techniques you'd like to see implemented, I'd love to hear about it :)
[0] https://github.com/databridge-org/databridge-core/


Classical ML Still Relevant?

Classical ML Still Relevant?. ** Pls bear with me if its been already discussed or not related **<p>With all the proliferation of DL and LLM along with near unlimited compute, energy and bandwidth do we still need classical ML approach for solving the problems? Is DL / NN going to take over everything?