+

LayerNorm Benchmarks - Aggregated Results

+
+ + + + + + + 2025-10-23T17:22:31.957235 + image/svg+xml + + + Matplotlib v3.10.7, https://matplotlib.org/ + + + + + + + + + + + + + + +
+ +
+
+ +▼ code +▼ output + ▶ uv-logs + | +Cell: combine | 16.33s + | + +Raw +
+
+
+
# /// script
+# requires-python = ">=3.10"
+# dependencies = ["torch", "kernels-benchmark-tools", "matplotlib"]
+# [tool.uv.sources]
+# kernels-benchmark-tools = { path = "../../../../../tools", editable = true }
+# ///
+from kernels_benchmark_tools.core.visuals import generate_combined_results
+
+cache_env_map = {
+    "Torch LayerNorm": "UVNOTE_FILE_TORCH_LAYER_NORM_BENCHMARK",
+    "HF Kernels LayerNorm": "UVNOTE_FILE_HF_KERNELS_LAYER_NORM_BENCHMARK",
+}
+
+generate_combined_results(
+    cache_env_map=cache_env_map,
+    output_filename="ln.jsonl",
+    svg_filename="latency.svg",
+    figure_id="layernorm"
+)
+
+ +
+
+
+
+
======================================================================
+LOADING BENCHMARK DATA
+======================================================================
+✓ Torch LayerNorm               : /__w/kernels-benchmarks/kernels-benchmarks/benches/layer_norm/impls/.uvnote/cache/1bda5b899820f7f63d5a0e32c1b9c5158de8b0a0b5c9fc5f1433f8340fa77c9e
+✓ HF Kernels LayerNorm          : /__w/kernels-benchmarks/kernels-benchmarks/benches/layer_norm/impls/.uvnote/cache/62beee1947f36fde87fd5f8d1955811791ad33790e7abc7f23a0ecc4a9b97f43
+
+  ✓ Found Torch LayerNorm
+     Path: /__w/kernels-benchmarks/kernels-benchmarks/benches/layer_norm/impls/.uvnote/cache/1bda5b899820f7f63d5a0e32c1b9c5158de8b0a0b5c9fc5f1433f8340fa77c9e/ln.jsonl
+  ✓ Found HF Kernels LayerNorm
+     Path: /__w/kernels-benchmarks/kernels-benchmarks/benches/layer_norm/impls/.uvnote/cache/62beee1947f36fde87fd5f8d1955811791ad33790e7abc7f23a0ecc4a9b97f43/ln.jsonl
+
+======================================================================
+Summary: 2 found, 0 skipped, 0 missing
+======================================================================
+
+COMBINED BENCHMARK SUMMARY
+
+impl                     wl                  p50(ms)  ok
+hf_kernels_layer_norm    llama_S1024_D4096      0.04  False
+hf_kernels_layer_norm    llama_S1024_D8192      0.04  False
+hf_kernels_layer_norm    llama_S2048_D4096      0.04  False
+hf_kernels_layer_norm    llama_S2048_D8192      0.05  False
+hf_kernels_layer_norm    llama_S4096_D4096      0.05  False
+hf_kernels_layer_norm    llama_S4096_D8192      0.21  False
+hf_kernels_layer_norm    llama_S512_D4096       0.04  False
+hf_kernels_layer_norm    llama_S512_D8192       0.04  False
+torch_layer_norm         llama_S1024_D4096      0.03  False
+torch_layer_norm         llama_S1024_D8192      0.03  False
+torch_layer_norm         llama_S2048_D4096      0.03  False
+torch_layer_norm         llama_S2048_D8192      0.05  False
+torch_layer_norm         llama_S4096_D4096      0.04  False
+torch_layer_norm         llama_S4096_D8192      0.20  False
+torch_layer_norm         llama_S512_D4096       0.03  False
+torch_layer_norm         llama_S512_D8192       0.03  False
+
+GENERATING COMBINED VISUALIZATION
+
+Loaded 16 records
+No valid records found
+✓ Visualization saved as latency.svg
+✓ SVG visualization ready!
+
+ANALYSIS COMPLETE
+Total implementations analyzed: 2
+
+Implementations included:
+  ✓ Torch LayerNorm
+  ✓ HF Kernels LayerNorm
+
+
+
▶ UV Install Logs
+ +
+
+

Artifacts:

+latency.svg +
+ + + + + + + 2025-10-23T17:22:31.957235 + image/svg+xml + + + Matplotlib v3.10.7, https://matplotlib.org/ + + + + + + + + + + + + + + +
+
+
+
+