Abid Ali Awan Codex commited on
Commit ·
ba935c7
1
Parent(s): c93cae8
Show saved traces in the default dataset view
Browse filesRestore runtime traces as the default configuration and retain the reviewed seed records under a separate examples configuration.
Co-authored-by: Codex <codex@openai.com>
- traces/dataset_card.md +9 -9
traces/dataset_card.md
CHANGED
|
@@ -17,11 +17,11 @@ configs:
|
|
| 17 |
default: true
|
| 18 |
data_files:
|
| 19 |
- split: train
|
| 20 |
-
path: data/
|
| 21 |
-
- config_name:
|
| 22 |
data_files:
|
| 23 |
- split: train
|
| 24 |
-
path: data/
|
| 25 |
---
|
| 26 |
|
| 27 |
# NoticeCheck Privacy-Safe Traces
|
|
@@ -92,19 +92,19 @@ successful assessments whose content is genuinely unclassified.
|
|
| 92 |
|
| 93 |
## Provenance
|
| 94 |
|
| 95 |
-
The default configuration contains
|
| 96 |
-
|
| 97 |
-
|
| 98 |
Trace generation itself does not invoke the model.
|
| 99 |
|
| 100 |
The seed rows are illustrative examples, not an evaluation split. All six
|
| 101 |
currently have the `Likely scam` label, so they must not be used to estimate
|
| 102 |
class balance, accuracy, recall, or real-world scam prevalence.
|
| 103 |
|
| 104 |
-
|
| 105 |
repeated examples, unclassified image descriptions, and incomplete `none`
|
| 106 |
-
assessments may be common. For training or evaluation, curate the
|
| 107 |
-
|
| 108 |
|
| 109 |
- exclude `risk_label: none`
|
| 110 |
- review or exclude unclassified image rows
|
|
|
|
| 17 |
default: true
|
| 18 |
data_files:
|
| 19 |
- split: train
|
| 20 |
+
path: data/*/*/*/*.jsonl
|
| 21 |
+
- config_name: examples
|
| 22 |
data_files:
|
| 23 |
- split: train
|
| 24 |
+
path: data/seed/trace_samples.jsonl
|
| 25 |
---
|
| 26 |
|
| 27 |
# NoticeCheck Privacy-Safe Traces
|
|
|
|
| 92 |
|
| 93 |
## Provenance
|
| 94 |
|
| 95 |
+
The default configuration contains privacy-safe runtime traces and may include
|
| 96 |
+
successful, rejected, or failed requests. The `examples` configuration contains
|
| 97 |
+
the six reviewed public examples bundled with NoticeCheck.
|
| 98 |
Trace generation itself does not invoke the model.
|
| 99 |
|
| 100 |
The seed rows are illustrative examples, not an evaluation split. All six
|
| 101 |
currently have the `Likely scam` label, so they must not be used to estimate
|
| 102 |
class balance, accuracy, recall, or real-world scam prevalence.
|
| 103 |
|
| 104 |
+
Default runtime rows intentionally preserve repeated requests. Consequently,
|
| 105 |
repeated examples, unclassified image descriptions, and incomplete `none`
|
| 106 |
+
assessments may be common. For training or evaluation, curate the default
|
| 107 |
+
configuration by:
|
| 108 |
|
| 109 |
- exclude `risk_label: none`
|
| 110 |
- review or exclude unclassified image rows
|