Custom dataset CNN/DailyNews

README.md

@@ -0,0 +1,36 @@
+
+# Dataset Card for Custom Text Dataset
+
+## Dataset Name
+Custom CNN/DailyMail Text Summarization Dataset
+
+## Overview
+This dataset is a custom subset and extension of the CNN/DailyMail dataset, consisting of news articles and their corresponding summaries.
+
+## Composition
+Train Dataset: A custom train dataset consisting of one long news article with its manually written summary.
+Test Dataset: A test dataset sampled from the original CNN/DailyMail dataset, consisting of 100 articles and their corresponding highlights.
+
+## Collection Process
+The custom train dataset was crafted using news articles from the CNN/DailyMail dataset.
+
+## Preprocessing
+The intput text was tokenized.
+
+## How to Use
+```python
+from datasets import load_from_disk
+
+# Load the custom dataset
+train_dataset = load_from_disk("./results/custom_dataset/train")
+test_dataset = load_from_disk("./results/custom_dataset/test")
+```
+
+## Evaluation
+This dataset can be evaluated using metrics such as ROUGE or BLEU.
+
+## Limitations
+The train dataset consists of only one example.
+
+## Ethical Considerations
+The data originates from news sources, which may contain sensitive or politically biased contents.

test/dataset_dict.json

@@ -0,0 +1 @@
+{"splits": ["test"]}

test/test/data-00000-of-00001.arrow

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1e6aa13a3e10a33624931f6c220c9618528323886bd7b7ac334af681b8dc0646
+size 346576

test/test/dataset_info.json

@@ -0,0 +1,22 @@
+{
+  "citation": "",
+  "description": "",
+  "features": {
+    "sentence": {
+      "feature": {
+        "dtype": "string",
+        "_type": "Value"
+      },
+      "_type": "Sequence"
+    },
+    "labels": {
+      "feature": {
+        "dtype": "string",
+        "_type": "Value"
+      },
+      "_type": "Sequence"
+    }
+  },
+  "homepage": "",
+  "license": ""
+}

test/test/state.json

@@ -0,0 +1,13 @@
+{
+  "_data_files": [
+    {
+      "filename": "data-00000-of-00001.arrow"
+    }
+  ],
+  "_fingerprint": "a966e5e39a3a551f",
+  "_format_columns": null,
+  "_format_kwargs": {},
+  "_format_type": null,
+  "_output_all_columns": false,
+  "_split": null
+}

train/dataset_dict.json

@@ -0,0 +1 @@
+{"splits": ["train"]}

train/train/data-00000-of-00001.arrow

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:c3b84a293ed7afd9641f578c760558feab774e12174775ffef3bd6d130873903
+size 1400

train/train/dataset_info.json

@@ -0,0 +1,16 @@
+{
+  "citation": "",
+  "description": "",
+  "features": {
+    "sentence": {
+      "dtype": "string",
+      "_type": "Value"
+    },
+    "labels": {
+      "dtype": "string",
+      "_type": "Value"
+    }
+  },
+  "homepage": "",
+  "license": ""
+}

train/train/state.json

@@ -0,0 +1,13 @@
+{
+  "_data_files": [
+    {
+      "filename": "data-00000-of-00001.arrow"
+    }
+  ],
+  "_fingerprint": "a1df46296853828f",
+  "_format_columns": null,
+  "_format_kwargs": {},
+  "_format_type": null,
+  "_output_all_columns": false,
+  "_split": null
+}