Buckets:
| # Pipeline | |
| ## Pipeline[[lighteval.pipeline.Pipeline]] | |
| <div class="docstring border-l-2 border-t-2 pl-4 pt-3.5 border-gray-100 rounded-tl-xl mb-6 mt-8"> | |
| <docstring><name>class lighteval.pipeline.Pipeline</name><anchor>lighteval.pipeline.Pipeline</anchor><source>https://github.com/huggingface/lighteval/blob/vr_994/src/lighteval/pipeline.py#L116</source><parameters>[{"name": "tasks", "val": ": str"}, {"name": "pipeline_parameters", "val": ": PipelineParameters"}, {"name": "evaluation_tracker", "val": ": EvaluationTracker"}, {"name": "model_config", "val": ": lighteval.models.abstract_model.ModelConfig | None = None"}, {"name": "model", "val": " = None"}, {"name": "metric_options", "val": " = None"}]</parameters></docstring> | |
| </div> | |
| ## PipelineParameters[[lighteval.pipeline.PipelineParameters]] | |
| <div class="docstring border-l-2 border-t-2 pl-4 pt-3.5 border-gray-100 rounded-tl-xl mb-6 mt-8"> | |
| <docstring><name>class lighteval.pipeline.PipelineParameters</name><anchor>lighteval.pipeline.PipelineParameters</anchor><source>https://github.com/huggingface/lighteval/blob/vr_994/src/lighteval/pipeline.py#L82</source><parameters>[{"name": "launcher_type", "val": ": ParallelismManager"}, {"name": "job_id", "val": ": int = 0"}, {"name": "dataset_loading_processes", "val": ": int = 1"}, {"name": "nanotron_checkpoint_path", "val": ": str | None = None"}, {"name": "custom_tasks_directory", "val": ": str | None = None"}, {"name": "num_fewshot_seeds", "val": ": int = 1"}, {"name": "max_samples", "val": ": int | None = None"}, {"name": "cot_prompt", "val": ": str | None = None"}, {"name": "remove_reasoning_tags", "val": ": bool = True"}, {"name": "reasoning_tags", "val": ": str | list[tuple[str, str]] = \"[('<think>', '</think>')]\""}, {"name": "load_responses_from_details_date_id", "val": ": str | None = None"}, {"name": "bootstrap_iters", "val": ": int = 1000"}]</parameters></docstring> | |
| </div> | |
| ## ParallelismManager[[lighteval.pipeline.ParallelismManager]] | |
| <div class="docstring border-l-2 border-t-2 pl-4 pt-3.5 border-gray-100 rounded-tl-xl mb-6 mt-8"> | |
| <docstring><name>class lighteval.pipeline.ParallelismManager</name><anchor>lighteval.pipeline.ParallelismManager</anchor><source>https://github.com/huggingface/lighteval/blob/vr_994/src/lighteval/pipeline.py#L70</source><parameters>[{"name": "value", "val": ""}, {"name": "names", "val": " = None"}, {"name": "module", "val": " = None"}, {"name": "qualname", "val": " = None"}, {"name": "type", "val": " = None"}, {"name": "start", "val": " = 1"}]</parameters></docstring> | |
| An enumeration. | |
| </div> | |
| <EditOnGithub source="https://github.com/huggingface/lighteval/blob/main/docs/source/package_reference/pipeline.mdx" /> |
Xet Storage Details
- Size:
- 2.7 kB
- Xet hash:
- d072d5de9c263195bad655736ffe1fb5fe248d50d5439a3ffd6340a585782170
·
Xet efficiently stores files, intelligently splitting them into unique chunks and accelerating uploads and downloads. More info.