Mo-Qin's picture
Add gated pretraining and preprocessing source code
586c839 verified
|
Raw History Blame Contribute Delete
2.41 kB
metadata
tags:
  - human-genomics
  - dna
  - pretraining
  - gated-access

hEvo pretraining and data-construction code

This repository contains the source code for the hEvo pretraining pipeline and its cohort-aware preprocessing statistics workflow. Access to files is manually reviewed by MulinLab. Sign in to Hugging Face and select Request access on this page; approved users can then clone or download the source.

Contents

  • hEvo_pretrain/: Stage I haplotype corpus preparation and masked-language-model training, plus Stage II variant-centred dataset generation and prediction-head calibration.
  • hEvo_benchmark/scripts/preprocess_stats/: cohort genotype normalization, phased haplotype-window statistics, global sequence deduplication, validation, and Fig. 1 source-table generation.

This repository contains code and placeholder configurations. It does not contain source VCF/BCF files, reference genomes, sample lists, generated training datasets, model checkpoints, run outputs, or access credentials. Keep source data and generated artifacts on approved local or HPC storage and apply each source dataset's terms.

Access and setup

  1. Sign in to your Hugging Face account and request access to this repository. MulinLab reviews requests manually.

  2. After approval, install Git LFS if required by your environment, authenticate with hf auth login, then clone:

    git clone https://huggingface.co/MulinLab/hEvo-pretraining-code
    
  3. Follow the README in the selected workflow. The scripts target Linux/HPC environments; Slurm, C++/HTSlib, PyTorch, and other dependencies vary by stage. The example commands use the llmbm micromamba environment when available.

Public resources

The source code repository does not currently declare a software license. Contact MulinLab before redistributing or reusing the code beyond the access granted here. Dataset and reference-genome terms remain specific to their original sources.