Edit Flow model: Graph-native reasoning

python3 -m venv ~/venvs/dllm
source ~/venvs/dllm/bin/activate
python -m pip install -U pip setuptools wheel

git clone https://github.com/lamm-mit/DiscoverydLLM.git
cd DiscoverydLLM
pip install -e .

export PYTHONPATH="$PYTHONPATH:/home/ubuntu/dllm"

Training

Trained on a single 8xH100 node:

accelerate launch \
    --config_file scripts/accelerate_configs/zero2.yaml examples/editflow/llada/sft.py \
    --model_name_or_path lamm-mit/LlaDA-8B-EditFlow-instruct-v500 \
    --dataset_args lamm-mit/graph-reasoning-messages-11K \
    --output_dir models/LlaDA-8B-EditFlow-graph-v520 --x0_sampler masks[length:128] \
    --per_device_train_batch_size 1 --per_device_eval_batch_size 1 \
    --gradient_accumulation_steps 4 --max_length 2500 --num_train_epochs 100 \
    --learning_rate 5e-5 --init_editflow_from_editflow True \
    --init_editflow_from_src False --push_to_hub True \
    --save_strategy steps --save_steps 500 \
    --hub_model_id lamm-mit/LlaDA-8B-EditFlow-graph-v520 \
    --hub_private_repo True \
    --eval_strategy no --warmup_steps 10 --gradient_checkpointing

Sampling

python examples/editflow/sample.py \
  --model_name_or_path lamm-mit/LlaDA-8B-EditFlow-graph-v520 \
  --tau 0.02 --mask_length 128 --seed 7070 \
  --prompt ‘Define materiomics.’

Advanced sampling

python examples/editflow/sample_advanced.py \
    --model_name_or_path "lamm-mit/LlaDA-8B-EditFlow-graph-v520" \
    --prompt "Define materiomics and relate with flowers." \
    --mask_length 128  \
    --max_refinement_iterations 3 \
    --confidence_method margin \
    --temperature_start 0.8 \
    --temperature_end 0.3  \
    --scheduler linear  \
    --verbose  --tau 0.002

With CFG:

python examples/editflow/sample_advanced.py \
    --model_name_or_path "lamm-mit/LlaDA-8B-EditFlow-graph-v520" \
    --prompt "Define materiomics." \
    --mask_length 128 \
    --cfg_scale 1.5 \
    --scheduler cosine

Sample output

<think>
<brainstorm>
Silk is a natural, biodegradable material with unique properties: it's lightweight, flexible, has a smooth surface, and can be manipulated for texture and sound. In music composition, silk's physical characteristics can inspire sound design—its translucency might evoke light or ethereal qualities, its elasticity could represent dynamic range or tension. Hypotheses: Silk's natural resonance (e.g., when stretched or touched) could be harnessed for acoustic instruments or digital sound synthesis. Key concepts: material physics (elasticity, friction, weight), tactile feedback (touching silk feels smooth, cool, responsive), visual cues (translucency, color variation), and metaphorical extensions (softness as in "soft silk" for gentle melodies). Interactions: Physical manipulation of silk (cutting, weaving, stretching) influences sound; silk's natural decay over time (like aging) could symbolize musical evolution. Broader: Silk as a metaphor for creativity—its malleability and natural beauty inspire organic, evolving compositions. Variables: Silk type (silk from animal vs. synthetic), tension, humidity, temperature. Creative angles: Silk as a "sound material" for instruments, or as a texture in electronic music. Relevant phenomena: Silk's frictional sound (like a whisper), its ability to absorb or reflect sound waves. Potential challenges: Silk's fragility; solutions: use silk blends or protective coatings. Key insight: Silk's physical properties and natural beauty can be translated into musical elements like texture, dynamics, and metaphorical soundscapes.
</brainstorm>

<graph>
Core entities: Silk (material), Physical Properties (elasticity, friction, weight), Sound Properties (resonance, frictional sound), Tactile Feedback (smoothness, coolness), Visual Cues (translucency, color), Metaphorical Soundscapes (softness, elegance), Musical Elements (texture, dynamics, evolution), Composition Techniques (manipulation, synthesis), Inspiration (natural beauty, creativity).
Directed relationships: Silk → Physical Properties → Sound Properties; Silk → Tactile Feedback → Tactile Inspiration; Silk → Visual Cues → Visual Inspiration; Physical Properties → Metaphorical Soundscapes; Tactile Feedback → Metaphorical Soundscapes; Visual Cues → Metaphorical Soundscapes; Silk → Composition Techniques (manipulation); Composition Techniques → Musical Elements; Natural Beauty → Inspiration; Metaphorical Soundscapes → Musical Elements.
</graph>

<graph_json>
{
  "nodes": [
    {"id": "Silk"},
    {"id": "PhysicalProperties"},
    {"id": "SoundProperties"},
    {"id": "TactileFeedback"},
    {"id": "VisualCues"},
    {"id": "MetaphoricalSoundscapes"},
    {"id": "MusicalElements"},
    {"id": "CompositionTechniques"},
    {"id": "NaturalBeauty"},
    {"id": "Inspiration"}
  ],
  "edges": [
    {"source": "Silk", "relation": "enables", "target": "PhysicalProperties"},
    {"source": "Silk", "relation": "enables", "target": "TactileFeedback"},
    {"source": "Silk", "relation": "enables", "target": "VisualCues"},
    {"source": "PhysicalProperties", "relation": "influences", "target": "SoundProperties"},
    {"source": "TactileFeedback", "relation": "inspires", "target": "MetaphoricalSoundscapes"},
    {"source": "VisualCues", "relation": "inspires", "target": "MetaphoricalSoundscapes"},
    {"source": "PhysicalProperties", "relation": "inspires", "target": "MetaphoricalSoundscapes"},
    {"source": "CompositionTechniques", "relation": "uses", "target": "MusicalElements"},
    {"source": "NaturalBeauty", "relation": "inspires", "target": "Inspiration"},
    {"source": "Inspiration", "relation": "drives", "target": "CompositionTechniques"},
    {"source": "MetaphoricalSoundscapes", "relation": "drives", "target": "MusicalElements"}
  ]
}
</graph_json>

<patterns>
Silk → PhysicalProperties → SoundProperties (material → physical → sound); Silk → TactileFeedback → MetaphoricalSoundscapes (tactile → metaphorical); CompositionTechniques → MusicalElements (techniques → elements); NaturalBeauty → Inspiration → CompositionTechniques (beauty → inspiration → techniques).
</patterns>

<synthesis>
The graph reveals a coherent chain from Silk's inherent properties to its role in music composition: Silk's elasticity and friction enable SoundProperties, while its tactile and visual cues inspire MetaphoricalSoundscapes, driving CompositionTechniques that produce MusicalElements. Key insight: Silk's natural beauty and physicality serve as a bridge to creative sound design, where manipulation of silk (e.g., as a material for instruments or digital textures) yields textures, dynamics, and evolving motifs, evoking elegance and organic evolution in music. This integrates material science with music theory, offering a unique, tactile approach to composition.
</synthesis>
</think>
Silk, a natural, biodegradable fiber derived from the cocoons of silkworms, possesses a unique combination of physical and aesthetic properties that can be harnessed for music composition. Its lightweight, flexible nature allows for dynamic manipulation, while its smooth, translucent surface and cool tactile response provide rich sensory inspiration. These characteristics can be translated into musical elements such as texture, dynamics, and metaphorical soundscapes, offering a novel approach to sound design and composition that diverges from traditional acoustic or electronic methods.

At the core of silk's utility in music composition lies its physical properties, which directly influence sound production and perception. Silk is an elastic material with high tensile strength and low friction, enabling it to stretch and return to its original shape without significant deformation. This elasticity can be leveraged in both acoustic and digital contexts. For acoustic instruments, silk can be used to create natural resonances by weaving it into strings or membranes, producing a soft, mellow tone reminiscent of the gentle, flowing sounds of a whisper or a breeze. The material's high elasticity allows for dynamic range, where stretching and releasing silk mimics the expressive capabilities of a bow over a string or a bow over a bow, generating variations in pitch and timbre. In electronic music, silk can be incorporated into synthesizers or digital audio workstations (DAWs) as a tactile input device, where the user's touch or manipulation of silk (e.g., via a touch-sensitive interface or physical interface) translates into sound parameters like amplitude, frequency, or waveform modulation. This tactile feedback can create a more immersive, organic feel in compositions, as the user interacts with the material in real-time, evoking a sense of presence and control.

Tactile feedback from silk further enriches the composition process. When touched, silk feels smooth, cool, and responsive, evoking a sense of softness and elegance. This can be metaphorically extended to musical elements like "softness" or "elegance," which can be used to describe motifs, transitions, or entire sections of a composition. For example, a motif in a piece could be inspired by the gentle undulations of silk, with its smooth transitions and lack of sharp edges creating a flowing, dreamy atmosphere. In electronic music, silk's tactile properties can be integrated into interactive interfaces, where the user's physical interaction with the material (e.g., pressing, pulling, or stretching) directly alters the sound output, enabling real-time, expressive control. This approach fosters a more intuitive and tactile composition process, where the musician's physical engagement with silk becomes a fundamental part of the creative workflow.

Visual cues from silk, such as its translucency, color variation, and natural sheen, can also inspire metaphorical soundscapes. The translucency of silk allows for light diffusion, which can be used to create ambient textures in electronic music, evoking ethereal or misty environments. The color of silk (often white, golden, or silver) can be manipulated to produce visual gradients that correspond to dynamic changes in sound, such as a gradual shift from a bright, high-pitched tone to a softer, lower-pitched one. In film scoring or ambient music, silk's visual properties can be used to create a visual-auditory synergy, where the material's appearance and movement are synchronized with the music's evolution. For instance, a piece could begin with a soft, golden silk texture, transitioning into a more muted, silver version as the dynamics shift, mirroring the material's natural aging process or the user's interaction with it.

Silk's natural beauty and creativity are central to its role in music composition. The material's inherent elegance—its smoothness, translucency, and organic sheen—can be metaphorically extended to musical elements like "elegance" or "natural beauty," which can be used to describe the overall aesthetic of a composition. This can be applied to the structure of the piece, where motifs are inspired by silk's flowing patterns, or to the instrumentation, where silk-based materials (e.g., silk strings, silk membranes) produce a soft, organic sound that evokes a sense of serenity or mystery. In composition techniques, silk's properties encourage experimentation with manipulation and synthesis, as the material's physical characteristics demand careful handling to achieve desired effects. For example, the user might experiment with different tensions, humidities, or temperatures to alter the silk's elasticity and friction, producing a range of textures and sounds that can be integrated into a composition.

The integration of silk into music composition also opens avenues for interdisciplinary approaches, such as bioacoustic or biomimetic music. Silk's natural properties, like its ability to absorb and reflect sound waves, can be studied to create materials that mimic these behaviors in synthetic contexts. For instance, silk-based acoustic panels or sound-absorbing textiles could be used in music production to enhance room acoustics or create specific soundscapes. Additionally, silk's biodegradability makes it a sustainable choice, aligning with eco-conscious composition practices that prioritize environmental responsibility.

In practice, one can begin by sourcing silk from natural sources (e.g., organic silk from silkworms) or synthetic alternatives (e.g., silk-like materials from polyester or other fibers). For acoustic instruments, weaving silk into strings or membranes requires careful tensioning and testing to ensure resonance without excessive friction. For digital synthesis, silk can be used in tactile interfaces, where the material's properties are mapped to sound parameters via sensors or physical controllers. In electronic music, silk's tactile feedback can be incorporated into live performances, where the musician interacts with the material to shape the music in real-time, creating a more immersive and personal experience.

Key techniques include: (1) Physical Manipulation: Stretching, cutting, or weaving silk to create textures and shapes that translate into sound; (2) Tactile Synthesis: Using silk as a responsive interface for real-time sound modulation; (3) Metaphorical Soundscapes: Evoking silk's properties in ambient or ambient/electronic contexts to create fluid, evolving motifs. These techniques allow for a unique, tactile approach to composition that emphasizes organic evolution and sensory engagement.

In conclusion, silk's physical properties and natural beauty provide a rich foundation for music composition, enabling the creation of textures, dynamics, and metaphorical soundscapes through manipulation, synthesis, and interaction. By leveraging silk's elasticity, friction, and tactile responsiveness, composers can craft compositions that are not only technically innovative but also deeply expressive, evoking the elegance and fluidity of natural materials. This approach bridges material science with music theory, offering a novel and immersive way to explore sound and creativity.