README.md

metadata

language:
  - en
library_name: sentence-transformers
tags:
  - sentence-transformers
  - sentence-similarity
  - feature-extraction
  - dataset_size:10K<n<100K
  - loss:CosineSimilarityLoss
base_model: sentence-transformers/all-distilroberta-v1
metrics:
  - pearson_cosine
  - spearman_cosine
  - pearson_manhattan
  - spearman_manhattan
  - pearson_euclidean
  - spearman_euclidean
  - pearson_dot
  - spearman_dot
  - pearson_max
  - spearman_max
widget:
  - source_sentence: >-
      Ingredients: 2 mangoes - peeled, seeded, and chopped, 3/4 cup chopped
      onion, 3/4 cup chopped cilantro, 1/2 cup chopped fresh mint, 1 1/2 limes,
      juiced, 1/2 teaspoon minced fresh ginger root (optional). Instructions:
      Stir mangoes, onion, cilantro, mint, lime juice, and ginger in a bowl
      until evenly mixed.
    sentences:
      - >-
        Ingredients: 2 mangoes - peeled, seeded, and chopped, 1 (8 ounce) can
        pineapple tidbits, drained, 1/4 cup chopped fresh cilantro leaves, 2
        tablespoons peeled and finely chopped fresh ginger, 1/2 cup chopped red
        onion, 1/4 cup rice vinegar, 1 teaspoon crushed red pepper flakes, or to
        taste. Instructions: Combine mango, pineapple, cilantro, ginger, red
        onion, vinegar, and red pepper flakes in a bowl, and stir lightly to mix
        well.
      - >-
        Ingredients: 3 egg whites, 1 cup white sugar, 1/2 teaspoon distilled
        white vinegar, 1/2 teaspoon vanilla extract, 1 pinch salt, 2 cups
        semisweet chocolate chips. Instructions: Preheat oven to 300 degrees F
        (150 degrees C). Grease  baking sheets or line them with parchment
        paper. In a medium bowl, whip egg whites to soft peaks. Gradually add
        the sugar, vinegar and vanilla while whipping to stiff peaks. Fold in
        chocolate chips. Drop by spoonfuls onto the prepared cookie sheets. Bake
        for 20 to 25 minutes in the preheated oven, until cookies are dry.
      - >-
        Ingredients: 1 (18.25 ounce) package yellow cake mix, 5 tablespoons
        instant lemon pudding mix, 2 eggs, 1/4 cup butter, softened, 1/3 cup
        water, 1/8 cup applesauce. Instructions: Preheat oven to 350 degrees F
        (175 degrees C). Grease and flour a 9 inch springform pan. In a medium
        bowl, stir together the cake mix and instant pudding. Add the eggs,
        butter, water and applesauce, mix with an electric mixer until smooth.
        Pour batter into the prepared pan. Bake for 30 to 35 minutes in the
        preheated oven, until a toothpick inserted comes out clean. Let cake
        cool in the pan for 10 minutes before removing from pan to cool on a
        wire rack.
  - source_sentence: >-
      Ingredients: 1 (.25 ounce) package active dry yeast, 3 cups bread flour,
      1/4 cup dry milk powder, 1 tablespoon butter, softened, 1 teaspoon salt.
      Instructions: Place ingredients in the pan of the bread machine in the
      order recommended by the manufacturer. Select White Bread setting; press
      Start.
    sentences:
      - >-
        Ingredients: 1 1/4 cups water, 2 tablespoons margarine, softened, 2
        tablespoons dry milk powder, 2 tablespoons brown sugar, 1 1/4 teaspoons
        salt, 3 cups bread flour, 1/3 cup whole wheat flour, 1/4 cup cracked
        wheat, 1 1/4 teaspoons active dry yeast. Instructions: Place ingredients
        in the pan of the bread machine in the order recommended by the
        manufacturer. Select regular/light cycle; press Start.
      - >-
        Ingredients: 2 3/4 cups baking mix, 1/2 teaspoon crushed red pepper
        flakes, 3/4 teaspoon garlic powder, 1 cup milk, 1 cup shredded Cheddar
        cheese, 2 tablespoons butter, melted. Instructions: Preheat oven to 425
        degrees F (220 degrees C). Combine biscuit mix, pepper, and 1/2 teaspoon
        garlic powder in a large bowl.  With a fork, stir in milk and cheese
        until mixture forms a soft dough.  Drop by 1/4 cupfuls onto greased
        cookie sheet. Combine butter and remaining 1/4 teaspoon garlic powder,
        and brush on top of biscuits. Bake for 10 to 12 minutes, or until golden
        brown.
      - >-
        Ingredients: 4 skinless, boneless chicken breast halves, 1 cup lime
        juice, 3/4 cup lemon juice, 3/4 cup orange juice, 1/2 cup pineapple
        juice, 1/2 cup cherry juice. Instructions: Preheat outdoor grill for
        medium high heat and lightly oil grate; OR preheat oven to Grill/Broil.
        Place chicken on grill/grate. In a medium bowl mix together the lime
        juice, lemon juice, orange juice, pineapple juice and cherry juice. Pour
        mixture over chicken a little bit at a time; turn after 5 to 7 minutes
        and repeat. Cook until chicken is cooked through (juices run clear),
        about 15 minutes.
  - source_sentence: >-
      Ingredients: 1 (4 pound) whole chicken, 1 1/2 cups prepared barbecue
      sauce. Instructions: Put chicken, legs up, into slow cooker.  Pour sauce
      over and inside the chicken.  Cover. Cook for 8 to 10 hours on low
      setting.  It is not a good idea to check it, as steam escapes and it takes
      quite awhile to reheat.
    sentences:
      - >-
        Ingredients: 1 (3 pound) whole chicken, 1/2 cup soy sauce. Instructions:
        Place chicken in a slow cooker and add soy sauce. Cook on Low until
        chicken is cooked through, about 5 hours. An instant-read thermometer
        inserted into the thickest part of the thigh, near the bone should read
        165 degrees F (74 degrees C).
      - >-
        Ingredients: 1/2 cup margarine, softened, 2/3 cup milk, 2 eggs, 2 1/2
        cups all-purpose flour, 1 cup white sugar, 2 1/2 teaspoons baking
        powder, 1/2 teaspoon baking soda, 1 teaspoon salt, 2/3 cup mashed
        bananas, 1/2 cup chopped walnuts. Instructions: Spray bread machine pan
        with vegetable oil spray. Premix ingredients in order listed.  Place
        mixture in bread machine pan. Select the Quick Bread/Cake cycle.  Press
        Start. Check after 1 minute to see if mixture is well blended. Cook
        until cake cycle stops.  Remove pan, and cool completely before removing
        bread from pan.
      - >-
        Ingredients: 7/8 cup water, 3/4 teaspoon cider vinegar, 1 1/2 cups bread
        flour, 1/2 cup rye flour, 1/4 cup oat bran, 1 tablespoon margarine, 1
        1/2 tablespoons white sugar, 1 teaspoon salt, 1 teaspoon caraway seed, 1
        teaspoon dried minced onion, 2 tablespoons unsweetened cocoa powder, 1
        teaspoon active dry yeast. Instructions: Place the ingredients in the
        pan of the bread machine in the order suggested by the manufacturer.
        Select Normal setting, and then press Start.
  - source_sentence: >-
      Ingredients: 1 egg, 1 cup orange juice, 1/4 cup hot water, 1 tablespoon
      margarine, 1/4 cup white sugar, 3 1/2 cups bread flour. Instructions:
      Place ingredients into the pan of the bread machine in the order suggested
      by the manufacturer. Select the White Bread or Basic cycle, and Start.
    sentences:
      - >-
        Ingredients: 2 eggs, 2 tablespoons white sugar, 3 tablespoons
        all-purpose flour, 3/4 cup milk. Instructions: Place the eggs, sugar,
        flour and milk into the container of a blender. Process until smooth on
        low speed. Heat a large skillet or griddle over medium heat. Pour batter
        about 1/4 cup at a time (or more for larger pancakes). Tilt pan to
        achieve a round shape. Heat until golden, then flip and brown on the
        other side. Serve immediately with syrup, or fresh berries and whipped
        cream.
      - >-
        Ingredients: 2 large eggs, 1 tablespoon ground cinnamon, 1 tablespoon
        vanilla extract, 1 cup maple syrup, 2 slices bread, 8 slices bacon.
        Instructions: Whisk eggs, cinnamon, and vanilla extract together in a
        shallow bowl. Pour syrup into a skillet over low heat. Dip bread into
        egg mixture, allowing excess liquid to drip back into bowl. Wrap 4
        slices bacon around each piece of bread. Dip bacon-wrapped bread back
        into egg mixture. Cook 1 piece bacon-wrapped bread in the syrup at a
        time until bacon is cooked to desired doneness, about 8 minutes per
        side.
      - >-
        Ingredients: 7 cups chopped new potatoes, 1 (8 ounce) container sour
        cream, 2 teaspoons chopped fresh dill weed, 1 teaspoon dried parsley.
        Instructions: Bring a large pot of salted water to a boil. Add potatoes
        and cook until tender but still firm, about 15 minutes. Drain, cool,
        peel and chill. Meanwhile, in a medium bowl combine sour cream, dill,
        parsley, Dijon, salt and pepper. Pour dressing over potatoes and toss
        gently. Chill before serving.
  - source_sentence: >-
      Ingredients: 1 head cabbage, cored and shredded, 1/8 cup olive oil.
      Instructions: Place the shredded cabbage in a large bowl, and drizzle
      olive oil over it. Toss until evenly coated. Season with garlic powder,
      lemon juice and cilantro, and stir to blend in all of the flavors.
    sentences:
      - >-
        Ingredients: 1/2 cup canola oil, 1/4 cup red wine vinegar, 1 tablespoon
        soy sauce, 6 tablespoons white sugar, 1 (8 ounce) package shredded
        cabbage. Instructions: Mix canola oil, red wine vinegar, soy sauce, and
        sugar in a large bowl, mixing until sugar has dissolved. Toss cabbage,
        green onions, almonds, and sunflower seed kernels into the dressing.
        Cover bowl and refrigerate at least 1 hour before serving; slaw tastes
        better when chilled overnight.
      - >-
        Ingredients: 1/4 cup instant cocoa powder, 1 cup shredded coconut, 1/3
        cup raisins, 1/2 cup cornflakes cereal, 1/4 cup chopped walnuts, 1
        teaspoon sherry, 2 cups vanilla wafer crumbs, 1/4 cup sweetened
        condensed milk, 3 (1 ounce) squares unsweetened chocolate. Instructions:
        Lightly butter a 7 or 8 inch square pan. Put all ingredients (except
        chocolate squares) into mixing bowl: mix well together.  Press into pan;
        smooth surface. Melt chocolate in double broiler; spread evenly over top
        of mixture.  Score with fork.  Refrigerate until firm.  Cut into small
        bars.
      - >-
        Ingredients: 1 3/4 cups all-purpose flour, 1 tablespoon baking powder,
        1/2 teaspoon salt, 3/4 cup white sugar, 1/2 cup lowfat cream cheese, 2
        eggs, 3/4 cup mashed bananas, 1/4 cup brewed chai tea. Instructions: In
        a medium bowl mix together flour, baking powder, and salt. In a separate
        bowl mix sugar, cream cheese, and eggs until light and fluffy. Mix
        mashed bananas and Chai into cream cheese mixture. Add flour mixture and
        mix until smooth. Pour mixture into a greased 9x5 inch loaf pan. Bake in
        a preheated 350 degree F(175 degrees C) oven for 60 minutes. Cool on
        rack. Remove from pan after 10 minutes.
pipeline_tag: sentence-similarity
model-index:
  - name: SentenceTransformer based on sentence-transformers/all-distilroberta-v1
    results:
      - task:
          type: semantic-similarity
          name: Semantic Similarity
        dataset:
          name: val evaluator
          type: val-evaluator
        metrics:
          - type: pearson_cosine
            value: 0.9427502034315512
            name: Pearson Cosine
          - type: spearman_cosine
            value: 0.9450402775914729
            name: Spearman Cosine
          - type: pearson_manhattan
            value: 0.9339570316757035
            name: Pearson Manhattan
          - type: spearman_manhattan
            value: 0.9423095584878247
            name: Spearman Manhattan
          - type: pearson_euclidean
            value: 0.9368025558795947
            name: Pearson Euclidean
          - type: spearman_euclidean
            value: 0.9450402775914729
            name: Spearman Euclidean
          - type: pearson_dot
            value: 0.9427502030632885
            name: Pearson Dot
          - type: spearman_dot
            value: 0.9450402775914729
            name: Spearman Dot
          - type: pearson_max
            value: 0.9427502034315512
            name: Pearson Max
          - type: spearman_max
            value: 0.9450402775914729
            name: Spearman Max

Model Overview & Purpose

This is a sentence-transformers model finetuned from sentence-transformers/all-distilroberta-v1. The model is specifically fine-tuned on culinary recipes. It maps recipes to a 768-dimensional dense vector space and can be used for:

• Semantic textual similarity
• Semantic search
• Text classification and clustering

Motivation for Fine-Tuning

As detailed in our associated paper, “Cooking Up Creativity: Enhancing LLM Creativity through Structured Recombination” (https://arxiv.org/abs/2504.20643):

• Problem with Standard SBERT: Initial experiments with the standard sentence-level SBERT model showed a tendency to group recipes based on textual instructions while overlooking key ingredients.
• Failure Case: This resulted in the model failing to reliably distinguish both broad categories (e.g., salad vs. soup) and finer-grained distinctions (e.g., carrot cake vs. cheesecake).

Model Details

To address this, we fine-tuned the model to better handle true recipe similarity.

• Dataset: Our fine-tuning dataset consisted of 30k pairs of recipes.
• Target Similarity Scores: New similarity scores were calculated for these pairs by equally weighting the original Sentence-BERT score and a Rubicka-based similarity score of the two recipes’ ingredient lists (as computed in: https://arxiv.org/pdf/2210.17235).
• Result: The resulting model has a specialized understanding of recipe similarity that incorporates both textual and ingredient-based features (see full details in the paper).

Model Description

• Model Type: Sentence Transformer
• Base model: sentence-transformers/all-distilroberta-v1
• Maximum Sequence Length: 512 tokens
• Output Dimensionality: 768 tokens
• Similarity Function: Cosine Similarity

Model Sources

• Documentation: Sentence Transformers Documentation
• Repository: Sentence Transformers on GitHub
• Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: RobertaModel 
  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("sentence_transformers_model_id")
# Run inference
sentences = [
    'Ingredients: 1 head cabbage, cored and shredded, 1/8 cup olive oil. Instructions: Place the shredded cabbage in a large bowl, and drizzle olive oil over it. Toss until evenly coated. Season with garlic powder, lemon juice and cilantro, and stir to blend in all of the flavors.',
    'Ingredients: 1/2 cup canola oil, 1/4 cup red wine vinegar, 1 tablespoon soy sauce, 6 tablespoons white sugar, 1 (8 ounce) package shredded cabbage. Instructions: Mix canola oil, red wine vinegar, soy sauce, and sugar in a large bowl, mixing until sugar has dissolved. Toss cabbage, green onions, almonds, and sunflower seed kernels into the dressing. Cover bowl and refrigerate at least 1 hour before serving; slaw tastes better when chilled overnight.',
    'Ingredients: 1/4 cup instant cocoa powder, 1 cup shredded coconut, 1/3 cup raisins, 1/2 cup cornflakes cereal, 1/4 cup chopped walnuts, 1 teaspoon sherry, 2 cups vanilla wafer crumbs, 1/4 cup sweetened condensed milk, 3 (1 ounce) squares unsweetened chocolate. Instructions: Lightly butter a 7 or 8 inch square pan. Put all ingredients (except chocolate squares) into mixing bowl: mix well together.  Press into pan; smooth surface. Melt chocolate in double broiler; spread evenly over top of mixture.  Score with fork.  Refrigerate until firm.  Cut into small bars.',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 768]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]

Evaluation

Metrics

Semantic Similarity

• Dataset: val-evaluator
• Evaluated with EmbeddingSimilarityEvaluator

Metric	Value
pearson_cosine	0.9428
spearman_cosine	0.945
pearson_manhattan	0.934
spearman_manhattan	0.9423
pearson_euclidean	0.9368
spearman_euclidean	0.945
pearson_dot	0.9428
spearman_dot	0.945
pearson_max	0.9428
spearman_max	0.945

Training Details

Training Dataset

Unnamed Dataset

• Size: 28,937 training samples
• Columns: sentence_0, sentence_1, and label
• Approximate statistics based on the first 1000 samples:

  	sentence_0	sentence_1	label
  type	string	string	float
  details	min: 57 tokens mean: 230.8 tokens max: 512 tokens	min: 44 tokens mean: 235.93 tokens max: 512 tokens	min: 0.02 mean: 0.48 max: 1.44

• Samples:

  sentence_0	sentence_1	label
  Ingredients: 2 cups milk, 2 (.25 ounce) packages active dry yeast, 1/2 cup warm water, 1/3 cup white sugar, 1/3 cup vegetable oil, 1 tablespoon baking powder, 2 teaspoons salt, 1 egg, 7 cups all-purpose flour, 1 cup packed brown sugar, 1/2 cup butter, 2 tablespoons light corn syrup, 1 cup pecan halves, 1/4 cup butter, softened, 1/2 cup white sugar, 1 1/2 tablespoons ground cinnamon. Instructions: Warm the milk in a small saucepan until it bubbles, then remove from heat. Let cool until lukewarm. In a small bowl, dissolve yeast in warm water. Let stand until creamy, about 10 minutes. In a large bowl, combine yeast mixture, milk, sugar, oil, baking powder, salt, egg and 3 cups flour. Beat until smooth. Stir in the remaining flour, 1/2 cup at a time, beating well after each addition. When the dough has pulled together, turn it out onto a lightly floured surface and knead until smooth and elastic, about 8 minutes. Lightly oil a large bowl, place the dough in the bowl and turn to coat with oil. Cover with a damp cloth and let rise in a warm place until doubled in volume, about 1 hour. Heat brown sugar and 1/2 cup butter until melted. Remove from heat; stir in corn syrup. Divide mixture between two 9x13 inch baking pans. Sprinkle 1/2 cup pecans in each pan. When dough has doubled in size, punch down and turn out onto a lightly floured surface. Roll out into a large rectangle and spread with butter. Sprinkle with sugar and cinnamon. Starting with the long side, roll up the rectangle into a log, and slice into 1 inch wide rolls. Place the rolls slightly apart in pans. Wrap pans with aluminum foil and refrigerate at least 12 hours but no longer than 48. Remove rolls from refrigerator and let stand in a warm place until doubled in size, about 30 minutes. Meanwhile, preheat oven to 350 degrees F (175 degrees C). Bake uncovered in preheated oven until golden 30 to 35 minutes. Immediately invert pan on heatproof serving plate. Wait for 1 or 2 minutes before removing pan, so that caramel drizzles over rolls.	Ingredients: 1/2 cup boiling water, 3/4 cup cold milk, 1 teaspoon white sugar, 1 1/2 teaspoons active dry yeast, 1 egg, beaten, 2 tablespoons butter, melted and cooled. Instructions: In a large bowl, stir together the water, milk, and sugar. Sprinkle the yeast over the top, and let stand for 5 minutes to dissolve. Stir the egg and butter into the yeast mixture, then stir in the salt, nutmeg, and 2 cups of the flour. Mix until everything is well blended. Mix in remaining flour, 1/2 cup at a time until the dough pulls away from the side of the bowl. Turn out onto a floured surface, and knead for 10 minutes (no cheating!). Place dough into a greased bowl, and let rise until doubled in size. Divide the dough into 8 balls, and let rest for another 20 minutes. Roll each ball out to 8 to 10 inches in diameter. Heat a cast-iron skillet over medium-high heat. Fry each of the pieces of bread fro 30 to 60 seconds on each side, or until light to medium brown spots appear. Keep covered with a damp cloth, or store in a plastic bag until serving.	0.7624140157295458
  Ingredients: 4 cups bread flour, or more as needed, 1/3 cup white sugar, 1 teaspoon salt, 1 (.25 ounce) package rapid-rise yeast, 1/3 cup unsalted butter, melted, 1 1/2 cups hot tap water, 1 large egg, 1 teaspoon oil, or as needed, 1/2 cup brown sugar, or as needed, 1/2 cup chopped pecans, or as needed, 2 tablespoons ground cinnamon, or as needed, 1/2 cup unsalted butter, melted, or as needed, 1 1/2 cups confectioners' sugar, 1/4 cup unsalted butter, softened. Instructions: Sift 2 cups flour, sugar, and salt for dough together into the bowl of a stand mixer fitted with the paddle attachment. Stir in yeast. Add butter and blend at low speed until combined. Add hot water (the hottest it comes from your tap) all at once with the mixer running. Mix in egg until fully incorporated. Add remaining 2 cups flour and mix briefly until dough is soft and flour is incorporated. Change to the dough hook and knead dough for 10 minutes. If dough does not knead, you may need to add a little bit more flour carefully while the mixer is running. Once the dough climbs up the dough hook you have the right consistency. Make dough into a ball. Oil a bowl. Place the dough into the bowl and turn to coat with oil. Cover with a cloth and let sit until doubled in size, 1 to 2 hours. Cover your countertop with flour and roll dough out to a large rectangle, roughly 18x24 inches. Sprinkle brown sugar, pecans, and cinnamon on the dough, then pour melted butter over top. Roll the dough up from the longer side and cut into twelve 2-inch pieces. Place the pieces in a baking pan or on a baking stone. Cover with a cloth and let rise until doubled in size, about 45 minutes. Keep a close eye on the rolls; if they start to fall or look deflated at all, bake them immediately. Preheat the oven to 375 degrees F (190 degrees C). Bake the rolls in the preheated oven until golden brown, 6 to 10 minutes. Meanwhile, combine confectioners' sugar, butter, cream cheese, vanilla, and salt in a large bowl; beat with an electric mixer until no lumps of cream cheese remain. Whip for 2 to 3 more minutes on medium speed. Spread icing on warm rolls and serve.	Ingredients: 1 cup all-purpose flour, 1 cup rolled oats, 1 cup packed brown sugar, 1 teaspoon baking soda, 1/4 teaspoon salt, 1/2 cup butter, 2 eggs, 1 cup packed brown sugar, 1/2 teaspoon almond extract, 1 tablespoon all-purpose flour, 1 teaspoon baking powder, 1/2 teaspoon salt, 1 cup flaked coconut, 1 cup maraschino cherries, drained and juice reserved, 1/2 cup chopped pecans, 6 tablespoons butter, softened, 4 cups confectioners' sugar, 2 teaspoons vanilla extract. Instructions: Preheat oven to 350 degrees F (175 degrees C). In a medium bowl, stir together 1 cup flour, oats, 1 cup brown sugar, baking soda and 1/4 teaspoon salt. Rub in the 1/2 cup of butter until crumbly. Press into the bottom of a 9x13 inch baking pan. Bake for 10 minutes in the preheated oven. Remove and cool. Make the filling while the crust is baking. In a medium bowl, beat eggs, almond extract, 1 cup of brown sugar, 1 tablespoon of flour, baking powder and 1/2 teaspoon of salt until smooth. Stir in the coconut, cherries and pecans. Spread over the pre-baked crust. Bake for 25 minutes in the preheated oven, until light brown. Let cool before icing. To make the icing, mix together the remaining 6 tablespoons butter, confectioners' sugar and vanilla until smooth. Gradually add the reserved cherry juice until the desired consistency is reached. Drizzle over cooled bars before cutting into squares.	0.7566587642301353
  Ingredients: 1/2 cup butter, 1 7/8 cups white sugar, 4 egg yolks, 1 cup all-purpose flour, 1 cup unsweetened cocoa powder, 1 1/3 tablespoons baking powder, 1/2 teaspoon salt, 4 egg whites, 1 cup milk, 2 teaspoons vanilla extract, 2 cups semisweet chocolate chips, 3/4 cup sour cream, 1 teaspoon vanilla extract, 1 pinch salt. Instructions: Preheat oven to 325 degrees F (165 degrees C). Grease and flour three 9 inch round cake pans. In a large bowl, cream together the butter and sugar. Beat in the egg yolks, one at a time. Stir in 2 teaspoons vanilla. Combine the flour, cocoa, baking powder and salt, stir into the creamed mixture alternately with the milk. In a large clean glass or metal bowl, whip egg whites until soft peaks form. Fold 1/3 of whites into batter to lighten it, then quickly fold in remaining whites until no streaks remain. Divide batter into the 3 prepared pans. Bake for 20 to 25 minutes in the preheated oven, until a toothpick inserted into the center of the cake comes out clean. Cool in pans on a wire rack. To make the frosting: Melt the chocolate chips in the top of a double boiler, stirring occasionally until smooth. Remove from heat and stir in the sour cream, 1 teaspoon vanilla and pinch of salt. Frosting can be used warm to fill and frost the 3 layers.	Ingredients: 1/2 cup butter, 2 cups all-purpose flour, 1 cup white sugar, 1/2 cup packed brown sugar, 2 eggs, 1 teaspoon baking powder, 1 teaspoon baking soda, 1 cup sour cream, 1 teaspoon vanilla extract, 1 teaspoon ground cinnamon, 1/4 cup brown sugar, 4 tablespoons milk, 1 cup confectioners' sugar, 1/4 ounce candy sprinkles (optional). Instructions: In a large bowl, blend together butter or margarine, white sugar, 1/2 cup brown sugar, sour cream, eggs, and vanilla. Add to these ingredients the flour, baking powder, and soda. Blend until smooth. To Make Filling: Combine cinnamon and 1/4 cup brown sugar. Grease and flour a large Bundt pan. Pour 1/2 of the batter into the prepared pan. Sprinkle the cinnamon sugar mix on top of the batter in the pan, and cover with the remaining batter. Bake at 350 degrees F (175 degrees C) for 45 to 50 minutes. Cool. Make a thick glaze by mixing together confectioners' sugar with 2 to 3 tablespoons milk until smooth. Pour over cooled cake, and add sprinkles if desired.	0.8263426596124509

• Loss: CosineSimilarityLoss with these parameters:

  {
      "loss_fct": "torch.nn.modules.loss.MSELoss"
  }
  

Training Hyperparameters

Non-Default Hyperparameters

• eval_strategy: steps
• per_device_train_batch_size: 16
• per_device_eval_batch_size: 16
• num_train_epochs: 1
• multi_dataset_batch_sampler: round_robin

All Hyperparameters

Click to expand

• overwrite_output_dir: False
• do_predict: False
• eval_strategy: steps
• prediction_loss_only: True
• per_device_train_batch_size: 16
• per_device_eval_batch_size: 16
• per_gpu_train_batch_size: None
• per_gpu_eval_batch_size: None
• gradient_accumulation_steps: 1
• eval_accumulation_steps: None
• learning_rate: 5e-05
• weight_decay: 0.0
• adam_beta1: 0.9
• adam_beta2: 0.999
• adam_epsilon: 1e-08
• max_grad_norm: 1
• num_train_epochs: 1
• max_steps: -1
• lr_scheduler_type: linear
• lr_scheduler_kwargs: {}
• warmup_ratio: 0.0
• warmup_steps: 0
• log_level: passive
• log_level_replica: warning
• log_on_each_node: True
• logging_nan_inf_filter: True
• save_safetensors: True
• save_on_each_node: False
• save_only_model: False
• restore_callback_states_from_checkpoint: False
• no_cuda: False
• use_cpu: False
• use_mps_device: False
• seed: 42
• data_seed: None
• jit_mode_eval: False
• use_ipex: False
• bf16: False
• fp16: False
• fp16_opt_level: O1
• half_precision_backend: auto
• bf16_full_eval: False
• fp16_full_eval: False
• tf32: None
• local_rank: 0
• ddp_backend: None
• tpu_num_cores: None
• tpu_metrics_debug: False
• debug: []
• dataloader_drop_last: False
• dataloader_num_workers: 0
• dataloader_prefetch_factor: None
• past_index: -1
• disable_tqdm: False
• remove_unused_columns: True
• label_names: None
• load_best_model_at_end: False
• ignore_data_skip: False
• fsdp: []
• fsdp_min_num_params: 0
• fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
• fsdp_transformer_layer_cls_to_wrap: None
• accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
• deepspeed: None
• label_smoothing_factor: 0.0
• optim: adamw_torch
• optim_args: None
• adafactor: False
• group_by_length: False
• length_column_name: length
• ddp_find_unused_parameters: None
• ddp_bucket_cap_mb: None
• ddp_broadcast_buffers: False
• dataloader_pin_memory: True
• dataloader_persistent_workers: False
• skip_memory_metrics: True
• use_legacy_prediction_loop: False
• push_to_hub: False
• resume_from_checkpoint: None
• hub_model_id: None
• hub_strategy: every_save
• hub_private_repo: False
• hub_always_push: False
• gradient_checkpointing: False
• gradient_checkpointing_kwargs: None
• include_inputs_for_metrics: False
• eval_do_concat_batches: True
• fp16_backend: auto
• push_to_hub_model_id: None
• push_to_hub_organization: None
• mp_parameters:
• auto_find_batch_size: False
• full_determinism: False
• torchdynamo: None
• ray_scope: last
• ddp_timeout: 1800
• torch_compile: False
• torch_compile_backend: None
• torch_compile_mode: None
• dispatch_batches: None
• split_batches: None
• include_tokens_per_second: False
• include_num_input_tokens_seen: False
• neftune_noise_alpha: None
• optim_target_modules: None
• batch_eval_metrics: False
• batch_sampler: batch_sampler
• multi_dataset_batch_sampler: round_robin

Training Logs

Epoch	Step	Training Loss	val-evaluator_spearman_max
0.0553	100	-	0.8950
0.1106	200	-	0.9175
0.1658	300	-	0.9211
0.2211	400	-	0.9221
0.2764	500	0.0093	0.9239
0.3317	600	-	0.9308
0.3870	700	-	0.9340
0.4422	800	-	0.9324
0.4975	900	-	0.9338
0.5528	1000	0.0063	0.9376
0.6081	1100	-	0.9379
0.6633	1200	-	0.9420
0.7186	1300	-	0.9419
0.7739	1400	-	0.9420
0.8292	1500	0.0057	0.9441
0.8845	1600	-	0.9446
0.9397	1700	-	0.9446
0.9950	1800	-	0.9450
1.0	1809	-	0.9450

Framework Versions

• Python: 3.10.12
• Sentence Transformers: 3.0.0
• Transformers: 4.41.1
• PyTorch: 2.3.0
• Accelerate: 0.30.1
• Datasets: 2.19.1
• Tokenizers: 0.19.1

Citation

BibTeX

Cooking Up Creativity: Enhancing LLM Creativity through Structured Recombination

@article{mizrahi2025cooking,
  title={Cooking Up Creativity: Enhancing LLM Creativity through Structured Recombination},
  author={Mizrahi, Moran and Shani, Chen and Stanovsky, Gabriel and Jurafsky, Dan and Shahaf, Dafna},
  journal={arXiv preprint arXiv:2504.20643},
  year={2025}
}

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}