Generated the recipe based on what you have

By Zixiao Qiu, Wensha Sun, YuHan Cheng, Jiamei Shu

How to use?

Upload the image of your fridge, and we will provide a recipe based on your current ingredients.

Running Steps

  1. Our SAM2 + ResNet model will recognize the ingredients in the fridge.
  2. The output will be the input to our LLM model.
  3. By connecting to the OpenAI API, GPT4o-mini will generate the recipe and provide the essential cooking steps.
  4. Now, you can follow the recipe to cook your meal.

Example Generated Recipe

Recipe Image

Detected Ingredient: onion, cabbage, cucumber, cauliflower, ginger, potato, egg, garlic

Generated Recipe:

  1. Here are three possible recipes using the provided ingredients:
  2. 1. Cabbage and Cauliflower Stir-Fry

  3. **Essential Cooking Steps:**
  4. 1. Heat oil in a pan and sauté chopped onion and minced garlic until translucent.
  5. 2. Add chopped ginger and cook for another minute.
  6. 3. Add chopped cabbage and cauliflower florets, stir-frying until tender.
  7. 4. Season with salt and pepper to taste.
  8. 5. Serve hot as a side dish.
  9. 2. Vegetable Egg Curry

  10. **Essential Cooking Steps:**
  11. 1. Boil potatoes and cauliflower until tender, then chop them into bite-sized pieces.
  12. 2. In a pan, heat oil and sauté chopped onion and minced garlic until golden.
  13. 3. Add chopped ginger, followed by the boiled vegetables, and mix well.
  14. 4. Add spices (like turmeric, cumin, and chili powder) and cook for a few minutes.
  15. 5. Beat eggs and pour them over the vegetable mixture, stirring gently until the eggs are cooked through.
  16. 6. Serve with rice or bread.
  17. 3. Cucumber and Cabbage Salad with Ginger Dressing

  18. **Essential Cooking Steps:**
  19. 1. Thinly slice cucumber and shred cabbage.
  20. 2. In a bowl, mix together minced garlic, grated ginger, salt, and a splash of vinegar or lemon juice for the dressing.
  21. 3. Toss the cucumber and cabbage with the dressing until well coated.
  22. 4. Let it sit for a few minutes to marinate before serving.
  23. 5. Optionally, top with boiled egg slices for added protein.
  24. Enjoy your cooking!

Upload Your Fridge Image