paper-with-me

Papers

Cook-Gen: Robust Generative Modeling of Cooking Actions from Recipes

2023-06-01 · Revathy Venkataramanan, Kaushik Roy, Kanak Raj, Renjith Prasad, Yuxin Zi, Vignesh Narayanan, Amit Sheth

As people become more aware of their food choices, food computation models have become increasingly popular in assisting people in maintaining healthy eating habits. For example, food recommendation systems analyze recipe instructions to assess nutritional contents and provide recipe recommendations. The recent and remarkable successes of generative AI methods, such as auto-regressive large language models, can lead to robust methods for a more comprehensive understanding of recipes for healthy food recommendations beyond surface-level nutrition content assessments. In this study, we explore the use of generative AI methods to extend current food computation models, primarily involving the analysis of nutrition and ingredients, to also incorporate cooking actions (e.g., add salt, fry the meat, boil the vegetables, etc.). Cooking actions are notoriously hard to model using statistical learning methods due to irregular data patterns - significantly varying natural language descriptions for the same action (e.g., marinate the meat vs. marinate the meat and leave overnight) and infrequently occurring patterns (e.g., add salt occurs far more frequently than marinating the meat). The prototypical approach to handling irregular data patterns is to increase the volume of data that the model ingests by orders of magnitude. Unfortunately, in the cooking domain, these problems are further compounded with larger data volumes presenting a unique challenge that is not easily handled by simply scaling up. In this work, we propose novel aggregation-based generative AI methods, Cook-Gen, that reliably generate cooking actions from recipes, despite difficulties with irregular data patterns, while also outperforming Large Language Models and other strong baselines.

📄 PDF Abstract BibTeX arXiv:2306.01805

Code (1)

revathyramanan/cooking-action-generation 공식 구현 pytorch

Tasks

Food recommendationNutritionRecommendation Systems

Methods 이 논문이 사용한 방법론

AWARE We propose to theoretically and empirically examine the effect of incorporating weighting schemes into walk-aggregating GNNs. To this end, we propose a simple, interpretable, and…

Similar Papers 제목 키워드 기반

Learning Program Representations for Food Images and Cooking Recipes

2022-03-30 · CVPR 2022 1 · Dim P. Papadopoulos, Enrique Mora, Nadiia Chepurko, Kuan Wei Huang 외

In this paper, we are interested in modeling a how-to instructional procedure, such as a cooking recipe, with a meaningful and rich high-level representation. Specifically, we propose to represent cooking recipes and foo…

Cross-Modal RetrievalRetrieval

Multi-modal Cooking Workflow Construction for Food Recipes

2020-08-20 · Liangming Pan, Jingjing Chen, Jianlong Wu, Shaoteng Liu 외

Understanding food recipe requires anticipating the implicit causal effects of cooking actions, such that the recipe can be converted into a graph describing the temporal workflow of the recipe. This is a non-trivial tas…

Common Sense ReasoningDecoder

RecipeGPT: Generative Pre-training Based Cooking Recipe Generation and Evaluation System

2020-03-05 · Helena H. Lee, Ke Shu, Palakorn Achananuparp, Philips Kokoh Prasetyo 외

Interests in the automatic generation of cooking recipes have been growing steadily over the past few years thanks to a large amount of online cooking recipes. We present RecipeGPT, a novel online recipe generation and e…

Language ModelingLanguage ModellingRecipe GenerationText Generation

A generative grammar of cooking

2022-10-12 · Ganesh Bagler

Cooking is a uniquely human endeavor for transforming raw ingredients into delicious dishes. Over centuries, cultures worldwide have evolved diverse cooking practices ingrained in their culinary traditions. Recipes, thus…

NutritionRecipe Generation

Inverse Cooking: Recipe Generation from Food Images

2018-12-14 · CVPR 2019 6 · Amaia Salvador, Michal Drozdzal, Xavier Giro-i-Nieto, Adriana Romero

People enjoy food photography because they appreciate food. Behind each meal there is a story described in a complex recipe and, unfortunately, by simply looking at a food image we do not have access to its preparation p…

Recipe GenerationRetrieval