Video to Cooklang Recipe Converter

Convert the recipe video at: $ARGUMENTS

Supports TikTok, Instagram, YouTube, and any site supported by yt-dlp.

CRITICAL RULES

DO NOT web search for the recipe. If extraction fails, tell the user what went wrong and stop. Never search the web or guess a recipe from another source - the whole point is to capture THIS specific creator's version.

If any step fails:

1. Tell the user exactly what failed (download, transcription, etc.)
2. Suggest they check dependencies are installed (brew install yt-dlp ffmpeg openai-whisper)
3. Stop. Do not proceed with partial or guessed information.

Your Task

1. Extract recipe information from the video URL
2. Format as Cooklang using proper syntax
3. Save to the appropriate meal folder in the user's Cooklang directory

Step 1: Extract Recipe Information

1a. Clean up previous run

Always start by clearing tmp files to avoid cross-contamination from previous recipes:

rm -rf /tmp/recipe_video.mp4 /tmp/recipe_audio.mp3 /tmp/recipe_audio.txt /tmp/recipe_frames

1b. Quick check - fetch the page

Use WebFetch to get basic metadata (title, creator). Note: Social media descriptions rarely contain full recipes - this is mainly for the recipe name and attribution.

1c. Download and analyze the video (PRIMARY METHOD)

Recipe videos contain instructions in BOTH visuals AND audio narration. Extract both:

# Download video (install with: brew install yt-dlp)
yt-dlp -o "/tmp/recipe_video.mp4" "$ARGUMENTS"

# Extract frames every 3 seconds (install with: brew install ffmpeg)
mkdir -p /tmp/recipe_frames
ffmpeg -i /tmp/recipe_video.mp4 -vf "fps=1/3" /tmp/recipe_frames/frame_%03d.jpg

# Extract and transcribe audio (install with: brew install openai-whisper)
ffmpeg -i /tmp/recipe_video.mp4 -vn -acodec mp3 /tmp/recipe_audio.mp3
whisper /tmp/recipe_audio.mp3 --model small --output_format txt --output_dir /tmp

1d. Combine transcript + visuals

From the transcript (/tmp/recipe_audio.txt):

• Exact measurements and quantities
• Oven temperatures and timing
• Technique names and tips
• Specific ingredient recommendations

From the frames:

• Ingredient identification (what's being added)
• Equipment used
• Cooking stages and techniques
• Best image for the recipe photo

The transcript is the primary source for accuracy - visuals confirm and supplement.

1e. Fallback: estimate from visuals

If audio transcription fails or is unclear, estimate from visuals:

• Visual portion sizes (handful ≈ 100g, splash ≈ 1 tbsp)
• Standard recipe ratios for the dish type
• Number of servings from final plating

1f. Fallback options

If video download fails, ask the user to:

• Provide screenshots of key moments
• Describe what they remember from the video

Step 2: Format as Cooklang

Convert the extracted recipe to Cooklang syntax:

Metadata Header

---
source: [Video URL]
servings: [number if known]
---

Style Rules (IMPORTANT)

• Capitalize all ingredients and equipment: @Chicken{} not @chicken{}
• No adjectives inside keywords: large #Skillet{} not #large skillet{}
• Prefer metric: Use grams/ml/litres, not cups. Tsp/tbsp are OK.

Ingredient Syntax

Use @Ingredient{quantity%unit} format with optional prep instructions in parentheses:

• @Chicken Breast{500%g}
• @Olive Oil{2%tbsp}
• @Garlic{3%cloves}(minced) - prep in parentheses
• @Onion{1}(diced)
• @Salt{} - no quantity = to taste
• For optional ingredients, write in text: "Add optional @Chilli Flakes{1%tsp} if desired."
• Don't use -, ?, or & prefixes - they're not supported by Cooklang apps

Equipment Syntax

Use #Equipment{} format with adjectives BEFORE the keyword:

• large #Skillet{}
• #Baking Sheet{}
• #Mixing Bowl{}

Timing Syntax

Use ~{time%unit} format with single values only (NO ranges):

• ~{5%minutes} - correct
• ~{10-15%minutes} - WRONG, will break
• For variable times, pick a middle value or write in text: "about 10-15 minutes"

Section Headers (for complex recipes)

Use == Section Name == format:

• == Marinade ==
• == Assembly ==

Step 3: Determine Meal Category

Based on the recipe content, classify into one of:

• Breakfast: eggs, pancakes, waffles, oatmeal, smoothie, toast, cereal, bacon, french toast, muffins
• Lunch: salad, sandwich, soup, wrap, bowl, quesadilla, light meals
• Dinner: main proteins (chicken, beef, fish, pork), pasta dishes, stir-fry, roasts, curries, casseroles, substantial meals

Step 4: Save the Recipe

First, read the config file to get the Cooklang directory:

cat config.json  # in the plugin directory, or ~/.claude/config.json

The cooklang_directory value is the base path. Save to:

[cooklang_directory]/[MealType]/[Recipe Name].cook

Filename rules:

• Use the recipe title, properly capitalized
• Replace special characters with spaces
• Keep it readable (e.g., "Garlic Butter Shrimp.cook")

Step 5: Save Recipe Image

Select the most appealing frame from the extracted frames (usually the final plated dish or a key cooking moment) and copy it with the same name as the recipe:

cp /tmp/recipe_frames/frame_XXX.jpg "[cooklang_directory]/[MealType]/[Recipe Name].jpg"

The image filename must match the recipe filename exactly (just with .jpg instead of .cook).

Step 6: Clean Up

Remove temporary files to prevent cross-contamination with future runs:

rm -rf /tmp/recipe_video.mp4 /tmp/recipe_audio.mp3 /tmp/recipe_audio.txt /tmp/recipe_frames

Step 7: Confirm Success

After saving, tell the user:

• The recipe name
• Where it was saved (full path)
• The inferred meal category
• A brief summary of what was captured

Example Output

For a garlic shrimp recipe saved to Dinner:

Created: Garlic Butter Shrimp.cook
Location: Dinner/Garlic Butter Shrimp.cook
Image: Dinner/Garlic Butter Shrimp.jpg
Category: Dinner (main protein dish)

The recipe includes 5 ingredients and takes about 15 minutes to prepare.
Source: [Video URL]