6 min read

Make a product video with the Pi coding agent and Remotion

By Founder & Research Lead, Kalaris Labs · Updated

Pi is a deliberately small coding agent: a short system prompt, a few tools and nothing hidden. That makes it predictable on a job like a video, where you want it to follow a plan rather than improvise.

Connect a library of launch videos measured frame by frame and Pi has the plan: exact shot boundaries, entrances and motion, mapped onto your product.

Want only the install and a few prompts? The Pi launch video page has them on one screen.

Why Pi suits video work

  • Few moving parts, so it does what the blueprint says.
  • pi mcp add writes the server to ~/.pi/agent/mcp.json in one step.
  • /reload picks up a new server in a running session.
  • Works with whichever model provider you have set up.

Start a Remotion project

Remotion turns React components into video: every frame is a render of your component at that frame number, so Pi edits a video the way it edits any other code. You need Node.js. Ask Pi to scaffold the project, or run it yourself:

npx create-video@latest

Give Pi a reference to work from

A blank prompt gets a generic video. A real launch video measured frame by frame gets one with a rhythm: when each shot starts, how it enters and how much moves. The library at https://kuchi.kalarislabs.com/mcp is a free MCP server with no sign-in and no API key. Add it to Pi:

1. Add the server from your terminal. It is saved to ~/.pi/agent/mcp.json. No sign-in is needed.

pi mcp add kuchi --url https://kuchi.kalarislabs.com/mcp

2. Or add it to ~/.pi/agent/mcp.json by hand.

{
  "mcpServers": {
    "kuchi": {
      "url": "https://kuchi.kalarislabs.com/mcp",
      "description": "Real product-launch videos to use as templates"
    }
  }
}

3. Check it with pi mcp list. In a running session, type /reload to pick it up.

Then paste the setup prompt, so the agent knows how to use the library:

Setup prompt
Connect the Kuchi MCP server at https://kuchi.kalarislabs.com/mcp (Streamable HTTP, no sign-in) and confirm it works by listing its tools.

Kuchi is a library of real product-launch videos to use as inspiration templates. When I want a launch video, read kuchi_get_workflow and follow it: get a short list with kuchi_suggest_templates and show me each one's poster and link so I can choose, in chat or by picking a video on kuchi.kalarislabs.com and pasting its link. Once I pick one, study it with kuchi_get_breakdown, look at its storyboard and note what each shot shows, then call kuchi_plan_remake with my product details and your shot analysis, and ask me for my logo, screenshots and anything else it lists as missing. Build to the blueprint's frames. Before you deliver, run kuchi_check_remake and compare your frames with the reference. Copy only the reference's motion and taste; everything on screen comes from my product.

The prompts, in order

  1. Suggest launch video templates for an open-source library and show me each poster and link.
  2. Read the breakdown of the one I choose and describe each shot.
  3. Plan the remake with my logo at ./logo.svg.
  4. Create a Remotion project and build the shots on those frames.
  5. Check the remake against the reference, then render.

Writing one shot in Remotion

A Remotion video is a React component rendered once per frame. Inside a shot, useCurrentFrame() returns the frame number counted from the start of that shot's <Sequence>, and useVideoConfig() gives the fps and size. Everything that moves is a function of that number, which is why Pi can match a reference to the frame: an entrance that takes 12 frames in the reference takes exactly 12 frames in yours.

The blueprint says how each shot enters. Each entrance has a direct translation:

Blueprint `enters`In Remotion
cutNo entrance animation: the shot is fully on screen at its first frame.
transitionAnimate over the first frames: interpolate(frame, [0, 12], [0, 1], { extrapolateRight: 'clamp' }) for opacity, or a spring() for scale or position.
holdSame scene as the shot before: keep the layout and resume the motion where it stopped.
blank_black, blank_whitePut a frame or two of solid black or white between the shots, as the reference does.

Here is a product-screen shot that enters with a short transition, written the way Pi should write every shot: assets from public/ through staticFile(), timing from the frame number, nothing random.

src/shots/Shot3.tsx
import { AbsoluteFill, Img, interpolate, spring, staticFile, useCurrentFrame, useVideoConfig } from 'remotion';

// Blueprint shot 3: kind ui_screen, enters "transition", motion "medium".
export const Shot3 = () => {
  const frame = useCurrentFrame();
  const { fps } = useVideoConfig();
  const opacity = interpolate(frame, [0, 12], [0, 1], { extrapolateRight: 'clamp' });
  const rise = spring({ frame, fps, config: { damping: 200 } });

  return (
    <AbsoluteFill style={{ background: '#0b0b0f', alignItems: 'center', justifyContent: 'center' }}>
      <Img
        src={staticFile('screens/dashboard.png')}
        style={{ width: '78%', borderRadius: 16, opacity, transform: `translateY(${(1 - rise) * 40}px)` }}
      />
    </AbsoluteFill>
  );
};

For a screen recording use <OffthreadVideo src={staticFile('screens/demo.mp4')} /> instead of <Img>. Never use Math.random() or the clock inside a shot: Remotion renders frames in parallel and out of order, so anything not derived from the frame number flickers. Use Remotion's random(seed) when you need variation.

Preview, check and render

Open the Remotion Studio to scrub through the video while Pi works, render single frames to compare with the reference at the times the check gives, then render the file. Launch stands for your composition id.

npx remotion studio
npx remotion still Launch out/frame-90.png --frame=90
npx remotion render Launch out/launch.mp4

What trips people up in Pi

  • Forgetting /reload after adding the server mid-session.
  • A small model losing the shot list. Ask Pi to write the plan to plan.md and read it back per shot.
  • Skipping pi mcp list. It confirms the URL was saved correctly.

Questions

What is the Pi coding agent?

A minimal, extensible coding agent for the terminal from pi.dev. It reads and edits files and runs commands.

Where does Pi keep MCP servers?

In ~/.pi/agent/mcp.json. pi mcp add writes it for you.

Can a small agent handle a whole video?

Yes, shot by shot. The plan gives every shot exact frames, so each step is small and checkable.