6 min read

Grok Build and Remotion: code a product video from the terminal

By Founder & Research Lead, Kalaris Labs · Updated

Grok Build is xAI's coding agent for the terminal. It writes code and runs commands in your project, so it can build a Remotion video and render it like any other build artefact.

This guide connects a library of real launch videos with one command, so Grok has a measured reference to copy the timing and motion from.

Want only the install and a few prompts? The Grok Build launch video page has them on one screen.

Why Grok Build suits video work

  • One command adds the server; it is saved in ~/.grok/config.toml.
  • A project-level .grok/config.toml shares the server with everyone on the repo.
  • grok mcp list confirms the connection before you start.
  • It renders locally, so the MP4 and its source stay in your project.

Start a Remotion project

Remotion turns React components into video: every frame is a render of your component at that frame number, so Grok Build edits a video the way it edits any other code. You need Node.js. Ask Grok Build to scaffold the project, or run it yourself:

npx create-video@latest

Give Grok Build a reference to work from

A blank prompt gets a generic video. A real launch video measured frame by frame gets one with a rhythm: when each shot starts, how it enters and how much moves. The library at https://kuchi.kalarislabs.com/mcp is a free MCP server with no sign-in and no API key. Add it to Grok Build:

1. In a terminal, add the server. It is saved to ~/.grok/config.toml. No sign-in is needed.

grok mcp add --transport http kuchi https://kuchi.kalarislabs.com/mcp

2. Or add it to ~/.grok/config.toml by hand (or .grok/config.toml to share it with your project).

[mcp_servers.kuchi]
url = "https://kuchi.kalarislabs.com/mcp"

3. Check it with grok mcp list, then start Grok Build and paste the setup prompt.

Then paste the setup prompt, so the agent knows how to use the library:

Setup prompt
Connect the Kuchi MCP server at https://kuchi.kalarislabs.com/mcp (Streamable HTTP, no sign-in) and confirm it works by listing its tools.

Kuchi is a library of real product-launch videos to use as inspiration templates. When I want a launch video, read kuchi_get_workflow and follow it: get a short list with kuchi_suggest_templates and show me each one's poster and link so I can choose, in chat or by picking a video on kuchi.kalarislabs.com and pasting its link. Once I pick one, study it with kuchi_get_breakdown, look at its storyboard and note what each shot shows, then call kuchi_plan_remake with my product details and your shot analysis, and ask me for my logo, screenshots and anything else it lists as missing. Build to the blueprint's frames. Before you deliver, run kuchi_check_remake and compare your frames with the reference. Copy only the reference's motion and taste; everything on screen comes from my product.

The prompts, in order

  1. Suggest three launch video templates that fit a CLI tool and show me the posters.
  2. Study the one I pick and describe each shot.
  3. Plan the remake with our README screenshots and logo.
  4. Scaffold Remotion, build each shot on its planned frames and render.
  5. Run the remake check and fix what it flags.

Writing one shot in Remotion

A Remotion video is a React component rendered once per frame. Inside a shot, useCurrentFrame() returns the frame number counted from the start of that shot's <Sequence>, and useVideoConfig() gives the fps and size. Everything that moves is a function of that number, which is why Grok Build can match a reference to the frame: an entrance that takes 12 frames in the reference takes exactly 12 frames in yours.

The blueprint says how each shot enters. Each entrance has a direct translation:

Blueprint `enters`In Remotion
cutNo entrance animation: the shot is fully on screen at its first frame.
transitionAnimate over the first frames: interpolate(frame, [0, 12], [0, 1], { extrapolateRight: 'clamp' }) for opacity, or a spring() for scale or position.
holdSame scene as the shot before: keep the layout and resume the motion where it stopped.
blank_black, blank_whitePut a frame or two of solid black or white between the shots, as the reference does.

Here is a product-screen shot that enters with a short transition, written the way Grok Build should write every shot: assets from public/ through staticFile(), timing from the frame number, nothing random.

src/shots/Shot3.tsx
import { AbsoluteFill, Img, interpolate, spring, staticFile, useCurrentFrame, useVideoConfig } from 'remotion';

// Blueprint shot 3: kind ui_screen, enters "transition", motion "medium".
export const Shot3 = () => {
  const frame = useCurrentFrame();
  const { fps } = useVideoConfig();
  const opacity = interpolate(frame, [0, 12], [0, 1], { extrapolateRight: 'clamp' });
  const rise = spring({ frame, fps, config: { damping: 200 } });

  return (
    <AbsoluteFill style={{ background: '#0b0b0f', alignItems: 'center', justifyContent: 'center' }}>
      <Img
        src={staticFile('screens/dashboard.png')}
        style={{ width: '78%', borderRadius: 16, opacity, transform: `translateY(${(1 - rise) * 40}px)` }}
      />
    </AbsoluteFill>
  );
};

For a screen recording use <OffthreadVideo src={staticFile('screens/demo.mp4')} /> instead of <Img>. Never use Math.random() or the clock inside a shot: Remotion renders frames in parallel and out of order, so anything not derived from the frame number flickers. Use Remotion's random(seed) when you need variation.

Preview, check and render

Open the Remotion Studio to scrub through the video while Grok Build works, render single frames to compare with the reference at the times the check gives, then render the file. Launch stands for your composition id.

npx remotion studio
npx remotion still Launch out/frame-90.png --frame=90
npx remotion render Launch out/launch.mp4

What trips people up in Grok Build

  • Adding the server inside a session that already started. Start a new session after grok mcp add.
  • Personal and project configs disagreeing. Keep the server in one of them.
  • Rushing the build. Ask for the shot analysis first; the plan depends on it.

Questions

What is Grok Build?

xAI's coding agent for the terminal. It edits files and runs commands in your project.

How do I add an MCP server to Grok Build?

Run grok mcp add --transport http with a name and URL, or add an [mcp_servers.<name>] block with url to ~/.grok/config.toml.

Is Grok Build the same as the Grok chat app?

No. The chat app adds servers as connectors and plans; Grok Build writes and renders the video.