Add advanced keyframe editing and camera trajectory tools

[grafpez]

Would be great to replicate the functionality of the Lumalabs.ai Fields Editor:

• Timeline extends when 'add keyframe' is selected when playhead is at end
• Cameras and path are visible,
• and when keyframes are selected, they can be moved on the timeline <-> or edited manually
• comprehensive camera editor with sliding values (left-click mouse hover over number entry field and move left/right to change values)
• 'prefab' trajectories
• import/export camera path (for virtual production)
  or at least, to begin with, the ability to 'select previous/next keyframe' with either [shift] + [left arrow] or similar.
  Thank you for considering, keep up the good work!

[willeastcott]

Thanks for the detailed write-up and the kind words — this is a great list. Good news is that SuperSplat already has a timeline/keyframe editor, so a fair bit of this is available today, some is partially there, and a couple of items I'd love a bit more detail on. Breaking it down against your list:

Already available

• Select previous/next keyframe (your "at least, to begin with" ask): press < / > to jump the playhead to the previous/next key (, / . step a single frame). You can also Shift+click the ◀ / ▶ transport buttons in the timeline. The full list is in the keyboard-shortcuts help (?).
• Cameras visible: enable Show Cameras in the Settings panel and each keyframe draws a camera frustum in the viewport.
• Move keys on the timeline: drag a key left/right to retime it, Shift+drag to duplicate it, and Ctrl+click a key to overwrite it with the current view.

Partially there / on the radar

• Path curve in the viewport: the individual camera frustums are drawn, but the connecting interpolated path line between them isn't rendered yet — noted as a good addition.
• Manually editing a selected keyframe (typing an exact frame, or editing the pose values numerically): not yet — today it's drag-based only. A proper per-keyframe editor is something we'd like to add.
• Camera editor with slider-drag fields: the value fields we use already support click-and-drag scrubbing, so that interaction is a good fit — what's missing is a dedicated panel exposing the selected key's parameters. See the question below on which parameters matter to you.
• Import/export camera path: the camera animation is already saved inside the project file and is exported into the published/downloaded viewer as a JSON animation track (per-key position, target, FOV, plus frame rate, loop mode and smoothness). What we don't have is a standalone interchange export aimed at a DCC — see below.

Would help to know more

• Auto-extend timeline on "add key" at the end — makes sense; right now the timeline length is fixed (set via the frame-count field) and keys are added within it. Noting this as a nice enhancement.
• "Prefab" trajectories — what did you have in mind? e.g. one-click orbit / turntable / dolly / fly-through presets that drop in a set of keys? A concrete example or two would help.
• Import/export for virtual production — what's the target? A specific DCC or format (FBX, USD, Alembic, Blender, Unreal, Nuke, a documented JSON schema…), and is it primarily export to your pipeline, import into SuperSplat, or both? Knowing the exact tool/format at the other end makes this much more actionable.

Thanks again — really useful feedback.

[grafpez]

Hi @willeastcott , Claude has helped me compile a quick document outlining my thoughts re. 'Prefab Trajectories', as instructed, it pretty much sums up what I would envisage; Please let me know if that helps.
Re. import/export, I shall get back you soon in a similar fashion ;-)

SuperSplat_Camera_Trajectories_Proposal.docx

[grafpez]

And @willeastcott here's a detailed description of purpose and implementation of Camera Tracking feature request for Virtual Production for your kind consideration please:

SuperSplat_VP_Camera_Tracking_Proposal_v3.docx

[slimbuck]

@grafpez please can you explain precisely what feature(s) you wish supersplat editor to implement.

Is it literally you just want to generate a video of a gaussian splat scene using a pre-recorded camera path?

[grafpez]

@grafpez please can you explain precisely what feature(s) you wish supersplat editor to implement.
Hi @slimbuck sorry if my request sounded a little convoluted and confusing, since I (initially) missed some functionality already existing through keyboard-shortcuts as mentioned by Will.
The rest as in the papers above as a clarification for Will's return questions, in brief:

• prefab camera trajectories
• advanced timeline and keyframe value editing
• camera trajectory import options to support common virtual production file types (for now as a video render only, non-realtime)
  hope this helps clarifying the feature request