Skip to content

Question on using direct temporal embeddings vs. temporal separator tokens #3

@song-wensong

Description

@song-wensong

Hi, thank you for your great work on TimeMarker — it’s a very inspiring paper!

I noticed that the paper adopts temporal separator tokens to distinguish between frames. I’m curious:
Have you experimented with directly adding learnable temporal embeddings to each frame instead?
If yes, how does it compare in terms of performance and temporal coherence?

I’m wondering whether direct temporal embeddings might offer advantages, or whether the separator token provides better flexibility or generalization.

Looking forward to your insights!

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions