[multimodal] Allow generate and prefill to take move sematics

[larryliu0820]

As titled

[pytorch-bot]

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/14643

• 📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 2 New Failures, 3 Unrelated Failures

As of commit 0e60d1b with merge base dfa17bc ():

NEW FAILURES - The following jobs have failed:

• pull / test-eval_llama-wikitext-linux / linux-job (gh)
  RuntimeError: Command docker exec -t ce1b06a6b58c00d27ba8dcb26b6277a34b7f7cf31b6254bd22142a6a4dfcfbed /exec failed with exit code 1
• pull / test-vulkan-operators-linux / linux-job (gh)
  RuntimeError: Command docker exec -t 645f665409f0a585ee3c79e225c7863a7a136c79434cd19e1bf6f33f28d67cc3 /exec failed with exit code 127

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

• pull / test-binary-size-linux-gcc / linux-job (gh) (trunk failure)
  ##[error]The operation was canceled.
• pull / test-setup-linux-gcc / linux-job (gh) (trunk failure)
  ##[error]The operation was canceled.
• pull / unittest / macos / macos-job (gh) (trunk failure)
  exir/tests/test_quant_fusion_pass.py::TestQuantFusionPass::test_embedding_torchao

This comment was automatically generated by Dr. CI and updates every 15 minutes.

[kirklandsign]

Sorry I am still not sure about the use case. const vector& is a superset of vector&& ?

[larryliu0820]

Sorry I am still not sure about the use case. const vector& is a superset of vector&& ?

If only const vector& then it doesn't take std::move(inputs), basically rvalues. With this new API you can do stuff like:

runner.generate({make_text_input("my prompt"), make_image_input(image_data)});

[kirklandsign]

We can't do this with const vector&?

runner.generate({make_text_input("my prompt"), make_image_input(image_data)});

[larryliu0820]

We can't do this with const vector&?

runner.generate({make_text_input("my prompt"), make_image_input(image_data)});

Can't do this without this PR, we are creating an rvalue and generate doesn't take it.