Test: Drag and Drop of notebook outputs into chat

[Yoyokrazy]

Refs: #245364

• anyOS
• anyOS

Complexity: 3

author: @Yoyokrazy

---

Summary

Notebook Cell Outputs can now be dragged into chat as an attachment.

Steps to Test:

• Open a notebook editor with outputs, with chat open to the side.

• Do the following with a variety of output types:

  • For images, you can directly drag into the chat input box
  • For textual outputs (plaintext, errors, etc), hold the modifier key alt and then drag to the chat input box

• Ensure the following:

  • Regardless of the timing with which you hold or release the alt key, cells don't remain in a dragging state (ie you don't want to be able to drag a textual output without holding alt)
  • Textual outputs can still be highlight and selected as normal with your mouse. Only the alt modifier should allow you to drag them across.
  • Outputs are being properly attached and sent to the model (ask questions about the output that would force it to interpret the image, etc)

Currently supported mime types:

[
	'text/plain',
	'text/html',
	'application/vnd.code.notebook.error',
	'application/vnd.code.notebook.stdout',
	'application/x.notebook.stdout',
	'application/x.notebook.stream',
	'application/vnd.code.notebook.stderr',
	'application/x.notebook.stderr',
	'image/png',
	'image/jpeg',
	'image/svg',
];

Known Issues

• Discoverability for the alt key is nonexistent. Will be exploring some amount of UX in the future to make it clear how to interact with outputs wrt chat.

---

Thanks for testing!