Set properties on the floppy icon so that the filesystem type is set to' vfat'. Click on icon.
It doesn't work, claiming that it's the wrong filesystem. But trying it from the command line works fine.
Incidentally, I'd installed without a CD-ROM drive, and then added one in, if that's relevant.
This bug is still present in beta3.
fixed for 6.2 final.