When I exit JExpress or the Installer, I get a message about a drive being open.

According to Sun's Bug Parade, this is a known challenge with the JFileChooser (Bug report 4147513). According to Sun, this happens when you open JFileChooser in the home directory. Apparently there is no way to stop Windows 95/NT from showing the warning message.

You can keep a disk in your drives, including any external ZIP drives, to prevent this error message.

Work around
Applies to
open drive, ZIP drives, JFileChooser

All information is provided "as is", without warranty of any kind, and subject to change. DeNova uses its best efforts to provide complete and accurate information. DeNova disclaims all warranties, either explicit or implied, including the warranties of merchantability and fitness for a particular purpose. In no event shall DeNova or its suppliers be liable for any damages whatsoever, including direct, indirect, incidental, consequential, loss of business profits or special damages, even if DeNova or its suppliers have been advised of the possibility of such damages.