I tried with the modal popup extender in Ajax toolkit also with the same result. The mulitselect didn't work in FF.

As I mention before, it's not a big deal. But if you release the modal dialog as a separate product, I will be the first one to use it :)