If this is the setting you are talking about, then the insert hyperlink window does not resize. Note that I have made it resizable below..

 

// Default editorconstant ornaments for the Link dialog
editorconstant._linkDialogFeature = "help:0;status:0;resizable:1;dialogWidth:460px;dialogHeight:214px;";

 

When I made similar edits to the Image and Achor dialogs, I was able to resize them.