This option enables you to specify the CSS to be used in all popup/dialog windows within TinyMCE this option is set to a CSS file found in the currently used theme by default.
Example of usage of the popups_css option:
tinyMCE.init({ ... popups_css : "/mypopup.css" });