It does have to do with file size. I use Tony Kuiper's luminosity masks. If the channels used in the production of the the masks are not cleared after the mask is generated the file is very large. Also accumulating a big pile of masks will slow thing down considerably. Removing the channel's after it is used will prevent this. I'm not sure if this is how you process but that worked for me.
Best
Kelly