Some food for thought:
I think it could be a credit based system. Perhaps allow each PLAPA member 2 submission cerdits per enrollment period. (I just selected an arbitrary number here - could be higher, could be lower depending on how many songs and how often reviews will take place) I think limiting the number. From there it would just be a matter of getting in a queue similar to FBF, First-in-First out. Perhaps you could tack 3 reviews on per week after FBF reviews? Heck, you could even do a rush submission and charge a small fee to review anything in excess of the allotted amount for those of us who are more prolific and don't mind paying to get back in the queue.
Some additional thoughts: Could we explore the use of standard set of metrics for assessing this material? Perhaps comments regarding commercial viability, balance, dynamics, etc with each area getting a score? Maybe I am a bit too left-brained, but I think it would be nice to have a bar set so we can really hone our actions to get better.
I think this would be a fantastic addition to the curriculum. I look forward to this possibility!