Hi,
I remember a performance issue related to the workflow inbox when users have loads and loads of Roles attached to them (it might be that this issue is fixed now).
You should check if this is maybe causing the dire performance.
Kind regards, Rob Dielemans