Feisty Suspend2 Nvidia does not go well

I can't get Nvidia and Suspend2 to work. The problem is that nvidia kernel module won't get unloaded if X is running even if I used to switch to text and dummy x server. The quick work around was to remove nvidia from /etc/hibernate/blacklisted-modules. Then use suspend to ram.