It does go away in a few seconds after start-up. However, I am not running nor have I ever run a cheap oil filter. The oil filter it has now has maybe 250 miles on it, and it's making the noise, so I cannot attest it to that.
OP: Sorry for jacking your thread, but hopefully you're getting some...