It is actually a bug in the Everquest2.exe Pygar. I found a workaround on the official forums, albeit my performance is a lot lower and the game is using A LOT more memory. I actually brought up taskmanager and saw the Everquest2.exe process sit there, with me not doing a thing in game, and memory usage just kept going up. It went from nearly 500MB, was in the range of 1.5GB-2GB when a window I've never seen before (for any program) popped up from Vista saying it had to close EQ2 because it was "mismanaging resources that could lead to system instability". I ignored the prompt since EQ2 appeared to still be working. It worked for about 1 more minute before crashing with a "Fatal error exception 0xc0000005 occurred in the application at location 0x4738bfc4". Plus Event viewer is full of "Memory resource" problems saying Everquest2.exe (it lists process ID here each time) tried to consume 1821675392 bytes but couldn't. The actual number of bytes is different for each event listed.
This is bare EQ2, without Innerspace running at all. I changed some more settings (disabled the new "adaptive combat music") and have it running now without crashing nearly as much. Still a crap shoot when I go to zone though.
At least I know I'm not alone with some odd issue nobody else has run into though since the only way I was able to get it to start at all was by doing the workaround some other people had found.