I finally got around to installing the ConfigMgr Webservice to test out BIOS updates. Set it all up, however it would just stop the pool when I executed a query from the client.
I re-entered the username and password and would get an error about the specified password is invalid.
Turns out my IIS setup only runs the pool correctly with the Pre-Windows 2000 username.