By all means, you can use JSP w/ about just about any webserver. Although, you will need an engine that is capable of running JSPs and Servlets such as Tomcat ( http://apache.org ), Jrun ( http://www.allaire.com ) that is capable of running them.
When set up properly, the webserver will direct any requests for JSPs or Servlets to the Servlet engine. Go to the above sites and read for more info.
-Derek