Connecting to memcache through remote server

I have two servers (Server A that is a web server) and server B that is an application server. Server B has memcache installed on it and server A is pointing to server B. On server A, if I navigate to the ip address of server B with the port number of 8091 specified, I get a page cannot be displayed message. I can only connect to memcache on server B by navigating to http://localhost:8091.

I have checked the firewall and nothing is blocking it nor are there any errors in the event log to show why server A cannot bring up the admin console or connect to server be. Does anyone have any suggestions?