Server挂了

[farawayxxx]

MaxRetryError: HTTPConnectionPool(host='8.218.239.54', port=8080): Max retries exceeded with url: /rapidapi (Caused by
ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7fd9977ed990>, 'Connection to 8.218.239.54 timed out.
(connect timeout=15)'))

[wwfnb]

+1 HTTPConnectionPool(host='8.218.239.54', port=8080): Max retries exceeded with url: /rapidapi (Caused by ConnectTimeoutError(<urllib3.connection.HTTPConnection object at 0x7f7cdad71720>, 'Connection to 8.218.239.54 timed out. (connect timeout=None)'))

[kingb12]

Also seeing issues connecting to this server

[Mrlyk423]

We are working to fix the server now. Please wait for some time.

[itshuey]

Is it possible to receive a rapidapi key during this time? I am planning on hosting the server locally.

[skzhang1]

Is it possible to receive a rapidapi key during this time? I am planning on hosting the server locally.

The same question here.. The provided rapid API seems have some problems. Can you provide an instructions to illustrate the way of getting a Rapidapi key that could access to the API available in this benchmark? Thanks

[zkx06111]

Any guide for building our own server/obtaining an API key that works would be helpful.

[itshuey]

@zkx06111 I was able to build a local copy from the link in their repository. However, it requires you to sign up for rapidapi and manually subscribe to each API. For example, for the cocktail API, you need to subscribe here to get an api key, put the key into the rapidapi_keys.txt, and then start the server. You can then use the following query to test that it is running correctly:

curl -X POST "http://0.0.0.0:8080/rapidapi" -H "Content-Type: application/json" -d '{
"category": "Food",
"tool_name": "Cocktail",
"api_name": "Receive the cocktail data",
"tool_input": "{"cocktail_name": "blood"}",
"strip": "filter",
"toolbench_key": "setyourownuserkeyheresoyoucandistributetootherpeople"
}

By hosting the ToolBench server, OpenBMB essentially handles the subscriptions for us, which saves a lot of work. Hope the server can be fixed soon and thanks for the hard work!

[skzhang1]

Anyone can provide a Rapidapi key subscribing all tools in the benchmark? Really appreciate it!

[quocthai9120]

Hi @Mrlyk423 , thanks for spending efforts to fix the server! Do you have some eta of when the server will be available again? We want to do some benchmark using the evaluation sets from ToolBench, so it would be very nice to have the server alive. Thank you!