Discuss for the discord-bot deployment

[corona10]

The short story

We need to discuss the deployment options for the discord-bot.

Long version

@Mariatta and I are developing a discord bot that will utilize OpenAI APIs to enhance the productivity of the core development team. Currently, the bot is deployed on my Azure server(Standard D2as v4), but this setup is not sustainable. We would like to explore alternative options, such as requesting a quota for PSF Heroku deployment or any other viable alternatives. It would be greatly appreciated if we could discuss this matter further.

cc @python/infrastructure-staff

[ewdurbin]

What is the timeline?

[corona10]

What is the timeline?

There is currently no set timeline, but I hope to transition to an infrastructure that can be managed collaboratively, if possible. It is not a problem if the discussion takes some time. :)

[ewdurbin]

Really the only reason I'm asking is PyCon prep! If I don't have better information for you next week, we'll get you setup on Heroku.

What sort of resource requirements are you expecting in terms of RAM/CPU?

[corona10]

What sort of resource requirements are you expecting in terms of RAM/CPU?

I guess that the Standard 2X will be enough. Please let me know if this is too expensive.

[ewdurbin]

What is the functionality of the bot? That's a pretty big dyno. The PSF is currently footing bill for Heroku as they never relaunched their credit program, so that is a bit steep.

Do you have any metrics on the running instance to estimate the need a bit more precisely?

[corona10]

The PSF is currently footing bill for Heroku as they never relaunched their credit program, so that is a bit steep

Oh, in that case, please provide the minimal resource that can be provided.
I will explore other options if the minimum resources are insufficient. Currently, the application only communicates with the OpenAI server and the only computational operation involves using the tiktoken library.

[corona10]

Do you have any metrics on the running instance to estimate the need a bit more precisely?

Since this is the discord bot with limited people, traffic will not be over 20 requests per minute .

[Mariatta]

We also don't need it to be in Heroku. If there is other platform that The PSF recommends that is more affordable, we can go with that.

[CAM-Gerlach]

I'm no web expert, but it seems like you could run many such bots and other services on a DO $5/mo. VPS, assuming you don't already have one handy.

[ewdurbin]

There's good stuff on the horizon for Heroku type experience. We're actively working to get the same platform that deploys PyPI setup so it is user friendly enough to move all our Heroku apps. Sounds like discord-bot is a good candidate for the first one.

Marginal cost of running something like this is well less that $5/mo :)

We're close but I can't say "before PyCon" close at this time.

[corona10]

We're close but I can't say "before PyCon" close at this time.

I can wait :)