I have a personal project that needs to run several small tasks in parallel. A "director" breaks a huge task in many small ones and sends it (in any way possible) to the workers. It breaks down to ~22k small tasks per day, each taking about a second to finish.
I tried running it on GCP Cloud Functions, but time running makes it way too expensive.
Does anyone have any ideas on how/where I could build it?
Thanks in advance.