Is it possible to create distributed or federated AI?
-
This post did not contain any content.
-
-
[email protected]replied to [email protected] last edited by
I'm not even sure what you're asking, let alone if it's possible.
I mean, you could probably divide its tasks/processes between different servers or computers, but I don't see what the point of that would be. It'd just make things significantly slower and more costly.
-
[email protected]replied to [email protected] last edited by
Like AI Horde?
-
[email protected]replied to [email protected] last edited by
That is a good question actually. I was looking into buying a graphics card to run som llms but it seems you need a huge amount of VRAM which makes the cards cost a huge amount of money.
I read you can buy several cheaper ones and connect them so the VRAM is enough, but that was on one computer.
It would be cool if several people could run their GPUs together similar to SETI@home to do GPU sharing. Even better if it's done federated.
-
[email protected]replied to [email protected] last edited by
Ooh, neat! This feels like Folding@Home for AI tasks.
-
[email protected]replied to [email protected] last edited by
Probably, but why? Who is going to spend money to run a server just to provide compute for random people they don't know to generate garfield fanfics
-
[email protected]replied to [email protected] last edited by
Around 2018 people trained go playing AI LeelaZero together in a distributed way. Google's AlphaGo was not available.
-
[email protected]replied to [email protected] last edited by
I downvoted OP as if this is StackOverflow.
What is the use case for OP for using AI?
What does OP not like about the current setup?
What goal is OP trying to achieve?
What drawback and extra cost is OP willing to take?
Without providing any of the information, asking such a question, slabbing buzz words like "federated" to the title is just wasting everyone's time. A few days ago there was even a question asking for a "federated browser". (¯―¯٥)
Despite all these some pals still provided insightful answers. You guys are amazing.
-
[email protected]replied to [email protected] last edited by
it's already created https://aihorde.net/