By default, users don't have sovereignty over their data in the cloud.

· Bits and Bobs 9/3/24

To regain sovereignty, the obvious step is to build local first software.

The users have sovereignty over their data, because the data remains on their turf.

Local gives you privacy, agency, control.

But the cloud gives you efficiency, scale, reliability, power.

Going local first introduces a number of new challenges:

How do you do decentralized sync?

Any device might be arbitrarily out of sync, for an arbitrarily long amount of time.

How do you shrink down LLM inference to be efficient enough to run on device?

How do you accomplish code that every user has to trust is running in an environment that none of them can tamper with?

These are hard challenges!

In the cloud, these are all easy; you can presume a small number of beefy devices that are available practically 24/7.

Private cloud enclaves provide a different approach.

The power of the cloud, the sovereignty of local.

More on this topic

From other episodes