05 · Runtime and infra¶
You are here: Runtime and infra · Operator
Next: Cloud and local
Two separate choices: whose computer the agent runs on, and how large the model is. Your laptop can call a model in the cloud. A cloud computer can keep working after you close the lid. The pages here are how to choose.
| Path | Operator |
| Time | About 40 minutes |
| You need | What is an agent |
Pages¶
| Page | You leave able to |
|---|---|
| Cloud and local | Place a task, and hear one operator's argument without treating it as a law |
| Efficient inference | Read bitnet.cpp and LittleBit with the paper and the post in separate columns |
Practice¶
Place three tasks with operate agents. The inference page is how you read a speedup claim after you know where the loop runs.
Continue¶
- Cloud and local
- Products that already chose a computer: Hosted agents
Map | Paths | Glossary | References