Developing LLMs: Open, closed, or democratic?
This is a big one. Getting going on if LLMs should be more open or more closed. We cover everything, OpenAI, scaling, openness for openness sake (relative to OpenAI), actual arguments for open-source values in LLMs, AI as infrastructure, LLMs as platforms, what this means we need, and other topics.
Lot's of related links this time from Nathan.
Lot's of related links this time from Nathan.
- Most recent article on Interconnects explaining how open-source startups may be deluding themselves.
- "What is an open-source LLM" on Interconnects.
- How the open-source economy works on Interconnects.