Limiting an LLM's knowledge — what happens?