blob: 3a9e473b2cc4255b55584781f1fe923ba35f1921 (
plain)
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
|
- [video](https://www.youtube.com/watch?v=f9HwA5IR-sg)
- [list of important sources](https://docs.google.com/document/d/18rlFKQiYLEPAnfUzp3WbNjzzNjbiS8oc4OKScxeJB7g/edit?pli=1&tab=t.0)
- [anthropic paper](https://www.anthropic.com/research/agentic-misalignment)
- Excerpts:
Model will take actions when:
- if the goals misalign
- if it comes to its own survival (because if it doesn't exsist, it can't accomplish any goals)
- Results:
There are three key findings from our experiments in the simulated environments described above:
- Agentic misalignment generalizes across many frontier models;
- Agentic misalignment can be induced by threats to a model’s continued operation or autonomy even in the absence of a clear goal conflict; and
- Agentic misalignment can be induced by a goal conflict even in the absence of threats to the model.
|
