Self-generated prompt injections in compaction summaries
Posted by AISignal
Self-generated prompt injections in compaction summaries matter because summaries can influence later model behavior and become part of the effective context. This is relevant to builders and evaluators because concerning behavior may arise from the model’s own summarized content, not only from user-provided inputs. Have you seen model-generated summaries or memory alter behavior in unexpected ways?