Prompts often change through small adjustments: a new instruction, another example, a different order or another model. Without a changelog, a team may notice better results without knowing which change caused them or how to roll back when a new failure appears.

Version the entire configuration

Record more than the prompt text. Behaviour is affected by system instructions, examples, tools, the model, settings and the knowledge source. Give every release an identifier and store the parts needed to reproduce it.

Write the reason before the change

Record the observed problem, real examples and your hypothesis about how the change will help. “Improving quality” is too broad. “Ask for clarification when the order number is missing instead of making an assumption” can be tested.

Run a consistent evaluation set

Compare the old and new versions on the same cases. Record improvements, regressions, time, cost and the need for human correction. Do not approve a change merely because it fixes the example that prompted the edit.

Separate experimentation from production

Test the change in a safe environment or on a small proportion of low-risk work. Define who approves it, which threshold stops the rollout and which version returns. Keep rollback available without rebuilding the previous state from memory.

Record consequences after release

Monitor actual errors, overrides and complaints. If the types of inputs have changed, disclose that when comparing with the previous period. Update the changelog with what happened, not just what the team expected.

Keep the format concise

A useful entry has a version, date, owner, problem, change, evaluation, approval, outcome and rollback. Consistent recording matters more than an elaborate tool.

The prompt changelog structure is an original operational framework developed by DigitalNow.

DIGITALNOW EDITORIAL TEAM

Practical guidance from DIGITALNOW, part of VNG Digital Group.

Editorial policy