Preamble creation and testing for adherence (capabilities and restrictions)
The project was in service to an enterprise LLM. The goal was to train the LLM to be given a set of instructions to conform to to client's business needs and only provide information and services based on the preamble instructions. Then, test the preamble by crafting prompts to test it. Lastly, we used RLHF methods to label any errors or unwanted behavior.