An alternative to Constitutional AI or simple RLHF-based approaches for fine-tuning LLMs based on moral information from diverse populations.
Exciting work! Canโt wait to try the prototype ๐๐ผ
Introducing Democratic Fine-Tuning
Exciting work! Canโt wait to try the prototype ๐๐ผ