Well, no. Without controls, a language model can drive sensitive individuals to violence or suicide. The idea of releasing a frontier model without RL is frightening based on what we have learned.
> The idea of releasing a frontier model without RL is frightening
In case you were not aware, strong base models (no post training at all) have been available for quite some time now. Including ones that eclipse “scary” frontier models from even a year ago.
Words out of a magic box on a computer can’t make you kill yourself. Perhaps the people that would use that as encouragement are already mentally ill enough that it really doesn’t matter what the trigger is?
On a more callus but fully serious note, evolution starts out physical, that the species that don’t eat and breed as well, die. What happens when you remove that? When life is so safe that you basically wont stave, get eaten, catch a disease, don’t really need to compete all that hard for scarce resources, etc? Do you think evolution just stops? Or perhaps does a social or mental evolution become the predominant differentiator for successful reproduction over time?
You are obviously very new to the tech world if you dont recall the many years of customer lobbying, and Apple refusing outright for a long time until they were strongarmed into it by law. You cant then turn around and claim they are all sunshine and roses because they support open protocols when they were forced to begrudgingly.
reply