8 comments
A security researcher at OpenAI that clearly doesn't have limits.
> First, the safety researcher perspective. These folks work tirelessly to evaluate model capabilities and the dangers they pose as they advance at an alarming pace. They understand fundamentally better than nearly anyone else how models are able to interpret their environment, reason, and solve problems. They study models as they try and deceive their graders, evade chain-of-thought monitoring, and do all sorts of crazy stuff. These researchers are continuously stress testing the models to determine why and how they behave the way they do, and are working vey hard to make tangible progress in aligning their interests with ours. Many of these researchers have formal backgrounds in these types of networks, with expertise that takes many years to develop. However, a lot of safety researchers, even ones that I respect enormously, have never been in a real incident, don’t understand security vulnerabilities, or really know how to break a system. That’s okay. That is not their background. But safety has direct overlap with security, and so it does pose a problem.
Wow. This just makes them appear incredibly incompetent.
Read the full thread on Hacker News →
Related stories
- The Verge · 0 points · 4 days ago
- Can John Ternus find Apple’s next big thing?theverge.comThe Verge · 0 points · 9 days ago
- The Verge · 0 points · 2 days ago
- The Verge · 0 points · 11 days ago
- I have some questions for Mark Zuckerbergtheverge.comThe Verge · 0 points · 6 days ago
- Hacker News · 3 points · 2 days ago