More than 1200 AI workers are asking for Washington's help to build an AI slowdown plan

It specifically calls out the risks around AI systems that start to design their own successors faster than anyone can understand or control them.