Several federal agencies are investigating whether the large chain of psychiatric hospitals held patients without medical justification.