The publishers were just chasing traffic just like everyone else. Link pages were replaced by inline links which were preferred by both search engines and users. The goal was to provide relevant resources on relevant context rather in one big bucket dump no one's going to dig through anyway.