This is just an anecdote, but when I was an undergraduate, my teacher Prof. Thomas Burrow told us that the earliest possible historical reconstruction of PIE still looked like a "loosely connected set of dialects," not a single language. 

Best,
Dominik