Copy-paste Hayek’s response (his nobel prize speech, “Pretense of Knowledge”):
"Why should we, however, in economics, have to plead ignorance of the sort of facts on which, in the case of a physical theory, a scientist would certainly be expected to give precise information? It is probably not surprising that those impressed by the example of the physical sciences should find this position very unsatisfactory and should insist on the standards of proof which they find there. The reason for this state of affairs is the fact, to which I have already briefly referred, that the social sciences, like much of biology but unlike most fields of the physical sciences, have to deal with structures of essential complexity, i.e. with structures whose characteristic properties can be exhibited only by models made up of relatively large numbers of variables. Competition, for instance, is a process which will produce certain results only if it proceeds among a fairly large number of acting persons.
In some fields, particularly where problems of a similar kind arise in the physical sciences, the difficulties can be overcome by using, instead of specific information about the individual elements, data about the relative frequency, or the probability, of the occurrence of the various distinctive properties of the elements. But this is true only where we have to deal with what has been called by Dr. Warren Weaver (formerly of the Rockefeller Foundation), with a distinction which ought to be much more widely understood, “phenomena of unorganized complexity,” in contrast to those “phenomena of organized complexity” with which we have to deal in the social sciences. Organized complexity here means that the character of the structures showing it depends not only on the properties of the individual elements of which they are composed, and the relative frequency with which they occur, but also on the manner in which the individual elements are connected with each other. In the explanation of the working of such structures we can for this reason not replace the information about the individual elements by statistical information, but require full information about each element if from our theory we are to derive specific predictions about individual events. Without such specific information about the individual elements we shall be confined to what on another occasion I have called mere pattern predictions - predictions of some of the general attributes of the structures that will form themselves, but not containing specific statements about the individual elements of which the structures will be made up."
Also, it might not be appropriate to bring up here; but a lot of people who take about epistemology in such a way usually take the stance of only looking at the data. I have a parable regarding this:
Imagine we had no theory and only data. A rain-dancer is testing the effect of rain-dancing on the occurence of rain. So, beind a good scientist he has a control, a rain-dancer with no feather on his head. And he has test groups of rain-dancers in various controlled conditions and locations with 3 different types of feathers in his head…
This is why theory is important and needs to be analyzed.
Thought you guys might be interested in reading it:
