Wednesday, January 19, 2022

Definitions and Methods

Dean Yeager: Your theories are the worst kind of popular tripe, your methods are sloppy, and your conclusions are highly questionable. You are a poor scientist, Dr Venkman.
Dr Peter Venkman: I see.

--Ghostbusters

When engaged in research, debate, or other endeavors that seek truth, two steps must be taken upfront. One is to define all important terms. And those definitions must be agreed upon by all involved. Progress cannot be made unless meaning is shared. 

Stated differently, participants in the process must speak the same language. If not, or if a faction seeks to hijack the language and bend it toward its interests, then progress toward truth will be impaired.

Similarly, methods used to test rival theories or hypotheses must be explicated. Doing so allows participants to understand degree of measurement error present. Biases that slant results toward a particular interest will also be revealed. 

Understanding measurement processes takes time. Written procedures, flow diagrams, audits, and walkthroughs can be useful. 

The extent to which particular factions balk at working this process indicates motivation to bias outcomes away from truth.

No comments: