The American Public Health Association has been among those we've contested when they abandoned an outcomes- and evidence-based approach to public health nutrition. So it seems fair to compliment APHA when it gets it right. This week, APHA released its 2009 Agenda for Health Reform . It contains six "critical changes" to achieve "health improvement." (It also contains five recommendations for health care delivery, beyond our balliwick).
We hope APHA examines its previous program recommendations against these critical priorities and abandons, for example, its past advocacy of universal sodium reduction as inconsistent with its new policy priorities. The six "critical changes" include four goals we share, but would accord a lower priority: 1) investing more in prevention program "that have been proven to prevent disease and injury and improve the social determinants of health," 2) investing more to address "the chronic underfunding of the nation’s public health system," 3) improving programs "to reduce disparities in health," and 4) requiring "an annual report to the nation that holds the system accountable for achieving agreed upon health goals and outcomes. The federal government should develop appropriate standardized measures and health status indicators, along with methods for collecting, reporting and analyzing such data." We like the outcomes focus of #4; it almost rises to the higher priority we'd accord to APHA's other two "critical change" recommendations.
We hope the Obama Administration seriously addresses the other two recommendations which are:
Account for the real cost savings and cost avoidance of preventive and early intervention services at the individual and community levels through more accurate fiscal scoring methods. The Congressional Budget Office (CBO ) and the Office of Management and Budget (OMB ) should be directed to develop and implement methods to more accurately score the costs savings associated with community-based and other prevention programs.
and
Require methods to assess the impact federal policies and programs have on public health. Health is intricately tied to community design and directly affected by policies and programs across various sectors, including housing, transportation, environment, land use, agriculture, labor, education, trade and the economy. Therefore, health reform legislation should require a health impact assessment for all new federal policies and programs.
"Real cost" savings can only be determined by an examination of health outcomes of an intervention. We cannot support the APHA's call for a health impact on the vast array of policies -- at least as a priority recommendation -- but let's start with an assessment of policies intended to improve health. We are woefully light on real-world assessment. These two recommendations surely tie together. If we can assess real outcomes, we will better target our interventions and realize "real cost savings."
To exemplify these points, consider, naturally, the question of efforts to reduce population salt intakes. What "real cost savings" can be realized? We've seen the scary numbers produced by computer projections from models developed by salt reduction advocates. But consider the data. Three studies of the federal government's National Health and Nutrition Examination Survey have found those on the "recommended" levels of salt intake suffer between 20% and 37% greater mortality. The only two health outcomes randomized clinical trials of salt-reduction documented that high-risk congestive heart failure patients treated with low-salt diets died more often and more quickly and were readmitted to the hospital more frequently than those consuming regular amounts of salt. And evidence is now available that there exists in the human brain a "central regulation of sodium appetite " more powerful than conscious food choices which helps explain why salt intakes have been unchanged for a century and are unlikely to be modified by calls to substitute low-sodium foods for our normal diet.
So we join with APHA in endorsing new emphasis on examining actual health outcomes, not computerized models, and the real cost savings we can expect by properly targeting our interventions, abandoning those that aren't evidence-based or likely to deliver theorized benefits.
Bias in medical research isn't confined to financial matters, a recent Washington Post op ed explained. Dr. David A. Shaywitz , a former Harvard University endocrinologist and stem cell researcher, reminds
University research is not a pure enterprise; its researchers have feet of clay and are subject to an array of professional biases.
Consequently, our myopic obsession with industry conflicts of interest may have the unintended consequence of distracting us from some of the more important sources of prejudice and concern.
He might have included government researchers, either on-staff or on-the-research-dole. There are many conflicts and motivations for researchers to publish and interpret junk science. In many ways, the publications can be career-enhancing -- unless discovered and exposed. Writes Shaywitz:
Researchers are unlikely to become less self-serving -- just as reporters are unlikely to become less opportunistic in their hunt for news. Ultimately, it is up to each of us to develop a more skeptical ear, to approach received wisdom cautiously and to pay more attention to data than to narrative.
Amen.
Mail online, a UK popular website associated with the Daily Mail, recently ran an excellent article by journalist Jerome Burne on the work published in January, 2009 by Dr. Paul Welton and his group at Loyola University in Chicago.
Burne stressed the study suggested that by concentrating on the effects of salt on blood pressure we could be missing the bigger picture. That's because salt doesn't affect blood pressure on its own; it does so only in concert with another mineral - potassium. To go one step further, it should also be understood that by focusing on blood pressure alone we are missing the far more important issue of overall health outcomes. Of course, for some, blood pressure may indeed be an issue, however, health outcomes are paramount for everyone.
On the issue of blood pressure itself, the research indicated found that there was no significant difference in the risk of heart disease whether patients had been eating a lot or a little sodium. What did reduce the risk, however, was the ratio of sodium to its counter-balancing mineral potassium. Concuming more potassium tipped the balance in favour of reducung blood pressure for those who may be sensitive.
Burne went on to review evidence from the British medical Journal showing that cutting back on salt may help those taking medication for high blood pressure, but held no clear benefits for everyone else. He also referred to the excellent research carried out at the Albert Einstein College of Medicine in New York showing no benefit and perhaps harm accruing from salt reduction. Finally, Burne stressed the importance of DASH-type diet as being one of the most effective ways of improving cardiovascular health.
Obviously, we need many more journalists delving more deeply into the issue of salt and health.
Yesterday's Politico had an interesting article suggesting "A lesson for Obama from the other Roosevelt ." Bush White House aide Daniel M. Price extracted a quote of Theodore Roosevelt from historian Edmund Morris' TR biography, Theodore Rex . Roosevelt responded to a journalist who suggested that popular opinion favored nationalizing American railroads instead of Roosevelt's tack of increasing regulation; TR said:
Here is the thing you must bear in mind. I do not represent public opinion: I represent the public. There is a wide difference between the two, between the real interests of the public and the public’s opinion of those interests. I must represent not the excited opinion [of some], but the real interests of the whole people.
A parallel leapt to mind, probably because I spent yesterday in a meeting with medical scientists and nutrition experts. Many public health nutrition groups and the federal government have used "expert consensus" as an argument to support a public policy of encouraging everyone to eat less salt. Expert opinion mirrors public opinion in this case; the federal government has spent tens if not hundreds of millions of dollars "educating" the public and public opinion is that dietary salt is consumed in "excess" amounts. As in TR's apt distinction, however, there is a "wide difference between this expert/public opinion and the public's true interest.
The public cares about improving health. It cares about the quality of the evidence underlying public policy. And for good reason: physiology trumps expert opinion. Whether the experts get it right or not, the body is going to do "its thing" by responding to changing conditions. So it is with the science concerning dietary salt.
While some groups prescribe salt reduction, the inventors of "evidence-based medicine," the Cochrane Collaboration , finds insufficient evidence to recommend a population-wide lowering of dietary salt. The Cochrane Review, "Advice to reduce dietary salt for prevention of cardiovascular disease ," concluded: "There was not enough information to assess the effect of these changes in salt intake on health or deaths."
Policy should reflect the needs of the public, not public opinion. However that may play out in President Obama's efforts to stabilize the U.S. financial system, it's a sound prescription for healthy public nutrition policy.
In a new editorial commentary published today by the American Heart Association , John B. O'Connell MD points out that the AHA's new guidelines for managing heart failure patients are "eminence-based," not evidence-based. Nice turn of phrase, that.
It turns out that the guidelines include 24 recommendations. Only one is level of evidence A. O'Connell continues:
Although some have called such recommendations "eminence-based," until there are randomized controlled clinical trials to justify the recommendations, the quality of expertise on the panel and their collective experience justifies consensus recommendations.
The increased focus on quality of evidence underlying recommendations is refreshing, even if it reminds us of just how uncertain are the foundations of many "consensus" recommendations. Certainly salt reduction falls in that category.
Small amounts of a well-known white powder should be ingested daily to prevent coronary heart disease, the federal US Preventive Services Task Force (USPSTF) reiterated in a March 17 article in The Annals of Internal Medicine .
No, the white powder, in this article, isn't salt, it's aspirin. The USPSTF reiterated its 2002 finding that men over age 45 and women over age 55 should take aspirin. The recommendations receive the top "A" grade for strength of evidence supporting the recommendation.
USPSTF does have a recommendation on that "other white powder" (no, not THAT one!) -- salt. USPSTF concludes: "There is insufficient evidence to recommend for against counseling the general population to reduce dietary sodium intake....
That's what USPSTF concludes for aspirin-taking advice when men and women reach 80.
If we believe in evidence-based health recommendations, let's not pick and choose. Let's take our daily aspirin...and our daily salt!
Newspapers and websites around the country are reporting a story coming out of the American Heart Association's Cardiovascular Disease Epidemiology and Prevention annual conference in Palm Harbor, Florida yesterday. Medical researcher Dr. Kirsten Bibbins-Domingo, an assistant professor of medicine and epidemiology at the University of California, San Francisco, reported that if Americans cut just one gram of salt from their daily diet, there would be 250,000 fewer new cases of heart disease and more than 200,000 fewer deaths over a decade.
This dramatic statement was not the result of any clinical trials or observed data but rather the product of a computer simulation called the Coronary Heart Disease Policy Model. Many such statistical models are available and were the subject of a systematic review in 2006. The conclusion of this review stated that
"…few Coronary Heart Disease Policy Models have been calibrated, replicated or validated against minimum quality criteria. Before being accepted as a policy aid, any model should explicitly include a statement of its aims, assumptions, outputs, strengths and limitations."
Despite this, most media devoted to food and health report this study without any qualifications - as if it were fact and not the consequence of speculation and assumption. It's little wonder that in his book "Life on the Mississippi" Mark Twain wrote:
"There is something fascinating about science. One gets such wholesale returns of conjecture out of such a trifling investment of fact."
Over the last number of years we have heard, seen and read about hundreds, of medical breakthroughs and pending calamities that vanished into thin air after a short period, never to be heard from again. Most of these were based on conjectures and assumptions that never panned out, yet, the media, consumer advocates and the medical establishment latched onto them without any reference to the quality of data - as if they were proven fact.
It's a pity that there isn’t a requirement to have all public statements regarding health, conform to a minimum level of evidentiary quality. At the very least, there should be a system established so that consumers will be informed of the level of evidence behind any health-related public statements or claims. After all, the consumer advocacy movement, followed by the medical establishment, was the first to insist on food labels so that consumers would be better informed as to what they were getting for their money. Why shouldn’t the same sentiment govern the public statements consumers get concerning our health, so that they can judge their value and trustworthiness?
The Salt Institute has long extolled "performance-based" policies. For roadways, "performance management" means policy driven by outcomes measured in terms of safety and reliability in moving people and goods from point A to point B. For dietary salt, we've called for "performance-based" policies driven by health outcomes: a person's salt intake should be driven by the health consequences of that person's dietary salt intake. The goal is safe, reliable and efficient roads and longer, healthier lives.
University of California-Berkeley law professor Stephen D. Sugarman authored an op ed piece in today's San Francisco Chronicle urging what he termed "performance-based regulation" of dietary salt intake. He called for a "cap and trade" system as has been widely debated as a means of curbing America's carbon emissions.
Sugarman should stick with law. He clearly doesn't understand physiology, economics or history.
His argument goes off-track early when he posits that consumers are helpless victims of food processors. To him, consumers are unable to determine how much salt they're eating despite widespread use of nutrition labels. Since a major portion of the salt Americans ingest comes from processed foods, the clear answer for Sugarman is to regulate salt consumption by "imposing financial penalties" on food manufacturers. Specifically, "we could demand that large retailers cut the total amount of salt in food they sell." Retailers like Wal-Mart would then demand "its food providers to reduce the salt they add to their products, reducing the volume of salty products it sells (by raising the price, providing smaller or less attractive shelf space), introducing and promoting less-salty or salt-free alternatives, given Wal-Mart customers more information about the salt they're consuming, and more." Trouble is: that's hardly creative. That's what's happening now here in North America and in the UK. And it's not working.
Food procesors have used a "stealth" approach to paring back the salt content of food products. They put their salt alternative products at eye level on grocery shelves and relegate "round cans" to shoetop shelves. They've introduced an enormous array of "low-salt" or "salt free" products. They've provided consumer education materials going far beyond federally-mandated nutrition labels. And they've watched as salt intake continues unabated.
The problem lies not with the food manufacturers, but with the customers. And customers "know" they want to cut back on salt. Some assiduously count milligrams of sodium towards a target based on a "daily reference value." To no avail. Why not? Physiology. Economics. History.
Human salt intakes are unchanged over the past century. When humans have access to salt, they consume it in a predictable and fairly narrow range of about 2,300 - 4,600 milligrams sodium a day. We know this because for many years medical scientists have studied various health concerns and routinely extracted 24-hour urine specimens. Those numbers and unchanged over many decades. Nor are humans unique: livestock and poultry, like humans, need salt to live and each species has developed its own predictable, narrow range of intakes -- the phenomenon is well understood by animal nutritionists.
Why it should be so has been more elusive, but even that conundrum is yielding to scientific assault. A February 2008 Experimental Physiology article on "Central regulation of sodium appetite " explains how our brains control salt intake. Appetite is what counts. Not taste. Not politically-correct menu choices. Not even the cost or quantity of the food. Americans eat a diet far less dense in sodium compared to calories than they used to -- perhaps because consumers have the tools and the motivation to try to reduce salt. They just cannot behaviorally control a hard-wired, neurally-mediated appetite. Sugarman suggests food manufacturers and retailers can "reduce the flow of slat in ways that best satisfy consumer preferences." But all "preferences" are not conscious choices. Salt appetite is not a conscious consumer choice.
Thus, the economics is all wrong. "Demand" is not elastic at all. It's fixed. You can reduce the amount of salt per serving and all that you'll produce is consumption of more servings. Taxing Wal-Mart for the amount of salt it sells would be impossible to control; would you have Wal-Mart tell its customers to buy their food elsewhere because they had used up their allotment?
And history gives no comfort either. Recognizing this inelasticity of demand -- the physiologic requirement expressed as salt appetite -- many countries throughout history have monopolized the salt trade and taxed it heavily. The French gabelle triggered the bloody French Revolution. China's imperial salt tax funded much of the country's rule, from dynasty to dynasty. India won independence in no small part based on Gandhi's adroit exploitation of indefensible British "protection" of salt production.
Sugarman admits he has no idea how much cutting salt would lower blood pressure. Of course, that's the wrong question. If he's interested in "performance" it's not blood pressure by health outcomes he should be championing. He says he seeks "a big step in a healthier direction, and performance-based regulation is the most promising way to get there."
We agree, Mr. Sugarman, but you need to learn a bit more about what performance really means. A performance-based intervention would improve health. Salt reduction won't.
It is human nature to continually want to improve things. In a great many cases, when our knowledge was sufficient and the universe unfolded as expected, our efforts led to social, material and medical advances that have stood the test of time. In other cases, rather than delivering the expected benefits, these innovations led to unintended consequences that plagued us for long periods before we discovered the true nature of their effects and dispensed with them. One of the areas of interest that has seen a great many of these dilemmas has been the field of food and nutrition.
The ancient Greeks and Romans discovered that when they coated the interiors of their copper or bronze cooking pots with lead, many of the food and beverages they prepared tasted much better. Nowhere was this more evident than in the preparation of acidic products such as wines. Popular recipes of the day called for the boiling of the must from grapes in lead-lined vessels in order to prepare a liquid additive that would enhance the color, flavor and shelf life of wine. The resultant sweet, syrupy liquid was called “sapa”.
Sure, they could have added natural honey as they had for centuries, but this new development was considered a real advancement. What actually happened when they boiled the must in lead vessels was a reaction between the acetic acid from the grape ferment and the lead of the pot to form a compound called lead acetate. Lead acetate is also called ‘lead sugar’ because it is so sweet and it made wine more tasty.
What they did not know was that lead sugar was toxic - not the acute toxicity that could be detected immediately - but the chronic toxicity which often evades immediate notice. Thus, the unintended consequence of lead poisoning ushered in an epidemic of morbidity and mortality that lasted for more than 1500 years before being discovered . Unbelievably, this new development in taste contributed significantly to the downfall of Rome, because more than two thirds of the leading Roman aristocrats who served between 30 – 220 C.E. including all the Roman Emperors, were most likely victims of lead poisoning .
In the current rush to replace salt (sodium chloride) in our diet with chemicals that mimic its taste, we may be seeing "déjà vu, all over again." Salt replacement is a very complex task because nothing quite duplicates its taste perfectly. For example, not only does potassium chloride have a considerably lower taste intensity, but it has a large bitter component that has to be compensated for. To get over the bitterness, chemicals such as 2,4-dihydroxybenzoic acid have to be added. But it doesn't stop there because the low-level of salty taste inherent in all the proposed salt replacers require that they be enhanced through the employment of chemical enhancers such as inosine 5-monophosphate, disodium guanylate, glycine monoethyl ester, ornithyl-β-alanine, L-arginine or (N-(1-Carboxethyl)-6-hydroxymethyl-pyridinium-3-ol) commonly known as alapyridaine.
In the past, these industrial chemicals have been approved as additives with the understanding that they would be used in minute amounts within our foods. However, if they are to be used to replace salt throughout our food system we will consume a lot more of them than ever anticipated. Unless long-term chronic toxicity testing of these chemicals is carried out, we may very well be exposing ourselves to the unintended consequences that have befallen humankind in the past. In fact, it is strange that consumer advocacy groups such as CSPI have not questioned their use more closely.
Of course, in more recent history, we have seen the good intentions of trying to eliminate all forms of fat in our diet. Unfortunately, good intentions may not have been enough, because we are now coming to realize that the whole genre of no fat, low fat and reduced fat foods may have contributed significantly to the epidemic of obesity we now see all around us.
Before we go grabbing at another dietary gold ring, it may be prudent to get all our knowledge in place if we want the universal to unfold as it should.
German bakers are up in arms, reports Judy Dempsey in the Feb. 26 NY Times .
European Union officials have offered to sit down with German bakers in an endeavor to defuse the latest uproar over proposed regulations from Brussels.
Echoing a recent furor over legislation dictating the size, shape and texture of fruits and vegetables, German bakers have criticized a proposal that would force a change in the salt content of their products.
The anger of the bakers — who condemned the bureaucrats in Brussels as “taste police” — seems to reflect a rising resentment of the European Union by a country that has long been among its biggest supporters.
The bakers' association declared:
“What the E.U. is doing amounts to stupid interference. ... “The E.U. is trying to change the way we bake our bread, change the way we market it — and of all things, change the taste of our bread. And all this is taking place just months before we go to the polls to elect a new European Parliament. This is exactly the kind of interference and overregulation by Brussels that annoys citizens and even makes the E.U. unpopular.”
This is noteworthy on two counts:
- Until now, food companies in Europe and North America acted like lapdogs of the food police, failing to challenge the fundamentally-flawed science behind "healthy" food definitions and taking the stance that food manufacturers can avoid being tarred for destroying their customers' health by rolling out new "healthy" foods; and
- The bakers' lobbying group, the Central Association of German Bakeries, has developed a new line of defense: preparing low-salt breads as the EU wants is energy inefficient, "undermining its goal of improving energy efficiency." The article quotes a Bavarian bakery spokesperson declaring: "We are being asked to change our recipes by reducing the level of salt. But that means we will have to bake the bread for longer and use more energy."
We don't know the validity of the energy efficiency argument, but it's heartening that food companies are awakening to the insatiable bureaucratic appetite for regulating personal dietary choices.
Medical science is evolutionary. We learn as we go and adjust our remedies as we better understand the problems we confront. Guidelines for medical practicioners and for consumers can help us make intelligent choices, but their credibilty can be jeopardized if they stray from recounting the scientific data into the minefield of promoting the policy preferences of the expert scientists who draft the guidelines.
We can and should preserve the credibilty of guidelines by injecting them with a healthy dose of humility.
Scientists have developed a system to grade the guidelines based on the quality of the evidence supporting the advice. The process is as valuable for clinical advice given in the doctor's office as it is for general population advisories such as the Dietary Guidelines for Americans.
The February 25 issue of the Journal of the American Medical Association contains an important article by Pierluigi Tricoci et al which grades the evidence underlying the joint cardiovascular practice guidelines of the American College of Cardiology and the American Heart Association. The results were important in their own right. Authors from Duke University and the University of North Carolina agreed that most of the guidelines are based on "lower levels of evidence or expert opinion" and disturbingly documented that "(t)he proportion of recommendations for which there is no conclusive evidence is also growing." Nearly half (48%) of the guidelines were based solely on expert opinion, not data. And, an icreasing percentage of guidelines are not based on "Class I" evidence but more on "Class II" which are supported by "conflicting evidence and/or a divergence of opinion about the usefulness/efficacy of a procedure or treatment." Fully 41% of the ACC/AHA guidelines are based on contentious Class II evidence.
The authors called for a more evidence-based approach.
We agree. The background discussion of the paper should be required reading for all expert groups preparing guidelines. After all, at least the ACC and AHA report that their recommendations are based on "Level of evidence C" -- expert opinion, the lowest level of evidence after "Level of evidence A: recommendations based on evidence from multiple randomized trials or meta-analyses" or "Level of evidence B: recommendations based on evidence from a single randomizd trial or nonrandomized studies."
In contrast, the process of preparing the Dietary Guidelines for Americans is purely "Level of evidence C: recommendation based on expert opinion, case studies, or standards of care." Sure, the experts select evidence of quality scientific studies, but the process is inverted: their cited literature follows the experts' conclusions (level C) rather than drive the process (levels A and B).
In an accompanying editorial , Terrence M. Shaneyfelt and Robert M. Centor opine:
Current use of the term guideline has strayed far from the original intent of the Institute of Medicine. Most current aticles called "guidelines" are actualy expert consensus reports. ...
The overreliance on expert opinin in guidelines is problematic. All guideline committees begin with implicit biases and values. However, bias may occur subconsciously and, therefore, go unrecognized. Converting data into recommendations requires subjective judgments; the value structure of the panel molds these judgments.
While many focus on direct financial conflicts of interest as the motivating bias of experts, Tricoci et al dig a bit deeper:
Recommendations based only on expert opinion may be prone to conflicts of interest becaue, just as clinical trialists have conflicts of interests, expert clinicians are also those who are likely to receive honoraria, speakers bureau, consulting fees, or research support....
The list could be much longer and include career and other professional advancement considerations.
The overall message is one of humility and restraint. Don't over-interpret the evidence and fit the evidence to desired policy options. That's what robs guidelines of credibilty and leaves practicioners and the general public whip-sawed with conflicting advice.
For guidelines on dietary salt, the lesson is that we need to adhere more faithfully to an evidence-based approach embodied in the approaches of the international Cochrane Collaboration and the U.S. Preventive Services Task Force, both of which have concluded there is insufficient evidence to justify a population guideline on salt intake levels. That's a "Class I, Level of evidence A" conclusion we should incorporate.
The article and editorial are timely for two reasons:
- One of the authors, Dr. Robert Califf of Duke University, is reportedly a top contender to become the new Commissioner of Food and Drugs in the Obama Administration and
- The Dietary Guidelines Advisory Committee has just begun a periodic reassessment of the Dietary Guidelines.
Our vote is for Dr. Califf to head FDA and for a new measure of data-driven humility in rendering dietary advice on Americans' eating habits, converting the Guidelines from expert opinion to a true evidence-based product.
George Will's column today, "Bon Appetit ," his reader-voted best column so far this year, explores the thesis of Stanford University/Hoover Institution fellow Mary Eberstadt that human appetites for food and sex are polar opposites. Intriguing speculation.
The argument runs that a half century ago, people were uptight about sex and casual about their diets while today the reverse is true.
Surely we'll all accept that humans are hard-wired to consume food and enjoy sex, both are essential to our survival as a species. But Will's (and Eberstadt's) thesis that social mores are the driving force in determining the level of indulgence -- the appetite -- may be misplaced. At least for food.
Research published a year ago in Experimental Physiology -- and being studiously ignored by today's dietary morality enforcers -- shows that, at least in the case of "salt appetite," consumption of given dietary intake levels is an unconscious process driven by the brain, not a conscious behavioral choice by consumers.
Theories are stimulating. Data are controlling. That's why human physiology trumps dietary guidelines and why Americans (and others around the world) are eating the same amount of salt today as they did a century ago -- before the food police arrived on the scene to render assistance.
John Tierney's Science column in yesterday's New York Times , is yet another reminder of the problems we're having sorting out scientific fact from scientists' opinion. Tierney takes his cue from the new book, The Honest Broker , by Roger Pielke, Jr. who asks: can scientists be honest brokers? Pielke's concerned that scientists are "jeopardizing their credibility while impeding solutions to problems."
Tierney notes how Pres. Obama's new Energy Secretary and National Science Advisor have both made extremely radical "scientific" doomsday predictions (e.g. no farms in California by the end of the century and a billion deaths from climate change-induced famines by the year 2020, respectively) and recounts Pielke's analysis that scientists think they have two roles: pure researchers or experts providing evidence for political decisions:
A scientist can enter the fray by becoming an advocate for certain policies, like limits on carbon emissions or subsidies for wind power. That’s a perfectly legitimate role for scientists, as long as they acknowledge that they’re promoting their own agendas.
But too often, Dr. Pielke says, they pose as impartial experts pointing politicians to the only option that makes scientific sense. To bolster their case, they’re prone to exaggerate their expertise (like enumerating the catastrophes that would occur if their policies aren’t adopted), while denigrating their political opponents as “unqualified” or “unscientific.”
“Some scientists want to influence policy in a certain direction and still be able to claim to be above politics,” Dr. Pielke says. “So they engage in what I call ‘stealth issue advocacy’ by smuggling political arguments into putative scientific ones.”
When experts disagree, too often the result is name-calling, not resort to hard scientific data.
We've seen that in spades in the discussion of salt and health policy. We need to elevate science to its proper role in sorting out facts, not muddy the waters with expert opinion self-proclaimed as "science."
Put another way, as it is titled in an editorial in February's PLosMedicine: "An unbiased scientific record should be everyone's agenda ." Absolutely.
Recognizing that authors and publishers have built-in biases, the editorial identifies five problem areas:
- "Journals generally have policies regarding declaration of competing interests by authors. Similarly, editors’ political and scientific views, personal relationships, and professional and financial interests can all conceivably interfere with the objectivity of their decisions."
- "So much has been published relating to the damaging nature of commercial competing interests that it is tempting to ignore the influence of non-commercial interests in research. Yet publications can be influenced by the desire to promote an idea, or a research program, rather than a commercial product."
- "All contributors to the debate agree on one thing: a transparent declaration of author contributions is an essential requirement. As part of such a transparency policy, editors can therefore ensure that the individuals responsible for essential roles in research (such as designing the project, carrying out analyses, and writing the paper) are actually named, and their roles and competing interests made clear in the publication."
- "Many journals now have policies requiring, or recommending, the submission of original protocol documents before papers reporting the results of clinical trials are peer reviewed....these policies enable verification of the study’s prespecified objectives and analysis plan, and require clear description of any subsequent changes."
- "Editors have an important role to play in encouraging authors to value their results, irrespective of the study’s outcome. For example, in an attempt to impress editors with the importance of a study, authors may overemphasize an intriguing post-hoc subgroup analysis, or may avoid stating that a well-conducted trial was inconclusive in its primary outcomes. Editors can help combat this problem by emphasizing to authors that their data are still publishable if overstated conclusions are appropriately toned down."
We stand with the editors who conclude:
Peer-reviewed publication is the final, essential step in any research project, providing legitimization and credit for the work that has been done. It is the responsibility of everyone involved to ensure that the published record is an unbiased, accurate representation of research. We recognize that today there are many, and increasing, pressures on authors and journals to bias this record. If this pressure is not resisted, journals may increasingly become closer to works of fiction telling the stories dictated by various lobbies rather than works of science. We hope that PLoS Medicine’s efforts, and those of many other journals, to promote full transparency will ultimately lead to a more rigorous and unbiased knowledge base.
A study just published in Hypertension documents that continuous activation of the renin-angiotensin system impairs cognitive function in mice. In humans, low-salt diets reliably predict increased activity of the renin-angiotensin system. The body produces these neurohormones when it senses inadequate salt intake -- and that "inadequacy" is far, far above the IOM's "adequate intake" level for sodium. Low-salt dieters can be assumed to have continuously high renin-angiotensin activity levels.
Other studies have suggested low-salt diets may produce mental impairment. This could be the mechanism.
All this is in addition to the contributions of iodized salt, the consensus solution to overcoming the most easily-prevented, but still-widespread cause of mental retardation: iodine deficiency
Elsewhere we report the news that the European Union is cracking down on food health claims, approving only 9 of the first 43 evaluated and imposing stricter-than-FDA standards, usually based on "convincing" evidence from human clinical trials.
We applaud EFSA for its professed objective of preventing unproven health claims on food labels that would further confuse consumers in making informed dietary choices. To do the job right, EFSA has addressed one critical element: reliable, high quality data should be required to support approved health claims. There is a second crucial standard EFSA should also address: health claims should be based on disease outcomes, not intermediate variables, risk factors or biomarkers -- hard outcomes like disease-caused events or mortality.
On the first point, data quality, the key is to adopt a process like "evidence-based" medicine as defined by the Cochrane Collaboration: first set the standard for quality before looking at what the evidence might be; that's exactly the opposite of what the US Dietary Guidelines Advisory Committee is doing in its expert-based review (which it also calls "evidence-based").
For the second point, the key is to stop looking at "indicators" and "risk factors," recognizing that there are often multiple and conflicting bodily processes affected by any single nutrient. Not only is a carefully controlled trial needed to isolate those effects, but its is their combined totality that concerns us: does the intervention improve health, extending healthy lives, or just change one risk factor (ignoring others)?
With regard to salt, the implications are enormous. The Cochrane Review on health outcomes of salt-reduced diets finds insufficient evidence of improved health to justify a population advisory (as has the US Preventive Services Task Force). That much is clear, though ignored by diehard salt reductionist activists like WASH and its most vocal advocate, Dr. Larry Appel. It is the second question that will prove pivotal for EFSA if it hews consistently to the high standard it professes. For salt, the proper measure is cardiovascular health. Not blood pressure. Not insulin resistance. Not neurohormonal activity. All of these are risk factors. Some "improve" in some people when they reduce salt. Others impose additional risks when salt is reduced. It is the net effect -- the health outcome -- that is important.
In the US, FDA has wandered off into the health policy wilderness on this point. Its health claim (whatever one's view of its scientific rigor, the subject of another discussion) is for "hypertension," a risk factor, not "cardiovascular health" (or heart attack incidence, another "hard outcome"). FDA could just as well approve a health claim that diets with today's salt intake levels protect insulin resistance and warn consumers of the fact that salt-reduced diets endanger our ability to metabolize glucose properly, setting up low-salt dieters for diabetes and metabolic syndrome. For FDA to follow the professed EFSA approach, it should replace a "salt and hypertension" health claim with one for "salt and cardiovascular health" -- but then, of course, back to point one, quality of evidence, there would be insufficient evidence to support such a claim.
The challenge for EFSA is to resist the blandishments of the salt reduction lobbyists who claim to "know" that their computer-modeled extrapolations of blood pressure changes due to salt intake levels represent true health outcomes. EFSA should insist not only on good quality science, but on evidence that an intervention (or food) will actually improve HEALTH.
Add comment