Bad science, new chapters

Jordi Varela
Editor

In July of last year I commented on a work by Paul Glasziou and Iain Chalmers that concluded that taking into account methodological shortcomings, unpublished studies and poorly explained ones, the waste of biomedical research could be of the order of 85%. According to these authors, only 15% of what is investigated reaches the clinic in conditions of quality and appropriate communication. A little over a year later, other sources insist that biomedical research, in general terms, does not show signs of recovery and, to make it understandable, I will follow the same scheme that I used in the post I have quoted.

Measuring efficiency: is it going well?

Mª Luisa de La Puente

While the concept of efficiency is easy to understand if we consider it as the system that uses resources (inputs) to improve the health of the population, it's not as easy to measure as it appears due to the multiple methodological problems. The relationship between inputs and outcomes in the health sector is influenced by multiple factors external to the control of the health sector itself.

The European Union Health System Performance Assessment (HSPA) expert group has recently published a report on this (1).

It defines efficiency as the quotient between the inputs of the system (equipment, resources) and its outputs (the number of patients treated, for example) or its outcomes (the number of years of life gained, for example). He accepts them both but warns that using outputs as an approximation of outcomes can lead to false interpretations. It also highlights the importance of differentiating efficiency from cost control, since cost control is only concerned with reducing inputs without measuring the outputs/outcomes that that reduction causes.

In a health system, efficiency can arise for two different but related reasons. Efficiency materializes:

 1) When the same result could be produced, or even better, consuming fewer inputs, and

 2) When resources are spent on a mix of services that maximize the health of society as a whole (outcomes). These two typologies of efficiencies are conventionally cited, respectively, as technical efficiency and allocation efficiency. The allocation efficiency can be produced on a macro basis (paying attention to the service with the best cost/effectiveness ratio) and on a micro character (giving the treatment with the best cost/effectiveness ratio). The OECD idea of waste is associated with the notion of technical efficiency (2).

A survey is carried out in the 29 countries that are part of the group of experts, of which 22 answered. The survey only explores technical efficiency, since the assignment would require information on the relative value of the outputs of the services that don't it's available in most of the investigated countries. Half of the respondents state that they don't have a unified system to measure efficiency. Of the other half, approximately 40% respond that they consider the relationship between intermediate inputs and outputs, 40% between inputs and outcomes, and the remaining 20% consider the two previous possibilities. 80% responded that the hospital area is subject to regular measurements, not so much for strategy as for lack of information from other health areas such as primary care, mental health or social and health care. Technical efficiency in hospitals is also measured as it's the functional area with the highest cost. The results show how, although European countries place improving efficiency as their priority, the vast majority have real problems when it comes to having the necessary methodology and instruments to measure it.

The report presents as an example of evaluation of technical efficiency the management of the demand of acute pathology, which requires evaluating three moments of the process: before hospitalization, during the stay and after discharge, expanding the spectrum of the analysis to other areas such as primary care and social health care.

The OECD report insists on the same recommendation to broaden the spectrum when looking at the overuse of hospitals. This is exemplified by the excessive use of emergency services in mild pathologies and the excessive use of emergency and hospital services in chronic pathologies, both of which can be better managed in other devices. It also illustrates this with different examples of how certain OECD countries have made these changes.

The recommendations that emerged after reading the OECD report are:

1. It’s essential to have more homogeneous instruments for measuring and evaluating the efficiency of health systems that serve to guide decision-making.

2. It’s dangerous to make decisions based on comparisons and benchmarks with outputs/outcomes that are not well validated or contextualized.

3. When analyzing efficiency, as opposed to the concept of cost control, it's essential to broaden the spectrum of analysis to all services that address the care process. This formula also allows crossing the border between technical and assigned efficiency.

It seems, therefore, that the measure of efficiency is still at a very early stage. Improving the information that supports efficiency measurement is essential to support change. On the one hand, it will avoid inappropriate policies, on the other, it favours the evaluation of services with greater precision. Also, finally, it will promote the awareness of the population about what it means to obtain appropriate care, a necessary aspect in our country.

Bibliography

1. EU. Report by the Expert Group on Health System Performance Assessment. TOOLS AND METHODOLOGIES TO ASSESS THE EFFICIENCY OF HEALTH CARE SERVICES IN EUROPE. 2019

2. OCDE. Tackling wasteful spending on health. 2017.

Pedal and ask

Joan Escarrabill

On November 18, 2019, the so-called Experience Exchange Space (EIE), a living lab, was inaugurated at the Hospital Clinic. Setting dates of notable events allows build ephemeris or, at the least, landmarks. They say that on November 18 William Tell shoot the apple from his son’s head (1307), on November 18 Mickey Mouse was also seen for the first time (1928) and it’s also the day of the year in which Niels Bohr died (1885-1962). Naturally, the inauguration of the EIE will not be part of any general reference, but it’s an important point in the approach to evaluating (and taking into account) the experience of patients in our Hospital. 

For an integrated primary care network

When we think of primary care, we tend to stick to the services provided in health centres, but too often we forget that luckily, other actors work in the territory, such as continuous and urgent care devices, community-based services, social services, mental health and addiction teams, sexual and reproductive health care services, public health teams, rehabilitation providers, palliative care teams, and others that may specifically exist in some places.