Skip to content

24/7 dementia helpline 800-272-3900

Dementia Today

Flaw in Alzheimer’s drug trial test

Dementia TodayPublished December 16, 20123 min read

Key points

  • New research led by Plymouth University Peninsula Schools of Medicine and Dentistry suggests that the cognitive test used in Alzheimer’s drug trials is flawed.
  • The studies show that the ADAS Cog is not subtle enough to properly track changes in the early stages of Alzheimer’s.
  • In the second study, the research team moved on to use the modern method of “Rasch analysis” to further test the data.
  • He said: “It is impossible to say precisely the extent to which the ADAS Cog’s flaws have undermined the numerous clinical trials in which it has been used.

New research led by Plymouth University Peninsula Schools of Medicine and Dentistry suggests that the cognitive test used in Alzheimer’s drug trials is flawed.

The current standard cognitive test for the disease is the ADAS Cog. The new research, published as two studies in Alzheimer’s & Dementia: The Journal of the Alzheimer’s Association, investigates the role of the test and questions its effectiveness.

The studies show that the ADAS Cog is not subtle enough to properly track changes in the early stages of Alzheimer’s. This is important because data from this key stage is required to show whether or not a new drug is working. The study also showed that the modern method of “Rasch analysis” confirmed the flaw.

In their first study, the researchers examined 675 measurements from people, aged 53 to 90, with mild Alzheimer’s disease across five time points – 0, six, 12, 18 and 24 months. In terms of final patient score the ADAS-cog seemed sound. But by breaking down all the data to component level, a different story emerged. A “ceiling effect” was exposed for eight out of the 11 parts of the ADAS-cog with many patients – ranging from 32 to 83 per cent – “passing” the section when in reality much greater variance between the patients almost certainly existed and needed scoring.

In the second study, the research team moved on to use the modern method of “Rasch analysis” to further test the data. This confirmed the flaw. The more sophisticated method of analysis also suggested a number of possible pathways to improvement including making parts of the ADAS-cog test more difficult as well as re-thinking the scoring structure.

As a consequence, the Plymouth-based research team is suggesting urgent changes to the ADAS Cog – and is not ruling out the need for a new test.

The study was led by Professor Jeremy Hobart. He said: “It is impossible to say precisely the extent to which the ADAS Cog’s flaws have undermined the numerous clinical trials in which it has been used. It has been used, unchanged, for many years and its apparent contribution to suboptimal trials has led a number of drug companies to rethink their strategies. However, it is very clear that in its current form the ADAS Cog underestimates cognitive differences between people and changes over time. To determine if treatments, developed from painstaking years of research, work in expensive studies we need to invest in developing measurement instruments that are fit for purpose. This requires the routine use of different methods. In its current form, the ADAS Cog is not working in people with mild Alzheimer’s disease.”

###

Notes to Editors

The Alzheimer’s Disease Assessment Scale Cognitive Behaviour Section (ADAS Cog) was developed in the 1980s. It has 11 component parts including memory tests, language skills, naming objects and responding to commands. Patients get a score for each section resulting in a single overall figure. A low total score signals better cognitive performance.

The exposure of the limitations of the ADAS Cog comes as leading pharmaceutical companies are widely reported to be rethinking their strategy over new Alzheimer’s treatments. For example: Pfizer and Johnson & Johnson halted the development of the drug Bapineuzumab after it did not work in clinical trials using the ADAS Cog; and Eli Lilly said its Alzheimer’s drug solanezumab “failed in its main goal of halting progress of the disease” – the trials had used the ADAS Cog.

Alzheimer’s disease is the most common form of dementia, affecting some 27 million people worldwide with incidence rates expected to quadruple by 2050.

###

Andrew Gould
andrew.gould@pcmd.ac.uk
44-188-438-346
University of Plymouth

The content on this site is for information only and is not a substitute for professional medical advice, diagnosis or treatment. If a person with dementia is missing, injured or in danger, call 911 or your local emergency number.

Filed underDementia News

Worried about memory changes?

Normal aging, or an early warning sign?

Ten common changes, each set beside what is typical with age. Tick what you have noticed and see what to do next.

Open the 10-sign checklist

Getting help

Sudden changes are not just the dementia.

Dementia usually changes slowly. A sharp change over hours or days can mean an infection, delirium, a stroke or a medication problem, and needs a doctor the same day. Call 911 or your local emergency number if you see any of these:

  • Confusion that comes on suddenly, over hours or days
  • Face drooping, arm weakness or slurred speech
  • A fall, a head injury or new severe pain
  • Very drowsy or hard to wake

The free Alzheimer’s Association Helpline answers questions about memory loss, diagnosis and caregiving, day and night, in more than 200 languages (US).

If someone with dementia is missing

  1. STEP 115 minSearch close by firstCheck the house, garden, car and the places the person often walks to. Don’t spend longer than about 15 minutes.
  2. STEP 2911Then call for helpTell the operator the person has dementia and is a vulnerable adult. Police treat this as urgent.
  3. STEP 3PhotoHave details readyA recent photo, what they were wearing, medical conditions and places they used to live or work.

Based on Alzheimer’s Association guidance on wandering. Outside the US, call your local emergency number.