“To err is human, but to really mess things up takes a computer,” runs a modern version of the old Pope proverb.
The notion surfaced at a recent conference in Toronto, where speaker after speaker graphically described just how messy things get when IT fails.
The session was organized by Toronto-based improve-it-institute.org, dedicated to enhancing the effectiveness of health care IT through measurement and evaluation. The focus on failures represented neither an exercise in recrimination nor a communal washing of dirty laundry.
Its purpose was articulated by Dr.Tom Rosenal, Medical Director, Electronic Health Record, Calgary Health Region (CHR).
“In some ways,” said Dr. Rosenal, “milking failure for all it’s worth can be more useful than basking in success.” With 22,000 staff, including 2,200 physicians, the Calgary Health Region is the largest employer in southern Alberta. It has four acute care sites, 17 community health centres and three administration sites. Long-term care is provided at 18 facilities operated by the Region.
As an example of how past failures can become springboards for future success, Rosenal cited the rollout of TDS-7000, a patient care system that was deployed several years ago at a couple of CHR sites.
A prominent trade journal on clinical systems reportedly dubbed the project one of the two worst IT implementations in the world – along with the ambulance system in London, England.
“We did several things badly,” said Rosenal.
The first mistake, he said, was implementing Order Entry before everything else – as lab results had to be tied to an order. “So two years before users saw a lab result or an x-ray report, they were putting in orders.” In addition, he said, the user interface was uninviting. “The screens were black and white, the letters all upper case – so they screamed at you – and it was very difficult to launch the system.” Despite these obvious issues, any criticism of the system was not well received at the time.
One resident who spoke up, Rosenal said, was asked whether he intended to continue his residency. “It wasn’t the fault of the people who really gave their lives to the system. The technology was old, and the degree of engagement by the community was low.”
Though clearly a painful experience, said Rosenal, the TDS-7000 implementation eventually set CHR up for where it is going now.
For one thing, he said, physicians at the two hospitals where TDS-7000 was implemented now have a definite idea of what they need and expect in an IT system. “If you ask them that, they will give you a clear and specific answer.” The experience, he said, has not only created a knowledgeable group but an engaged group as well. CHR, he said, now has a Clinical Design Committee of 32 people, including 11 physicians. “We actually have problems keeping people off the committee.”
Rosenal said the biggest IT project challenges are usually not technology-related. “Of course you need to balance the value of an integrated system versus best-of-breed; of course you need to focus on features like stability, redundancy, performance, and security. But the biggest issues are above the technology line.”
He said a key lesson from TDS-7000 is that the toughest challenges are people-related. The pain from the project, he said, has driven several positive changes from a technology and people perspective. “We understand our culture better, as well as the power shifts that have occurred as we’ve implemented systems. Maintaining a sense of humour has also been a key factor in all our efforts.”
Taking measure
According to Rosenal, while learning from failure is great, pre-empting and preventing it is even better – and that requires clear metrics to measure the progress of projects.
At one time, he said, informatics personnel at CHR were “too busy doing stuff to formally measure any of its impact.”
That’s now changed – noticeably.
According to Rosenal, in any IT project, how you measure is as important as what you measure.
He said different aspects of a project should be reviewed using different methods to avoid a skewed picture.
In another presentation at the conference, Alex Jadad, Director, Centre for Global eHealth Innovation, University Health Network said Canada should learn from other countries’ failures – not repeat them.
He said he has worked in health care informatics in Columbia, England, the U.S. and Canada – and the problems in each country are the same. “In Canada, there seems to be a 5-10 year lag before we repeat the same mistakes as the U.S,” said Jadad.
He said very few health care discussions here have to do with what kind of system the next generation expects and deserves, but they are rather all about decreasing wait times and securing more health professionals.
“We’re keeping our eye on the ball, not on the game,” said Jadad, “and that’s the road to bankruptcy.”
