KEEP THIS TO 1-3 – PAGES LONG (EXCLUDING REFERENCE PAGE)
Author: Sara Baase
Date of Publication: 2008
Book: A Gift of Fire
Sections read: Chapter 8: Errors, Failures, and Risk
1. (Knowledge)Tell three interesting elements of this chapter:
a. A big reason for the problems with the elections of 2000 was that many of the names who voted in Florida had the same names as convicted felons, therefore a recount was in order (Baase, 409).
b. Devices such as Blackberries and portable gaming systems case repetitive strain injury, which is a pain in the joint area (typically by the hand) which can be very crippling (Baase, 411).
c. “Fly-by-wire” planes make it so that pilots indirectly tell the plane where to go by inputting commands; they don’t like this, as there is a lack of familiarity and it feels as if the plane has a “mind of its own” (Baase, 422)
2. (Comprehension) Summarize what is being discussed within this chapter?
With technology, it is hard to have a system that is completely error proof. However, this can also lead to devastating effects. From things such as billing errors (A woman being charged 6.3 million dollars instead of $63 for her electric bill) (Baase, 407), to an error election where a recount is needed as names match up with those of convicted felons, errors in technology have a clear and sometimes threatening effect (Baase, 409). The factors that cause this are a large population, automated processing without human common sense, overconfidence in the accuracy of the data, errors in data entry, the failure to update and correct errors, and a lack of accountability for errors (Baase, 410). Repetitive strain injury is caused by mini-keyboards and buttons on small devices, and while companies are trying to make these devices less straining on people, it is still up to the person to use the technology reasonably (Baase, 412). Even errors such as weather data not appearing can do something as extreme as ground every airplane and cancelling flights (Baase, 413). Voting on electronic terminals comes with its own issues; one county lost 4,000 votes because the system’s memory was full, and one county in Texas gained 100,000 votes out of the blue. Another concern is whether or not one can hack these terminals or not (Baase, 416). Many systems are abandoned, such as a supply management system a British food retailer invested $500 million into. Robert Charette estimates that 5-15% of these projects are scrapped for their inadequacy, which can be quite costly (Baase, 419). A legacy system is an out-of-date system still in use while fitted to work with modern systems – an example is the 3x5 card used by airlines to mark a reservation. Of course, older software fails more often, uses older computer language, and is hard to find replacement parts for. Companies keep legacy systems due to cost issues, the learning curve of new technology doesn’t apply, and the transfer of info to the new system may be disruptive (Baase, 420). “Fly-by-wire” planes, where the pilot inputted commands for the plane to follow, resulted in four crashers, as there was a lack of familiarity with pilots, as well as errors by the plane itself (In one case, the plane wouldn’t let the pilot break as he dismounted, as it didn’t know that he had dismounted) (Baase, 422). While there’s criticism, since new technology, there have been 76% more trades in the stock market and air travel accidents have decreased 60% from ten years earlier. It is also hard to tell if the technology itself is causing problems, or human skepticism of technology itself is also to blame (Baase, 424). Therac-25 is a radiation therapy machine that has accounted for massive overdoses and 6 deaths between 1985 and 1987. While only 100-200 rads were supposed to be administered, patients got between 13,000 and 25,000 (Baase, 425). A big issue with its hardware was that it eliminated hardware safety features, and because of this it frequently malfunctioned and underdosed, error messages were so common they were ignored, and not even the manual explained the strange error messages (Baase, 426). The Set-Up period was supposed to read a zero reading from the device to start it up, though it didn’t matter anyways, as after 256 nonzeros, the machine would incorrectly read zero anyways. Only some parts of the machine understood human edits, where the other parts never acknowledged them (Baase, 427). Errors in technology have an impact in our lives, whether it simply results in a silly typo or a machine that overdoses with radiation.
3. (Application)Name a specific example or NEW solution for this type of problem/similar situation in society or that you have experienced – BE SPECIFIC AND EXPLAIN?
A similar situation I run into is with the GPS (and other location-based services) in my phone. For the most part, it runs smoothly, can help me get to point A to B painlessly and is fast. However every now and then it won’t load correctly (or at all), it will give me an overly painful and incorrect route to get where I want to go, and sometimes it won’t even correctly tell me where I currently am (at one time it told me I was somewhere in the nation’s capital). While this doesn’t hinder me much, I can easily see how it can be devastating to someone planning a cruise on it or trying to find somebody’s house.
4. (Analysis)Address ANY that apply. How can you compare one of the situations in this chapter to something that does not relate to computers, technology, or the Internet? Be sure to reference the chapter and your solution. What ideas NEW can you add to the issue that is being presented within the reading? Try to connect what you have by reading this article and how it applies to the stages in Bloom's taxonomy in 2 full sentences.
One thing that strikes me is that while the blame is put on technology, human error also plays a part, as it does in almost every scenario. Regarding the Therac-25 scenario, technicians ignored “error” messages simply because they always showed up, and in another scenario technicians overdosed their patients simply because they mistook curies and millicuries (levels of radiation dosage) (Baase, 429). Human error also shows itself, as with technology that does not work correctly, it must take a human that did not put enough effort in the program to ensure everything worked, even including something as simple as making sure information in the credit bureau is correct and up-to-date (Baase, 408). We can wag our fingers at technology all we’d like, but the fact of the matter is that there will always be someone who did not test the technology as well as they could have, which can amount for the errors in technology.
5. (Synthesis) Address all that apply. Do you agree with what is being said within the article (Why/Why not? Back up with FACTS)? What new conclusions can you draw about this (or other topics) after reading this material?
I agree with the fact that technology can bring devastating errors, some as serious as crashing a plane because something is not being inputted correctly, and some can even bankrupt businesses (Such as the Warehouse Manager program mentioned on page 414 which gave false prices and in actuality made everything much slower). I have concluded that as painful and time-consuming as it may be, we must do our very best to make sure absolutely every kink is worked out in technology, as some people rely on this technology with their lives. We must not become overconfident in the success of the technology and always make sure everything is working perfectly, as this will severely lower the error ratio that we are used to seeing.
6. (Evaluation) Address all that apply. Judge whether or not this topic is relevant in today’s society? Evaluate why you are viewing the topic in this manner based on your experiences. What ethical evaluations (see Chap1-1.4 for exp of Ethics) or decisions were made/can be assumed from this chapter? What new ideas will you make after reading this chapter?
While it is a very relevant issue in today’s society, I am hopeful that as time goes on and technology becomes more sophisticated that it won’t be as much of an issue (though that doesn’t mean we shouldn’t continue to second-guess the technology for safety’s sake). With technology that dictate whether we live or not (such as those pertaining to radiation therapy), we must always check every system as much as possible and make sure it is working correctly, as if we don’t it doesn’t seem much better than human experimentation due to negligence. There will always be errors, regarding technology as well as everything else, but we should still do everything we can to make as little errors as possible.
Therac-25
One resource on the web that I found particularly useful detailed exactly everything that happened in the Therac-25 situation. It details how the machine works, it’s problems, why they happened, as well as detailed accounts of the victims. It seems that a lot of the problems Therac-25 is so popular for stem from the fact that AECL went ahead and made the software do everything whereas it only regulated some functions in earlier models. Making it more user-friendly, eventually led to many of the problems that occurred with it (Especially in the case where the operator only pressed the up arrow and enter to change the mode, and continued to do so when an “Error-54” message showed up). It’s also interesting to see how AECL flat out ignored the issue until the FDA began to investigate them; before the fifth incident, their excuses would range from an electrical issue in the facility to it simply being “impossible” that it would malfunction. Even when they attempted to make it safer, they didn’t know what made it unsafe in the first place. More information on Therac-25 can be found at http://users.csc.calpoly.edu/~jdalbey/SWE/Papers/THERAC25.html
References
Baase, Sara. "Chapter 8: Errors, Failures, and Risk." A Gift of Fire: Social, Legal, and Ethical Issues in Computing. Upper Saddle River, NJ: Prentice Hall, 2008. Print.
Porrello, Anne. "Death and Denial: The Failure of the THERAC-25, A Medical Linear Accelerator." Cal Poly - Computer Science and Software Engineering. Web. 19 Nov. 2011.