Full Terms & Conditions of access and use can be found at
http://www.tandfonline.com/action/journalInformation?journalCode=vjeb20
Journal of Education for Business
ISSN: 0883-2323 (Print) 1940-3356 (Online) Journal homepage: http://www.tandfonline.com/loi/vjeb20
Real-Time Case Method: Analysis of a Second
Implementation
James M. Theroux
To cite this article: James M. Theroux (2009) Real-Time Case Method: Analysis of a Second Implementation, Journal of Education for Business, 84:6, 367-373, DOI: 10.3200/ JOEB.84.6.367-373
To link to this article: http://dx.doi.org/10.3200/JOEB.84.6.367-373
Published online: 07 Aug 2010.
Submit your article to this journal
Article views: 26
View related articles
he traditional case method can beclassifiedasatypeofexperi-ential learning because students treat the problem in the case as if it were realandimmediate,eventhoughevents in the case occurred many months or yearsinthepast.Untiltheemergence of the Internet, there was no practical way for cases to actually be real and immediate.TheInternetmakesinstan-taneous distribution of cases possible, and offers the potential for their cre-ation in real time. The present article describesanattempttousetheInternet to bring business reality to business courses, and to facilitate communica-tion among instructors, students, and the case company. My goal was to stimulate a dialogue about how the Internet can be used to move current teaching methods forward—especially the case method—because it is so prominentinschoolsofbusiness.
Educators over the past 50 years have introduced many learning models
for business characterized as
experi-ential learning. They shared the pur-pose of increasing motivation through interactivity(Swift&Kent,1999).Cases provide a proxy for the most direct form of experiential learning: intern- ships(Shulman,1992).Recentdevelop-ments in experiential learning include simulations(Antepohl&Herzig,1999), games (Saunders, 1997), living cases (Andrews & Noel, 1986), team
learn-ing(Harrison-Walker,2000),andaction learning (Cribbs, 2000). These efforts represent the search for more compel-linginstructionalmethods.
To affect management education, any pedagogical innovation must pass the following tests: (a) Students must like it; (b) faculty must find it worth theswitchingcost;and(c)theinnova-tionmustbeeconomicalandpractical to produce. It is interesting that the adoption of one pedagogical method over another is not based on evidence ofefficacy(Shulman,1992).Thepur-poseofthepresentarticlewastoreport onstudentsatisfactionduringthesec-ond implementation of an innovation
inexperientiallearningcalledthe
real-time case (RTC)study. Theroux and Kilbane (2004) evaluated student sat- isfactionwithRTCforthefirstimple-mentationoftheconcept.Kilbaneetal. (2004)assessedthefacultyexperience, and in my previous work (Theroux, 2007), I researched the feasibility and coststoproduceanRTCstudy.
TheSloanFoundation,theKauffman Foundation, and the Coleman Founda-tion facilitated the initial launch of an RTCstudyin2001asaninnovationin thecasemethodandexperientiallearn-ing,withmyselfasprojectdirector.The financialsupporters’goalwastostretch
thedefinitionofcasestudy
andtomod-ernize it. The subject company for the first production of an RTC study was
Real-TimeCaseMethod:Analysisofa
SecondImplementation
JAMESM.THEROUX
UNIVERSITYOFMASSACHUSETTSAMHERST AMHERST,MASSACHUSETTS
T
ABSTRACT.In2005,M.HopkinsandJ. Therouximplementedthesecondexample ofanexperimentalcasestudy,at11business schoolsintheUnitedStatesandCanada. Thenewtypeofcasestudy,namedthe real-timecase(RTC)study,usestheInternetto bringbusinessrealitytobusinesscourses andtofacilitatecommunicationamong faculty,students,andthecasecompany. Inthepresentstudy,datafromstudent surveysprovidedanassessmentofRTC. Theauthor’sanalysissuggeststhattheRTC conceptengagesandsatisfiesstudentsata higherlevelthandoaveragecoursesand presentsamorerealisticandintegratedview ofbusinessdecisionmaking.However,the levelofsatisfactiondeclinedincomparison withthefirstiterationofRTCin2001(S. House&J.Theroux).Inthepresentstudy, theauthorpresentsstudentfeedbackto explainthedifference.
Keywords:activelearning,casestudy, pedagogy
Copyright©2009HeldrefPublications
Optasite,Inc.,ofWorcester,Massachu-setts1(House&Theroux,2001).
AnRTC study is a series of weekly casestudiesfocusingonasinglecom-pany.Thecaseinstallmentsarewritten anddistributedtostudentsastheevents being described are unfolding in real time. Each weekly case focuses on a problem facing the subject company at that moment and invites students to solveit.Bytheendofasemester,stu-dentshavestudiedthesubjectcompany indepthandhavehadsomedirectcon-tactwiththecompanybywayofaWeb sitededicatedtoRTC.Studentsdonot need to use the company’s Web site; rather, the company uses the Web site dedicated to RTC as well.The follow-ing is an excerpt from the syllabus of a course that was centered on an RTC studythatIcreatedin2001:
As you read this, the managers of a new high-tech company are striving to achievetheentrepreneurialdream.Ona password-protected Web site (realtime- casestudy.com)youwillfollowthatcom-pany,andseeitsprogressweekbyweek. You will be actively engaged with the company, analyzing its problems, and making input.You will be participating, alongwithstudentsfromotheruniversi-ties,inafull-semester,RTCstudy.Unlike traditional case studies, this RTC study willdigdeeplyintoonecompanyduring the entire semester. At this moment, a case writer is stationed full time at the casecompany.Eachweek,thewriterwill provideuswiththeinformationweneed toanalyzeaparticularproblemorques-tionfacedbythecompany.Butourgoal isnotanalysisforitsownsake;instead, we want to go beyond critiquing and make valuable recommendations to the company.Thecompanyiscountingonus toperform,andwewanttodeliver.
Resultsfromthe2001case(Theroux & Kilbane, 2004) were positive: Par-ticipating students and faculty became supporters of the RTC, and the con-ceptgarneredthreenationalawardsfor pedagogical innovation (see Appendix A). The supporters were motivated to produceanewRTCstudyinthefallof 2005. The purpose of the second case was to validate results from the first case, to test scalability by expanding the use of the case from 4 universities to11,andtoimprovethecaseproduc-tion process by implementing lessons learnedfromthe2001case(Hopkins& Theroux,2005).
The subject company for the 2005 case was DAFCA, Inc., of Framing-ham, Massachusetts. DAFCA creates software tools that chip designers use. Thus, DAFCA is part of the highest high-tech industries. Its employees workintheinvisibleworldofthesemi-conductor.Theyareontheforefrontof newproductsandtechnology(Hopkins &Theroux,2005).
ScopeandLimitations
The purpose of the present study was to evaluate the effect of the RTC method(Hopkins&Theroux,2005)on students of the 2005 implementation andtocompareitwiththe2001imple-mentation (House & Theroux, 2001). TheRTCconceptisstillattheexperi-mental stage after just two implemen-tations. Although evaluation data such asthosepresentedinthepresentstudy are important, more evaluation work needstobedone,particularlywithother groups of students and other teachers usingthemethod.Myevaluationshould aid future RTC users, producers, and those who seek to evaluate the meth-od further. The degree to which these resultsgeneralizetootherteachersand settingsisanimportantareaforfurther research. It would have been ideal to useexperimentaldesignsthatrandomly assign students to RTC and non-RTC groupstobestevaluatethemethod,but suchdesignswerehardtoimplementin auniversitysetting.
METHOD
My main goal in evaluating RTC was to validate what I and the other researcherslearnedinthe2001inaugu-ralimplementation(House&Theroux, 2001).Inparticular,wewantedtocon-firm that students (a) found the RTC concept engaging and interesting, (b) perceived it had value for themselves and for others, and (c) believed that the RTC enabled some type of learn-ing not offered by conventional cases, including a more realistic understand-ingofbusinessandanappreciationfor thecomplexnatureofbusinessdecision making. I discuss the methodological issuesincarryingouttheevaluationof theseobjectives.
Participants
Because all RTC material is distrib-uted on a Web site, there is no limit to the number of schools that could study the case.The number of schools in 2005 was 11, including 1 in Puerto Ricoand1inCanada(foralistofpar-ticipatinginstitutions,seeAppendixB). Schools were self-selected in response toanopeninvitationthatImadeattwo academicmeetings.Ididnotrejectany school’s request for inclusion in the presentstudy.
InstrumentDevelopment
I developed a postimplementation survey with items to assess the three mainaforementionedobjectives,several questionsaboutspecificaspectsofRTC study (e.g., its depth and its real-time nature),andseveralopen-endedprobes. Toallowcomparisonsbetweenthefirst and second implementations of RTC study, the questions related to the two were the same. The survey contained (a) 14 selected-response items using a 5-point Likert-type scale ranging from 1 (strongly disagree) to 5 (strongly agree) and (b) 4 open-response items. I designed the questions to measure thedegreetowhichRTCstudyaccom-plished its specific pedagogical objec-tivesandtoinquireaboutthestudents’ impressionsofhowmuchtheyenjoyed andlearnedfromtheRTCexperience.I developedtheoriginalquestionsincon-junction with a panel of three experts ineducationaltestandsurveydevelop-mentattheUniversityofMassachusetts School of Education. I pretested the instrument by presenting the questions toagroupoffivegraduatestudentswho werenotincludedinthestudy.Iqueried thestudentsabouttheclarityandmean-ingfulness of the questions and made slightrevisionstoimprovetheclarityof
someitems.2
DataCollection
To discover students’ perceptions of theirexperiencewithRTC,eachpartici-pating professor administered a paper surveyattheendofthe14-weekexpe-riencewiththeRTCstudy.In2005,the survey included (a) all the questions asked in 2001 and (b) several others
relatingtothecostoftheRTCmaterials andthedegreeofdifficultyinusingthe onlinetechnology.
Ofthe245studentswhoparticipated in the case study, 167 students filled out the survey instrument (68%). This return rate exceeded the rate in 2001, whenprofessorsaskedtheirstudentsto fill out an online survey in their spare time(50%).In2005,allstudentsattend- ingclassonthedayofthesurveycom-pleteditinclass.Ihadnocontrolover theadministrationofthesurveysexcept inmyclassroom.Oneclasswasonline only (no face-to-face interaction), and itsstudentsfilledoutthesurveyonline. Allresponseswereanonymous.
RESULTS
A summary of data obtained from students is presented in the following figures. Students responded to state-ments on a continuum ranging from strongly disagree (SD) to strongly agree(SA).
Figures 1 and 2 indicate that the majority of students felt that RTC study was more realistic as a learning experienceandasaperspectiveonthe business world. In all, 80% (134) of studentssawthecaseasamorerealis-ticlearningexperiencethantraditional business courses, and 71% (119) felt it presented a more realistic view of the business world. Thus, RTC study appears to have strongly delivered a realismfactortostudents.
Whenevaluatedasatoolforteaching entrepreneurship, RTC study received high scores. In all, 84% (140) of stu-dents surveyed saw RTC study as an effective way to learn about entrepre-neurship(seeFigure3),and81%(135) would recommend using RTC study for future entrepreneurial courses (see Figure4).
Students’enjoymentlevelsweregen-erally high. In all, 81% (135) would recommendthecoursetoafriend(see Figure 5). In addition, 50% (84) of studentsenjoyedRTCmorethanother business courses, whereas 30% (50) wereunsure(seeFigure6).
The majority of students surveyed preferred RTC to traditional business courses. Moreover, 57% (95) would not choose a traditional course over
RTC study (see Figure 7), and 56% (94)didnotprefertraditionalcourses overRTCstudy(seeFigure8).There is some ambiguity with the 32–34% (55) who were unsure which type of course they would prefer. However, thepercentageofstudentswhowould choose traditional courses over RTC study was low, 10% (17) for both
questions comparing RTC study with traditionalbusinesscourses.
When comparing RTC study with a historicalcasestudy,67%(112)ofthe students indicated they would prefer RTC to a historical case (see Figure 9).Reasonsforthisareincludedinthe discussionofopen-endedquestions.In all, 23% (38) were unsure which they
60
Notsure Agree 16
Notsure Agree 21
Notsure Agree 10
wouldprefer.Itisunclearwhetherthis was because of (a) no prior exposure to historical cases or (b) no strong feelings toward either type of case. The results that indicated the value students assigned to the course was mixed(seeFigure10).Moreover,30% (50) felt that they would consider it the most valuable course ever taken, whereas22%(37)disagreed,and48% (80)werenotsure.
Student reaction to the Web-site technology that I used in the case was mixed but largely positive. In addition, 64% (107) did not feel that there were too many technical difficulties in using the case, whereas 26% (43) did see too many technical difficulties (see Figure 11).Iincludedthequestioninthesurvey because there were so many technical dimensionstousingthecase:onlinechat, online video, phone conferencing, and video conferencing. Unfortunately, the students who found too many technical difficultiesdidnotelaborateonorexplain thisviewintheopen-endedquestions.In all, 54% (90) did not see the course as disorganized when compared with other courses, whereas 31% (52) did consider RTCdisorganized(seeFigure12).
StudentResponsestoOpen-EndedQuestions
Amongresponsestoanopen-ended question regarding what could be improvedinthecasewereseveralindi-cating that students felt a strong con-nectiontothecasecompany(DAFCA, Inc.)andthattheywantedmoredirect communication with the company. Thisrequestformorecommunication wasnotvoicedinthe2001case(Opta-site, Inc.; Theroux & Kilbane, 2004). The absolute level of student–com-panycommunicationwasmuchhigher in 2001, and I explain that difference in the Discussion section. A conse-quenceofthestudents’interestinthe case company (DAFCA) was signifi-cant student frustration with some of the company’s business decisions and frustrationwiththecompany’slackof responsiveness to them. This frustra-tion, though it could be viewed as a negative, indicated a level of engage-ment not typically seen with tradi-tional cases. Students indicated that
they wanted more direct communica-tionwithDAFCA,wantedtointerview DAFCA executives, and wanted more feedbackfromthecompany.
Inresponsetoanopen-endedquestion aboutwhatmakesRTCstudymorecom-pelling than a conventional case study, studentsmadethefollowingcomments: if you work hard enough, you can helpchangetheoutcome.Itisfunto think that the recommendations we makecouldhelpDAFCAsucceed.” 2.“[Therewasa]senseof‘power’from
being given the chance to ‘consult’ foracompanyandbeingpartofthe historyofthecompany.”
3.“Youfeelasthoughyourworkmat-ters for something besides a letter
60
Notsure Agree 16
Notsure Agree 10
Notsure Agree 30
grade. There’s incentive to produce betterqualitywork.”
4.“Often, classes may not seem very applicabletoreallife.Thisclassreal-lyshowedushowtoapplytopicsin therealbusinessenvironment.”
In response to an open-ended ques-tion about what would improve RTC, there was an overwhelming indication from students that they wanted more communicationandinteractionbetween
andamongschools.Thesefeelingswere notexpressedin2001.Manyofthe2005 students suggested ways to facilitate this interaction. Suggestions included more videoconferences or conference calls, teams comprising students from various schools, and feedback among schoolsonteamsubmissions.
In response to an open-ended ques-tionaboutwhattheydislikedaboutthe case,somestudentsfeltthecoursewas toostrenuousanddislikedfocusingon
one company for an entire semester. Otherstudentswantedthecasetomove at a faster pace. Some representative studentcommentsfollow:
1.“You can only get a short snapshot of the company during a semester, since not a lot happens and recom-mendations made won’t be noticed formonthsoryearstocome.”
2.“Choosingacompanythatisn’tfast- paceddoesn’tutilizeRTCtoitsfull-est effect. Perhaps a company with fastturnaroundwouldmakeformore interestingcases.”
3.“Theentireclasswasbasedonpre-diction: What might or could hap-pen?Iwouldhavelikedtohaveseen moreaction.”
A majority of students disliked the technical nature of the company and foundtheeffortrequiredtounderstand DAFCA’s industry (semiconductor design) to be burdensome. Neverthe-less,approximately20%ofthestudents were intrigued and challenged by the high-tech nature of the case. Student sentiment can best be characterized by thefollowingcomments:
1.“There is a big learning curve. It took me a while to get to the point where I could understand elec-tronic design automations and what DAFCAdoes.”
2.“Youneedtoknowabouttheindustry to learn the company’s background, whichisverydifficult.”
3.“There was way too much back-groundinformationthatmustbegone overjusttohaveanideaofwhatthe casesaretalkingabout....Abusi-ness type that is more familiar to studentswouldprovideaneasiertime linkingideasandpractices.”
Inadditiontodifferencesofopinion among students in 2005, there were some broad, consistent similarities in the responses students gave after 2001 and 2005. These similarities included the following: (a) Students liked the realistic, real-world feel of RTC; (b) students noted that in a complex real-life case there was no right answer. Inaccordance,theprofessor’srolewas changed to one of coparticipant and coach.Studentsalsolikedthis.
Notsure Agree 32
Notsure Agree 34
Notsure Agree 23
StudentRecommendations Students provided a broad range of recommendations, and the following werethemostcommon:
1.“Use an industry that is easier to understand so not as much time needs to be spent on learning the technology.”
2.“Runthecaseforanentireyearso students can follow the company
foralongerperiodoftime.” 3.“Update students on DAFCA’s
reac-tion to their suggestions.Are any of therecommendationsimplementedat thecompany?”
4.“Provide students with a follow-up caseorupdatethesemesterafterthe
Because this was the second imple- mentationoftheRTCconcept,itisinter-esting to look at how student responses variedbetweenthetwoimplementations. I interpret those differences in the Dis-cussion.First,Ifocusonthecomparison data. In 2005, fewer students (50% vs. 84%) found the course more enjoyable than they did other courses they had taken. A much lower percentage (24% vs. 45%) of students in 2005 named RTCtheirfavoritecourse.In2005versus 2001,amuchlowerpercentage(24%vs. 45%)ofstudentsfeltRTCwasthemost memorable or valuable course they had taken.Slightlyfewerstudentsfrom2005 (79% vs. 91%) would recommend the course than would students from 2001, although the response for both imple-mentationswaspositive.
DISCUSSION
The 2005 data indicate that RTC achieved its stated goals of creating a coursethatis(a)engaging,(b)valuable
Although the 2005 case received posi-tiveratings,thoseratingsweresignificantly lowerthanthosefromthe2001case.What couldexplainthis?Althoughthestudents in2005appreciatedRTCfeaturessuchas immediacy,realism,anddepthofinforma-tion, they were troubled in the following twoareas:(a)theburdenofdigestingthe technologyunderlyingthecasecompany’s businessand(b)thelackoftwo-waycom-municationwiththecasecompany.
Regardingtheinscrutabilityofthecase company’s work and products, student feedback indicates that future case pro-ducers should avoid such types of com-pany.Perhapscertainstudentsintechnical fieldsmightbereadyandwillingtotake on such a challenge, but for the average studentitisnotworththeeffort.
Regarding the lack of two-way communicationwiththecasecompany thatthestudentsfelt,thiswasaproblem in 2005 but not in 2001. The RTC concept was designed to deliver two-waycommunication.Thiswaspromised
Notsure Agree 13
Notsure Agree 11
Notsure Agree 48
to students in both implementations, butdeliveredtoalargedegreein2001, versusasmalldegreein2005.Ibelieve thatthiswasamajorfactorinreducing student satisfaction in 2005. The problemin2005wasahumanonethat caused the CEO of the case company toreducehislevelofengagementwith thecaseproductionteam.Thesituation was not bad enough to prevent the writingoftheweeklycases,butitlead to a reduction in the planned RTC practices of weekly online chats with company managers, monthly video conferences, and regular feedback to studentrecommendations.
Theproblemwiththe2005CEOhigh-lights how critical it is to have the full cooperationofthecasecompany.Ihave ideas on how to increase the odds of thiscooperationinfuturecases,including a written agreement outlining responsi-bilities and commitments of each party. I invite readers to discuss this and other topicsrelatedtothecreationofRTCsand to read the economics and the practical
challenges of producing an RTC (Ther-oux,2007).
NOTES
1. A description of what an RTC study looks like and how it works is available at http://intra. som.umass.edu/theroux(Website).
2. AcopyofthesurveyisavailablefromJames M.Therouxonrequest.
JamesM.TherouxistheFlavinProfessorof EntrepreneurshipatUniversityofMassachusetts Amherst. He specializes in bringing business reality to the classroom. His research focuses on the evaluation of pedagogical innovation for businesseducation.
Correspondence concerning this article should beaddressedtoJamesM.Theroux,theUniversity ofMassachusettsAmherst,SchoolofManagement, 121PresidentsDrive,Amherst,MA01003,USA.
E-mail:theroux@som.umass.edu
REFERENCES
Andrews, E., & Noel, J. (1986). Adding life to the case method.Training and Development Journal,40(2),28–29.
Antepohl, W., & Herzig, S. (1999). Problem-basedlearningversuslecture-basedlearning:A controlled, randomized study.Medical Educa-tion,33,106–113.
Cribbs, G. (2000, May 29). Back in fashion yet again:Actionlearning.FinancialTimes,p.14. Harrison-Walker, L. (2000). A comprehensive
pedagogyforteam-basedcaseanalysis.Journal ofEducationforBusiness,75,241–245. Hopkins, M., & Theroux, J. (2005).DAFCA:
A real-time case study. Retrieved December 11, 2005, from University of Massachusetts Amherst, School of Management Web site: http://spark.oit.umass.edu
House,S.,&Theroux,J.(2001).Optasite: Areal-time case study. Retrieved December 12, 2001, from University of Massachusetts Amherst, School of Management Web site: http://spark. oit.umass.edu
Kilbane, C., Theroux, J., Sulej, J., Bisson, B., Hay,D.,&Boyer,D.(2004).Thereal-timecase method: Description and analysis of the first implementation.InnovativeHigherEducation, 29(2),121–135.
Saunders,P.(1997).Experientiallearning,cases,and simulationsinbusinesscommunication.Business CommunicationQuarterly,60(1),97–114. Shulman, J. (1992).Case methods in teacher
education. NewYork:Teachers College Press, ColumbiaUniversity.
Swift, C., & Kent, R. (1999). Business school internships.JournalofEducationforBusiness,
75,23–26.
Theroux,J.(2007).Whatittakestoinnovate:The experience of producing an online, real-time casestudy.Journal ofAsynchronous Learning Networks,11(4).RetrievedMay5,2009,from http://www.sloan-c.org/node/1047
Theroux, J., & Kilbane, C.(2004). The real-time casemethod:Anewapproachtoanoldtradition.
JournalofEducationforBusiness,79,163–167.
APPENDIXA
NationalRecognitionAwardedtotheReal-TimeCaseConcept
TheU.S.AssociationforBusinessandEntrepreneurship,thelargestorganization ofprofessorsofentrepreneurship,namedthereal-timecasestudyasthePedagogical InnovationoftheYearin2002.
TheSloanConsortium,aleaderinthestudyanddisseminationofbestpracticesin onlineeducation,selectedthereal-timecaseforBestPracticeforStudentSatisfaction in2002.
TheU.S.DistanceLearningAssociationisoneofthethreelargestorganizations focusedonthedevelopmentandimprovementofonlinelearning.In2003,itselected thereal-timecasestudyfortheExcellenceinDistanceTeachingAward.
APPENDIXB
Real-TimeCaseParticipants,bySite
Site Studentprofile Institution
Site1 13MBAstudents ClarkUniversity
Site2 14undergraduateseniorbusinessmajors UniversityofNortheastOklahoma
Site3 14highschooljuniorsandseniors Wilbraham-MunsonAcademy
Site4 15undergraduateengineeringandbusinessmajors LoyolaMarymountUniversity Site5 25undergraduatebusinessandengineeringstudents OlinCollege,BabsonCollege Site6 28MBA,executive,andundergraduatestudents UniversityofMaryHardin-Baylor
Site7 7MBAstudents InterAmericanUniversityofPuertoRico
Site8 26MBAstudents,part-timeandfull-time PennsylvaniaStateUniversity Site9,Section1 40full-timeundergraduatestudents UniversityofMassachusettsAmherst Site9,Section2 13full-timeMBAstudents UniversityofMassachusettsAmherst Site10 34MBAstudents,4wereexecutives UniversityofNewBrunswick,Canada
Site11 16undergraduatebusinessmajors UniversityofTampa