• Tidak ada hasil yang ditemukan

Manajemen | Fakultas Ekonomi Universitas Maritim Raja Ali Haji joeb.83.1.37-44

N/A
N/A
Protected

Academic year: 2017

Membagikan "Manajemen | Fakultas Ekonomi Universitas Maritim Raja Ali Haji joeb.83.1.37-44"

Copied!
9
0
0

Teks penuh

(1)

Journal of Education for Business

ISSN: 0883-2323 (Print) 1940-3356 (Online) Journal homepage: http://www.tandfonline.com/loi/vjeb20

Building Skills in Thinking: Toward a Pedagogy in

Metathinking

Victoria Crittenden & Arch G. Woodside

To cite this article: Victoria Crittenden & Arch G. Woodside (2007) Building Skills in Thinking: Toward a Pedagogy in Metathinking, Journal of Education for Business, 83:1, 37-44, DOI: 10.3200/JOEB.83.1.37-44

To link to this article: http://dx.doi.org/10.3200/JOEB.83.1.37-44

Published online: 07 Aug 2010.

Submit your article to this journal

Article views: 35

View related articles

(2)

he฀ way฀ chief฀ executive฀ officers฀ (CEOs)฀ draw฀ conclusions฀ and฀ make฀decisions฀can฀have฀disastrous฀con-sequences.฀ For฀ example,฀ government฀ CEOs฀ George฀W.฀ Bush฀ (United฀ States),฀ Tony฀ Blair฀ (United฀ Kingdom),฀ John฀฀ Howard฀(Australia),฀and฀additional฀coali-tion฀ country฀ CEOs฀ concluded฀ in฀ early฀ 2003฀ that฀ Iraqi฀ leaders฀ had฀ weapons฀ of฀ mass฀ destruction฀ and฀ were฀ refusing฀ to฀ disarm฀ these฀ weapons.฀ Thus,฀ these฀ government฀CEOs฀made฀the฀decision฀to฀ declare฀war฀on฀Iraq.฀In฀mid-2004฀(more฀ than฀a฀year฀after฀the฀war฀was฀declared฀as฀ officially฀won),฀the฀CEOs฀had฀found฀no฀ weapons฀ of฀ mass฀ destruction,฀ close-to-full-blown฀civil฀war฀was฀raging฀in฀Iraq,฀ and฀world฀terrorism฀had฀increased.฀Amid฀ all฀ of฀ this,฀ the฀ U.S.฀ CEO฀ reported฀ that฀ there฀were฀weapons฀of฀mass฀destruction.

At฀ a฀ more฀ mundane฀ level,฀ consider฀ why฀highly฀successful฀firms฀such฀as฀Pola-roid฀ and฀ Lucent฀ became฀ failures.฀ The฀ cover฀story฀of฀the฀May฀27,฀2002฀issue฀of฀ Fortune ฀magazine฀described฀10฀big฀mis-takes฀ as฀ the฀ primary฀ reasons฀ why฀ com-panies฀fail,฀with฀a฀critical฀mistake฀being฀ that฀ people฀ presume฀ that฀ the฀ future฀ will฀ be฀good฀on฀the฀basis฀of฀historical฀success-es฀ rather฀ than฀ planning฀ for฀ unexpected฀ changes฀(Charan,฀Useem,฀&฀Harrington,฀ 2002).฀Weick฀and฀Sutcliffe฀(2001)฀made฀ the฀same฀observation฀in฀their฀aptly฀titled฀ monograph,฀Managing฀the฀Unexpected.

These฀ examples฀ point฀ out฀ the฀ obvi-ous:฀that฀CEOs,฀middle฀level฀managers,฀

and฀the฀rest฀of฀us฀are฀prone฀to฀drawing฀ inaccurate฀conclusions฀and฀making฀bad฀ decisions.฀ It฀ is฀ unfortunate฀ that฀ such฀ thinking฀ (a)฀ occurs฀ frequently,฀ (b)฀ can฀ be฀ very฀ expensive,฀ (c)฀ often฀ wrecks฀ local฀economies,฀and฀(d)฀can฀cause฀mas-sive฀ layoffs,฀ terror,฀ or฀ even฀ death฀ (for฀ reviews฀on฀this฀point,฀see฀Baron,฀2000;฀ Bazerman,฀1998;฀Gilovich,฀1991).฀Rath-er฀ than฀ shaking฀ our฀ heads฀ or฀ pointing฀ fingers฀at฀someone฀else’s฀bad฀decisions,฀ people฀should฀identify฀tools฀to฀improve฀ the฀ accuracy฀ and฀ quality฀ of฀ decisions฀ (cf.฀Martz฀&฀Shepherd,฀2003).฀In฀other฀ words,฀ what฀ tools฀ will฀ help฀ decision฀ makers฀become฀more฀cognizant฀of฀their฀ decision฀processes฀and฀outcomes?฀With฀ the฀ high฀ frequency฀ and฀ seriousness฀ of฀ bad฀decision฀making,฀the฀creation,฀test-ing,฀ and฀ teaching฀ of฀ tools฀ to฀ improve฀ thinking฀ (i.e.,฀ increasing฀ sensemaking฀ quality฀ in฀ becoming฀ aware,฀ acquiring฀ knowledge,฀interpreting฀data฀and฀infor-mation,฀drawing฀conclusions,฀deciding,฀ and฀ evaluating)฀ are฀ important฀ in฀ the฀ business฀school฀classroom฀(cf.฀Shadish,฀ Cook,฀&฀Levitton,฀1991;฀Weick,฀1995).฀ March฀and฀Olsen฀(1976)฀observed,฀ “Individuals฀ and฀ organizations฀ make฀ sense฀ of฀ their฀ experiences฀ and฀ mod-ify฀ behavior฀ in฀ terms฀ of฀ their฀ inter-pretations”฀ (p.฀ 56).฀ Weick฀ (1995)฀ referred฀ to฀ this฀ as฀sensemaking,฀ and฀ he฀ described฀ sensemaking฀ as฀ “how฀ people฀generate฀that฀which฀they฀inter-pret”฀(p.฀13).฀

Building฀Skills฀in฀Thinking:฀Toward฀a฀

Pedagogy฀in฀Metathinking

VICTORIA฀CRITTENDEN฀ ARCH฀G.฀WOODSIDE฀ BOSTON฀COLLEGE฀฀

CHESTNUT฀HILL,฀MASSACHUSETTS

T

ABSTRACT.฀Most฀managers฀do฀not฀

receive฀formal฀training฀in฀metathinking— that฀is,฀they฀are฀not฀trained฀formally฀in฀ thinking฀about฀thinking฀or฀in฀thinking฀about฀ deciding.฀In฀this฀article,฀the฀authors฀review฀ the฀lack฀of฀educational฀focus฀on฀metathink-ing฀and฀suggest฀several฀tools฀for฀improving฀ the฀decision-making฀process฀and฀for฀skill฀ building฀in฀metathinking.฀The฀tools฀include฀ two฀experiential฀exercises฀that฀facilitate฀ learning฀in฀metathinking.

Keywords:฀decision฀analysis,฀learning฀ theory,฀metathinking,฀pedagogy฀ ฀

Copyright฀©฀2007฀Heldref฀Publications

(3)

Parry฀ (2003)฀ suggested฀ that฀ sense- making฀is฀a฀process฀in฀which฀individu-als฀and฀groups฀in฀organizations฀organize฀ their฀ experiences฀ about฀ reality.฀ As฀ an฀ example,฀consider฀the฀question,฀“What’s฀ really฀happening?”฀This฀question฀gener-ally฀contains฀four฀subissues:

1.฀What฀ actions฀ being฀ done฀ now฀ help฀ improve฀the฀organization’s฀performance?

2.฀What฀ actions฀ are฀ wasted฀ motions฀ (i.e.,฀what฀actions฀are฀we฀taking฀that฀do฀ not฀contribute฀but฀do฀waste฀our฀time)?

3.฀What฀ actions฀ harm฀ the฀ organiza-tion’s฀ performance฀ (i.e.,฀ what฀ actions฀ are฀ counterproductive฀ in฀ the฀ organiza-tion’s฀achievement฀of฀what฀really฀needs฀ to฀ be฀ overlooked฀ in฀ this฀ process฀ is฀ more฀ important.฀ How฀ does฀ one฀ go฀ about฀the฀process฀of฀finding฀out฀what฀ is฀really฀happening?฀An฀ implicit฀men-tal฀ model฀ that฀ decision฀ makers฀ often฀ use฀is฀one฀in฀which฀the฀person฀believes฀ that฀what฀comes฀to฀mind฀first฀is฀accu-rate฀(Senge,฀1990).

It฀seems฀that฀the฀process฀of฀interpretation฀ is฀ so฀ reflexive฀ and฀ immediate฀ that฀ we฀ often฀ overlook฀ it.฀ This,฀ combined฀ with฀ the฀ widespread฀ assumption฀ that฀ there฀ is฀ but฀one฀objective฀reality,฀is฀what฀may฀lead฀ people฀ to฀ overlook฀ the฀ possibility฀ that฀ others฀ may฀ be฀ responding฀ to฀ a฀ very฀ dif-ferent฀situation.฀(Gilovich,฀1991,฀p.฀117;฀ cf.฀Surowiecki,฀2004)฀

This฀fifth฀subissue฀requires฀individu-als฀to฀engage฀in฀metathinking.฀Leff฀and฀ Nevin฀(1990)฀described฀metathinking฀as฀ thinking฀and฀creating฀strategies฀to฀assist฀ one’s฀thinking.฀

thinking฀in฀relation฀to฀decision฀quality.฀ Then,฀ we฀ suggest฀ a฀ simple฀ classroom฀ example฀ that฀ engages฀ students฀ in฀ the฀ thinking-about-thinking฀topic.฀We฀pro-vide฀two฀rigorous฀experiential฀exercise฀ examples฀ that฀ are฀ applicable฀ in฀ the฀ business฀school฀classroom.฀In฀the฀next฀ section,฀ we฀ discuss฀ classroom฀ use฀ of฀ the฀ exercises฀ and฀ offer฀ a฀ brief฀ list฀ of฀ recommended฀ readings.฀ We฀ conclude฀ with฀a฀look฀at฀the฀differences฀between฀ scientific฀and฀executive฀thinking.

Improving฀the฀Quality฀of฀ Decisions

Traditionally,฀ educators฀ have฀ not฀ included฀ formal฀ training฀ in฀ metathink-ing฀ in฀ the฀ core฀ (or฀ even฀ elective)฀ busi-ness฀ education฀ curriculum.฀ Few฀ aca-demic฀ programs,฀ including฀ those฀ in฀ executive฀education,฀include฀courses฀in฀ thinking฀ about฀ thinking฀ or฀ in฀ thinking฀ about฀ deciding.฀ Therefore,฀ few฀ busi-ness฀students฀participate฀in฀courses฀that฀ focus฀on฀acquiring฀prescriptive฀tools฀for฀ improving฀ the฀ quality฀ of฀ thinking฀ and฀ deciding฀(e.g.,฀Sterman,฀2001).฀

Two฀ reasons฀ may฀ be฀ responsible฀ for฀ this฀lack฀of฀educational฀focus฀and฀train- ing.฀First,฀overconfidence฀bias฀is฀wide-spread:฀ Most฀ executives฀ tend฀ to฀ rely฀ too฀often฀on฀their฀unconsciously฀driven฀ automatic฀ thoughts฀ (Bargh,฀ Gollwitzer,฀ Lee-Chai,฀ Barndollar,฀ &฀ Troetschel,฀ 2001;฀ Wegner,฀ 2002).฀ There฀ is฀ a฀ natu-ral฀ tendency฀ to฀ assume฀ that฀ intuitive฀ beliefs฀are฀accurate฀and฀that฀relying฀on฀ external฀heuristics฀(e.g.,฀written฀check-lists,฀explicit฀protocols)฀is฀unnecessary.฀ People’s฀ initial฀ response฀ is฀ often฀ one฀ of฀disbelief฀and฀resentment,฀even฀when฀ presented฀ with฀ hard฀ evidence฀ that฀ for-

mal฀external฀searching฀of฀relevant฀infor-Tools฀for฀Improving฀Thinking฀ Quality

Regarding฀ the฀ quality฀ of฀ decisions,฀ Gilovich฀(1991)฀stated,

A฀fundamental฀difficulty฀with฀effective฀ policy฀ evaluation฀ is฀ that฀ we฀ rarely฀ get฀ to฀ observe฀ what฀ would฀ have฀ happened฀ if฀ the฀ policy฀ had฀ not฀ been฀ put฀ into฀ effect.฀Policies฀are฀not฀implemented฀as฀ controlled฀experiments,฀but฀as฀concert-ed฀ actions.฀ Not฀ knowing฀ what฀ would฀ have฀happened฀under฀a฀different฀policy฀ makes฀ it฀ enormously฀ difficult฀ to฀ dis-tinguish฀ positive฀ or฀ negative฀ outcomes฀ from฀good฀or฀bad฀strategies.฀If฀the฀base฀ rate฀ of฀ success฀ is฀ high,฀ even฀ a฀ dubious฀ strategy฀can฀be฀seen฀as฀wise;฀if฀the฀base฀ rate฀is฀low,฀even฀the฀wisest฀strategy฀can฀ seem฀foolish.฀(pp.฀41–42)฀

Several฀useful฀tools฀are฀now฀available฀ for฀improving฀sensemaking฀capabilities฀ (e.g.,฀ Baron,฀ 2000;฀ Gigerenzer,฀ 2000;฀ Green,฀ 2002;฀ Green฀ &฀ Armstrong,฀ 2004).฀These฀ tools฀ include฀ (a)฀ estimat-ing฀what฀would฀happen฀if฀a฀policy฀had฀ not฀been฀put฀into฀effect฀(e.g.,฀Campbell,฀ 1969)฀ and฀ (b)฀ software฀ programs฀ that฀ help฀ structure฀ problems฀ and฀ test฀ the฀ impact฀of฀alternative฀problem฀structures฀ (e.g.,฀Clemen฀&฀Reilly,฀2001).

Training฀ in฀ metathinking฀ may฀ help฀ overcome฀ fundamental฀ attribution฀ error.฀ Fundamental฀ attribution฀ error฀ is฀ the฀ tendency฀ of฀ a฀ person฀ to฀ blame฀ other฀ people฀or฀environmental฀forces฀for฀a฀bad฀ decision฀rather฀than฀recognizing฀that฀the฀ process฀that฀the฀person฀applied฀to฀reach฀a฀ decision฀reflects฀shallow฀systems฀think-ing฀ (Plous,฀ 1993).฀ “When฀ we฀ attribute฀ behavior฀ to฀ people฀ rather฀ than฀ system฀ structure,฀ the฀ focus฀ of฀ management฀ becomes฀ scapegoating฀ rather฀ than฀ the฀ design฀ of฀ organizations฀ [and฀ problem-solving฀ procedures]฀ in฀ which฀ ordinary฀ people฀can฀achieve฀extraordinary฀results”฀

(4)

ficial฀in฀the฀learning฀process.฀In฀an฀ expe-riential฀exercise,฀learners฀can฀construct฀ a฀ world฀ by฀ combining฀ past฀ informa-tion฀with฀future-oriented฀dispositions฀to฀ actively฀engage฀in฀the฀learning฀process฀ (cf.฀Kolb,฀1984).฀

Classroom-Oriented,฀Experiential฀ Exercises฀in฀Metathinking

Thinking฀ about฀ how฀ one฀ thinks฀ is฀ not฀ an฀ easy฀ topic฀ of฀ discussion฀ among฀ students,฀regardless฀of฀whether฀they฀are฀ undergraduates,฀ graduates,฀ or฀ execu-tives.฀By฀nature,฀the฀topic฀of฀“thinking”฀ is฀ vague฀ and฀ hard฀ to฀ grasp.฀ Davenport฀ (2004)฀suggested฀a฀basic,฀yet฀provoking,฀

A฀ natural฀ response฀ is,฀ “Well,฀ I฀ just฀ know฀ that!”฀ This฀ drives฀ home฀ the฀ pri-mary฀ question,฀ “How฀ do฀ you฀ know฀ that?”฀Although฀simplistic,฀this฀exercise฀ engages฀participants฀easily฀and฀actively฀ in฀a฀discussion฀about฀how฀business฀peo-ple฀ address฀ problems.฀ In฀ this฀ scenario,฀ participants฀ may฀ recall฀ kindergarten฀ classes฀with฀four฀of฀the฀same฀items฀on฀ the฀ board,฀ envision฀ flash฀ cards,฀ recall฀ counting฀ on฀ fingers,฀ or฀ recall฀ problem฀ recitation.฀ Regardless฀ of฀ the฀ solution฀ method,฀the฀exercise฀forces฀participants฀ to฀ become฀ aware฀ of฀ their฀ individual฀ thinking฀ processes.฀ This฀ awareness฀ is฀ the฀first฀step฀in฀metacognition.฀

This฀ simple฀ exercise฀ and฀ subse-quent฀ discussion฀ engage฀ students฀ in฀ the฀ metathinking฀ process.฀This฀ may฀ be฀ the฀ first฀ time฀ they—as฀ business฀ school฀ students—have฀ talked฀ about฀ thinking,฀ although฀some฀of฀their฀syllabi฀(particu-larly฀ those฀ in฀ case-based฀ courses)฀ may฀ have฀referred฀to฀critical฀thinking฀skills.฀ Yet,฀ becoming฀ aware฀ of฀ one’s฀ indi-vidual฀ knowledge,฀ assumptions,฀ skills,฀ and฀ intellectual฀ resources฀ is฀ a฀ critical฀ success฀ factor฀ in฀ business฀ (Davenport,฀ 2004).฀

After฀students฀have฀become฀engaged฀ in฀ thinking฀ about฀ thinking,฀

profes-sors฀ can฀ implement฀ the฀ following฀ two฀ experiential฀ exercises฀ and฀ the฀ follow-ing฀ decision-tree฀ analytical฀ tool฀ in฀ the฀ classroom.฀ They฀ are฀ good฀ exercises฀ in฀ management฀ classrooms฀ and฀ training฀ programs฀ that฀ involve฀ an฀ overt฀ effort฀ to฀ improve฀ metathinking฀ processes.฀ Although฀ in฀ the฀ classroom฀ the฀ discus-sion฀ and฀ analysis฀ can฀ become฀ confus-ing,฀the฀decision-tree฀framework฀allows฀ the฀professor฀to฀present฀the฀process฀in฀a฀ straightforward฀ manner.฀ Thus,฀ we฀ rec-ommend฀ that฀ the฀ decision-tree฀ be฀ used฀ as฀ a฀ visual฀ for฀ framing฀ the฀ discussion.฀ However,฀it฀is฀interesting฀to฀allow฀class-room฀participants฀to฀wander฀through฀the฀ process฀ before฀ providing฀ a฀ process฀ for฀ structuring฀their฀thinking.

Example฀1:฀The฀Taxicab฀Accident฀฀ A฀cab฀was฀involved฀in฀a฀hit-and-run฀acci-dent฀ at฀ night.฀ Two฀ cab฀ companies,฀ the฀ Green฀ and฀ the฀ Blue,฀ operate฀ in฀ the฀ city.฀ You฀ are฀ given฀ the฀ following฀ data:฀ (a)฀ 85%฀of฀the฀cabs฀in฀the฀city฀are฀Green฀and฀ 15%฀ are฀ Blue฀ and฀ (b)฀ a฀ witness฀ identi-fied฀the฀cab฀as฀Blue.฀The฀court฀tested฀the฀ reliability฀of฀the฀witness฀under฀the฀same฀ circumstances฀ that฀ existed฀ on฀ the฀ night฀ of฀ the฀ accident฀ and฀ concluded฀ that฀ the฀ witness฀ correctly฀ identified฀ each฀ one฀ of฀ the฀two฀colors฀80%฀of฀the฀time฀and฀failed฀ 20%฀of฀the฀time.

What฀ is฀ the฀ probability฀ that฀ the฀ cab฀ involved฀in฀the฀accident฀was฀Blue฀rather฀ than฀ Green?฀ Please฀ write฀ your฀ answer฀ here:฀฀_____%

Most฀ participants฀ say฀ that฀ the฀ prob-ability฀is฀over฀50%฀that฀the฀cab฀involved฀ in฀ the฀ accident฀ was฀ blue,฀ and฀ many฀ say฀ that฀ it฀ is฀ 80%฀ (Tverksy฀ &฀ Kahne-man,฀1982).฀The฀later฀decision฀focuses฀ mainly฀ on฀ the฀ conditional฀ probability฀ that฀ the฀ witness฀ accurately฀ predicts฀ a฀ cab’s฀ color,฀ when฀ the฀ color฀ is฀ known,฀ and฀ignores฀the฀base฀rate฀marginal฀prob-ability฀of฀cabs฀being฀blue฀versus฀green.฀ From฀ a฀ Bayesian฀ analysis฀ perspective,฀ the฀ correct฀ answer฀ is฀ 41%.฀ Structuring฀ the฀problem฀in฀a฀decision฀tree฀is฀helpful฀ in฀solving฀the฀problem฀(see฀Figure฀1).

Additional฀defensible฀solutions฀to฀the฀ cab฀ problem฀ are฀ found฀ in฀ the฀ litera-ture฀(e.g.,฀Birnbaum,฀1983;฀Levi,฀1983).฀ For฀ example,฀ according฀ to฀ Gigerenzer฀ (2000),

If฀Neyman-Pearson฀theory฀is฀applied฀to฀the฀ cab฀problem,฀solutions฀range฀between฀0.28฀ and฀0.82,฀depending฀on฀the฀psychological฀

theory฀about฀the฀witness’s฀criterion฀shift— the฀ shift฀ from฀ witness฀ testimony฀ at฀ the฀ time฀of฀the฀accident฀to฀witness฀testimony฀ at฀the฀time฀of฀the฀court’s฀test.฀(p.฀16)฀฀

Thus,฀educators฀can฀go฀beyond฀Tver-sky฀ and฀ Kahneman’s฀ (1974)฀ view฀ of฀ one฀ correct฀ answer฀ that฀ Bayes’฀ statis-tics฀supplied฀and฀go฀beyond฀considering฀ the฀ deviation฀ between฀ the฀ participant’s฀ answer฀ and฀ the฀ so-called฀ normative฀ answer฀ as฀ a฀ bias฀ of฀ reasoning.฀ Giger-enzer฀ (2000,฀ p.฀ 17)฀ quotes฀ Neyman฀ and฀ Pearson฀ (1928)฀ on฀ this฀ point:฀ “In฀ many฀ cases฀ there฀ is฀ probably฀ no฀ sin-gle฀ best฀ solution”฀ (p.฀ 176).฀ Because฀ of฀ the฀ nuances฀ (contingencies)฀ in฀ how฀ the฀ problem฀ is฀ framed,฀ it฀ is฀ important฀ for฀ professors฀ to฀ advocate฀ a฀ particular฀ theoretical฀ model฀ to฀ follow฀ in฀ decid-ing฀ on฀ a฀ final฀ answer฀ to฀ the฀ problem฀ (cf.฀Koehler,฀1993;฀Woodside฀&฀Singer,฀ 1994)฀ rather฀ than฀ advocating฀ exactly฀ one฀ correct฀ solution.฀ It฀ is฀ unfortunate฀ that,฀ except฀ in฀ a฀ statistics฀ classroom,฀ extending฀ the฀ discussion฀ beyond฀ that฀ offered฀by฀Tversky฀and฀Kahneman฀may฀ confuse฀ students,฀ causing฀ them฀ to฀ lose฀ sight฀of฀the฀primary฀motivation฀for฀the฀ exercise:฀ to฀ think฀ about฀ their฀ thinking.฀ In฀ many฀ classrooms,฀ keeping฀ the฀ deci-sion฀ tree฀ and฀ subsequent฀ discusdeci-sion฀ as฀ a฀ Bayesian฀ analysis฀ may฀ be฀ the฀ best฀ approach฀for฀teaching฀and฀learning. However,฀ many฀ business฀ school฀ situa-tions฀ are฀ not฀ as฀ straightforward฀ as฀ the฀ taxicab฀ example.฀ There฀ are฀ generally฀ various฀ viewpoints฀ and฀ functional฀ per-spectives฀ in฀ business฀ decision฀ making,฀ and฀all฀opinions฀must฀be฀included฀in฀the฀ decision-making฀process.฀The฀following฀ example,฀the฀pricing฀of฀a฀new฀product,฀ presents฀ a฀ common฀ business฀ scenario฀ and฀ allows฀ students฀ to฀ dig฀ deeper฀ into฀ the฀ use฀ of฀ a฀ metathinking฀ tool฀ in฀ the฀ decision฀process:

Plaswire฀is฀a฀new฀fencing฀wire฀made฀from฀ polyethylene฀ terephthalate.฀ Plaswire฀ is฀

(5)

designed฀as฀a฀replacement฀for฀galvanized฀ steel฀ wire฀ in฀ permanent฀ fencing฀ con-struction.฀The฀president฀of฀Kiwi฀Fencing฀ requests฀ that฀ the฀ assistant฀ sales฀ manager฀ implement฀a฀pricing฀strategy฀for฀Plaswire฀ that฀will฀help฀it฀achieve฀national฀distribu-tion.฀ The฀ president฀ believes฀ that฀ pricing฀ Plaswire฀ substantially฀ lower฀ (30%฀ less)฀ than฀ the฀ competing฀ steel฀ wire฀ price฀ will฀ help฀ gain฀ distributor฀ acceptance฀ of฀ the฀ product,฀ as฀ some฀ farmers฀ and฀ livestock฀ station฀managers฀may฀be฀price฀sensitive.฀ The฀president฀feels฀certain฀that฀steel฀wire฀

four฀times.฀The฀final฀result฀was฀failure฀or฀ very฀low฀market฀share฀for฀new฀products฀in฀ 92฀of฀the฀96฀cases฀that฀the฀assistant฀sales฀ manager฀had฀reviewed.฀

However,฀ the฀ assistant฀ sales฀ manager฀ also฀knew฀that฀the฀president฀often฀predicted฀ competitive฀reaction฀correctly.฀The฀president฀ had฀been฀correct฀in฀his฀predictions฀in฀two฀of฀ the฀three฀recent฀cases฀concerning฀competi-tors’฀ responses฀ to฀ new฀ product฀ prices.฀The฀ assistant฀sales฀manager฀favors฀pricing฀Plas-wire฀to฀match฀the฀current฀price฀of฀competing฀ steel฀ wire฀ products.฀ This฀ pricing฀ decision฀

the฀new฀products฀were฀still฀available฀even฀ when฀ introduced฀ at฀ prices฀ higher฀ than฀ competitors’฀prices.

What฀ decision฀ do฀ you฀ recommend?฀ What฀is฀the฀likelihood฀of฀success฀of฀your฀ strategy฀(i.e.,฀the฀new฀product฀is฀still฀being฀ marketed฀ 5฀ years฀ after฀ market฀ introduc-tion,฀and฀it฀is฀profitable)?฀Please฀provide฀ your฀answers฀here.฀

Your฀recommendation,฀circle฀one: (a)฀ Price฀ Plaswire฀ 30%฀ below฀ that฀ of฀ steel฀wire.

FIGURE฀1.฀Decision฀tree฀for฀taxicab฀color฀problem.฀The฀participant฀will฀say฀“blue”฀29%฀of฀the฀time฀(.17฀+฀.12฀=฀.29);฀the฀ participant฀will฀be฀accurate฀41%฀of฀the฀time฀when฀saying฀“blue”฀(.12/.29฀=฀.41).฀Thus,฀when฀the฀participant฀says฀“blue,”฀ the฀chances฀are฀still฀greater฀than฀50:50฀that฀the฀cab฀was฀green.

Base฀rate: Marginal

Probabilities ConditionalProbabilities

Joint฀ Probabilities

Decision: Color฀of฀cab

Blue

Green

Blue Blue Green

Green

.85

.80

.20

.20

.68

.17

.15

.80

.03

.12

(6)

mates฀leads฀to฀the฀same฀recommenda-tion:฀ A฀ price฀ that฀ is฀ higher฀ than฀ that฀ of฀ steel฀ wire฀ results฀ in฀ the฀ highest฀ likelihood฀ of฀ success.฀ Figure฀ 2฀ and฀ Figure฀ 3฀ include฀ the฀ probabilities฀ in฀ the฀ problem฀ description฀ and฀ one฀ set฀ of฀ reasonable฀ probabilities฀ for฀ the฀ other฀ alternatives.฀ Most฀ students฀ and฀ executives฀advocate฀adopting฀the฀pres-ident’s฀recommendation฀to฀price฀lower฀ than฀ the฀ competing฀ steel฀ wire.฀ They฀ do฀ so฀ without฀ considering฀ the฀ base฀ rate฀ probability฀ (0.75)฀ that฀ competi-tors฀usually฀react฀when฀a฀new฀product฀ is฀introduced฀at฀a฀price฀lower฀than฀that฀ of฀their฀product.฀

As฀ with฀ the฀ taxicab฀ example,฀ we฀ recommend฀ that฀ the฀ professor฀ use฀ the฀ decision฀trees฀as฀visuals฀in฀helping฀stu-dents฀organize฀their฀thinking.฀In฀reality,฀ the฀ probability฀ estimation฀ process฀ is฀ not฀complicated,฀although฀it฀appears฀to฀ be฀ so฀ when฀ thinking฀ is฀ not฀ organized.฀ Learning฀to฀organize฀one’s฀thoughts฀is฀ critical฀ to฀ the฀ success฀ of฀ teaching฀ and฀ learning฀metathinking.

Classroom฀Use

Professors฀have฀used฀these฀exercises฀ successfully฀in฀various฀business฀class-rooms฀ and฀ seminars฀ at฀ several฀ univer-sities฀ around฀ the฀ world.฀ Starting฀ the฀ discussion฀ with฀ the฀ simple฀ arithmetic฀ problem฀ engages฀ participants฀ in฀ the฀ topic฀ of฀ metathinking.฀ Following฀ the฀ arithmetic฀ problem฀ with฀ the฀ taxicab฀ example฀ helps฀ participants฀ progress฀ into฀ the฀ probabilistic฀ components฀ of฀ decision฀making.฀The฀more฀complicat-ed฀Plaswire฀example฀focuses฀attention฀ on฀ the฀ use฀ of฀ probabilities฀ in฀ decision฀ making฀and฀provides฀participants฀with฀ much฀more฀information฀with฀which฀to฀ make฀a฀decision.฀

People’s฀ minds฀ tend฀ to฀ limit฀ cog-nitive฀ effort฀ (Payne,฀ Bettman,฀ &฀ Johnson,฀ 1993)฀ and฀ prefer฀ to฀ apply฀ intuitive฀ problem-solving฀ routines฀ even฀when฀given฀strong฀evidence฀that฀ these฀ routines฀ are฀ not฀ very฀ accurate.฀ For฀ example,฀ in฀ an฀ executive฀ MBA฀

program฀at฀Tulane฀University฀(Wood-side,฀ 1997),฀ the฀ instructors฀ tested฀ the฀ Plaswire฀ pricing฀ case฀ experimentally฀ among฀24฀two-person฀groups฀of฀exec-utives.฀The฀professors฀instructed฀12฀of฀ the฀groups฀in฀the฀use฀of฀decision฀trees฀ for฀ framing฀ problems฀ and฀ computing฀ expected฀ values฀ of฀ alternative฀ solu-tions.฀The฀other฀12฀groups฀received฀no฀ such฀ instruction.฀ Of฀ the฀ 12฀ untrained฀ groups,฀8฀recommended฀the฀low-price฀ solution,฀ and฀ none฀ recommended฀ the฀ high-price฀solution.฀Of฀the฀12฀trained฀ groups,฀ 7฀ decided฀ on฀ the฀ high-price฀ solution,฀and฀only฀2฀selected฀the฀low-price฀solution.฀

Although฀the฀prescriptive฀solution฀to฀ each฀of฀the฀examples฀is฀informative฀and฀ a฀ necessary฀ component฀ of฀ the฀ class-room฀ experience,฀ the฀ major฀ objective฀ of฀ the฀ exercises฀ is฀ to฀ engage฀ students฀ in฀the฀art฀and฀science฀of฀understanding฀ one’s฀ metacognitive฀ abilities.฀ Accord- ingly,฀the฀professor฀should฀debrief฀par-ticipants฀after฀the฀use฀of฀each฀example.฀ The฀ following฀ questions฀ would฀ facili-tate฀the฀debriefing:

(7)

1.฀What฀ were฀ your฀ thoughts฀ when฀ reading฀the฀example?

2.฀How฀did฀you฀organize฀and฀use฀the฀ information฀provided฀in฀the฀example?

3.฀What฀ (if฀ any)฀ personal฀ knowledge฀ did฀you฀use฀in฀arriving฀at฀an฀answer?

Once฀ participants฀ dissect฀ their฀ own฀ thought฀ processes,฀ they฀ grow฀ more฀ aware฀of฀their฀own฀knowledge,฀assump-tions,฀ skills,฀ and฀ intellectual฀ resources฀ and฀become฀cognizant฀of฀the฀way฀they฀ use฀ these฀ resources฀ in฀ decision฀

mak-Summary

Executive฀ thinking฀ differs฀ from฀ sci-entific฀ thinking฀ in฀ at฀ least฀ three฀ funda-mental฀ ways฀ (cf.฀ Kozak,฀ 1996).฀ First,฀ scientists฀ (e.g.,฀ academic฀ researchers)฀ get฀to฀choose฀their฀problem.฀In฀organi-zations,฀ circumstances฀ often฀ thrust฀ the฀ problems฀ (and฀ symptoms฀ of฀ problems)฀ on฀ the฀ executive฀ (e.g.,฀ see฀ Mintzberg,฀ 1978).฀ Second,฀ scientists฀ focus฀ on฀ a฀ limited฀ number฀ of฀ problems฀ at฀ a฀ time.฀ However,฀ a฀ vast฀ number฀ of฀ potential฀

dence,฀ (d)฀ discounting฀ disconfirming฀ evidence฀ if฀ it฀ does฀ appear,฀ (e)฀ being฀ hostile฀ to฀ the฀ belief฀ that฀ using฀ deci-sion฀ tools฀ such฀ as฀ computer฀ software฀ programs฀ (see฀ Gaither,฀ 2002)฀ results฀ in฀ more฀ accurate฀ problem฀ framing฀ than฀ does฀ trusting฀ one’s฀ own฀ judg-ment,฀ (f)฀ not฀ thinking฀ outside฀ the฀ box฀ and฀ considering฀ all฀ theoretically฀ possible—even฀ if฀ seemingly฀ implau-sible—combinations฀ of฀ events฀ and฀ their฀ outcomes,฀ and฀ (g)฀ implement-ing฀a฀decision฀on฀the฀basis฀of฀limited฀ FIGURE฀3.฀CEO฀predictions,฀accuracy,฀and฀outcomes.฀Posterior฀probability฀competitor฀responds฀=฀.0050฀+฀.0026฀+฀.4752฀ +฀.2524฀=฀.74.฀฀Posterior฀probability฀competitor฀does฀not฀respond฀=฀.0016฀+฀.0008฀+฀.1584฀+฀.0841฀=฀.26.฀Conclusion:฀ Because฀the฀CEO฀is฀not฀highly฀accurate฀and฀the฀prior฀probability฀is฀very฀high฀that฀the฀competitor฀will฀respond฀(.75),฀the฀ posterior฀likelihood฀of฀the฀competitor฀responding฀is฀close฀to฀the฀same฀as฀the฀prior฀probability.

Predicts฀competitor responds

Predicts฀competitor does฀not฀respond CEO

predicts?

CEO฀accurate? Prior฀probability Revised฀probability

Yes

Yes

Yes Yes

Yes

Yes No

No

No

No

No

No .66

.34

.34 .66 .99

.01

.75

.75

.75

.75 .25

.25

.25

.25

1.฀=฀.0050

8.฀=฀.0841 7.฀=฀.2524 6.฀=฀.1584 5.฀=฀.4752 4.฀=฀.0008 3.฀=฀.0026 2.฀=฀.0016 CEO฀“certainty”฀

transformed฀into .99฀probability฀that competitor฀will฀not respond

(8)

NOTES

Dr.฀ Victoria฀ Crittenden’s฀ research฀ interests฀ are฀formulation฀and฀implementation฀of฀marketing฀ strategies,฀especially฀as฀related฀to฀cross-functional฀ decision฀ making.฀ She฀ is฀ widely฀ recognized฀ as฀ a฀ case฀researcher,฀case฀writer,฀and฀case฀teacher.฀

Dr.฀ Arch฀ G.฀ Woodside’s฀ research฀ interests฀ are฀ decision฀making,฀marketing฀strategies,฀and฀tourism.

Correspondence฀ concerning฀ this฀ article฀ should฀

be฀addressed฀to฀Dr.฀Victoria฀Crittenden,฀Chairper-Bargh,฀ J.฀ A.,฀ Gollwitzer,฀ P.฀ M.,฀ Lee-Chai,฀ A.,฀ Barndollar,฀ K.,฀ &฀ Troetschel,฀ R.฀ (2001).฀ The฀ automated฀ will:฀ Nonconscious฀ activation฀ and฀ pursuit฀of฀behavioral฀goals,฀ Journal฀of฀Person-ality฀and฀Social฀Psychology,฀71,฀230–244. Baron,฀ J.฀ (2000).฀Thinking฀ and฀ deciding฀ (3rd฀

ed.).฀Cambridge,฀England:฀Cambridge฀Univer-sity฀Press.

Bazerman,฀ M.฀ H.฀ (1998).฀Judgment฀ in฀ mana-gerial฀ decision฀ making฀ (4th฀ ed.).฀ New฀ York:฀ Doubleday.

Birnbaum,฀ M.฀ H.฀ (1983).฀ Base฀ rates฀ in฀ Bayesian฀ inference:฀Signal฀detection฀analysis฀of฀cab฀prob-lem.฀American฀Journal฀of฀Psychology,฀96,฀85–94.

Campbell,฀D.฀T.฀(1969).฀Reforms฀as฀experiments.฀

American฀Psychologist,฀24,฀409–429.

Charan,฀ R.,฀ Useem,฀ J.,฀ &฀ Harrington,฀A.฀ (2002,฀ May฀ 27).฀ Why฀ companies฀ fail.฀Fortune,฀ 145,฀

50–64.

Clemen,฀R.฀T.,฀&฀Reilly,฀T.฀(2001).฀Making฀hard฀ decisions฀ with฀ decision฀ tools.฀ Pacific฀ Grove,฀ CA:฀Duxbury.

Davenport,฀ D.฀ B.฀ (2004).฀Mega฀ success฀ requires฀ meta฀ thinking.฀ Retrieved฀August฀ 12,฀ 2007,฀ from฀ http://www.davenportfolio.com/ar-mega_success. php

Gaither,฀C.฀(2002).฀What฀your฀doctor฀doesn’t฀know฀ could฀ kill฀ you.฀ [Electronic฀ version].฀Boston฀ Globe.฀Retrieved฀August฀12,฀2007,฀from฀http:// www.boston.com/news/globe/reprints/071402_ whenyourdoc/

Garman,฀ N.฀ B.฀ (1997).฀Introduction฀ to฀ active฀ learning .฀A฀2-day฀workshop฀conducted฀at฀Uni-versity฀of฀Pittsburgh,฀Pittsburgh,฀PA.฀

Gigerenzer,฀ G.฀ (2000).฀Adaptive฀ thinking.฀ New฀ York:฀Oxford฀University฀Press.

Gigerenzer,฀ G.,฀ &฀ Selten,฀ R.฀ (2002).฀Bounded฀ rationality:฀ The฀ adaptive฀ toolbox.฀ Cambridge,฀ MA:฀MIT฀Press.

Gigerenzer,฀ G.,฀ Todd,฀ P.฀ M.,฀ &฀ ABC฀ Research฀ Group.฀ (1999).฀Simple฀ heuristics฀ that฀ make฀ us฀smart.฀Oxford,฀England:฀Oxford฀University฀ Press.

Gilovich,฀T.฀(1991).฀How฀we฀know฀what฀isn’t฀so.฀ New฀York:฀Free฀Press.

Green,฀ K.฀ (2002).฀ Forecasting฀ decisions฀ in฀ con-flict฀ situations:฀A฀ comparison฀ of฀ game฀ theory,฀ role-playing,฀ and฀ unaided฀ judgment.฀ Interna-tional฀Journal฀of฀Forecasting,฀18,฀321–344. Green,฀ K.฀ C.,฀ &฀Armstrong,฀ J.฀ S.฀ (2004).฀

Struc-tured฀ analogies฀ for฀ forecasting.฀ (Working฀ Paper).฀Wellington,฀New฀Zealand:฀Victoria฀Uni-versity฀of฀Wellington.฀

Koehler,฀J.฀J.฀(1993).฀The฀base฀rate฀fallacy฀myth.฀

Psycoloquy,฀4,฀10.

Kolb,฀ D.฀ (1984).฀Experiential฀ learning:฀ Experi-ence฀ as฀ the฀ source฀ of฀ learning฀ and฀ develop-ment.฀Englewood฀Cliffs,฀NJ:฀Prentice฀Hall. Kozak,฀A.฀(1996).฀Local฀clinicians฀need฀knowledge฀

tools.฀American฀Psychologist,฀51,฀1335–1336.

Leff,฀H.฀L.,฀&฀Nevin,฀A.฀(1990).฀Dissolving฀bar-riers฀ to฀ teaching฀ creative฀ thinking฀ (and฀ meta-thinking). ฀Teacher฀Education฀and฀Special฀Edu-cation,฀13,฀36–39.

Levi,฀I.฀(1983).฀Who฀commits฀the฀base฀rate฀fallacy?฀

Behavioral฀and฀Brain฀Sciences,฀6,฀502–506. March,฀ J.,฀ &฀ Olsen,฀ J.฀ (1976).฀Ambiguity฀ and฀

choice฀in฀organizations. ฀Oslo,฀Norway:฀Scandi-navian฀University฀Press.

Martz,฀B.,฀Neil,฀T.฀C.,฀&฀Biscaccianti,฀A.฀(2003).฀ TradeSmith:฀ An฀ exercise฀ to฀ demonstrate฀ the฀ illusion฀ of฀ control฀ in฀ decision฀ making.฀ Deci-sion฀Sciences฀Journal฀of฀Innovative฀Education,฀ 1,฀273–288.

Martz,฀B.,฀&฀Shepherd,฀M.฀M.฀(2003).฀Testing฀for฀ the฀transfer฀of฀tacit฀knowledge:฀Making฀a฀case฀ for฀implicit฀learning.฀Decision฀Sciences฀Journal฀ of฀Innovative฀Education,฀1,฀41–56.

Mintzberg,฀H.฀(1978).฀Patterns฀in฀strategy฀forma-tion.฀Management฀Science,฀24,฀934–948. Neyman,฀ J.,฀ &฀ Pearson,฀ E.฀ S.฀ (1928).฀ On฀ the฀

use฀ and฀ interpretation฀ of฀ certain฀ test฀ criteria฀ for฀ purposes฀ of฀ statistical฀ inference:฀ Part฀ 1.฀

Biometrika,฀20A,฀175–240.฀

Parry,฀J.฀(2003).฀Making฀sense฀of฀executive฀sen-semaking:฀ A฀ phenomenological฀ case฀ study฀

with฀ methodological฀ criticism.฀Journal฀ of฀ Health฀ Organisation฀ and฀ Management,฀ 17,฀ 240–263.

Payne,฀ J.฀ W.,฀ Bettman,฀ J.฀ R.,฀ &฀ Johnson,฀ E.฀ J.฀ (1993).฀The฀ adaptive฀ decision฀ maker.฀ Cam-bridge,฀England:฀Cambridge฀University฀Press. Plous,฀S.฀(1993).฀The฀psychology฀of฀judgment฀and฀

decision-making.฀New฀York:฀McGraw-Hill. Senge,฀P.฀(1990).฀The฀fifth฀discipline.฀New฀York:฀

Doubleday.

Shadish,฀W.฀R.,฀Jr.,฀฀Cook,฀T.฀D.,฀&฀Levitton,฀L.฀ C.฀(1991).฀Foundations฀of฀program฀evaluation.฀ Thousand฀Oaks,฀CA:฀Sage.

Sterman,฀J.฀D.฀(2001).฀Systems฀dynamics฀model-ing:฀ Tools฀ for฀ learning฀ in฀ a฀ complex฀ world.฀

California฀Management฀Review,฀43,฀8–25. Surowiecki,฀ J.฀ (2004).฀The฀ wisdom฀ of฀ crowds.฀

New฀York:฀Doubleday.

Tversky,฀A.,฀ &฀ Kahneman,฀ D.฀ (1974,฀ September฀ 27).฀ Judgment฀ under฀ uncertainty:฀ Heuristics฀ and฀biases.฀Science,฀185,฀1124–1131.฀ Tversky,฀ A.,฀ &฀ Kahneman,฀ D.฀ (1982).฀

Eviden-tial฀ impact฀ of฀ base฀ rates.฀ In฀ D.฀ Kahneman,฀ P.฀ Slovic,฀ &฀A.฀ Tversky฀ (Eds.),฀Judgment฀ under฀ uncertainty:฀ Heuristics฀ and฀ biases฀ (pp.฀ 153– 160).฀Cambridge,฀England:฀Cambridge฀Univer-sity฀Press.

Wegner,฀D.฀M.฀(2002).฀The฀illusion฀of฀conscious฀ will.฀Cambridge,฀MA:฀MIT฀Press.

Weick,฀ K.฀ E.฀ (1995).฀Sensemaking฀ in฀ organiza-tions.฀Thousand฀Oaks,฀CA:฀Sage.

Weick,฀K.฀E.,฀&฀Sutcliffe,฀K.฀M.฀(2001).฀ Manag-ing฀the฀unexpected.฀New฀York:฀Jossey-Bass. Wilson,฀E.฀J.,฀McMurrian,฀R.฀C.,฀&฀Woodside,฀A.฀

G.฀(2001).฀How฀buyers฀frame฀problems:฀Revis-ited.฀Psychology฀and฀Marketing,฀18,฀617–655. Woodside,฀ A.฀ G.฀ (1997).฀Applying฀ alternative฀

rational฀theories฀to฀the฀cab฀problem.฀(Working฀ paper).฀ New฀ Orleans,฀ LA:฀ Freeman฀ School฀ of฀ Business,฀Tulane฀University.฀

Woodside,฀ A.฀ G.฀ (1999).฀ Evaluating฀ alternative฀ pricing฀ strategies฀ for฀ market฀ introduction฀ of฀ new฀ industrial฀ technologies฀ [Monograph].฀

Advances฀in฀Business฀Marketing฀and฀Purchas-ing,฀8,฀181–186.฀

Woodside,฀A.฀ G.฀ (Ed.).฀ (2003).฀ Evaluating฀ mar-keting฀ actions฀ and฀ outcomes:฀ Advances฀ in฀ business฀ marketing฀ &฀ purchasing฀ (Vol.฀ 12).฀ Amsterdam:฀JAI฀Press.

Woodside,฀A.฀G.,฀&฀Singer,฀A.฀E.฀(1994).฀Social฀ interaction฀effects฀in฀the฀framing฀of฀buying฀deci-sions.฀Psychology฀&฀Marketing,฀11,฀27–34.

(9)

In Arts Education Policy Review (AEPR), teachers, teacher educators, administrators, policymakers, researchers, and others involved in arts education discuss diffi cult, often controversial policy issues regarding K–12 education in the arts throughout the nation and the rest of the world. Focusing on education in music, visual arts, theater, dance, and creative writing, the journal encourages varied views and emphasizes analytical exploration. AEPR’s purpose is to present and explore many points of view; it contains articles for and against different ideas, policies, and proposals for arts education. Its overall purpose is to help readers think for themselves, rather than to tell them how they should think.

Contributors should make sure that any submission is a policy article, complete with policy

recommendations about arts education from prekindergarten through twelfth grade. Articles about college education should focus on teacher preparation for these grades or teacher retention in arts education. AEPR intends to bring fresh analytical vigor to perennial and new policy issues in arts education. AEPR presents analyses and recommendations focused on policy. The goal of any article should not be description or celebration (although reports of successful programs could be part of a policy article).

Any article focused on a program (or programs) should address why something works or does not work, how it works, how it could work better, and most important, what various policymakers (from teachers to legislators) can do about it. Many articles are rejected because they lack this element.

These orientations can be applied to many issues—from the structure and results of psychometric research to the values climate that would support the arts as an educational basic. They can deal with the relationships of teacher preparation to cultural development, the problems of curriculum building, the particular challenges of teaching specifi c art forms, and the impact of political, economic, cultural, artistic, and other climates on decision making for arts instruction.

AEPR does not promote individuals, institutions, methods, or products. It does not aim to repeat commonplace ideas. Editors want articles that show originality, probe deeply, and take discussion beyond common wisdom and familiar rhetoric. Articles that merely restate the importance of arts education, call attention to the existence of issues long since addressed, or repeat standard solutions cannot be considered.

Authors must prepare their manuscripts according to the The Chicago Manual of Style, 15th edition, for all matters of style. All manuscripts require an abstract, preferably no longer than 120 words, and 3–5 keywords to be used for indexing purposes. Keywords should capture the precise content of the manuscript and should be found in the abstract. Authors are responsible for the accuracy of the content. Manuscripts should not exceed 25 pages in length, including references. The managing editor screens manuscripts to determine their appropriateness for distribution to the editorial board.

Manuscripts will be edited for clarity and readability, and editors may make changes so the text conforms to the journal’s style.

����฀���฀������

Referensi

Dokumen terkait

48/VII Pelawan II pada Dinas Pendidikan Kabupaten Sarolangun Tahun Anggaran 2012 , dengan ini diumumkan bahwa

Mengingat sebuah organisasi nirlaba (OPZ) tanpa menghasilkan dana maka tidak ada sumber dana yang dihasilkan. Sehingga apabila sumber daya sudah tidak ada maka

Berdasarkan Surat Penetapan Pemenang Nomor : 44.i /POKJA /ESDM-SRL/2012 tanggal 15 Agustus 2012, dengan ini kami Pokja Konstruksi pada Dinas ESDM Kabupaten

[r]

RKB Ponpes Salapul Muhajirin Desa Bukit Murau pada Dinas Pendidikan Kabupaten Sarolangun Tahun Anggaran 2012, dengan ini diumumkan bahwa :.. CALON

Bertitik tolak dari latar belakang pemikiran tersebut di atas, maka masalah yang sangat pundamental diteliti dan dibahas dalam rangkaian kegiatan penelitian ini

[r]

Sastra kaitannya sebagai cermin dari masyarakat tetunya juga mengangkat permasalahn-permasalahan yang ada di masyarakat, baik mengenai nilai-nilai, moral, ideologi dan