*, Wu Wei, Li Deheng, ,
Development of a VR-based Experienceable Education System for Operating a Nuclear Power Plant
Ishii Hirotake, Wu Wei, Li Deheng, Shimoda Hiroshi and Yoshikawa Hidekazu (Graduate School of Energy Science, Kyoto University)
Abstract
A VR-based experienceable education system has been developed by realizing human-shaped virtual operator in virtual control room of Nuclear Power Plant (NPP). The virtual operator has expertise knowledge about NPP operation and it can operate the control panels by himself. With this education system, a trainee can watch the virtual operator operating the control panels from any view-direction the trainee would like to see. And the trainee can understand what the virtual operator thinks, by hearing the verbal utterance of the virtual operator. The overall architecture of the developed education system and the functional configuration of the system are described in this paper.
!"#$, %&'(), *+,)&-, ./'012, 34567)8 (virtual reality, human motion, human model, education system, nuclear power plant)
.
3459:;<=)>(NTC)?@A34567)8B CDEFGHI/JKLDMNAOPQRBST;<UV +72IWXAY22Z[N\L]TB./;<I#^_
`aLb;<c@AdBST;<UV+72Nea`A fg@3459:Bhijkl3459:mBnoA9:
mBpqrstAuvwBxyz{|I}~?Ag
@&6IaD# ;<IXLbdB./;<
N;<c@AN34567)8IFG?L
XB INXLd?Lb__A# ;<B ST?@A;<c@SM`3459:mBI
KLdNELDMA;<vNA 5¡
08L&6IaD# ;<B#^T[I ]¢£LI¤EaB"¥?¦Lb
dB§NA# ;<BST?;<EL B@A;<cAB¨©ª«B§N¬®¯`
aLA«B§NKL|BA#°B±wB²³
´Iµ¶`aEaDM?¦L·¸¹¯Lbº¶`A;<
c# ;<N»LfNA¼¹Bz{?½MFG±B
²³´Iµd?¯¾A;<I¿ÀLd
?LTÁ®¯Lb
;<cN±B²³´IµD¢L./z{BÂ_
`AÃ<_DFGH34567)8IFGKLÄ4IÅ Æ_DÇ-È?É®¢Lz{¦LbdBz{@A;<
cÊ ?Ë?AÌÍEWÎÏÐÑ_Ea|BÒ Ó¦LAÔB§EÕÖ¦Lb
1. 34567)8Buvר@ÙÚN\AÛDAÜÝ uvרNx_`ÏA·¸¹¯Lxy@Þßàá KLbº¶`Aâ`BãäI;<cNÉ®¢LDM N@åEßBÇ-ÈIJKLÐѦLb 2. BWæçèNE¶DãäAÇ-ÈIJ_é
KÐѦLb
3. vNÜÝêÓ¹_±Iëì?Eab 4. ;<cí¹67)8B¥îIïð?Eab
ñd?ò?@AÔ¿BÕÖIóôKLCDE./' 012_`A !"#$ IaD%õö./'01 2I÷9_Db
%õö./'012?@Aøùú[ûN34567)8 BüIný_AñBþ?Aí¹B?34567) 8BuvxyIA#°BFGHNaíEq
?§d?LøùFGHI#"_Db;<c@A ò./'012IaLdNAøùFGH
IKLÄ4IíEêÓ¹MLd?Lb NA67)8BFG±I%õKL©_`AøùFG HBêÓ¹BI%ê_E¹MLdNA
¦DÏí?I_`aL§E$I¤Ld
?AN67)8FG±B²³´Iµ
d?LTÁ®¯LbÛDA±þNAøùFG H·I9KL©IÒKLdNA67 )8BuvBINó?LTÁ®¯Lb ò?@A÷9_D%õö./'012Bâ%nJA
%õö./'012InJKL¨'+>BÑA' +'()#ABÖNa`Lb
電気学会研究会資料, 原子力研究会, NE-99-7-12, pp.19-24, 1999
2.
%õö./'012@A'012â%IÞßB'+
>N _`#!KLA"ö'+'()'0 12_`#"_Dbd¯NA#Bæ$IÑKL ÌÍE'+'()IA%&'(Eæ$©IÞßË
KLdN)*I"®¢`#?LDMA¡0 8I+,?AÛDA'012B-.Ï/0N¸Lbò 1?@A%õö./'012B2384nJ5 4nJNa`Lb
2.1.
%õö./'012B2384nJI61N7Kb
%õö./'012@ASEAMAIDABody Motion Simulator (BM Simulator)ACRT Monitor Simulation Process (CRT-MS Process)ASpeech Synthesis Process (SS Process)Virtual Space Drawing Process (VSD Process)nJ®¯Lb
SEAMAID@89:©B:Ü?÷9_D,),' )²)>3;0Wæ<(=>'012?¦ANuclear Power Plant Simulator (NPP Simulator)AMan-Machine Interface Simulator (MMI Simulator)Human Model Simulator (HM Simulator)?nJ®¯L[1]b
NPP Simulator@A?6PWRöB67)8'+
>?AÞßBuvרIÍ@?Lb
MMI Simulator@AANBWæBCIDµ_Aøù
FGHBErêFzGNyÝ`AøùFGH¿
B«B©ªIH`aLII_Añ¯¹B©ªBBCI HM SimulatorNJLb
HM Simulator@AøùFGHBjEI§'+
>?¦AðjKBjHIL_D*+,)&
-BMNONhPný®¯`aL[2]bHM SimulatorB Ñ@3.1.QNea`Lb
BM Simulator@AHM Simulator¹BøùFGHBq NRKLBCISNA [¹_aqIäJ_AVSD Process NTUIJLbBM SimulatorBÑ@3.2.QNea`Lb
VSD Process@øùú[IVÆKL6W=0?ANPP
SimulatorAMMI SimulatorABM Simulator¹Añ¯X¯A
34567)8B"áB¥îNRKLBCABWæ BCAøùFGHBEYZNRKLBCIX[
üøùFGHIVÆKLbVSD ProcessBÑ@3.3.Q Nea`Lb
CRT-MS Process@A¿N¬®¯L©ªBÂ?
¦LCRT MonitorBÆ\¿N]7®¯LIÍ@KL' +>?A34567)8B^_aBCI_`KLb CRT-MS ProcessBÑ@A3.4.QNea`Lb
SS Simulator@AHM Simulator¹øùFGH9KL û/IX[AøùFGHB9IÍ@KL'+
>?¦LbSS SimulatorBÑ@3.5.QNea`Lb
2.2.
%õö./'012B54nJI62N7Kb
%õö./'012@ASEAMAIDI#KLDMBMain WorkstationABM SimulatorACRT-MS ProcessASS ProcessI
#KLDMBSub WorkstationAVSD ProcessI#KLD MBÞßBGraphic Workstation-a06²A;<cBê ÓIçèKLDMB?bS,40A?bSI%êK LDMBcd'e>MfAøùFGHB9I_7 KLDMB0gU?nJ®¯A¨Workstation[@8
Nh¯`aLb
ò%õö./'012@A"ö'+'()'0 12_`Wæ_`aLDMAGraphic WorkstationIÞßi
j_A¨Workstation¿?ÊkNVSD ProcessI#KLd
NA¨Graphic Workstation¿N_7KL?bSB ÆlImKdEAÂBüIÜwNÞßBzG
¹MLnoI_`KLdp?¦Lbd¯NA Â B;<cøùFGHBêÓ¹BI%ê_E
¹%õ_AÜwNqB;<cAøùFGHB±BÄ 4IqBzG¹ëìKLdÏp?¦Lb
3.
ò1?@A%õö./'012InJKL¨'+
>BÑILb
Operation Information Indicator
Information
Alarm & Instruments Information
Main Simulation Workstation SEAMAID
Sub Simulation Workstation Operator's
Action & Position
Graphics Workstation Indicator
Information
Operator's Motion Design
Information
Speech Text Nuclear Power Plant
(NPP) Simulator
Man-Machine Interface (MMI) Simulator
Human Model (HM) Simulator
Body Motion (BM) Simulator Virtual Space Drawing
(VSD) Process
Speech Synthesis Process CRT Monitor Simulation Process
Operator's Action & Position
Monitor Information
Operator's Action
6Â %õö./'012B2384nJ
CrystalEyes
3D mouse Displays
Graphics Workstation
Network
Main Workstation
Sub Workstation
Speaker
CrystalEyes
3D mouse Displays
Graphics Workstation
6r %õö./'012B54nJ
3.1. Human Model Simulator
HM SimulatorBnJI63N7KbHM Simulator@AANA [BsTtuN¦LvÓtu(Focal Working Memory;
FWM)wxtu(Peripheral Working Memory; PWM)]
TtuNyDLjkz0?¦L34567)8Bj k(Knowledge Database for Anomaly Diagnosis){|wNe X L 6 7 ) 8 } ~ B j k(Knowledge Database for Emergency Operation)nJ®¯Lb
HM Simulator@MMI Simulator¹J¹¯L34567) 8B¥îNRKLBCISNAÔB}~?67)8B
xyI§b
1. 34567)8B¥îIêKLb67)8B¨7
³>Ajk_`µv¹N¯Dã äAñB7³>Nuv9c_DÏB_`
I÷ KLb
2. uvIðk_D7³>BNyÝ`A345 67)8BjkIa`A·¸¹¯L67)8 BuvרIuvר_``Lb
3. ·¸¹¯LuvרBûÂI_AñBuv
ר9c_DøI_DãäN·¸¹¯LB7
³>BBçI½ù_A#°NIïðKLb½ ù_aãä@ïI_A_Eaãä@ï
I,¹Kb
4. ï¦LIÏE¶DãäN@ñBu vרI_AN·¸¹¯LuvרB ûBÂICDN_A3.IKb
5. ï¦LIÏE¶DãäAñBuv
ר9c_DÏBI_A{|wNeXL67 )8}~BjkIa`xyI§b Ô¿B}~NAHM Simulator@AøùFGH¼
NqKA¼IHLA¼I«B§NK
BI§b
ò./'012?@AHM SimulatorBjkz0ljk z0IKL6W=0IçèKLdNAøùF GHNAÜÝuvרNx_`ÏAuE¶D}~?±I
¢DA[¶D±I¢LdÏp?¦Lb HM SimulatorB^Na`@A ·¡[2]I ¢®¯
Dab
3.2. Body Motion Simulator
;<c34567)8BuvwNeXLxy
B±BÄ4I²³´?L§NKLDMN@Aø ùFGH#°B ÜÄBq?IKLÐÑ
¦Lb
"áA BqI?bS£³'()_`äJKL z{@A¤_¥®¯`aLAò?@AV>
²2NøùFGHBqIäJKLÐѦLdA
B@A%&¦EaBqINOä¢`]"
?Ld|I·§_A?bS&'()e6¨e'0 12IaLz{I©_DbKEªA?bS&'(
)e6¨e'012Ia`hòEFGHBqIæ
«_Ahòq->z0IJKLbñ_`AøùF GHBqIäJKL°N@Ahòq->z0¹
ϬBqNaqI_Añ¯IçKLd
N¬BqIäJKLÏB_Db®%N@AF GHBqIA¯q©ªIKLqNXA¯
qNR_`@A]1N7K233BhòqIA©ª IKLqNR_`@]2N7K117BqIhò q->z0_`J_Db
dB}{NAüB°jBãmA°jBzG±B
¯qA%Bf\N¯D©ªIKLqN
a`O²yD10³30YZB´µEç_`æ$KL dpE¶DbøùFGHBqBäJz{B^
Na`@ ·¡[3]I ¢®¯Dab
Knowledge Database Search Process
Knowledge Database for Emergency Operation FWM
PWM
Anomaly Diagnosis Engine (Expert System)
Knowledge Database for Anomaly Diagnosis FWM
Process
Sensory Process Human Model
Simulator
Alarm Information
Instruments Information Input Output Operator's Action Operator's Position
6? Human Model SimulatorBnJ
]Â ¯qNxKLhòq->z0 hò->B hò->B ->ß
¯B¯ ÷ zG¶·¸zG¶·
¯rzG@30016
98
r¯B¯ ÷ zG¶·¸zG¶·
¯rzG@30016
98
¯@ÝM zG¶zG@30016 7
Iv¯ ¹ºfA»ºf 2
¯ zG¶zG@30016·
¯r·N¼O½Kºr
28
]r ©ªNxKLhòq->z0 hò->B hò->B ->ß
¾ ¿KzGr·©ªBEÀ 18 Á>)
é¹BÀ
é±BÀ
´µÁ>)81
99
3.3. Virtual Space Drawing Process
VSD Process@AøùFGHIKL
Ä4I?bS£³'()_`VÆKLbòQ?@A
BVÆz{AøùFGHBVÆz{AøùFG HBêÓ¹BIäJKLz{Na`Lb
3.3.1.
ò?÷9_D./'012?@AüN10ÊB
¬®¯Añ¯¹B¿NY20B©ªA äæY500ʬ®¯`aLb;<cøùú[ûB¨©
ªIHLdNAa?Ï67)8B¥îIïð?
L§NKLDMA¨©ªB®%Eß]7|ÏVÏ B_Db
d¯¹â`IÂVÃ)Ia`^NVãäAvN VÆ5a(Eæ$©ÐÑELbñd?ò
?@A©ªB^@AÂVÃ)IaAâ`10¨e Ia`VÆ_A®¹NA;<cBêÓÊkB©ªB ÄÅNyÝ`AV©ªB^I箢L Level Of
Detail(LOD)B}{IÆ_Db®%N@A;<cBêÓ
©ªBÄÅNyÝ`A©ªBVzIA1. ©ªBMB OVA2. ß]7ÔÇB©ªBâ%IVA3. ©ªB ß]7|Û?VAB?NX`VÆKLÏB_
DbÛDANPP Simulator¹@AèC®¯D©ªBB CBOX[LÏB_DbdB}{NAâ`B©ª Bß]7|Û?^NVãä%`AY1.5È;<
cBÄÅaãä¹5È;<c
BÄÅÉaãäBVÆÊI¤Ld?Db64 Nò}{?VÆ_DüIA65NI7Kb
3.3.2.
øùFGH@AËB]®lºB®|A#°B B¨
ÌEBͲÎIæ«_AñBTUIÏNCADIa`
¥IJ_Dbd¯NAøùFGHInJKLÂVà )BÏß@Y700ÊE¶DbÛDAøùFGHB¨ÌE N@A10¨eI.¶`aLb
øùFGHB}BÐBq@AÑB./'012?@A ñ¯Ò«í?¦LÐÑ@Ea·¸A¯qwN@Ó âN÷AÁ>)IÔKãäN@A÷aD¥î¹ÕkN Ö_ÐX×¾K¥îN箢L£³'()I_
7KLÏB_Db
3.3.3.
øùFGHBêÓ¹B@AhòN@BM Simulator Nea`ØM¹¯DøùFGHBYZNeXLAÙBE
zGISNäJ®¯Lb
¸¾AøùFGH¦L©ªNG¶`¯a`aLw N@A¿%Ú¯LDMAü¿»¹NÚ¯E¹A
¬B©ªÕkNE¶`a£³'()ä J®¯LbÛDAøùFGHÛLãäN@Aü
øùFGHBÙBÛNyÝ`ÕkNÜN¯L£
³'()äJ®¯Lb®¹NA©ªIKLãäN
@AxØEL©ªIêÝBþKNä¢E¹øùFG HB}©ªIKLÄ4IMLdNELb66N øùFGHBêÓ¹BI7Kb
3.4. CRT Monitor Simulation Process
ÑB./xØ_D34567)8B@A67 )8B¥îIÛM`]7KLCRT MonitorIθ`aL
AdBÆ\¿N@A67N7K§E8)Þ73
]7®¯Lãä¦Lbd¯¹BÆ\Iøùú[ûN?b S_`^NVÆKLãäAæ$©NÙE)*
L¿NAvNHNa½ù®¯Lbñd?Aò
?@ACRT Monitor Simulation ProcessIný_A¿
B CRT MonitorN]7®¯LÆ\B^@Aøùú[ûN
@VA?bSI_7KL-a06²@qB -a06²¿NrbSB_`VÆKLÏB_Db
®%N@ACRT-MS Process@AHM Simulator¹Aø ùFGH"á«B©ªIM`aLNRKLBCI¤
`Añ¯NyÝ`ACRT MonitorBÆ\¿NV¯Lû/
IôIKLb
68NCRT-MS Process]7KLrbSBI7Kb dBÆ\@AøùFGHH`aLCRT MonitorBN yÝ`V>²2NçKLb®¹NAøùFGHd BCRT MonitorBÆ\B«BÌI ¢_`aLBI7 KDMNAøù±H ¢_`aL7³>]7Ì NßàI]7_A ¢_`aL7³>ç_DãäA ñ¯NyÝ`AßàqKL©Ïný_Db
65
64 ü
3.5. Speech Synthesis Process
ò./'012?@AøùFGHBqIMLDMB
©Ná¸`AøùFGH·¸`aLû/IV>² 2N9®¢L©Ïný_DbñB°A;<cøùF GHB·Ió?L§NKLDMNAANÔ BãäN9®¢LÏB_Db
1. 67)8BuvIðk_Dãä
uv9c_Û_DbI÷ _ÛKb 2. uvרBI`Dãä
RCSâã9c_DBøäI`ÛKb 3. 67)8B7³>IHNãä
áåªå5IæÛKb 4. 7³>BI ¢_Dãä
áåªçE@èé®E¶`aÛKb 5. uvרB3êë_Dãä
bâã9c_D¯ÛKb 6. ìC9c_Dãä
6W=0&£>íjìC9c_Û_Db
#°N@ASS Process@HM Simulator¹J¹¯`Lø ùFGHB9û/NRKLBCISNA½M 9_
Dû/IÅî_`J_DÈ-aÈ3ï²IðcKL dNøùFGHB9IÍ@_DbñB°AÅîK LÈ-aÈ3ï²IAñòAqò|A¤N _A 9IäJKL°NÆóE3ï²IÞß_`Añ¯
¹I´µ_`ðcKLdNA½MôÎKÈ -aÈ3ï²BÏßI,¹K!õI¶Dbd¯NA
¸¾bâãBuvרIKL'+'()I
#KLDMNÐÑEÈ-aÈ3ï²BÏß@Y70
E¶Db
4.
%õö./'012B#_`ANPP SimulatorN RCSâãBuvI9c®¢DãäBøùFGHBq9 û/I]3]4NAñBwBøùFGHüûI
¯aDö÷I610N7Kbd¯¹BTUNAøùFG HAÒø#°BFGHÜÄBÊ®}~?AuvIð k_A67)8I_AxyI§dïð?
Lb
ÛDAò?_¥_D./'012IaLdN
A;<cA34567)8BuvxyBÄ 4Iëì?ABû/Ió?LdIïðKLD MNAüBß BcN./'012Iù_`
Ϲ¶DbñBTUÔB§E$ùI¤Ld?Db 1. øùFGHBêÓ¹BIML©IaLd
NAí?üBþI¯Ñ¶`aL$I
¤Ld?Db
2. øùFGHBêÓI%õKL©@eÏ_úab 3. øùFGH¼I·¸A¼I_§_`aLB
¶Db
4. '012IË_`aLûNûE¶`Db d¯¹BTUNAò./'012?@A'012B ËüøùFGHBqIMA9û/IýdN
AøùFGHB·qIó?Ldï ð?Db
ÛDAøùFGHBêÓI%õKL©@eÏ_ú aa§jH¤¹¯DdNAò./'012@A '012ËüBÉjþIKLp¦Ld
¶Db
zA'012IË_`aLûNûE¶`
DbBjH¤¹¯DA./'012IËKL dNA;<cBûELE¹¾A;<cB ÉjþI+p¦Lbº¶`A./'012IË
_`Ï'012ËüBûE¹Ea§N¼¹
BxI§ÐѦLb
5.
ò?÷9_D%õö./'012IA#°B;<N ËKLN@AÔB¬BáI§ÐѦLb 66 øùFGHBêÓ¹B
67 8)Þ73B
68 CRT-MS Process]7KLrbSB
1. ;<cí¹øùI?L©Bný
"wÓB%õö./'012IaLdNA;<
c@A34567)8BuvwNeXLArxy
BÄ4I²³´?L§NELTÁ®¯LAd¯
Ná¸`A;<c±B²³´I¤DNA;<cí
¹øùIKLdNA²³´Bïð
?L§NE¯¾A®¹NÉU¿L¯Lb
2. øùFGHpEuvרBá
"wÓB'012?@AøùFGHrxyp Euvר@ARCSâãSGTRBr?¦Lbf_D
§NA;<crxy IɤKuvר@
ÙÚNDA"áB'012?@ @¸Eab
AøùFGHBjkIlKdNArxy
pEuvרBIlKÐѦLb
3. %õö./'012B²)>3;0B
;<c]w[./'012IË_`ÏûE
¹EaÄA'012B²)>3;0IIKLРѦLb
4. %õö./'012BËNLÉUB<(
ÑA%õö./'012IË_`Ϲ¶DTUN
A'012BËüøùFGHBqIíNMA øùFGHB·Ió?Ldïð®¯DA
#°NA;<cAò./'012IaLdN
ÉU¿L«§B<(@_`aEabd¯Bïð ÏABÖ?¦Lb
6.
ò?@AøùFGH34567)8BI
KLÄ4IíEêÓrzG?MLd?AÜw NøùFGHB·ÏV>²2NjLd?
L%õö./'012B÷9I¶DbÑB?@A '012â%I"ö'+'()'012_`#
"_AñBqIïð_DbÛDA./'012I#°B
;<NËKLDMNAML±Na`Ï _Db
7.
SEAMAID@345 ©nBN÷
9_DÏB?¦Lb
< >
[1] H. Yoshikawa et al., “Development of an Analysis Support System for Man-Machine System Design Information”, Control Engineering Practice, Vol. 5, No. 3, 1997, pp. 417-425.
[2] Wu Wei, “67)8FGHBuvqB&-V)
Þ*+,)&-'+'()NLHCRFB
½{B”, *+,)²)>3;0, Vol. 1, No. 2, 1999, pp.11-23.
[3] H. Shimoda et al., “A Computer-Aided Sensing and Design Methodology for the Simulation of Natural Human Body Motion and Facial Expression”, Proceedings of EDA'98, 1998. (CD- ROM)
610 øùFGHB¯ö÷
] øùFGHBq
00:00 (Simulation start)
00:08 Notices the anomaly by a process monitor alarm 00:08 Suspects primary leak
00:24 Recognizes an alarm that Bu heater is ON 00:34 Confirms primary leak occurred
00:34 Suspects LOCA 00:48 Confirms LOCA occurred 00:50 Starts counter-operation of
pressurizer level & pressure
……….
02:26 Finishes the counter-operation 02:27 Starts emergency load down operation 04:38 Finishes emergency load down operation 05:00 (Automatically reactor tripped)
]? øùFGHB9 A-SG-çEIæÛK.
A-SG-çE@ç_`aÛ¢.
6W=0&£>íjìC9c_Û_D.
/ª0&£>IæÛK.
/ª0&£>B@E¶`aÛK.
·¸¹¯Luv@RCSâã?K.
º¶`RCSâãIæÛK.
rrrrrr
/ªÝ¦a&£>BçGIæÛK.
/ªÝ¦a&£>@èNá_"áÏáþ?K.
rrrrrr
áåªçEBçGIæÛK.
áåªçE@èN,¦_"áÏ,¦þ?K.
RCSâã9c_Dï_Û_D.
xyN»ÛK.