Xay dUUg Bo cong cu phan tich va xuT ly diir lieu anh quang hoc va radar
O TS. Ll/dNG THj HOANG HOAJhS. LOU QUANG THANG TS. BUI QUANG HUNG, PGSTS N G U Y I N THj NHAT THANH
GS. NGUYEN THANH THUY Dai hoc Cdng nghe - Dal hpc Quoc gia Ha Ndi
PGS. DOAN MINH CHUNG Ban chu nhiem ChUdng trinh KHCN Vu try Vidn Han lam Khoa hoc cdng nghe Viet Nam
Tom tit
Ky thuat xd ly anh viSn thdm vdi nen tang la xd ly anh sd da giai quyet dupe mgt sd van de ed ban trong khai thac, trich xuat thong tin tUanh viin tham vdi mot sd phan mem kha thdng dung nhU ENVI, ERDAS... song, mUe do chuyen sau va tU dgng hod chua cao va chi sd dyng trong linh vpc dan su Cdc phan mem ehuyen dyng trong linh vpe an ninh, qude phong (ANQP) thudng bj han ehe dieu kien thuong mai. Bdo cao nay trinh bay viec nghien cUu xay dung Bd cong cu phan tich va xd ly dU li^u anh quang hgc vd radar hd trp cdc chuyen gia trong viec xd ly dQ lieu anh vidn tham. Ket qua thij' nghi$m budc dau cho thay, Bg cdng cy cung cap 16 mo-dun phan tieh, xd ly tp dgng dd' lieu anh (quang hgc va radar) chuyen sau, tuy chinh tham linh hoat eae tham so va each thUc tUdng tdc than thien.
Gidi thi§u
Ky thult xii ly Inh vidn tham vdi nin ting la xQ ly Inh so da giai quyet dupe mdt s i van de cd ban trong khai thic, trich xul't thdng tin tU anh viin thim vdi mdt s i phan mIm kha thdng dung nhu ENVI, ERDAS... song mUc dp ehuyen sau va tu ddng hoi chua cao va chi sii dung trong ITnh vUe din su. Cac phan mIm chuyen dung trong iinh vUc ANQP thUdng bi han c h i dieu kien thUdng mai hoac ed gii thanh rat cac, ngoai kha nang tai chinh cua ngudi sii dung va gan nhU khdng tiep can dUdc y i u to khoa hpc edng nghd. Viec ehuyin giao cdng nghe chi gidi han d hudng d i n si!i dung, khai thac phan mIm. Tuy nhien, van d l dat ra la ben canh dO lieu anh thu dupe can phai nghien eUu, xay dung elc giai phip, cdng cy khai thac, trich xuat thdng tin ve doi tUdng muc tieu nam trong pham vi vung chup rpng Idn.
Trong bao clo nay, chung tdi trinh bay viec nghien cUu xay dung Bd cdng cu phan tieh va xU ly dQ lieu anh quang hpe va radar hd trd cac chuyen gia trong viee xii ly dQ lieu anh viin tham vdi 16 md-dun xii ly, gom: Hieu chinh bUcxa Inh VNREDSat-1 hoactUdng dUdng; hieu chinh bUc xa anh TerraSAR-X hoae tUdng dUdng; khCr nhiiu Inh ve tinh TerraSAR-X hoac tUdng dUPng; hieu chtnh hinh hpc Inh VNREDSat-1 hoac tUdng dUdng; hieu chinh hinh hoc anh TerraSAR-X hoac tUdng dUdng; trdn anh ting cudng dp phan giii
oo Tai nguyen va Moi Iftfirng Ky 1 - Thang 2/2020
image-sharpening cho Inh VNREDSat-1 hoac tUPng dUdng; sQ dung phUdng phip RXD; sCf dung phUdng phap eai tien RXD; sQ dung phUdng phip single- feature-base; SLf dung phUdng phip multi-feature- base; phan tach dd'i tupng dua tren gii trj dj thudng v l ngudng tren anh VNREDSat-1, TerraSAR-X hole tUdng dUdng; phat hien tau tren anh ve tmh VNRED- Sat-1 hoac tUdng dUdng; phat hien tau tren anh ve tinh TerraSAR-X hoac tUdng duong; phat hien gian khean tren Inh ve tinh VNREDSat-1 hole tUdng dUdng; phit hien giln khoan tren anh ve tinh TerraSAR-X hole tuong dUdng; phat hien biln ddng cdng trinh bien sQ dung anh ve tinh VNREDSat-1 hoac tUdng dUdng.
Phat trien Bo cong cu phan tich va xii ly dd lieu anh quang hgc radar
Phan tich yeu cau h§ thdng eua Bd cdng ey Dua tren danh sleh md-dun xis ly v l die ta yeu eau, nhdm phit then xac djnh Bd edng eu phan tich va XLf ly dQ lieu anh quang hpe va radar phii dip Ung 5 dac diem quan trpng: Kha nang tinh toin hieu nang eao; thdng lUdng truy xuat dQ lieu eao; tinh tUdng thich cao; khi ning da nhiem; tinh ddc lap.
Kien true he thd'ng eua Bg cong cy Trong nghien cUu v l trien khai he thd'ng quan ly tep tin (File System) si!f dung Hadoop d l neu bat len HDFS la mdt he thd'ng quan ly tap tin phin t i n co kha nang chju ldi cao va eung cap khi nang truy cap
thdng lUdng cao cho cac Ung dung va thich hpp vdi elc Ung dung cd xi!f ly dQ lieu I6n. Thiet k l kiln true cua Bp cdng cu dUpc xay dung dUa tren cdng nghe luu trQ cot loi la HDFS. TU dd, eae thanh phan h i trp tUdng tac dQ lieu va cac chiin thuat xi!f ly khac nhau dupe phat then. Kiln true tong quit cuoi cung gom 6 thanh phan.
Thanh phan ma nguon cua cac thuat toin xii ly (process code"): Vdi moi thanh phan xCr ly se si!f dung mpt hdae mdt so thuat toan va cdng nghe phat trien khic nhau. Do dd, de dam bao tinh thanh phan v l kha nang md rpng, cac thanh phan dUpc phat trien ddc lap va cung cap kha nang tUPng tac vdi ngudi phit then qua giao dien ddng lenh hoac Idi gpi ham. Dua tren kit q u i tim hieu each thUc xii ly va then khai cua 16 md-dun, thanh phan ma nguon cua elc thuat toan XLf ly dUdc chia thanh 4 nhdm: Cic md-dun xii ly cd ma nguon thuat toan yeu cau mdi trudng phit then Java: Vi du, thanh phan hieu chinh hinh hpc dQ lieu anh radar; elc md-dun xii ly cd ma nguon thuat toan ydu c l u mdi trUdng phat trien Python: Vi du, thinh phin phit hidn tau sQ dung Inh VNREDSat-1; cic md-dun xii ly cd ma nguon thuat toan yeu cau moi trudng phat then Python va C+-i-: Vi du, thinh phan hieu chinh bUe xa Inh VNREDSat-1; elc md-dun xCf ly phan tan cd ma nguin y§u clu mdi trudng phit then Seala: Vi du thanh phan xCf dung phUdng phap RXD.
Thinh phan ddng gdi cCia elc thult toan xi!; ly:
De cung cap mdt cdng cu ddn gian, hieu q u i ehd ngUdi SLf dung, toin bd ma nguon xQ ly sau khi phat trien hoan tat dUdc bien dieh v l ddng gdi thanh cic ddng gdi cija cdng cu. Cac thanh phan niy dupe luu trQ va quin ly tren miy ehu eua Bd cdng eu va san sang cho qua thnh gpi v l thuc thi.
Thanh phan lUu trQdQ lidu phan tin HDFS: Toan bp dQ lieu Inh se dupe lUu trQ tren he thdng quan ly tap tin phan t i n de toi Uu tde dp truy xuat dO lieu va dam bao k h i nang chju loi, an toan dQ lieu.
Cdng nghd trien khai cac md-dun xii ly
STT 1 7 1, 4
•i
' ,
9
LI
12
n
14 15 16
^[6l1<U1 \iiij H i n i c h m l i b i i c M i i i l i V N R E D S a l - l holeWOngduong Hi?u chmh hiic x» anh TenaSAR-X hojc nrane duong Khir nhicu i n h v6 imh TenaSAR-X ho)c njonB d u r a i Hieu chfnh hmh hpc anh VNREDSal-l hojc nrong dmmg H i p i chmh hmh hpc anh TetraSAR-X ho)c nroiig dinrag Tion anh iSng cinniE lip phan giai image-shupening cho Sob VNREDSai-L hoJc tinmB dUoHB-
Sir dimg phinmg phjp RXD
Su dunE phiroiiE phap sinple-fealiue-base
Phan lich doi nrong d m iKn p a Oi d) lhiiOn| \a TiffiHng Iren anh VNREDSal-1. TcriaSAR-X hojc mong <Iirang Phil hihi lAu ucD inh ve unh VNREDSal-1 hoJc tuong dirong Ph.i v . , ^ 1.11 iifr inh ve unhTenaSAR-X hoJc luong ducrag.
PhaihiniEJankhMntiraiiahvconhVNREDSa:-! bofc ttrong (tmrag.
Phil hi!ii gian khoan nui inh w toh TenaSAR-X hoJc luong diimig H a l ben b i n < J ^ congWnhbiaiEildimginlivelinti VN'REDSal-l ho3c luong dirong. _
Cons iiEhf lIlHI khni Pylhon va C - Pyihon Vi C++
Pylhon va C*+
Pylhon va C++
Pylhon v i C++
pylhon va C++
Scala Scala Python
Pylhon
Pylhon Java
Java python
Giao dien tUdng t i c ngudi dung: mdt may chCi cung cap dich vu web dupe xay dUng vdi chUe nang tUdng t i c giOa ngudi dung, he thong luu trQ phan tan v l cae thult toin xQ ly.
Cd sd dQ lieu: 2 loai co sd dQ lieu dupe sQ dung kit hpp:
Cd sd dQ lieu quan h§: Vdi ele dQ lieu cd cau true nhu eay thu muc, elc thdng tin ho trp quan ly thU muc va tep dUdc lUu trQ trong PostgreSQL.
Cd sd dQ lieu NoSQL: he thing may chu dieh vu eung cap giao dien cua Bp cdng cu dUdc lien kit vdi mpt he quin tri ed sd dO lieu khdng quan he MongoDB d l tang hieu ning cua he thong v l tUdng thich vdi edng nghe si!f dung tren mIy ehu djch vu.
Cac ham thuc thi: Cac ham thuc thi nay dupe eai dat tren may chu web giup khdi chay thuat toan khi cd yeu cau v l dau vao tU phia ngudi dung. Thanh phan bao gom elc chUe nang chuyen nhan trang thai v l thdng bio glQa thult toin xii ly tren may chu va giao dien de cung cap thdng tin cho ngUdi dung.
Quy trinh hoat dgng
Quy trinh hoat ddng cua bd edng eu II sU k i t hdp eua tat c l cac thanh phan cua he thong. Tuy nhien, ele thanh phan nay dupe eai dat tren mIy chu va tich hdp tU ddng. Ngudi sU dung chi ed the tUdng tie vdi thanh phan (iv) giao dien tUdng t i c cua Bd cdng cu. Quy trinh hoat dpng cP bin cua Bp cdng cu nhusau:
Ngudi dung truy cap Bd cdng cu thdng qua (iv) giao dien tUdng tic ngUdi dung tren nen tang web.
Thanh phan (iv) se truy xuat danh sach va thdng tin tren (v) cd sd dQ lieu de hien thj eae md-dun xQ ly cho ngudi dung. Dong thdi, (iv) se lac vdi (iii) thinh phan luu trQ phin tan de eung cap ele chUe nang tUdng t i c v l quin ly dQ lieu.
Ngudi dung sQ dung chUc nang quan ly dQ lieu de dang dQ lieu len he thong. DQ lieu Inh viin tham dupe tiep nhan va dupe thanh phan (ill) xii ly de luu trQ phan t i n dQ lieu tren toan he thong. Thanh phan (iii) cd chUe nang quin ly tap tin phan tan va cac may tinh bj quan ly bdi thanh phan nay dupe chia thanh 3 vai trd "Name-node", "Data-node" va "Clienf. De lUu trO mpt tep tin, (ill) sLf dung thult toin "Rack Awareness Algorithm - RAA". Dau tien, Client chia tap tin can luu trQ thanh nhiiu khd'i va mdi khoi dupe tao them eae bin sao de d i m bio khi nang chiu loi va gia tang hieu suit doc dQ lieu. Kich thude mac djnh eua mdi khd'i la 128IVIB va so ban sad mac dinh la 3. Sau dd.
Client gCfi yeu cau den Name-node de ghi ele khoi nay v i o HDFS. Name-node sQ dung RAA de xac djnh danh sach Data-node dupe cap phit de luu dQ lieu nhu sau doi vdi mdi khdi:
Tai nguyBii va Moi titfctnii n q Ky 1 - Thdng 2/2020 *
B i n s a o thU nhat d u p e luu n g l u nhien tren mot "Data-nodes"
k h d n g q u a day dQ lieu hoac dang b a n . B a n sao thU hai dupe luu trQ t r o n g m p t " D a t a - n o d e s " khac gia (rack) vdi ban sao dau tien. B i n sao thU ba dupe lUu trQ trong cung mdt gia vdi ban sao thU hai nhung k h i c
"Data-node". Sau d d , N a m e - n c d e gCfi lai c h d Client m p t d a n h s l e h cac Data-node dUpc sCf d u n g de ghi c i c khoi dCf lieu. Client ghi cae khoi len c u m H D F S theo d a n h sach da dupe eung cap. Ban sao thU nhl't e u a khoi A dupe luu trQ trong Data-node-1 c i j a R a c k - 1 , b i n sao thU hai v l thU ba cDa khoi A dupe luu trQ trcng Data-node-11 va Data-node-12 ci!ia Rack 2.
Client thUc hien tUdng tU vdi BIdck B va Block C v l t o i n bd dQ lidu dupe lUu trQ trong (iii).
Ngudi d u n g lua chpn md-dun xii ly, dQ lieu dau v a o dang dupe lUu trQ tren (iii) va lua c h p n e l c tham s i .
T h a n h p h a n (iv) se gQi e l e t h d n g tin xQ ly cho (vi) cae h i m thuc thi. C a c ham thuc thi nay se kieh hoat eae (ii) t h i n h phan d d n g cCia (i) m a nguon xCf ly. Dong thdi (iv) se kiem va lien tuc thu n h i n eae thdng bao va tinh trang xii ly c u a t i l n trinh de hien thj cho ngudi s i ^ d u n g thdng qua (iv).
Ket q u i
N h d m n g h i e n cUu da t h e n khai Bp c d n g cu p h i n tich va xi!f ly dQ lieu I n h quang hpc va radar vdi 6 thanh phan h o l n thien cung c a p 16 m d - d u n xQ ly, 1 m d - d u n tich hdp, lUu trQ, tuong t i c dU lieu va 1 m d - d u n xac thuc, p h i n q u y i n . C l e m a n g u o n xQ ly c u a 16 m d - d u n xii dupe phat then va tich hdp.
B d c d n g cu cung cap giao dien w e b de tUdng t i e vdi ngudi dung. 6 d i y , ngUdi sCf dung ed the q u a n ly, thao t i c vdi dQ lieu nhu:
T i i len, tai xuong dO lieu, x e m
a A T a i n g u y a n v a Moi trtfofng ' ' " Ky 1 - Thang 2/2020
thdng tin dQ lieu, q u a n ly cay t h u muc. Giao dien n i y cung cap danh s i c h cac md-dun xCf ly. NgUdi sQ d u n g cho the chpn m o - d u n xii ly mong muon. Vdi mdi mo-dun xCf ly, giao dien gom 3 phan:
Lua chpn dQ lieu dau vao: Tuy thupc va md-dun xii ly, dQ lieu dau v l d c c the la mpt I n h ve tinh, n h i i u I n h ve tinh hoac eae dQ lieu phu trd k h i c . Cac dQ lieu nay can dupe d a n g tai len bd c d n g cu v l dUdc lUu trQ tren H D F S trudc khi c d the nhin thay v l chpn la dau vao cija qua trinh xii ty.
LUa chpn tham so: Sc lUdng va e l e loai tham so thay d l i phu thude v i o m d - d u n xi!f ly, dQ lieu dau vao v l e l c tham so trUdc dd.
Thdng tin xi!f ly: Sau khi l i n h thue thi dupe chap nhan trong Bp cdng eu, giao dien tUdng t i c se gpi thanh phan thUe thi va m a nguon t h u l t t o i n tUdng Ung. Cae thdng tin XLf ly nhu tinh t r ^ n g , thdng b i o , ldi dupe may chu kiem tra lien tue v l hien thi true tuyen eho ngUdi dung. Ngoai ra, Bd edng cu cung lUu trQ tat ca e l c thdng tin xif ly va cd the xem lai khi can t h i l t .
Ket luan
Trong bao cao nay, ehung tdi da trinh bay c i c h thUe t h i l t k l xay dung bd edng cu phan tieh va xQ ly dQ lieu I n h quang hpe va radar. K i t qua bude dau cho thay, Bd cong cu nay cung cap kha nang phan tich va XLf ly dU lieu anh quang hpc va radar hd trd cae ehuyen gia trong viee xii ly dQ lieu v i i n tham chuyen sau vdi c i c h thUe tUdng tac than thien. Tuy nhien, B d cdng cu v i n chua tan dung dupe k h i n i n g eua ha t i n g va ehUe nang quan ly tien trinh edn k h i ddn g i l n . Trong tUdng lai, nhdm t i e g i i se t i l p tuc phat trien bd cdng cu on djnh va hieu n i n g tinh toan cao hdn. Ngoai ra, cac md-dun tinh toan mdi se dUdc nghien cUu va tich hpp de m d rdng b p c d n g e u .
Ldi e l m dn
Chung tdi ckm an ^ tai nghidn eOu khoa hoe cd'p Nha nUdc ma sd VT.UD.06/16-10 thuoc ChUdng trinh Khoa hoc ddc lap cSp nha nude vS Cong nghe Vu tru giai doan 2016-2020 da hd trd thUc hien nghien edu nay.
Tai lieu tham k h I o 1. "ENVI - The Leading Geospatiat Analytics SoftwarelHarhs Geospatiat."
[Online]. Available: https://www.
h a r r i s g e o s p a t i a l . c o m / S o f t w a r e Technology/ENVI.aspx. [Accessed:
l l - J u l - 2 0 1 8 ] ;
2. R, Pouncey, K, Swanson, and K. Hart, "ERDAS Field Guide.
Fifth Edition, Revised and Expanded,"
Imagine, 1999;
3. "VNREDSat-l Satellite Missions - eoPortal Directory. "[Online].
Available, https://directory.eoporial, org/web/eoportal/satellite-missions/
v-w-x-y-z/vnredsat-1. [Accessed:
14-May-2018];
4. "Radiometric Calibration of TerraSAR-X Data Beta Naught and Sigma Naught Coefficient Calculation," 20-\ 4-;
5. R. Riehter and D. Sehlipfer,
"Atmospheric / Topographic Correction fa-Satellite Imagery," Aerospace, 2011;
6. 8 . Li and B. Yang, "A new pan-sharpening method using a compressed sensing technique,"
IEEE Trans. Geosci. Remote Sens., 2 0 1 1 ;
7. L. V. Hung, "Operational Detection and Management of Ships in Vietnam Coastal Region Using Vnredsat-1 Image," 20-\6;
8. R. Rajak, D. Raveendran, M.
C. Bh, and S. S. Medasani, "High Resolution Satellite Image Processing Using Hadoop Framework," in 2015 IEEE International Conference on Cloud Computing in Emerging Markets (CCEM), 2015, pp. 1 6 - 2 1 ; 9. V. Mali, A. Jadhavar, G.
Mahimane, D. Chikmurge, and A.
Professor, "Retrieval of Satellite Images over Hadoop Distributed System,"lnt. J. Innov. Res. Gompu;
Commun. Eng. (An ISO Certif.
Organ., vol. 3297, no. 2, 2007.B
