Independence in Evaluating Web-Sites Within Ministry of Agriculture

(1)

(2)

Independence in Evaluating Web-Sites Within Ministry of Agriculture

Edi Abdurachman (Author)

Center for Agricultural Data and Information Ministry of Agriculture

Jakarta, Indonesia edi@deptan.go.id

Yenni Tat (Author)

Center for Agricultural Data and Information Ministry of Agriculture

Jakarta, Indonesia yenni@deptan.go.id

Abstract—In promoting the use of Information Communication Technology (ICT) to increase the efficiency and the effectiveness of the government services, the Government of Indonesia has issued a Presidential Instruction No. 3/2003. The instruction asks that all Government institutions must make use of the ICT to increase its public services. In line with this, Ministry of Agriculture of Indonesia (MoA) has also done some efforts toward this; one of them is Web-site contest among units within MoA. The contest has been done since 2004. The contestants are grouped into three categories: 1. Directorate General/Agency level; 2. Agricultural Provincial Office; 3. Agricultural District Office.

To implement the web-site contest, the MoA has appointed five jurors, which assisted by the Secretariat Committee Team. To evaluate whether any significant differences among jurors in giving the score to the web-site evaluated and what factors that might be related to the web-site scores, some analysis have been done. The variables are included in the analysis are Juror score, Juror, Level of the institution, Previous achievement in the contest, Location of the institution whether in Java or outside Java. The statistical methods used in the analysis are Multiple Linear Regression and Analysis of Variance. The analysis is based on the data from the MoA Web-site Contest for the year of 2008-2010. This research concludes that the jurors giving the score on web-site evaluated objectively. The factors that affecting the quality of the web-site are the institution level and achievement of the previous year (the best 3 or not).(Abstract)

Keywords-ICT, independence; evaluation; web-site; e-gov;

I. INTRODUCTION

Information Communication Technology (ICT) plays a major role in various aspects of live, including in running the government affairs. ICT can improve the productivity of civil servants.

In promoting the use of ICT to increase the efficiency and the effectiveness of the government services, the Government of Indonesia has issued a Presidential Instruction No. 3/2003. The instruction asks that all Government institutions must make use of the ICT to increase its public services. In line with this, Ministry of Agriculture of Indonesia (MoA) has also done some efforts toward this; one of them is Web-site contest among units within MoA. The contest has been done since 2004. The contestants are grouped into three categories: 1. Directorate General/Agency level; 2. Agricultural Provincial Office; 3.

Agricultural District Office. To implement the web-site contest, the MoA has appointed five jurors, which assisted by the Secretariat Committee Team.

The objectives of the research are : 1. To know how objective the jurors giving the score on web-site evaluated; 2. To identify what other factors that affecting the quality of the web-site.

II. LITERATURE RIVIEW

2.1 E-Government

E-government, based on The World Bank definition is the use of information technology by government offices for better services to people, business and to facilitate cooperation among government institutions. The use of E-government is expected to empower the community through public access to information resources available [1]. Based on Ministry of Communication and Information Technology, E-government is an effort to develop the implementation of governance-based (use) electronically in order to improve the quality of public services effectively and efficiently.

Based on Presidential Instruction No. 3/2003 [2], the strategic objectives of e-government can be achieved through the implementation of 6 (six) closely related strategies, namely:

a. Develop a service system that is reliable, trustworthy, and affordable by the public;

b. Restructure management systems and work processes of government and the autonomous regional government in a holistic manner;

c. Optimally utilize information technology;

d. Increasing the role of the private sectors and develop the telecommunication industry and information technology; e. Develop human resource capacity at both government and the regional government, coupled with the increasing e-literacy communities;

f. Carry out systematic development through the stages a realistic and measurable activities.

Based on the nature of the information transaction and public services provided by government through information networks, development of government can be implemented through 4 (four) stages as follows:

(3)

Page 2 of 8 - Preparation of an easy-access facilities such as

Multipurpose Community Center which provides facilities, internet cafes, SME-Center, etc.;

- Dissemination of information sites for both internal and to the public.

Level 2 – Maturation stage, include:

- Developing an interactive public information sites; - Making a connection interface with other agencies. Level 3 – Consolidation stage, include:

- Providing public services transaction site;

- Making application and data interoperability with other agencies.

Level 4 – Utilization stage, include:

- Making an application for service is G2G, G2B and G2C integrated.

2.2 How to Develop a Good Web-site

According to Ministry of Communication and Information Technology, there are 5 (five) issues that need to be considered in building and implementing a strategy online media publications [3], namely:

1. Usability - the purposes of what a local government presented in the form of online media?

5. Updating and maintenance - how to conduct monitoring and updating the information on local government web-site?

2.3 Government Web-site Development

Government Web-site can be said as a medium of information and communications from a government agency in public about anything related to government agencies concerned. Making government web-sites have targeted to the Indonesian people can easily gain access to information and services for government agencies.

Government web-site was made in accordance with the wishes of government in providing services to the community, namely:

1. Easy acquisition of information, true, fair, and broad coverage;

2. Dissemination of information through electronic media including:

- All ingredients that have been published or materials that are outside copyright protection (can be known by the public);

- All information created and collected according to the law (subject to considerations of commercial sensitivity and privacy);

- All necessary documents for public interests. Government web-sites should focus on:

a. Provision of information and public services that people want to continually evolve in the provision of information and public services;

b. Achieving universal accessibility and usability; c. Provision of interactive services;

d. Discriminatory treatment not for visitors, it means the government web-site can be opened without distinguishing facilities and computer capabilities possessed by the visitors.

One of the key commitments from the government is to provide community services that are responsive in meeting the needs of all different groups in society.

2.4 Standarization of Web-Site Development

Based on the Web-site Management Handbook publised by the Ministry of Communication and Information Technology in August 2003, the most important element of an effective web-sites on the Internet is must be good content and design [4]. Government web-site content is the information delivered by a government agency to the public. Government web-sites is a government-owned communications media, and therefore the information conveyed not only information initiated from government agencies (one-way communication), but also must consider information needed by the community (two-way communication). Minimum content of government web-sites differ between the central government agency web-sites and web-sites of local government agencies.

Minimum content of the central government agencies web-site are:

a. Organization of central government institutions

Explaining the vision and mission, duty and function, organizational structure, the Strategic Plan, Echelon II officials (if possible include e-mail address), biodata of the minister and first echelons, the information (office address, phone / fax, e-mail address) of government agencies. b. News

Each central government agency web-site must present news related to their institutions. News is presented can be from the internal institutions of the central government or from media (central and regional).

c. Regulation/Policy

Regulation/policy and all its derivatives, which have been issued by the related central government agencies. The web-site of central government institutions is one of the media to disseminate regulations/policies which have been released to the public.

d. Description of the Directorate-General/Deputy

Assuming that not all people know exactly about the organization and what kind of information is available at a central government agency, then on the web-site of the central government agencies should have a detailed description of the Directorate-General or Deputy within respectives institutions. If possible, provides a link to the web-site of each Directorate.

Minumum contents of local government web-sites are: 1. At a Glance

(4)

Page 3 of 8 Explain briefly on the existence of the Local

Government (history, local motto, symbols and meaning of symbols, location in map form, vision and mission).

2. Local Government

Describe the structure of organizations in the respective Local Government (executive, legislative) along with name, address, phone, e-mail from local officials. If possible biodata of the Regional Leadership is shown to the wider community.

3. Geography

Explains among other things, the topography, demographics, weather and climate, social and economic development, culture of the area concerned. All information in the form of numerical or descriptions should include the information of the source data.

4. Area Map Resources

Presents in the form of district boundary map of the area (preferably use a reference map issued by the Coordinating Agency for Surveys and Mapping Agency - Bakosurtanal, or other government agencies that have a fundamental duty and function of the map maker), and also the resources owned by the respective regions in the form of maps resources (used in reference maps issued by government agencies that have a fundamental duty and function of the map maker) that can be used for the purposes of the user.

5. Regulation/Policy Areas

Explaining the Regional Regulation issued by the Local Government. Through this web-site all the new local legislation, that has been issued, can be disseminated to the public.

6. News

News from the local government institutions, not taken from local newspapers. It is expected that local government news web-site to be a reference to the news published by local newspapers.

In addition to the contents of at least six of the above, government web-sites also must be capable of interacting with the public through two-way communication between managers and web-site visitors through the Forum Discussions, suggestions, visitors in the guestbook.

Homepage on a web-site identical to the cover of a book which was published previously. An interesting form of the homepage will have the impression for visitors to the web-site to learn more about the contents of the web-web-site concerned. A homepage of the web-site of the local government at least must present information on the following matters:

1. Name of Local Government;

2. Logo or symbol of the Local Government;

3. Office address, telephone and fax numbers, e-mail address of the Local Government;

4. An image that provide information on something interesting from the respective regions (landmarks), can be shaped landscape, monumental buildings, or superior products;

5. A text relating to the existence of local government web-site (jargon);

6. Contact e-mail (e-mail address of the Site Manager) to submit a request or information;

7. Links to the content available on the web-site of local government;

8. Search facility.

In addition to the contents of web-site, things that need to be handled by local government web-site administrator is the default web-site design presentation (visualization), which includes the homepage and navigation, the form of

Internet users in general do not like waiting. They do not like to linger just to wait for the emergence of the accessed information from the web. As much as possible the manager must optimize web design in order not to be too heavy to be accessed, even if using dial-up connection. The ideal speed of about 8-12 seconds. Optimize return web components (images, HTML, JavaScript, CSS) if you have not reached that number.

2. Contents readability

As much as possible not to use too small font, and color contrast that makes eyes tired quickly. Make your guests comfortable for reading the information provided, without having to change the font settings on your browser or even to change Brightness & Contrast on the monitor.

3. Consistent design layout

Design from one page to another must be made consistent to facilitate visitors to find content that is provided. Visitors will get confused if the menu is placed on the first page and second arbitrary position. Create a visitor easily adaptable, with a lightweight design and navigation is user friendly.

A government web-site should focus on:

a. Provision of information and public services that people want to continually evolve in the provision of information and public services;

b. Achieving universal accessibility and usability; c. Provision of interactive services;

d. Discriminatory treatment not for visitors, it means the government web-site can be opened without distinguishing facilities and computer capabilities possessed by the visitors.

2.5 Government Web-site Ranking

(5)

Page 4 of 8 5. Measure the quality of interaction (usability);

6. Readibility; order to perform the determination of the government site rating. The four criteria to evaluate a government web-site are:

1. The web-site functions; 2. The web-site quality; 3. View web-site; 4. Innovation.

2.6 MoA: Organization Structure, CADI

Center for Agricultural Data and Information (CADI) is a supporting office within the Secretariate General of the MoA that responsible for the development of agriculture information system. The function of CADI is to develop agricultural information system, provide data and information services, and provide guidance for other institutions within MoA [6].

Based on the Ministerial Decree No. 341/Kpts/OT.140/9/2005 dated September 8, 2005, the organization of CADI comprises of Information System Development Division, Data Foodcrop and Livestock Information Services Division, Data Horticulture and Estatecrop Information Services Division, Administrative Affairs Division and Functional Staffs (Annex Table 1).

Annex Table 1. Organization Structure, CADI.

CADI has a vision of providing accurate and reliable agricultural data and information, and its mission are

developing statistical methodology, keeping up and improving agricultural information system, providing and distributing the agricultural data and information, building up and providing qualified as well as reliable agricultural human resources.

With this mission, each operating unit within MoA should also functions as an information center, which collect, compile and develop database, and conduct statistical analysis and dissemination, in order to provide information to all users, and primarily to fulfill the needs of its own regions all over the country. For this purpose, it is necessary that all information centers be connected to each other through communication media such as Internet.

2.7 The Development of e-Gov in MoA

The development of e-Governmnet in MoA initiated with the construction of the MoA web-site. Web-site development of the MoA (http://www.deptan.go.id) was started in 1996 [7]. CADI initiated these activities by providing a menu that displays various data and agricultural information. In the following years web-site development is done by completing of menu that displays the information by category related to the function of Echelon I within the MoA. Also, in line with developments of information technology, the MoA web-site was developed as an interactive communication medium in the dissemination of agricultural information and data.

Furthermore, as part of its commitment to its service excellence in providing and disseminating data and information to all users, since 2002 has established a Web-site Management Working Group of the MoA and Editorial Team establised by Decree of the Minister of Agriculture No.508 and 509 Kpts/Kp.150/9/2002. The team members consist of management data and information across all units of the Echelon II within of the MoA. Activities and updating of the data and information become more coordinated. In addition, it has gradually built Echelon I web-site that provides information according to their respective functions in the Echelon II.

2.8 Web-site Contest within Ministry of Agriculture

In an effort to maintain continuity of the MoA web-site development, since 2004, CADI has conducted a web-site competition among Echelon I of the MoA. The following year, in addition to competition among the Echelon I web-sites, its also implemented a web-site competition among the Local Government Unit of the provincial agriculture offices and the Local Government Unit agricultural districts offices. The purpose of the conducting the web-site competition are:

1. To motivate all the Echelon I of the MoA, all the provincial and district agriculture offices to provide and update data and information displayed;

2. To support the acceleration of the implementation of e-Government;

3. To provide services to the people who communicate and interact with the government institution.

To carry out the assessment web-site, CADI appoint five jurors from five different agencies. Assessment criteria for

(6)

Page 5 of 8 the web-site competition refers to the parameters used by the

Ministry of Communications and Information Technology in the conducting of government web-site rating. The respective web-sites offices of the provincial and district agriculture offices. This makes the MoA web-site content is also increasingly enriched with links to each of the regional dan district web-sites. (whether central, provincial, or district), achievement the previous year (the best 3 large or not), and location of institution (whether in or outside of Java).

The data to be analyzed consists of the average value of the jury for the 12 team of Echelon I web-site, the 10 of the web-sites of provincial agricultural offices, and the 10 of the agriculture district offices web-site with a rating scale of 1-100.

Research Model

This study aims to determine how the jurors giving the score on web-site evaluated and to identify what other factors that affecting the quality of the web-sites.

To evaluate whether there are significant differences among the judges in giving scores to the web-site evaluated, the an Analysis of Variance (ANOVA) statistical methods was used. The hypothesis is the following:

H0: μ1 = μ2 = μ3 = μ4 = μ5

H1: at least one μi≠μj

Level of significance (α) used in this study is 0.05. If F value ≥ F critical value then reject H0, but if the F value <F of the web-sites, Multiple Linear Regression Analysis was used. It will be analyzed whether the jury was influenced by the level of institutions (whether located at the central level, provinces, or districts), achievement of the previous year; and location (outside of Java, or Java). Regression model to be tested are:

Y = β0 + β1L1 + β2L2 + β3A + β4L + Ɛ

Description:

Y = average value of jury β0 = constant

β1 = coefficient of the dummy of the institution level-1

β2 = coefficient of the dummy of the institution level-1

β3 = coefficient of the dummy variable for the achievement

of the previous year

β4 = coefficient of the dummy location

L1 = dummy variable-1 for the institution level

L2 = dummy variable-2 for the institution level

A1 = achievement the previous year (the best 3 large or not)

L = location

To determine whether the variable affect the dependent variable (Y), an individual coefficient regression testing will be done partially. The hypothesis used was:

H0: βi = 0 with i = 0,1,2,3,4

H1: βi ≠ 0

Level of significance (α) used was 0.05. If P-value <α0.05 then reject H0, but if the P-value ≥ α0.05 then H0 is accepted.

IV. RESULTS

To calculate the ANOVA, the analysis are done by using Microsoft Office Excel 2007. The result of the statistical tests are as follows:

- Category Echelon I - year 2008

From the Annex Table 1. is shown that F7.69≥ F2.54, so we can conclude that H0 is rejected at α0.05 which means that at least there are two jurors who gave different assessments on the web-site in 2008.

From the Annex Table 2. is shown that F1.37 <F2.54, so we can conclude that H0 is accepted at α0.05 which means that the jury gave the same assessment on the web-site in the year 2009.

From the Annex Table 3. is shown that F1.47 <F2.54, so we can conclude that H0 is accepted at α0.05 which means that the jury gave the same assessment on the Echelon web-site in 2010.

- Category Province - year 2008

From the Annex Table 4. is shown that F14.88≥ F2.58, so we can conclude that H0 is rejected at α0.05 which means that at least there are two jurors who gave different assessments on the web-site provincial agricultural office in the year 2008.

From the Annex Table 5. is shown that F4.82≥ F2.58, so we can conclude that H0 is rejected at α0.05 which means that at least there are two jurors who gave different assessments on the web-site provincial agricultural office in the year 2009.

From the Annex Table 6. is shown that F1.62 < F2.58 so we can conclude that H0 is accepted at α0.05 which means that the jury gave the same assessment on the scope of the web-site provincial agricultural office in the year 2010.

- Category District - year 2008

(7)

Page 6 of 8 From the Annex Table 7. is shown that F62.49≥ F2.58, so

we can conclude that H0 is rejected at α0.05 which means that at least there are two jurors who gave different assessments on the web-site district agricultural office in the year 2008.

From the Annex Table 8. is shown that F10.72 ≥ F2.58, so we can conclude that H0 is rejected at α0.05 which means that at least there are two jurors who gave different assessments on the web-site district agricultural office in the year 2009.

From the Annex Table 9. is shown that F0.74 < F2.58, so we can conclude that H0 is accepted at α0.05 which means that the jury gave the same assessment on the web-site district agricultural office in the year 2010.

To determine the significance of the regression model of each year, the assessment used the following Annex Tables: - Jurors assessment in 2008:

Annex Table 10. shows that only the P-value for the variable-2 for the institution level and achievement the previous year (the best 3 large or not) that smaller than α0.05 which means for these variables reject H0. So the

estimate regression model is: Ŷ2008 = 62.57 + 5.5L2 + 9.1A.

- Jurors assessment in 2009

Annex Table 11. It can be seen that variable for location have P-value0,60> α0.05 which means that for this variable accept H0 and other variables rejected H0. So the estimate

regression model is:

Ŷ 2009 = 42.27 + 12.97L1 + 15.79L2 + 18.15A.

- Jurors assessment in 2010

Annex Table 12. shown that only the P-value for the variable-1 for the institution level and achievement the previous year (the best 3 large or not) that smaller than α0.05 which means for these variables reject H0. So the

estimate regression model is: Ŷ 2010 = 55.05 + 13.72L1 + 16.69A.

V. CONCLUSION AND RECOMMENDATION

From the results of statistical test, the assessment of the jury for the category of Echelon I within of the MoA in year 2009 and 2010 tended to rate better than in year 2008 because the average value of each of the jurors did not differ significantly. Assessment of the provincial level, the avarage score given by the the jury were significantly different only in the year 2008 and 2009. Similarly, the analysis show that the same conclusion obtained for the category of the district agricultural offices.

From the regression results of the year 2008, we can conclude that variable-1 for the institution level and variable location of the central agencies (outside of java or java) does not influence scoring given by the jury. Factor that affecting the scores are variable-2 for the institution level and achievement of the previous year (the best 3 or not). Both variables make a positive contribution in the assessment of each jury. For the year of 2009 regression results, variable institution level and achievement the previous year (the best 3 or not) was also influenting in the assessment of the jury. In the year of 2010, which affect the assessment of judges are the institution level and achievement the previous year (the best 3 or not).

REFERENCES

[1] Pusat Sumberdaya Geologi, “Pengembangan dan Implementasi e

-Government”

http://psdg.bgl.esdm.go.id/makalah/e_Gov%20PSDG.pdf. [2] Instruksi Presiden Nomor 3 Tahun 2003.

[3] Kementerian Komunikasi dan Informasi, “Panduan Penyelenggaraan Situs Web Pemerintah Daerah”, 2003.

[4] Kementerian Komunikasi dan Informasi, “Acuan Rating Situs Web Pemerintah”.

[5] Kualitas Web-site menurut SEO,

[http://illtorro.blogspot.com/2009/07/kualitas-web-site-menurut-seo.html].

[6] Leaflet Pusdatin 2010.

(8)

Page 7 of 8 Annex Table 1. ANOVA Table Testing Differences Among Jurors for

Echelon I Category for the year of 2008

Annex Table 2. ANOVA Table Testing Differences Among Jurors for Echelon I Category for the year of 2009

Annex Table 3. ANOVA Table Testing Differences Among Jurors for Echelon I Category for the year of 2010

Annex Table 4. ANOVA Table Testing Differences Among Jurors for Province Category for the year of 2008

Annex Table 7. ANOVA Table Testing Differences Among Jurors for District Category for the year of 2008

Annex Table 8. ANOVA Table Testing Differences Among Jurors for District Category for the year of 2009

(9)

Page 8 of 8 Annex Table 9. ANOVA Table Testing Differences Among Jurors for

District Category for the year of 2010

Annex Table 10. Regression Analysis of the Jurors Assesment for the year of 2008