IJRIT International Journal of Research in Information Technology, Volume 3, Issue 4, April 2015, Pg. 57-62

International Journal of Research in Information Technology (IJRIT) www.ijrit.com

ISSN 2001-5569

A Model on the Factors Affecting Accuracy of Citations and Reference of an International Journal of Recent Technology and Engineering Dr. Sujit Kumar Basak Lecturer, Department of Information Technology, Durban University of Technology Durban, KwaZulu-Natal, South Africa [email protected]

Abstract This paper aimed to design a model of the factors affecting the accuracy of citations and reference of the international journal of recent technology and engineering, articles that published in volume 3 and issue 6 in January 2015. This aim is achieved by designing a model that affects research citations accuracy and this study identified errors from volume 3 and issue 6 (all the articles were taken for the analysis). The data were analyzed using the Warp PLS 4.0 software and a number of statistical tests, were performed using Warp PLS4.0 statistical software. The results reported that all the categories have more or less errors, namely these errors are: initials, year, journal, extra space need, upper case and lower case, after each article space, space need, name/name missing, comma missing et al./after name full stop missing/inverted comma, bracket missing, initial missing, extra word putting (letter putting), extra full stop putting, extra space putting, extra comma putting, and extra brackets putting. Finally, this study, however, suggests that researchers must use reference management software in order to improve and consistency for the citations and references. This study also indicated that using reference management software easily can be avoided some mistakes and can be always consistent in terms of citations and references.

Keywords: Model, References, Accuracy.

1. Introduction The reference is an important aspect for any scientific publications since it has multiple purposes because it can help researchers to access the relevant literature and it can also give credit to the previous researchers [1]. According to [2-3], accurate references increases the quality and credibility of the study, authors, and journals. [4] Highlighted that accurate references are very important when a computer search is needed and usually these are the following mistakes takes place such as an incorrect journal title abbreviation, misspelling of an author’s name, etc. These mistakes are usually obstacles to retrieve the original information from a computer cannot recognize any sort of inaccuracy. Another study by [13] indicated that accuracy reference allows readers to get more information related articles in terms of information when needed. In a study by [5] stated that in the surgical journals “authors do not check their references or may not even read them”. However, they also further indicated that reviewers are not checking the references. In a study by [2] and [3] found that for the research study accuracy reference is very important since it is one of the ways of transmitting the scientific knowledge so that it can easily write properly to make search easily.

Dr. Sujit Kumar Basak, IJRIT-57

IJRIT International Journal of Research in Information Technology, Volume 3, Issue 4, April 2015, Pg. 57-62

2. Literature Review A study conducted by [18] indicated that readers always frustrated with incorrect references while searching the related articles. A study conducted by [10] found that errors rate of 3% to 60%. [7] Found that the error rate in two radiology journals is: major error rate of 2% and a minor error rate of 45% for the AJR (American Journal of Roentgenology), with Radiology has the major error rate of 2% and the minor error rate of 23%. On surgical journals, several researchers conducted studies and found that different errors rate with different journals and this error rates are as follows: errors rate of 24% to 52% [5], error rate of 26% [19], error rate 31% [8], error rate of 66.7% [2]. A study was conducted by [6] and their sample size was selected through the random selection where the total number of citations was 1108 of from the volume 22 and the results shows that the thirteen citations had one error, and the two citations had two errors were 15 citations with the errors (15 percent, 95 percent CI 9.3-23.3%) with a total of 17 errors were from the analyzed 100 citations (17 percent, 95 percent, and CI 10.9 percent to 25.5 percent). Another study conducted by [11] found based on the five biomedical informatics journal and these five journals issued 37 articles. These articles had 656 references among that 225 (34.3%) contains at least one error. A total of 311 errors was identified among 225 references. Furthermore, they also found that errors rate respectively journal (31.2%), the title (17.7%), the page (7.4%), the year (3.5%), and volume (1.3%) information.

A study was conducted by [10] found that in 2000, the five medical journals the error rate was from 4.1% to 40.3% and highest errors were in the Lancet and the lowest errors were in the New England Journal of Medicine (NEJM). A study by [13] found that from the radiological journals, that 56% (n=145) contained at least 1 error followed by 15% contained major errors, 5% of the references contained more than 3% errors, and finally 75% of all errors that did not follow correct journal instructions, out of a total 259 references. Another study conducted by [9] found that after having analyzed four paediatric journals and their results indicated that the error rate of individuals was respectively Acta Paediatr 36% and the major error rate was 1%, Arch Dis Child 22% and the major error rate was 1%, J Padiatr 29% and the major error rate was 2%, Pediatrics 32% and the major error rate was 4%.

3. Methodology The objective of this research is achieved through the analysis of data from 23 articles from volume 3 and issue number 6, published in 2015 January. A total of 215 references was checked and the study took place in April 2015.

3.1 Research Variables The research variables of this study are: initials, year, journal, extra space, upper case and lower case, after each article space, space needed, name/name missing, comma missing et al./after name full stop missing/inverted comma, bracket missing, initial missing, extra word putting (letter putting), extra full stop putting, extra space putting, the extra comma putting, and extra bracket putting.

3.2 Data Analysis The data were analyzed using the Warp PLS 4.0 software and a number of statistical tests, were performed using both statistical software.

Dr. Sujit Kumar Basak, IJRIT-58

IJRIT International Journal of Research in Information Technology, Volume 3, Issue 4, April 2015, Pg. 57-62

4. Results 4.1 Model Fit According to [15], the strength of the measurement model is demonstrated through measures of the convergent and the discriminant validity. [16] Refers to ten categories: the average path coefficient (APC), Average R-squared (ARS), Average adjusted R-squared (AARS), Average block VIF (AFVIF), Average full collinearuty VIP (AFVIF), Tenenhaus Goodness of Fit (GoF), Sympson’s paradox ratio (SPR), Rsquared contribution ratio (RSCR), Statistical suppression ratio (SSR), and Nonlinear bivariate causality direction ratio (NLBCDR) (Table 1). Table 1: Model Fit and Quality Indices for Using ICT with Training, Using ICT without Training, and Using a Manual System (without using research software/tools and training) Using ICT Training Fit index

Model

Recommendation

Average path coefficient (APC)

21.339

Good if P<0.001

Average R-squared (ARS)

-17.937

Goof if P<0.001

Average

-Inf.

Good if P<0.001

Average block VIF (AVIF)

Inf.

Acceptable if <=5, ideally <=3.3

Average full collinearity VIF

Inf.

Acceptable if <=5, ideally <=3.3

0.000+4.235i

Small >=0.1, medium >=0.25, large

adjusted

R-squared

(AARS)

(AFVIF) Goodness of Fit (GoF)

>=0.36 Sympson’s paradox ratio (SPR)

0.417

Acceptable if >=0.7, ideally =1

R-squared

contribution

ratio

0.438

Acceptable if >=0.9, ideally =1

suppression

ratio

0.167

Acceptable if >=0.7

causality

0.938

Acceptable if >=0.7

(RSCR) Statistical (SSR) Nonlinear

bivariate

direction ratio (NLBCDR)

4.2 Structural Model (comparison of using ICT with training, using ICT without training, using a manual system (without using research software/tools and training) The structural model assessed using WarpPLS 4.0 software, after having confirmed the reliability and validity of the measurements. The variance

( R 2 ) of each dependent factor is an indication of how well the

2

model fits the data. R , which shows the amount of variance in a dependent factor, which the research model explains, is computed as [17].

Dr. Sujit Kumar Basak, IJRIT-59

IJRIT International Journal of Research in Information Technology, Volume 3, Issue 4, April 2015, Pg. 57-62

Fig. 1: A model on the factors affecting reference citation accuracy Figure 1 shows that Initials has significant values of

β =-1.23

and

p<.01 on Reference

Citation Accuracy. Year has significant values of β =45.82 and p<.01 . Similarly, Journal, Extra Space, Upper Case and Lower Case, After each article space, Space need, Name/Name missing, Comma missing et al./after name full stop missing/inverted comma, Bracket missing, Initial missing, Extra word putting (letter putting), Extra full stop putting, Extra space putting, Extra comma putting, and Extra brackets putting are respectively have significant values of β =-44.35 and p<.01 ; β =-0.62 and p<.01 ;

β =0.00 and p=1.00 ; β =0.00 and p=1.00 ; β =-21.40 and p<.01 ; β =0.09 and p=0.18 ; β =9.38 and p<.01 ; β =36.61 and p<.01 ; β =-56.47 and p<.01 ; β =0.00 and p=1.00 ; β =-16.88 and p<.01 ; β =21.32 and p<.01 ; β =0.00 and p=1.00 ; β =-1.90 and p<.01 . However, it clearly shows that all the category have impact on research citations accuracy.

5. Discussion and Conclusion This study revealed that all the categories have more and less errors in the volume 3 and issue 6 which published in 2015 January. With errors sometimes it becomes very difficult to access original source and name and also extremely difficult to measure the research productivity [12]. According to [14], reference management software is to organize references and citations with many different styles. [20] States that increasing using reference management software, namely, EndNote, Reference Manager, etc. can really contribute in terms of improving quality and can eliminate a lot of errors. According to [21] indicated that inaccuracy references might affect in the computerized citation databases, for example, Science Citation Index Expanded ®, Web of Science ® and journal Citation Reports ® and finally these are all indicated journal’s impact factor.

Dr. Sujit Kumar Basak, IJRIT-60

IJRIT International Journal of Research in Information Technology, Volume 3, Issue 4, April 2015, Pg. 57-62

“it gives the referee a bad impression when he or she attempts to locate reference only to find that the wrong author names or pages have been quoted in the manuscript” [13]. According to [14], “If a reference contains citation errors, it becomes difficult for the interested reader to obtain full text of the paper. On the other hand, if a quotation error is present, the base on which the entire work intends to build on becoming questionably quoted. The conclusion drawn from such as paper may lose some of their meaningfulness. Consequently, it becomes clearly important that references are correctly cited and quoted”. However, this paper has found that the errors in terms of citations and references. Furthermore, this study also indicated that references and citations must be checked before publication of the articles. Moreover, this research reported that in the international journal of recent technology and engineering in the volume 3 and issue number 6 published in 2015 have errors more or less in terms of citations and references. The limitation of the research was to consider only one journal and also was only one volume 3 and one issue 6 that published in 2015. In this relation, the conclusion cannot be drawn regarding volume number and issue number that were not concluded in this study or beyond the time frame that examined. Finally, this study suggested researchers must use reference management software tool in order to improve their citations and references.

References [1] M. S. Reddy, S. Srinivas, N. Sabanayagam, and S. P. Balasubramarian: Accuracy of References in General Surgical Journals-An Old Problem Revisited,” The Royal Colleges of Surgeons of Edinburgh and Ireland, Vol. 6, No. 2, 2008, pp. 71-75. [2] V. J. Roach, T. K. Lau, and W. D. Ngan Kee, “The Quality of Citations in Major International Obstetrics and Gynecology Journals,” American Journal of Obsterics Gynecology, Vol. 177, 1997, pp. 973-975. [3] M. F. McLellan, L. D. Case, M. C. Barnett, “Trust, but Verify: The Accuracy of References in Four anesthesia Journals,” Anesthesiology, Vol. 77, 1992, pp. 185-188. [4] K. W. Hinchcliff, N. J. Bruce, J. D. Powers, and M. L. Kipp, “Accuracy of References and Quotations in Veterinary Journals,” J. Am. Vet. Med. Assoc, Vol. 201, 1993, pp. 397-400. [5] J. T. Evans, H. I. Nadjari, S. A. Burchell, “Quotational and Reference Accuracy in Surgical Journals,” A Computing Peer Review Problem, JAMA, Vol. 263, 1990, pp. 1353-1354. [6] A. E. O’Connor, W. Lukin, L. Eriksson, C. O’Connor, “Improvement in the Accuracy of References in the Journal Emergency Medicine Australia,” Emergency Medicine Australia, Vol. 25, 2013, pp. 64-67. [7] M. E. Hansen, and D. D. McIntire, “Reference Citations in Radiology: Accuracy and Appropriateness of Use Major Journals,” AJR Am J Roentgenol, Vol. 163, 1994, pp. 717-723. [8] P. Eichorn, and A. Yankauer, “ Do Author Check Their References? A Survey of Accuracy of References in Three Public Health Journals,” American Journal of Public Health, Vol. 77, 1987, pp. 1011-1012. [9] A. Vargas-Origel, G. Gomez-Martinez, and M. A. Vargas-Nieto, “The Accuracy of References in Paediatric Journals,” Archives Diesease in Childhood, Vol. 85, 2001, pp. 497-498. [10] R. Siebers, and S. Holt, “Accuracy of References in Five Leading Medical Journals,” The Lancet, Vol. 356, 2000, pp. 1445. [11] D. Aronsky, J. Ransom, and K. Robinson, “Accuracy of References in Five Biomedical Informatics Journals,” Journal of the American Medical Informatics Association, Vol. 12, No. 2, 2005, pp. 225-228. [12] F. Hecht, B. K. Hecht, and A. A. Sandberg, “The Journal “impact factor”: A Misnamed, Misleading, Misused Measure,” Cancer Genet Cytogenet, Vol. 104, 1998, pp. 77-81. [13] R. F. Browne, P. M. Logan, M. J. Lee, and W. C. Torreqqiani, “The Accuracy of References in Manuscripts Submitted for Publication,” Canadian Association of Radiologists Journal, ProQuest Central, Vol. 55, No. 3, 2004, pp. 170-173. [14] S. Singh, and R. Chaudhary, “Accuracy of References Cited in Articles Published in Indian Journal of Dermatology, Venereology and Leprology: A Pilot Study,” Indian Journal of Dermatology, Venereolgoy, and Leprology, Vol. 75, 2009, pp. 488-491.

Dr. Sujit Kumar Basak, IJRIT-61

IJRIT International Journal of Research in Information Technology, Volume 3, Issue 4, April 2015, Pg. 57-62

[15]J. F. Hair, W. C. Black, B. J. Babin, and R. E. Anderson, Multivariate Data Analysis (7th ed.). Englewood Cliffs: Prentice Hall, 2010. [16]N. Kock, “Using WarpPLS in E-collaboration Studies: An Overview of Five Main Analysis Steps. International Journal of e-Collaboration, Vol. 6, No.4, 2010, pp.1-11. [17]J. A. Cornell, and R. D. Berger, “Factors that Influence the Value of the Coefficient of Determination in Simple Linear and Nonlinear Regression Models, Phytopathology, Vol. 77, No. 1, 1987, pp. 63-70. [18] A. Mohta, and M. Mohta, “Accuracy of References in Indian journal of surgery,” Indian Journal of Surgery, Vol. 65, 2003, pp. 156-158. [19] W. Orlin, J. Pehling, and M. A. Pogrel, “Do Authors Check Their References? A Survey of 500 References from the Journal of Oral and Maxillofacial Surgery,” Journal of Oral and Maxillofacial Surgery, Vol. 54, 1996, pp. 200-202. [20] A. E. O’Connor, “A Review of the Accuracy of References in the Journal Emergency Medicine. Emerg,” Med. 14, 2002, pp. 139-141. [21] S. Holt, R. Siebers, A. Suder, R. Loan, and O. Jeffery, “The Accuracy of References in Australian and New Zealand Medical Journals,” N. Z. Med. J., Vol. 113, 2003, 416-417.

Dr. Sujit Kumar Basak, IJRIT-62