Abstract
Purpose.:
There is a need for standardized texts to assess reading performance, for multiple equivalent texts for repeated measurements, and for texts equated across languages for multi-language studies. Paragraphs are preferable to single sentences for accurate speed measurement. We developed such texts previously in 6 languages. The aim of our current study was to develop texts in more languages for a wide range of countries and users, and to assess the reading speeds of normally-sighted readers.
Methods.:
Ten texts were designed for 17 languages each by a linguist who matched content, length, difficulty, and linguistic complexity. The texts then were used to assess reading speeds of 436 normally-sighted native speakers (age 18–35 years, 25 per language, 36 in Japanese), presented at a distance of 40 cm and size 1 M, that is 10-point Times New Roman font. Reading time (aloud) was measured by stopwatch.
Results.:
For all 17 languages, average mean reading speed was 1.42 ± 0.13 texts/min (±SD), 184 ± 29 words/min, 370 ± 80 syllables/min, and 863 ± 234 characters/min. For 14 languages, mean reading time was 68 ms/character (95% confidence interval [CI] 65–71 ms). Our analysis focussed on words per minute. The variability of reading speed within subjects accounts only for an average of 11.5%, between subjects for 88.5%.
Conclusions.:
The low within-subject variability shows the equivalence of the texts. The IReST (second edition) can now be provided in 17 languages allowing standardized assessment of reading speed, as well as comparability of results before and after interventions, and is a useful tool for multi-language studies (for further information see www.amd-read.net).
Ten paragraphs of German text were designed by a linguist from material for sixth grade reading (age 10–12 years) with a mean length of 132 words (SD ± 3.2). They were matched for difficulty and linguistic/syntactic complexity according to the theory of Gibson.
8,9
The paragraphs of texts (in the following named “texts”) were translated into 16 languages (Arabic, Chinese, English, Finnish, French, Hebrew, Italian, Japanese, Dutch, Polish, Portuguese/Brazilian, Swedish, Slovenian, Spanish, Russian, and Turkish), and adapted by linguists, all native speakers of the respective language, to be similar in difficulty and linguistic complexity to the German original. Additionally, the original demand was to make them similar in word and character counts. The number of words for all 10 Swedish texts (146) and the number of characters for all 10 Chinese texts (153) were identical.
The Chinese language is logographic and monosyllabic. A Chinese character represents a morpheme with one syllable, and a Chinese word in our texts consists of 1 to 4 Chinese characters. Unlike alphabetic languages, there are no demarcations between Chinese words, for example a space, and consequently it often is difficult to identify a word. Traditionally, reading speed of Chinese text has been measured in number of characters per minute, which we believe is the best measure for Chinese speakers. However, for studies comparing different languages, measuring reading speed in words per minute is desirable. For this purpose, we developed a two-step approach to identify a Chinese word: In step 1, we identified all the words that were found in two major Chinese dictionaries
10,11 and meaningful in the context. In step 2, for those Chinese characters that were not included in words identified in step 1, we used those characters to construct words based on grammatical rules
12,13 and meaning in the context.
A Chinese reader recognizes a character by its pattern, not by counting strokes. Thus, the number or spatial configuration of strokes does not affect reading speed. Therefore, we do not use the information about the number of strokes per character for calculating reading speeds, because these depend more on the frequency of the characters in the texts.
For the Arabic language, it was necessary to find a way of formulating the texts so that they would match the different Arabic speaking countries. We tested this in a group, where 25 students from eight different Arabic countries participated. There were no significant differences between their reading speeds.
14 For French (France/Canada) and Portuguese (Portugal/Brazil) we made sure that the texts also were familiar to speakers of the respective country, mainly by careful word selection and pilot testing with subjects who were not part of the main study. The Japanese texts were written in standard KanaKanji-Script, including Hiragana, Katakana, and Kanji.
Table 1 shows the number of words, syllables, and characters per text.
Language Code | Words | Syllables | Characters |
Ara | 119.2 (3.8) | 292.7 (6.1) | 528.2 (5.9) |
Chi | 95.0 (5.4) | 153.0 (0.0) | 153.0 (0.0) |
Dut | 141.4 (3.6) | 231.3 (7.2) | 685.7 (7.9) |
Eng | 153.5 (9.1) | 210.7 (6.3) | 664.5 (9.7) |
Fin | 101.5 (3.8) | 268.1 (7.8) | 678.1 (3.2) |
Fre | 133.5 (6.5) | 205.8 (10.1) | 681.4 (8.3) |
Ger | 132.2 (3.2) | 226.5 (6.8) | 678.5 (5.5) |
Heb | 121.6 (6.1) | 300.2 (13.4) | 541.6 (34.7) |
Ita | 134.8 (5.0) | 291.6 (12.4) | 683.3 (5.8) |
Jap | 159.5 (3.2) | 369.7 (7.6) | 295.5 (8.5) |
Pol | 126.8 (3.9) | 270.4 (6.0) | 699.5 (4.1) |
Por | 133.7 (7.1) | 277.9 (6.4) | 675.0 (12.6) |
Rus | 126.5 (7.7) | 301.7 (23.7) | 678.4 (48.3) |
Slo | 137.0 (7.8) | 176.1 (4.2) | 684.3 (8.1) |
Spa | 142.9 (6.6) | 343.7 (4.1) | 670.0 (7.6) |
Swe | 146.0 (0.0) | 240.2 (4.6) | 673.2 (1.7) |
Tur | 109.3 (1.8) | 293.6 (6.1) | 696.1 (14.9) |
During the analysis it became clear that the most important issue was the same content in the different languages—as the amount of information that must be processed. Thus, we accepted unavoidable differences in text length, especially if alphabetic and nonalphabetic languages are compared.
After developing the first version of the texts in each language, the linguists conducted a pilot study with five normal subjects. Texts were presented at a viewing distance of 40 cm and a size of 1 M, or 10-point Times New Roman font, for the 15 alphabetic languages; 1 M-unit subtends 5 minutes of arc at 1 m. It measures 1.454 mm or 1/7 cm or almost 1/16 inch.
15 These texts were not designed for determining reading acuity and, therefore, are provided only in 1 M letter size, which corresponds to many newspaper print sizes.
16 Texts were printed in black on white paper at high contrast (Michelson contrast 90% or higher). The paragraphs had a maximum line length of 8.5 to 10.0 cm. The mean number of lines/text was 14.3, for Chinese 8.5. Languages read from left to right were left justified and vice versa.
The texts were read aloud, and if there were parts where the readers hesitated or struggled, the texts were modified in the pilot study.
Principal Investigators. Arabic: Lama Shono, University of New South Wales, Australia/Saudi-Arabia.
Chinese: Lin Wang, Research and Outcomes Unit Care Management Administration, Johns Hopkins HealthCare LLC, Johns Hopkins Medicine, Baltimore, MD.
Dutch: Ger van Rens, Department of Ophthalmology, VU University Medical Centre Amsterdam, The Netherlands.
English: Gary S. Rubin, Department of Visual Neuroscience, UCL Institute of Ophthalmology, London UK.
Finnish: Lea Hyvärinen, University of Helsinki, and Markku Leinonen, Department of Ophthalmology, Turku University Hospital, Finland.
French: François Vital-Durand, SBRI Unit 846 Inserm, Bron, UCB-Lyon1, France.
German: Susanne Trauzettel-Klosinski (co-ordinator),1 Klaus Dietz,2 Raphael Niebler,3 Gesa A. Hahn,1 from the 1Centre for Ophthalmology, 2Department of Medical Biometry, and 3Department for Psychiatry, University of Tuebingen, Tuebingen, Germany.
Hebrew: Anat Kesler and Uri Soiberman, Neuro-Ophthalmology Unit, Department of Ophthalmology, Tel Aviv Medical Center, Israel.
Italian: Giacomo Stella, Department of Education and Human Sciences, University of Modena and Reggio Emilia, Italy.
Japanese: Satoshi Kashii, Faculty of Health and Medical Sciences, Aichi Shukutoku University, Nagakute-City, Japan.
Polish: Slawomir Teper, Department of Ophthalmology, Okregowy Szpital Kolejowy in Katowice, Poland.
Portuguese/Br: Andre Messias, Department of Ophthalmology, USP, Ribeirão Preto, Brazil.
Russian: Natalia Eliseeva, Burdenko Neurosurgery Institute, Moscow, Russia.
Slovenian: Marku Hawlina and Polona Jaki Mekjavić, Department of Ophthalmology, Faculty of Medicine, University of Ljubljana, Slovenia.
Swedish: Jorgen Gustafsson, Section of Optometry and Vision Sciences, Linnaeus University, Kalmar, Sweden.
Spanish: Jorge Arruga, Hospital Universitario de Bellvitge (HUB), Barcelona, Spain.
Turkish: Doğan Ceyhan, Yüzüncü Yıl University Department of Ophthalmology, Van, Turkey.
Linguists. Arabic: Haris Mohammad, Al-Azhar University, German Department, Cairo, Egypt.
Chinese: Jianguo Lu, Department of Psychology, Chengdu Medical College, Chengdu, China.
Dutch: Evy G. Visch-Brink, Department of Neurology, Erasmus MC, University Medical Center, Rotterdam, The Netherlands.
German: Doris Penka, Ocuserv, Department of Linguistics, University of Tuebingen, Germany/Department of Linguistics, University of Konstanz, Germany.
Italian: Gabriele Pallotti, University of Modena and Reggio Emilia, Department of Education, Italy.
Japanese: Susanne Miyata, Faculty of Health and Medical Sciences, Aichi Shukutoku University, Nagakute-City, Japan.
Polish: Ewa Baglajewska-Miglus, Europe University Viadrina, Language Centre, Frankfurt (Oder), Germany.
Portuguese/Br: Sonia Jecov Schallenmüller, Instituto de Ensino Brasil-Alemanha, Ribeirão Preto, Brazil.
Russian: Valeri Belianine, Institute of Psycholinguistic Psychotherapy, Toronto, Canada.
Slovenian: Uroš Mozetič, University of Ljubljana, Faculty of Arts, Department of English, Slovenia.
Spanish: Antònia Martí, CLiC-Centre de Llenguatge i Computació, University of Barcelona, Spain.
Swedish: Gustaf Öqvist Seimyr, The Bernadotte Laboratories, St. Erik Eye Hospital, Stockholm, Sweden.
Turkish: Dilek Fidan, Kocaeli University, Faculty of Education, Department of Turkish Language Teaching, Kocaeli, Turkey.
Table A1. Reading Speeds for Each Text in Each Language, Ranked in Order of Decreasing Speed. Texts with the Same Letter in Performance Category A to F Differ not More than 10 Words per Minute
Table A1. Reading Speeds for Each Text in Each Language, Ranked in Order of Decreasing Speed. Texts with the Same Letter in Performance Category A to F Differ not More than 10 Words per Minute
Language | No. of Text | Rank Order | Reading Speed (Words/Min)* | Performance Category |
Ara | 3 | 1 | 148 | A | | | | | |
Ara | 9 | 2 | 143 | A | B | | | | |
Ara | 7 | 3 | 142 | A | B | | | | |
Ara | 8 | 4 | 139 | A | B | C | | | |
Ara | 5 | 5 | 139 | A | B | C | | | |
Ara | 6 | 6 | 137 | | B | C | | | |
Ara | 4 | 7 | 136 | | B | C | | | |
Ara | 2 | 8 | 134 | | B | C | | | |
Ara | 1 | 9 | 132 | | | C | | | |
Ara | 10 | 10 | 131 | | | C | | | |
Chi | 2 | 1 | 170 | A | | | | | |
Chi | 8 | 2 | 163 | A | B | | | | |
Chi | 6 | 3 | 162 | A | B | C | | | |
Chi | 10 | 4 | 161 | A | B | C | | | |
Chi | 3 | 5 | 159 | | B | C | | | |
Chi | 1 | 6 | 157 | | B | C | D | | |
Chi | 4 | 7 | 157 | | B | C | D | | |
Chi | 5 | 8 | 156 | | B | C | D | | |
Chi | 7 | 9 | 152 | | | C | D | | |
Chi | 9 | 10 | 147 | | | | D | | |
Dut | 2 | 1 | 211 | A | | | | | |
Dut | 6 | 2 | 205 | A | B | | | | |
Dut | 8 | 3 | 204 | A | B | | | | |
Dut | 9 | 4 | 204 | A | B | | | | |
Dut | 4 | 5 | 203 | A | B | | | | |
Dut | 10 | 6 | 201 | | B | | | | |
Dut | 5 | 7 | 200 | | B | | | | |
Dut | 7 | 8 | 199 | | B | | | | |
Dut | 3 | 9 | 197 | | B | | | | |
Dut | 1 | 10 | 195 | | B | | | | |
Eng | 4 | 1 | 244 | A | | | | | |
Eng | 2 | 2 | 243 | A | | | | | |
Eng | 8 | 3 | 237 | A | B | | | | |
Eng | 1 | 4 | 236 | A | B | | | | |
Eng | 7 | 5 | 232 | | B | C | | | |
Eng | 5 | 6 | 229 | | B | C | | | |
Eng | 3 | 7 | 227 | | B | C | | | |
Eng | 9 | 8 | 226 | | | C | | | |
Eng | 10 | 9 | 211 | | | | D | | |
Eng | 6 | 10 | 197 | | | | | E | |
Fin | 7 | 1 | 167 | A | | | | | |
Fin | 5 | 2 | 165 | A | | | | | |
Fin | 6 | 3 | 164 | A | | | | | |
Fin | 1 | 4 | 164 | A | | | | | |
Fin | 4 | 5 | 163 | A | | | | | |
Fin | 8 | 6 | 161 | A | | | | | |
Fin | 3 | 7 | 161 | A | | | | | |
Fin | 10 | 8 | 159 | A | B | | | | |
Fin | 2 | 9 | 159 | A | B | | | | |
Fin | 9 | 10 | 150 | | B | | | | |
Fre | 7 | 1 | 215 | A | | | | | |
Fre | 1 | 2 | 205 | A | B | | | | |
Fre | 2 | 3 | 199 | | B | C | | | |
Fre | 8 | 4 | 197 | | B | C | | | |
Fre | 4 | 5 | 194 | | | C | | | |
Fre | 5 | 6 | 192 | | | C | | | |
Fre | 3 | 7 | 190 | | | C | D | | |
Fre | 10 | 8 | 190 | | | C | D | | |
Fre | 9 | 9 | 190 | | | C | D | | |
Fre | 6 | 10 | 182 | | | | D | | |
Ger | 2 | 1 | 188 | A | | | | | |
Ger | 4 | 2 | 185 | A | B | | | | |
Ger | 5 | 3 | 181 | A | B | C | | | |
Ger | 9 | 4 | 180 | A | B | C | | | |
Ger | 1 | 5 | 180 | A | B | C | | | |
Ger | 8 | 6 | 178 | | B | C | | | |
Ger | 6 | 7 | 176 | | B | C | | | |
Ger | 10 | 8 | 176 | | B | C | | | |
Ger | 3 | 9 | 175 | | B | C | | | |
Ger | 7 | 10 | 174 | | | C | | | |
Heb | 2 | 1 | 195 | A | | | | | |
Heb | 4 | 2 | 191 | A | B | | | | |
Heb | 9 | 3 | 190 | A | B | | | | |
Heb | 6 | 4 | 189 | A | B | | | | |
Heb | 8 | 5 | 186 | A | B | | | | |
Heb | 5 | 6 | 184 | | B | | | | |
Heb | 7 | 7 | 184 | | B | | | | |
Heb | 1 | 8 | 184 | | B | | | | |
Heb | 3 | 9 | 184 | | B | | | | |
Heb | 10 | 10 | 183 | | B | | | | |
Ita | 2 | 1 | 206 | A | | | | | |
Ita | 3 | 2 | 194 | | B | | | | |
Ita | 7 | 3 | 193 | | B | | | | |
Ita | 8 | 4 | 188 | | B | C | | | |
Ita | 5 | 5 | 188 | | B | C | | | |
Ita | 9 | 6 | 187 | | B | C | | | |
Ita | 4 | 7 | 185 | | B | C | | | |
Ita | 1 | 8 | 181 | | | C | D | | |
Ita | 10 | 9 | 179 | | | C | D | | |
Ita | 6 | 10 | 174 | | | | D | | |
Jap | 10 | 1 | 201 | A | | | | | |
Jap | 4 | 2 | 200 | A | | | | | |
Jap | 6 | 3 | 199 | A | B | | | | |
Jap | 5 | 4 | 197 | A | B | | | | |
Jap | 9 | 5 | 196 | A | B | | | | |
Jap | 8 | 6 | 196 | A | B | | | | |
Jap | 2 | 7 | 190 | | B | C | | | |
Jap | 3 | 8 | 185 | | | C | | | |
Jap | 7 | 9 | 184 | | | C | | | |
Jap | 1 | 10 | 181 | | | C | | | |
Pol | 5 | 1 | 172 | A | | | | | |
Pol | 8 | 2 | 172 | A | | | | | |
Pol | 4 | 3 | 172 | A | | | | | |
Pol | 7 | 4 | 169 | A | B | | | | |
Pol | 6 | 5 | 168 | A | B | | | | |
Pol | 10 | 6 | 163 | A | B | | | | |
Pol | 9 | 7 | 162 | | B | | | | |
Pol | 3 | 8 | 161 | | B | | | | |
Pol | 2 | 9 | 161 | | B | | | | |
Pol | 1 | 10 | 161 | | B | | | | |
Por | 7 | 1 | 192 | A | | | | | |
Por | 8 | 2 | 192 | A | | | | | |
Por | 2 | 3 | 187 | A | | | | | |
Por | 4 | 4 | 186 | A | | | | | |
Por | 9 | 5 | 182 | A | B | | | | |
Por | 3 | 6 | 176 | | B | C | | | |
Por | 5 | 7 | 175 | | B | C | | | |
Por | 6 | 8 | 174 | | B | C | | | |
Por | 1 | 9 | 173 | | B | C | | | | |
Por | 10 | 10 | 170 | C |
Rus | 8 | 1 | 195 | A | | | | | |
Rus | 4 | 2 | 190 | A | B | | | | |
Rus | 9 | 3 | 189 | A | B | C | | | |
Rus | 3 | 4 | 186 | A | B | C | | | |
Rus | 2 | 5 | 183 | | B | C | D | | |
Rus | 7 | 6 | 183 | | B | C | D | | |
Rus | 6 | 7 | 182 | | B | C | D | | |
Rus | 5 | 8 | 180 | | | C | D | | |
Rus | 10 | 9 | 179 | | | C | D | | |
Rus | 1 | 10 | 175 | | | | D | | |
Slo | 4 | 1 | 197 | A | | | | | |
Slo | 7 | 2 | 186 | | B | | | | |
Slo | 2 | 3 | 184 | | B | C | | | |
Slo | 8 | 4 | 184 | | B | C | | | |
Slo | 1 | 5 | 182 | | B | C | | | |
Slo | 6 | 6 | 181 | | B | C | | | |
Slo | 5 | 7 | 176 | | | C | D | | |
Slo | 9 | 8 | 176 | | | C | D | | |
Slo | 3 | 9 | 170 | | | | D | | |
Slo | 10 | 10 | 168 | | | | D | | |
Spa | 4 | 1 | 239 | A | | | | | |
Spa | 2 | 2 | 229 | A | B | | | | |
Spa | 5 | 3 | 225 | | B | C | | | |
Spa | 1 | 4 | 219 | | B | C | D | | |
Spa | 3 | 5 | 218 | | | C | D | E | |
Spa | 9 | 6 | 216 | | | C | D | E | |
Spa | 8 | 7 | 216 | | | C | D | E | |
Spa | 7 | 8 | 214 | | | | D | E | |
Spa | 10 | 9 | 208 | | | | | E | F |
Spa | 6 | 10 | 202 | | | | | | F |
Swe | 2 | 1 | 205 | A | | | | | |
Swe | 5 | 2 | 204 | A | B | | | | |
Swe | 8 | 3 | 203 | A | B | | | | |
Swe | 1 | 4 | 201 | A | B | | | | |
Swe | 9 | 5 | 199 | A | B | | | | |
Swe | 6 | 6 | 199 | A | B | | | | |
Swe | 7 | 7 | 199 | A | B | | | | |
Swe | 10 | 8 | 197 | A | B | C | | | |
Swe | 4 | 9 | 195 | | B | C | | | |
Swe | 3 | 10 | 188 | | | C | | | |
Tur | 9 | 1 | 175 | A | | | | | |
Tur | 3 | 2 | 175 | A | | | | | |
Tur | 5 | 3 | 169 | A | B | | | | |
Tur | 6 | 4 | 167 | A | B | C | | | |
Tur | 2 | 5 | 166 | A | B | C | | | |
Tur | 4 | 6 | 164 | | B | C | | | |
Tur | 7 | 7 | 164 | | B | C | | | |
Tur | 8 | 8 | 163 | | B | C | D | | |
Tur | 10 | 9 | 158 | | | C | D | | |
Tur | 1 | 10 | 153 | | | | D | | |