Work done at GTE Internetworking, Powered by BBN
Suggested citation:
Ravitz, J. (1998). Conditions that facilitate teachers' Internet
use in schools with high Internet connectivity: Preliminary Findings.
Proceedings of the Association for Educational Communications and Technology.
St. Louis, MO. February, 1998. Available: http://www.bie.org/Ravitz/Ravitz_AECT98.html.
Author notes:
The author gratefully acknowledges funding from the National School Network (NSN) project, organized by researchers at BBN in Cambridge, MA in 1994 with a grant from the National Science Foundation (Contract # RED-9454769), and the guidance provided by Dr. Henry J. "Hank" Becker at Univ. of California, Irvine. Additional NSN findings, copies of instruments and data from school administrators, network coordinators, and other teachers are available online: http://nsn.bbn.com/nsn_learnings/survey.html.
Abstract
Examines the presence of Ely's (1976, 1990) conditions that facilitate
innovation, as reported by Internet-using teachers in leading-edge schools.
Descriptive data from a national survey of teachers (N=238) in approximately
half of the 250 schools in the National School Network (NSN) are reported,
along with analysis of the correlation of the condition measures with teacher
and student Internet use. Connections are drawn to other NSN-related studies
and plans for further analysis of the covariance of the conditions and
interaction effects are described.
Background
The history of educational technology is filled with promises of technological innovation being offered as a way to improve teaching and learning. Today we are in the midst of yet another high-stakes, government and industry-sponsored effort to introduce technology to bring about educational change. The federal government, states, and private organizations are spending unprecedented amounts of money for the advancement of Internet use in schools -- offering the hope of more to win, and the risk of more to lose for those who are concerned with educational change and technology.
Many claim that the Internet is a revolutionary technology for learners because of its ability to provide resources, data sharing, and communication to all who are connected (Hunter, 1993, 1995a, 1997a). It is instructive to remember, however, that previous claims for the superiority of new technologies for education have often foundered not on the quality of the technologies themselves, but on complex issues related to implementation in schools (Berman, 1981; Fullan, 1993; Holloway, 1996; McLaughlin, 1990).
The informants for this study are Internet-using teachers in a select
group of schools that have already achieved a high level of Internet connectivity.[1]
These teachers are perhaps the best informants for what conditions facilitate
Internet use by students and teachers, i.e., once a school has already
been connected to the Internet. As more schools obtain Internet connectivity
the issues addressed in this study may become increasingly important. By
examining teachers who are striving to use the Internet, this paper avoids
problems associated with those who have not adopted (Rogers, 1983) or who
may be resistant to using these new technologies. Finally, while implementation
is often discussed at an organizational level, the variables for study
are viewed as teacher-level variables with the
teacher as the unit of
analysis, partly because one might expect different experiences and
perceptions reported by teachers in the same school (Becker, 1994a). Thus,
this study might be understood as an examination of individual teacher
behavior (extent of use) and conditions that may be determinant for those
who are among the strongest Internet users.
Framework of Analysis
Research demonstrates that many issues influence the implementation
of educational technology innovations. "The more factors supporting implementation,
the more change in practice will be accomplished" (Fullan, 1991, p. 67).
This study utilizes a reasonably holistic framework developed by Ely (1976,
1990), one of the few frameworks available in the literature (Holloway,
1996). Ely's claim is that lack of any of these eight conditions can hinder
use of an innovation:
1) dissatisfaction with the status quoThis framework appears to be broadly generalizable, readily applied in diverse educational settings, from school districts (Read, 1994), to libraries (Ely, 1976) to universities (Bauder, 1993), in the United States and abroad (Ely, 1990). A series of dissertation studies also support its usefulness for a variety of educational innovations (Bauder, 1993; Jeffrey, 1993; Read, 1994; Riley, 1995; Stein, 1996). Perhaps more importantly, the utility of this framework is supported by the literature related to computer use in schools, i.e., many of the studies one sees include variables that seem to be consistent with Ely's conditions -- e.g., dissatisfaction (Barker and Taylor, 1993); knowledge and skills (Sheingold, et al., 1981); resources (Becker, 1994b; Office of Educational Technology, 1996); the availability of time (Honey and Henriquez, 1993; Sheingold and Hadley, 1990), and so on.[2]
2) existence of knowledge and skills
3) availability of resources
4) availability of time
5) existence of rewards or incentives
6) expectation and encouragement of participation
7) commitment by those who are involved, and
8) evidence of leadership (Ely, 1990)
Methods
This study reports data from a national survey of teachers in
approximately 250 schools registered in the National School Network (NSN),
a project funded by the National Science Foundation since 1994. The schools
were required to have had at least 10 simultaneous LAN-based Internet connections
for a year prior to joining the project and to be nominated by an intermediary
organization involved in Internet-based school reform (Hunter, 1995b).
"Internet-using teachers" include teachers, media-specialists, or other
professional staff who do any of the following:
Internet Use
This study explores a wide range of Internet uses by teachers and students (Eisenberg and Ely, 1993; Harris, 1994; Honey and Henriquez, 1996). This includes constructivist practices identified in leading-edge schools, e.g., activities highlighted in conferences and newsletters shared across the National School Network project (Hunter, 1997b) such as project-based learning activities (email projects, telementoring, shared investigations, students publishing on the Web, collaborating with other school sites, and participating in live events over the Internet).
While some uses of an innovation may be more sophisticated (Hall and Loucks, 1977) or exemplary (Becker, 1994a) than others, implementation studies using Ely's framework have typically not differentiated between types or quality of use. It is understood that teachers will use the Internet differently. This study employs frequency-based measures (e.g., number of hours, how often), and measures of the breadth of use (e.g., number of students, number of activities) so that those who involve more students and and who participate in a wider range of activities score higher on use.[5]
To identify the extent of Internet use by teachers, this study combines
information from seven sets of questions in the teacher survey booklet
(comprising approximately 25 different response items):
* MAXUSE: The maximum use a teacher made of the Internet in his/her classes, on a scale from 1 to 4, where 1 represented no use; 2, voluntary student use; 3, occasional use by all students; and 4, use by all students on at least five occasions.While this study is generally more concerned with an overall use measure, factor analysis seems to confirm that two related factors can be identified. A "student use" factor is based on scores on the first three items listed above. These concern the extent of student classroom use. The last three items listed above load on a different factor called "teacher use". Interestingly, the variety of activities undertaken with students (NNETPROJ) loads with the "teacher use" items, suggesting that the variety of activities undertaken with students is more closely related to a teacher's own exploration or use. As a result, the "teacher use" factor may be interpreted more as reflecting exploratory use by the teacher.[6]* AVGUSE: The average use a teacher made of the Internet across all his/her classes.
* REQDUSE: The frequency with which the teacher requires students to use the Internet.
* NNETPROJ: The number of discrete types of network learning activities the teacher has had students participate in during the year (from a list of 17 types including working with scientists, tutoring students by e-mail, doing Web searches, etc.).
* USE4PREP: How frequently the teacher accesses the Internet while doing class preparation work during the school day.
* SELFUSE: How frequently the teacher engages in six other Internet-related activities, such as posting a message to a newsgroup, or creating or editing a World Wide Web page for their class or school.
* FUNCTION: How many of five functions for using the Internet (e.g., professional collegiality--sharing new ideas, discussing teaching) occupies the teacher for at least an hour per week.
Approximately 75% of the teachers reported that all the students in at least one of their classes had used the Internet, with approximately 20% indicating that they require student use of the Internet on a weekly basis. Of the variety of networking activities listed, by far the most frequently reported uses with students were looking at World Wide Web sites and searching for information online (both reported by over 90% of teachers). The next most common activities for students, creating Web sites or participating in email exchanges, were only reported by about 30% of teachers.
Concerning their own use, most teachers (approx. 70%) reported
spending at least an hour per week developing their Internet skills or
searching the Web for instructional materials. Only one-third reported
spending more than one hour per week using the Internet for professional
collegiality. About half reported having ever posted to newsgroups/listservs
or having ever created a Web page. Fewer than 20% reported that they had
ever participated in real-time events via the Internet, such as text-based
chats or videoconferencing. Additional descriptive analysis of use by students
and teachers within NSN schools is provided by Becker (1997) and Hunter
(1998).
Operationalizing Conditions
The conditions are understood to be "global" constructs that are made up of a variety of components. The approach has been to try to "write or select items presumed to be tapping each of the facets" (Pedhazur and Schmelkin, p. 68). Given the scope of the project, no exhaustive measurement of each condition is possible; instead a few indicators are intended to suggest the extent to which each condition might be present. In a few cases exploratory factor analysis seems to confirm that different elements of a condition are being measured.
Organization of the variables by condition is based on an interpretation of Ely's framework. For example, items related to peer use (Becker, 1994a) are interpreted as belonging to the commitment condition, an indication of support for Internet use by others, while administrator use is viewed as an indicator of leadership.[7] While formative use of the instrument generally focused on whether key issues for teachers were being addressed by the conditions items, perhaps more attention might have been paid to the subjects' view of the framework itself.[8]
Findings
Findings describe the extent to which the conditions seem to be present,
and the strength of relationship between the conditions and Internet use
measures. Correlations are discussed in terms of the ability to predict
the extent of use from knowledge of the conditions measures; this suggests
that a relationship exists, but not necessarily a causal one (the findings
could just have easily been discussed in terms of predicting the presence
of conditions from scores on use). These are preliminary findings because
no effort has yet been made to control for the presence of other conditions,
to explore the covariance (multi-colinearity) of the conditions, or to
examine interactions that might be more predictive of use. Addtional analysis
might also seek to control for intervening variables, such as grades and
subjects taught, class ability level, or school-wide demographics.[9]
Condition #1: Dissatisfaction with the status quo
Dissatisfaction indicators include the perception that all students would benefit from Internet use, both in general and in terms of learning outcomes. In addition, dissatisfaction with the status quo (in this case, non-Internet use) is indicated by the extent to which the teacher affirms a number of reasons for Internet use, choosing from a list of 13 options (Table 1).
Respondents overwhelmingly agreed that all students would benefit
from knowing how to use the Internet, with 80% indicating that they strongly
agree. Concerning whether students would enjoy learning more leading to
greater effort and accomplishment, the response was more mixed, although
still generally positive (Figure 1). Responses on the two items were correlated
(r=.28), and the mean response was significantly correlated with overall
use (r=.37).[10]
Figure 1. Perception that students would benefit from Internet use
The difference reflected in the above responses may reflect alternative rationales for use (Hawkridge, et al., 1990) such that benefits other than pedagogical ones are perceived. This interpretation is supported by analysis of the reasons given for use. The most prevalent reason among the teachers seemed to concern the pervasiveness of technology in society, a rationale that may not necessarily require learning outcomes.[11]
The distribution of mean responses for the reasons items (reliability
alpha =.83) approximated a normal curve and had about the same correlation
with overall use (r=.35)>as the mean "benefits" score. In the end, an average
z-score on both sets of items (reliability alpha = .84) was an even stronger
predictor (r=.44) of overall use.
Table 1. Reasons for Internet use ordered by mean response[12]
| Q-31 Which of these are reasons for your own use of the
Internet at school?
How important a reason is it for you? |
Mean | Med | Md | S.d. |
| e) to prepare students for life in an increasingly technological society | 2.69 | 3 | 3 | .57 |
| g) to keep up with new technologies yourself to gain access | 2.47 | 3 | 3 | .72 |
| l) to resources or materials that are not available in textbooks or in the library | 2.43 | 3 | 3 | .76 |
| a) to increase student motivation and participation in their own learning | 2.39 | 3 | 3 | .82 |
| b) to provide opportunities for students who do not have computers at home | 2.37 | 3 | 3 | .86 |
| d) to give students the skills they will need in college | 2.22 | 2 | 3 | .87 |
| f) to help students feel more a part of the global community | 2.22 | 2 | 3 | .93 |
| h) to find out about new teaching practices that you may want to use or adapt | 1.93 | 2 | 2 | .90 |
| j) to reduce your professional isolation through e-mail or collaboration with others | 1.49 | 2 | 2 | 1.10 |
| m) to support larger school change efforts by using the Internet as a catalyst | 1.49 | 2 | 2 | 1.10 |
| c) to fulfill students' and parents' expectations | 1.43 | 1 | 1 | 1.02 |
| *i) to overcome remoteness or geographic isolation in your school or community | 1.27 | 1 | 0 | 1.19 |
| *k) to overcome a lack of specialized staff or limited program offerings at your school | .89 | 1 | 0 | 1.01 |
Knowledge and skills indicators include self-reported skill levels with respect to 13 different Internet activities. In addition, teachers were asked to what extent they were sufficiently prepared to use the Internet with respect to five skills that may be required for classroom use. The most prevalent of the "Internet skills" included using a search engine and sending email (Table 2); the most prevalent of the "classroom skills" involved finding relevant online information and awareness of what the Internet can do (Table 3).
The mean for all items (reliability alpha=.93) was the best predictor
of "teacher use" (r=.70) and was strongly correlated with overall use (r=.54).
However, factor analysis created a single factor that combined the "classroom
skills" items with two from the "Internet skills" list --- searching the
Internet and downloading materials. This factor might still be interpreted
as "classroom skills" because the additional items represent among the
most frequent kinds of use with students (Becker, 1997). This factor alone
was the best predictor of student use (r=.32), an equally strong predictor
of overall use, and a reasonably strong predictor of teacher use (r=.48).
The two other factors -- one involving Web authoring and IRC/MOO, and the
second involving "other" skills (email, ftp) -- might be viewed as more
"technical" in nature; these correlated with teacher use, but were not
predictive of use with students.
Table 2. Self-reported "Internet skills" for 13 activities ordered
by mean response
| Q-40 How would you rate your ability to do each of the
following things
related to the Internet? |
Mean | Med | Md | S.d. |
| c) Use a search-engine like Alta Vista to find information you need | 2.52 | 3 | 3 | .86 |
| b) Send e-mail to groups of people without naming each person each time | 2.25 | 3 | 3 | 1.01 |
| a) Send attached files with an e-mail message | 2.11 | 2 | 3 | 1.05 |
| i) Download and read file saved in a specific format (e.g., Word, Adobe Acrobat) | 1.79 | 2 | 3 | 1.17 |
| e) Subscribe to a Listserv and participate in discussions with others | 1.47 | 1 | 3 | 1.19 |
| d) Find a Usenet newsgroup and discuss topics of interest on it | 1.40 | 1 | 1 | 1.08 |
| f) Put files on a server for others to access | 1.32 | 1 | 0 | 1.19 |
| j) Produce a simple Web page (e.g., containing text and graphics) | 1.30 | 1 | 0 | 1.24 |
| h) Translate graphics into a format for placing on the Web | 1.10 | 1 | 0 | 1.21 |
| k) Produce a complex Web page (e.g., tables, frames, sounds, animation) | .76 | 0 | 0 | .98 |
| l) Be a Web Master for a school or district (e.g., design and manage Web sites) | .61 | 0 | 0 | .95 |
| g) Participate in discussions on IRC, MOO, or MUD | .45 | 0 | 0 | .79 |
| m) Do programming for Web pages (e.g., CGI, PERL, JAVA, Shockwave) | .42 | 0 | 0 | .80 |
Table 3. Self-reported "classroom skills" related to Internet use
ordered by mean
| Q-41 To what extent are you sufficiently prepared to
use the Internet?
Do you have sufficient... |
Mean | Med | Md | S.d. |
| b) Ability to seek and find relevant online information | 2.40 | 3 | 3 | .70 |
| a) Awareness of what the Internet can do | 2.37 | 2 | 3 | .72 |
| d) Knowledge of how to use the Internet in the curriculum | 2.03 | 2 | 2 | .79 |
| e) Classroom management skills related to Internet use | 2.00 | 2 | 2 | .86 |
| c) Ability to manage large amounts of electronic information | 1.93 | 2 | 2 | .92 |
Condition #3: Resources
Two sets of resource indicators include support resources -- technical,
training and curriculum support -- and hardware resources (e.g., computers
and connectivity). Of the support resources, teachers generally
reported that technical support and training opportunities were sufficiently
present (Table 4). However, resources for Internet use in the curriculum
and help for integrating online activities into the curriculum were most
often reported as being insufficiently present. The mean score on these
four items (reliability alpha = .80), was correlated with overall use (r=.17,
p<.01), but the mean of the two curriculum-related items (correlated,
r=.58) was a stronger predictor (r=.22).
Table 4. Resource-related conditions reported as being sufficiently
present ordered by mean
| Q-35 To what extent are the following conditions sufficiently
present
to support Internet use by you and your students? Sufficiently present... |
Mean | Med | Mode | S.d. |
| e) Technical support is available when you need it | 4.05 | 4 | 5 | 1.56 |
| k) Training opportunities are offered to develop your Internet skills | 3.84 | 4 | 5 | 1.62 |
| f) Curriculum resources for Internet use are available | 3.41 | 3 | 2 | 1.49 |
| l) Help is available for integrating online activities into
the curriculum
(e.g., workshops or meetings to help teachers plan activities) |
3.10 | 3 | 2 | 1.54 |
Concerning hardware resources, teachers were asked whether or not better
Internet access in the future would increase their use (Table 5). A majority
indicated that classroom Internet access and simultaneous access for 20-30
computers would increase their use "a lot". Surprisingly, those who scored
higher on use were more likely to report that improved access would help
"a lot" -- this suggests that less frequent users may not perceive access
as being a critical issue, while more frequent users might take greater
advantage of improved access if it were provided. As a result, an indicator
score from these items (reliability alpha = .87) was not at all predictive
of use (r= -.03).
Table 5. Access-related resources would increase use ordered by percent
indicating "a lot"
| Q-1 Which of the following features of the Internet or
conditions for accessing
it would make you likely to use the Internet more? |
%
"A lot" |
%
"A little" |
%
"Not at all"/"NA" |
| a) Internet access in your own classroom rather than elsewhere in your school | 61 | 5 | 34 |
| c) Simultaneous Internet access for 20-30 computers in a computer lab | 57 | 14 | 29 |
| d) Access to the World Wide Web | 55 | 6 | 39 |
| b) High-speed Internet connection rather than modems | 52 | 11 | 37 |
| e) Electronic mail to/from anyone in the world with an Internet e-mail address | 44 | 14 | 42 |
Next, teachers were asked to indicate the number of simultaneous Internet
connections in the location where students most frequently use the Internet
-- inside the classroom, outside the classroom, or both. 60% indicated
that the classroom is a location where students most often use the Internet,
and 80% indicated that students most often use the Internet in another
location -- with 45% providing data on both locations. The highest number
of simultaneous connections reported in the classroom was 32, but a full
half reported only one Internet-connected computer (Figure 2). The mean
response for the number of simultaneous connections in a location outside
the classroom was 21, however some reported up to 100 (Figure 3); these
latter cases indicated that they were reporting for multiple locations
(e.g., "in other classrooms" or "labs").
| Figure 2. Number of simultaneous Internet connections
in the classroom
(if classroom is a location where students most often use the Internet) |
Figure 3. Number of simultaneous Internet connections
in other locations
(if students most often use the Internet outside the classroom) |
![]() |
![]() |
| Mean = 4.4; Med = 1; S.d.= 6.2 (n=142, 60%) | Mean = 21.6; Med = 20; S.d.= 17.97 (n=190, 80%)
Note: midpoints shown, first bar represents < 5 |
The number of simultaneous Internet connections in the classroom was correlated with overall Internet use (r=.26), predictive of use by teachers and students. When limiting the analysis to those who answered 50 or fewer (n=178), the number of simultaneous Internet connections outside of the classroom was only significantly correlated with student Internet use (r=.28), particularly when controlling for teacher use (r=.39). Because more than half of the teachers did not answer one of these items, a more useful indicator is the maximum z-score on the two items (the two z-scores were correlated, r=.29) -- i.e., whether or not a teacher reports a larger number of connections than other teachers in either location. This indicator was also predictive of overall use (r=.22).
Finally, teachers were asked about the amount of RAM memory on the computer they use most frequently at school. A little over 10% reported having 32MB or more. About half reported having 16MB; one-quarter reported 8MB, and fewer than 15% reported any less than that. When the amount of RAM was converted to an interval (as opposed to ratio) variable, it was moderately correlated with overall use (r=.19, p <.10).
Condition #4: Time
When asked whether there is sufficient time to support Internet use
-- in the teacher's work schedule and in the curriculum -- there was strong
disagreement on both items (Figure 4). The response concerning time in
the curriculum was a better predictor of Internet use, even though teachers
were more likely to disagree that there was sufficient time in the schedule.
Time in the schedule was correlated with overall use (r=.21), but not as
strongly as time in the curriculum (r=.35). The two items were correlated
(r=.55), and the mean response was also predictive of overall use (r=.32).
Figure 4. Insufficient time available for teacher Internet planning
and use in the curriculum
Teachers were also asked to report the actual amount of in-school preparation time they are given each week as part of their work schedule. Approximately 20% reported 1 hour or less per week. The most frequent response was 5 hours, with an average of about 4 hours. This included a few teachers who reported more preparation time, i.e., a cluster of about 10% who reported 6 or more hours/week, even up to 10 hours.
The amount of reported preparation time was, surprisingly, not
correlated with the above items related to the perception of time availability,
nor did the amount of actual preparation time correlate with any of the
Internet use measures. A possible explanation is that teachers do not necessarily
have access to the Internet during their in-school preparation time. This
might be an example of a resource variable "access" interacting with a
time variable "preparation time", a relationship that might be explored
further. Although not a time variable per se, those who reported using
the Internet more frequently during their class preparation time (USE4PREP)
also scored significantly higher on student use (r=.33) even when teacher
use was held constant (r=.11, p<.10).
Condition #5: Rewards & Incentives
Rewards and incentives indicators include two sets of items -- the first involves the perceived level of benefit for students with whom the teacher has used the Internet. While this variable may be more a result of use, not a cause, students benefiting is viewed as an important intrinsic motivation for continued, ongoing use, i.e., after some initial attempts have been made. The intention was to have some indication of a perceived reward concerning the teacher's relationship with students (Mitchell, et al., 1987). This item is different from the more hypothetical dissatisfaction measure concerning whether all students would benefit.
Teachers reported that most of their students had benefited greatly
from their use of the Internet (Table 6). Approximately 15% of the teachers
reported that
all of the students with whom they had used the Internet
had benefited greatly; nearly all (92%) reported that more than half had
benefited at least "somewhat". Finally, negative experiences were rarely
reported, most (62%) indciated that none of their students had a
negative experience overall. The percent of students reported as having
"greatly benefited" was significantly correlated with overall use (r=.38).
Table 6. Mean percent of students reported as having benefited at
each levels
| Q-25 Of your students who have used the Internet, estimate the percent of them in each category: | |||
| Negative experience overall | Benefited very little | Somewhat benefited | Greatly benefited |
| 3.3 | 10.2 | 29.7 | 56.7 |
The primary educational value that was reported involved access to a huge variety of curriculum information. Approximately half of the teachers reported that students were applying themselves for longer periods of time, taking more responsibility for their own learning and showing greater interest in world events and foreign cultures as a result of Internet use. About half also reported a more equal distribution of expertise among students and that average students were communicating at `gifted' levels. Fewer (less than 1/3) indicated benefits in terms of students having a deeper understanding of the ideas the encounter, and having experiences with or increased interest in the adult world.[13]
The second set of indicators concern the availability of various "extrinsic" rewards or incentives that might be provided to teachers by the school or district (Table 7). Of the items listed, those that were reported as being generally available involved the provision of computers, equipment or modems to teachers who are interested in the Internet. In addition, release time, reimbursement for inservice courses, and public recognition were reported in about half (40-50%) of the cases. For the remaining items a majority indicated that the reward or incentive was "not available".
The mean response for each teacher on all these "extrinsic" items
(reliability alpha =.70) was correlated with overall use (r=.22). For those
items that showed a relationship with use (a, c, d, f, g and h), the mean
score was only slightly more predictive of use (r=.25).[14]
There seemed to be no relationship between the percent of students having
greatly benefited and the availability of extrinsic rewards or incentives.
Table 7. Extrinsic rewards or incentives "somewhat" or "generally"
available ordered by sample mean
| Q-50 To what extent are each of the following rewards
and incentives available
at your school to encourage teachers' use of the Internet? |
Mean | Med | Md | S.d | %
available "at all" |
| a) Teachers who show they are interested are provided with computers/equipment | 2.08 | 2 | 3 | .82 | 80 |
| b) Computers or modems are loaned to teachers for use at home | 1.79 | 2 | 1 | .77 | 58 |
| e) Cost of in-service/graduate credits for Internet workshops/courses is reimbursed | 1.69 | 1 | 1 | .78 | 50 |
| c) Release time (substitutes) are provided for Internet development activities | 1.53 | 1 | 1 | .67 | 44 |
| f) Public recognition given for leadership, helping other teachers/staff use Internet | 1.53 | 1 | 1 | .69 | 42 |
| d) Paid time provided for after school hours spent on Internet-related activities | 1.33 | 1 | 1 | .59 | 26 |
| h) District/school has contests rewarding innovative technology-using teachers | 1.19 | 1 | 1 | .50 | 14 |
| g) Career-ladder opportunities for telecommunications-using teachers | 1.17 | 1 | 1 | .42 | 16 |
Condition #6: Participation
Participation indicators include the extent of a teacher's involvement
in setting the course for Internet implementation in their school or district
-- contact with decision makers concerning Internet-related issues and
the extent of involvement in various other activities supporting implementation.
Concerning direct involvement in decision making, respondents were most
likely to report having a trusted colleague to whom they can voice their
concerns. While they generally reported having an opportunity to voice
concerns, fewer reported having their input directly sought by decision
makers, e.g., before decisions are made (Table 8).
Table 8. Extent to which teacher input is sought by decision makers
ordered by sample mean
| Q-32 To what extent is your input sought by decision
makers
in your school or district concerning Internet- related issues? |
Mean | Med | S.d. | %
never (=1) |
%
sometimes (=2) |
%
often (=3) |
%
always (=4) |
| b) There's a trusted colleague to whom I can voice concerns | 3.18 | 3 | .89 | 5 | 16 | 34 | 45 |
| a) I have opportunity to voice concerns to decision makers | 2.72 | 3 | .86 | 6 | 37 | 37 | 20 |
| d) I am given updates and asked for feedback | 2.51 | 2 | .85 | 11 | 40 | 37 | 12 |
| c) My opinions are sought before decisions are made | 2.28 | 2 | .86 | 17 | 47 | 26 | 10 |
Of the various other types of activities in which a teacher might participate,
those reported most frequently included selection of hardware and software,
providing support to other teachers, and working on curriculum integration
(Table 9). Regarding other activities, half or more reported that they
were not involved "at all".
Table 9. Teacher involvement in various other activities ordered
by mean response
| Q-36 To what extent have you been involved in any of
the following activities? |
Mean | Med | S.d. | %
Not at all (= 1) |
%
Slightly (= 2) |
%
Generally (= 3) |
%
Very (= 4) |
| a) Reviewing, selecting, purchasing hardware/software products | 2.67 | 3 | 1.08 | 18 | 27 | 26 | 29 |
| b) Providing services to other teachers, training /tech support | 2.65 | 3 | 1.16 | 23 | 22 | 22 | 33 |
| f) Developing ways of integrating Internet into the curriculum | 2.32 | 2 | 1.10 | 31 | 25 | 25 | 19 |
| e) Serving on Internet-planning committee, school or district | 2.06 | 2 | 1.20 | 48 | 19 | 12 | 21 |
| c) Developing products for others, e.g., software or guidelines | 1.97 | 2 | 1.07 | 47 | 22 | 20 | 12 |
| d) Developing school or district-wide policies for Internet use | 1.93 | 1 | 1.11 | 50 | 21 | 15 | 14 |
| h) Meeting with parents/community members re: Internet use | 1.52 | 1 | .81 | 65 | 21 | 11 | 3 |
| g) Attending school board meetings to discuss Internet issues | 1.36 | 1 | .73 | 76 | 15 | 6 | 3 |
In addition, teachers were asked if regular meetings to discuss Internet issues were sufficiently present. Most (75%) respondents tended to disagree that Internet-related meetings were sufficiently present, many (36%) disagreed strongly; this was among the least sufficiently present of the items reported by Ravitz (1997). While this may indicate a desire for more involvement in decision-making, the wording of the question was not specific enough to determine this, i.e., responses could also indicate a desire to have others types of Internet-related meetings, e.g., with peers regarding curriculum uses.
Overall, teachers who use the Internet more were more likely to
participate in decision making and planning activities. A combined z-score
using the items from all three questions (reliability alpha =.88) correlated
with overall use (r=.35). Dropping the last item, which provided less value
in terms of predicting overall use (r=.17, p<.01), the mean score on
the two sets of items was more predictive of teacher use (r=.52) and overall
use (r=.42), than it was of student use (r=.24); in general, this condition
seems to be more closely associated with teacher use.
Condition #7: Commitment
Indicators of commitment include the extent to which there is sufficient organizational-level commitment for Internet use and to which various stakeholder groups have been supportive of Internet use over the past two years. Additional indicators include the number of other teachers in the school with whom the teacher regularly converses about the Internet, and the number of others who are estimated to be using the Internet. Finally, teachers were asked about the overall supportiveness of people in different stakeholder groups.
The "organizational-level" commitment indicators (Table 10) were reported
as being generally present, this included the existence of a long range
plan, a substantial budget being in place or assured, and Internet use
as a priority in school improvement plans. Approximately 70% tended to
agree that each was sufficiently present, with most respondents agreeing
strongly. Responses to these three items were correlated with each other
(r >.56) and the mean response on all three was predictive of overall use
(r=.23). The perception that Internet use is a priority was more closely
associated with increased use (r=.24), while the existence of a substantial
budget was a slightly less powerful predictor, although still statistically
significant (r=.16, p<.02).
Table 10. Commitment items concerning planning for Internet use are
present
| Q-35 To what extent are the following conditions sufficiently
present
to support Internet use by you and your students? |
Mean | Med | Md | S.d. |
| a) A long range plan for Internet development and use is in place | 4.26 | 5 | 6 | 1.55 |
| b) A substantial budget has already been approved, or is assured | 4.05 | 4 | 6 | 1.60 |
| c) Internet use is a priority in existing school improvement plans | 4.36 | 5 | 6 | 1.49 |
Concerning the supportiveness of various stakeholder groups (Table 11),
responses generally indicated support for Internet use from each of the
listed groups. Vendor or corporate sponsorship (item h) was the only of
these items that had a significant correlation with overall use on its
own (r=.22, p<.02). The mean of all these items (reliability alpha =
.86) was also predictive of overall use (r=.17, p<.02).
Table 11. Level of reported support by groups of stakeholders
| Q-33 Over the past two years, how supportive have people
in the
following positions been in promoting the school's Internet use? |
Mean | Med | Md | S.d. | Missing |
| b) Teachers (e.g., on committees, talking to others, demonstrating uses) | 3.28 | 3 | 3 | .69 | 5 |
| c) District-wide committee or task-force (e.g., district-level planning) | 3.21 | 3 | 4 | .85 | 20 |
| f) District technical support (e.g., install/maintain computers/ networks) | 3.21 | 3 | 4 | .94 | 15 |
| e) District administration (e.g., policies, hiring people, seeking grants) | 3.10 | 3 | 3 | .88 | 25 |
| d) School board or decision making body (e.g., budgets, dev. policies) | 2.98 | 3 | 3 | .90 | 20 |
| a) Parents (e.g., asking for Internet, bond issues, attending meetings) | 2.91 | 3 | 3 | .92 | 28 |
| i) District or school curriculum supervisors (e.g., ideas/materials for use) | 2.73 | 3 | 3 | 1.0 | 23 |
| g) Local community members (e.g., voting funds, interest, activities) | 2.52 | 3 | 3 | .90 | 54 |
| h) Vendors or corporate sponsors (e.g., hardware, software, telecom corps) | 2.45 | 2 | 2 | .95 | 51 |
| j) Local businesses (e.g., partnerships, instructional/technical support, interest) | 2.18 | 2 | 2 | .90 | 65 |
Concerning the number of other teachers in the school with whom a teacher
has discussed the Internet in the past month, most (80%) reported speaking
with 10 or fewer teachers, however approximately 10% reported speaking
with over 25 in the last month. This was a relatively strong predictor
of overall use (r=.37), especially after a square-root transformation created
a more normal distribution and one positive outlier was removed (r=.46).
Finally, the estimated proportion of other teachers at the school perceived
to be Internet users (Table 12) was also significantly correlated with
overall use (r=.27).
Table 12. Estimated proportion of teachers and administrators who
use the Internet
| Q-42 Approximately how many of the teachers and administrators at your school do you think use the Internet? Cirle one... | ||
| Teachers (Q-42a) | Administrators (Q-42b) | |
| "A few" | 24% | 35% |
| "About half" | 39% | 17% |
| "Most" | 19% | 17% |
| "Nearly all" | 14% | 21% |
| "Don't Know" | 2% | 9% |
| Mean=2.2; Med=2
S.d.=1.0; Missing=8 |
Mean=2.3; Med=2
S.d.=1.2; Missing=23 |
|
Condition #8: Leadership
The last condition involves the extent to which administrators and school principals are seen as advancing use of the Internet. This includes the estimated number of administrators who use the Internet themselves, the perception that administrative support is sufficiently present, and the overall stance taken by administrators with respect to Internet use. An additional form of leadership that was explored concerned a teacher's awareness of other individuals who may have made extraordinary efforts to bring about school Internet use.
The estimated proportion of administrators who are Internet users
(Table 11, above) was moderately correlated with overall use (r=.15, p<.05).
Generally, administrative support for Internet use was reported as being
"sufficiently present" (Figure 6); responses on this item correlated with
overall
use (r=.14, p<.05). Concerning the overall leadership stance, approximately
90% indicated that the principal or key administrators had at least been
generally supportive (Figure 7); however, this was not a useful predictor.
The mean z-score on these last two items was predictive of
teacher use
(r=.14, p<.05), but not student use -- the perception of administrative
support seems to be more closely associated with teacher use than student
use, possibly because of additional conditions required to support use
with students. Still, the mean z-score on all three items, including the
proportion of administrators using the Internet (reliability alpha =.68)
was predictive of overall use (r=.15, p<.02).
| Figure 6. Administrative support is sufficiently present
to support Internet use? |
Figure 7. Leadership stance taken by principal or key administrator |
![]() |
![]() |
| Mean 4.2; Med= 5; S.d.=1.56 Missing= 4 | Mean= 3.8; Med=4; S.d.=.98 Missing=9 |
Concerning others in the community making extraordinary efforts to bring about Internet use (Table 13), the most frequently mentioned types of individuals tended to be those who work in the school (principal, technology coordinator/media specialist, teachers) or a district-level specialist. None of the other types of individuals were mentioned in more than 10% of the cases. Incidentally, of those who wrote in "other" responses (n=15), three respondents chose to highlight extraordinary efforts made by the school board or a school board member.
Based on a comparison of means (ANOVA), those teachers who reported
extraordinary efforts by a university liaison were significantly more likely
to score higher on use measures.[15]
Other important leadership roles, by this criterion, included that provided
by a principal or school administrator, and that provided by vendors of
network software, educational content or computers.
Table 13. Extraordinary efforts by individuals in various groups
and relationship to Internet use ordered by reported frequency
| Q-51 Is there someone who has made extraordinary efforts
to bring to reality
a vision of tele-communications use in your school--someone who has made a substantial contribution that would not have been made by other individuals in that same role? Circle as many as apply, but be "tough." |
# | % | Mean
diff. in overall use |
| b) School computer or technology coordinator or media specialist | 60 | 25 | .02 |
| c) A teacher | 54 | 23 | .09 |
| d) District-level technology specialist or other district administrator | 40 | 17 | .15 |
| a) Principal or other school administrator | 31 | 13 | .37** |
| e) Specific parent(s) | 8 | 3 | .07 |
| h) University faculty member or students or network-based project liaison | 8 | 3 | .81*** |
| i) A provider of network software, educational content or computer retailer | 7 | 3 | .47* |
| f) Local business person, corporate sponsor or professional person in your community | 7 | 3 | -.12 |
| g) Government official | 0 | 0 | .00 |
Interestingly, those who reported extraordinary efforts by a local business person or community member scored slightly lower on overall use, however this was not a statistically significant finding. The total number of items selected was moderately predictive of use (r=.12, p<.05), while the number of the three significant items that were indicated was a somewhat better predictor (r=.19, p<.005). Of these three items, 60% of all respondents (n=141) reported none, 35% (n=82) indicated at least one, and only 5% (n=12) responded that individuals in two of these roles had made extraordinary efforts -- all but one indicated the principal or school administrator, paired seven times with a provider, and four times with a university liaison.
The number of people reported as making extraordinary efforts was correlated
with the mean z-score on the other leadership items. The mean z-score on
all four leadership indicators (reliability alpha=.63) was a better predictor
of overall use (r=.20, p<.005) than any single leadership indicator.
Summary
For each of Ely's conditions (1976, 1990) several survey items were developed based on a review of the literature. Descriptive data reported here suggest which conditions seem to be most present or lacking as reported by Internet-using teachers in leading-edge schools. For example, it seems that technical and training resources, administrative support and organizational commitment are among the most present; conditions that seem to be lacking include time for planning and curriculum use and the availability of curriculum-related help and resources.
In general, indicators for each condition are significantly correlated with use measures, including both teacher and student use. Within each condition certain indicators are stronger predictors than others. Some that appear to be more predictive of student use include classroom-related knowledge and skills, and curriculum resources; those that seem more predictive of teacher use include more "technical" Internet knowledge and skills, the extent of participation in decision making and other implementation-related activities, and the perception of support for Internet use by principals and administrators. The conditions that seem to be most predictive of use overall, based on measures developed here, include knowledge and skills and dissatisfaction with the status quo. In addition, a few individual indicators from other conditions seem to be strong predictors -- the number of other teachers in the school with whom a teacher discusses the Internet, and the number of students reported as having benefited greatly.
The next stage of analysis will focus on the covariance of these indicators across conditions and interaction effects. This may include identifying new factors that cut across the framework --- such as all the items related to curriculum integration. Finally, a regression model will determine the extent to which the conditions, as operationalized here, can account for differences in the extent of Internet use by teachers. Of course, more important than being able to predict use is the ability of the framework to shed light on the complex mix of conditions that are related to Internet implementation by teachers.
Bauder, D. (1993). Computer integration in K-12 schools: Conditions
related to adoption and implementation. Unpublished doctoral dissertation,
Syracuse University. Syracuse, NY.
Becker, H. (1992). Top down versus grass roots decision making about
computer use in American schools. Report # 40 from a national survey
sponsored by OERI. Baltimore: Center for Research on Effective Schooling
for Disadvantaged Students, Johns Hopkins University.
Becker, H. (1994a). How exemplary computer-using teachers differ from
other teachers: Implications for realizing the potential of computers in
schools.
Journal of Research on Computing in Education, 26(3), 291-321.
Becker, H. (1994b). Analysis and trends of school use of new information
technologies. Office of Technology Assessment. Washington, DC: U.S.
Government Printing Office (1996).
Becker, H. (1995). National School Network Testbed Phase 2: Baseline
Survey of Testbed-Participating Schools. Unpublished report. Available:
http://copernicus.bbn.com/testbed2/TBdocs/surveys/Baseline_report_8_31.html.
Becker, H. (1997, November). Two Years of Progress in the National School Network Schools. Presentation at TelEd'97. Austin, TX. Available: http://nsn.bbn.com/nsn_learnings/becker_teled97/overheads_explained.html
Becker, H. and Ravitz, J. (1997). The equity threat of promising innovations: The Internet in schools. Paper presented as part of the Internet and Equity in Education Symposium (Phillip Bowman, Chair), at the 1997 SPSSI Conference of the annual meeting of the American Psychological Asociation in Chicago, IL, August, 1997. Available: http://www.bie.org/Ravitz/equity.html
Berman, P. (1981). An implementation paradigm. In R. Lehming & M.
Kane, (Eds.). Improving Schools. Beverly Hills, CA: Sage Publications.
Eisenberg, M. and Ely, D. (1993). Plugging into the `Net. Emergency
Librarian (Nov/December), 8-16.
Ely, D. (1976). Creating the conditions for change. In S. Faibisoff
& G. Bonn (Eds.), Changing times: Changing libraries (pp. 150-162).
Champaign, IL: University of Illinois Graduate School of Library Science.
Ely, D. (1990). Conditions that facilitate the implementation of educational
technology innovations. Journal of Research on Computing in Education,
23(2), 298-305.
Fullan, M. (1991). The new meaning of educational change. (2nd
ed.). New York: Teachers College Press.
Fullan, M. (1993). Change Forces. London: Falmer Press.
Goldman, M. (1997, November). School-Community Partnerships: Potential Hero in Today's Transformation. In Two Years of Progress in the School Network Schools. Presentation at TelEd*97. Austin, TX. Available: http://nsn.bbn.com/nsn_learnings/school_community_partner.html
Goldman, M. and Laserna, C. (1998, Spring). Building school community
relationships: The role of higher education. Journal of Higher Education,
9(2), 44-70. Available: http://nsn.bbn.com/dissemination/docs/Goldman_HiEd.html
Hall, G. and Hord S. (1987). Change in Schools. SUNY Press: Albany.
Hall, G. and Loucks, S. (1977). A developmental model for determining
whether the treatment is actually implemented. American Educational
Research Journal, 14(3), 263-276.
Harris, J. (1995). Organizing and facilitating telecollaborative projects.
The
Computing Teacher, 22(5), 66-69. Available:
http://lrs.ed.uiuc.edu/Mining/February95-TCT.html
Hawkridge, D., et al. (1990). Computers in Third World Schools
(pp. 16-21). London: Macmillan.
Holloway, R. (1996). Diffusion and adoption of educational technology:
A critique of research design. In David Jonassen (Ed.). Handbook of
Research for Educational Communications and Technology (pp. 1107-1133).
New York: Macmillan.
Honey, M. and Henriquez, A. (1993). Telecommunications and K-12 educators:
Findings from a national survey. New York: Bank Street College of Education,
Center for Technology in Education.
Hunter, B. (1993). Internetworking: Coordinating technology for systemic
reform. Communications of the ACM, 36(5), 42-46.
Hunter, B. (1995a). Learning and teaching on the Internet: Contributing
to educational reform. In Kahin and Keller (eds.) Public Access to the
Internet. Cambridge, MA: MIT Press. 85-114.
Hunter, B. (1995b). Internetworking and educational reform: The National
School Network Testbed. I*NET Conference Proceedings. Available:
http://www.isoc.org/HMP/PAPER/065/html/paper.html
Hunter, B. (1997a). Learning in an Internetworked World. The Internet as Paradigm. Annual Review of the Institute for Information Studies. Queenstown MD: Aspen Institute, 103-121.
Hunter, B. (1997b). Fostering Collaborative Knowledge-Building: Lessons
Learned from the National School Network Testbed. TelEd Proceedings. Austin,
TX. November 14-15, 1997. Available: http://nsn.bbn.com/dissemination/docs/Hunter_TelEd97.html
Hunter, B. (1998). Internetworking and educational reform: Are these
different subjects? Paper to be given at the meeting of the Committee on
School Networking (CoSN). February, 1998. Washington, DC. Available: http://nsn.bbn.com/nsn_learnings/docs/cosn98_hunter/
Jeffery, J. (1993). Conditions that facilitate implementation of peer
coaching. Unpublished doctoral dissertation, Syracuse University. Syracuse,
NY.
Marcinkiewicz, H. (1993-94). Computers and teachers: Factors influencing
computer use in the classroom. Journal of Research on Computers in Education,
26(2), 220-237.
Marcinkiewicz, H. and Regstad, N. (1996). Teachers' computer use predicted
by subjective norms. Paper presented at Annual meeting of Association for
Educational Communications and Technology, February, 1996. Indianapolis,
IN.
McLaughlin, M. (1990). The Rand change agent study revisited: Macro
perspectives and micro realities. Educational Researcher, 19(9),
11-16.
Mitchell, D., Ortiz, F., and Mitchell, T. (1987). Work orientation and
job performance: The cultural basis of teaching rewards and incentives.
Albany, NY: SUNY Press.
Office of Educational Technology. (1996). Getting America's Students
Ready for the 21st Century: Meeting the Technology Literacy Challenge.
Washington, DC: GPO. Available online http://www.ed.gov/Technology/Plan.
Pedhazur, E. and Schmelkin, L. (1991). Measurement, Design, and Analysis:
An Integrated Approach. Hillsdale, NJ: Lawrence Erlbaum Associates.
Ravitz, J. (1997, November). What do Internet-using teachers say
about their Internet use? In Two Years of Progress in the National
School Network Schools. Presentation at Tel*Ed97 Austin, TX. Available:
http://www.bie.org/Ravitz/iut/iut.html
Read, C. (1994). Conditions that facilitate the use of shared decision
making in schools. Unpublished doctoral dissertation, Syracuse University.
Syracuse, NY.
Riley, M.E. (1995). Conditions that facilitate implementation of a career
development program to promote gender equity in middle and junior high
schools. Unpublished doctoral dissertation, Syracuse University. Syracuse,
NY.
Rogers, E. (1983). Diffusion of Innovations. (3rd ed.). New York:
Free Press.
Sheingold, K. et al. (1981). Study of issues related to implementation
of computer technology in schools. Final Report, July, 1981. Technical
Report No. 2. NY: Bank Street Collect of Education, Center for Children
and Technology. Sponsored by National Institute of Education, Washington,
DC. (ERIC Document Reproduction Service No. ED 319 370)
Sheingold, K. and Hadley, M. (1990). Accomplished teachers: Integrating
computers into classroom practice. NY: Center for Technology in Education,
Bank Street College of Education. Sponsored by OERI. (ERIC Document Reproduction
Service No. ED 322 900)
Stein, R. (1996). Conditions that facilitate the implementation of innovative freshman experience courses: A comparative analysis of three courses. Unpublished doctoral dissertation, Syracuse University. Syracuse, NY.
[1] The schools are part of the National School Network (NSN) project organized by researchers at BBN in Cambridge, MA in 1994 with funding the National Science Foundation (Contract # RED-9454769).
[2] Other topics from the literature, such as psychological variables (Marcinkiewicz, 1993; Marcinkiewicz and Regstad, 1996), and leadership styles (Hall and Hord, 1987) are not included in the current analysis.
[3] Henry "Hank" Becker at University of California, Irvine, co-authored and supervised the study. Network coordinators, technical coordinators, administrators and teachers not listed among the top ten Internet users were also surveyed. Copies of instruments, descriptive data, and reports are being made available online: http://nsn.bbn.com/nsn_learnings/survey.html.
[4] Along these lines, data cleaning removed approximately 30 teachers who failed to indicate use with students on a series of screening questions. A sample of "other" teachers suggests that approximately one-third of teachers not identified as among the top Intertnet users in their school would have met the minimum requirements for inclusion in this study had they completed the Internet-Using teachers survey.
5 Efforts to obtain a framework for determining "level of use" (Hall and Loucks, 1977) for Internet implementation were not successful prior to development of this study. Partly because the Internet is a relatively new innovation, any use by teachers is considered noteworthy. Becker (1997) begins to examine the impact of Internet use on specific teaching practices, such as having students work on longer projects.
[6] The overall use measure includes all the items (standardized reliability alpha = .81). It is calculated from the sum of the two orthogonal factors ("student" and "teacher" use) which is equivalent (r=1.00) to a single factor solution. Oblique factor analysis reveals the extent to which these factors are, in fact, related to each other (r=.53). Unless indicated otherwise, relationships to "overall" use and oblique factor scores are reported, i.e., not controlling for the other factor. If only overall use is reported, no striking differences were observed between student and teacher use.
[7] The next stage of analysis may examine the empirical validity of distinctions such as these.
[8] Formative use included completion of the survey by a dozen (12) teachers in seven (7) Syracuse-area schools accompanied by open-ended interviews, site visits, and an unpublished district-level case study.
[9] Becker and Ravitz (1997) found that higher ability classes may be favored with Internet use, particularly in schools with larger traditionally disadvantaged populations, and that subject and grade-level differences may exist as well.
[10] Unless indicated otherwise, all correlations reported in this paper are p < .001, two-tailed.
11 Hawkridge's fourth ratonale -- developing workplace-related skills -- was not asked here, however Goldman and Laserna (1996) found this to be an important rationale within the NSN schools they studied. Exploratory factor analysis suggests that reasons related to the pervasiveness of technology in society (items c, d, e, f, g) were related to both student and teacher use. However, reasons related to use of Internet as a catalyst for school improvement (items h, i, j, k, m) only correlated with teacher use (r=.35), while reasons related to other student benefits, only loosely interpreted as a pedagogical rationale (items a, b, i) were associated more with student use (r=.25).
[12] Data in all tables reflect four (4) or fewer missing cases (98% completion) unless indicated otherwise. Measures of central tendency and standard deviations are based on the scoring key shown within or below each table.
[13] Network coordinator data actually show a decrease in some of these benefits being reported since 1995, including students having greater interest in world events and foreign cultures, a deeper understanding of ideas they encounter, and greater interest in the adult world (Becker, 1997).
[14] Of course, selecting only those items that "work" as predictors of use may capitalize on chance; the utility of these particular items as opposed to others would have to be confirmed in follow-up studies.
[15] Goldman and Laserna (1996) provide case studies of NSN schools involved in university-school partnerships.