Conde School District

Technology Evaluation Plan

Michelle Mehlberg

Introduction:

The Conde School District has invested much time and money into developing a good technology infrastructure within the district. In order to determine if that infrastructure is being utilized to its maximum potential in enhancing student learning, the following technology evaluation plan was created. The plan is developed around several key components. The first portion deals with the purpose of the evaluation and key questions that the plan will address. In order to address the key questions, the next three sections deal with hardware evaluation within the district; software evaluation for purchasing and use purposes and finally website evaluations to determine the credibility and relevance to curriculum.

Section I

Evaluation Purpose:

The purposes of conducting this evaluation are formative in nature. The goals of the evaluation are aligned around providing the Conde School Board, Administration and teaching staff information regarding technology integration within the school and its effectiveness on student learning. Unfortunately, Conde does not have goals or standards in place for student learning outcomes in relation to technology. Therefore, at this point in time, the International Society for Technology in Education (ISTE), standards will be used as a base to evaluate student leaning in relation to technology integration within the classroom. Besides using the ISTE standards, the evaluation device itself will be a vital tool to help the district develop technology goals and standards and update its existing technology plan.

Evaluation Audience:

Those people identified who are interested in the outcome of this evaluation are the Conde School Board, Administration and teaching staff. As well as these three sets of people, parents and students will directly benefit from the data gathered.

The Conde School Board and administration will glean much information about the district and the integration of technology into curriculum and the effect that it is having on student learning. This will help them gauge the direction that technology integration within the district is going or where it needs to go in terms of meeting the ISTE standards. The results of the evaluation will also help these key people develop technology goals and standards unique to the Conde school District.

Conde staff members have a direct interest in the evaluation plan, as they are the ones that integrate technology into their curriculums. They will be able to determine what is being done that is beneficial to the student and student learning.

Parents and students obviously have a strong interest in the evaluation and its outcomes. What the students learn and achieve within the school setting is helping to prepare them for the working world. The evaluation outcomes will help identify if the technology being integrated into curriculum is enhancing student learning.

Description of the Evaluand:

The Conde School District is located in rural South Dakota. The town itself has a population of 250 people. It has the distinction of being the smallest school district in the state with serving 88 students K-12.

Although, it is the smallest district in the state, it is possibly farther ahead in its technology infrastructure than that of some of the larger districts within the state. Thanks to the "Connecting The Schools" project, all classrooms are connected to the Internet. This and the fact that the school board is very aggressive in keeping hardware and software current and up to date makes it very progressive technology wise. It is a mixed platform school, running Macintoshes and PC’s in the computer lab as well as having each classroom equipped with at least one PC. Students begin computer curriculum in their kindergarten year. Each elementary grade receives 40 minutes of technology instruction per week. Seventh and Eighth grade students, as well as sophomores take required technology classes and after that, they may choose to take electives in the technology field.

Teachers are encouraged to attend technology training sessions of all kinds, with the fees for some of them being absorbed by the school district. The school district has begun to send the whole staff to the TIE Conference in the spring.

Although the district has a technology plan in place, it is dated and needs to be brought current. It was written previous to the time when the district was connected to the Internet and does not identify goals and standards for the students.

Guiding Evaluation Questions:

Description of Evaluation Approach:

Although, Conde is not in the early stages of technology in the respect that technology has been within the district for the last 12 years, it is in the early stages of managing and integrating technology effectively into the curriculum. Therefore, this evaluation is formative; looking at the processes that impact student learning in relation to the integration of technology into the curriculum at the Conde School District.

Evaluation Methods:

There will multiple evaluation methods used to gather data including surveys of both students and teachers; Standardized test scores (Stanford); data from postsecondary schools; teacher created tests for the students; questionnaires; attitude scales given to students; and observation of both students and teaching staff. Student and teacher surveys, as well as attitude scales, are useful data collection tools because they are a good indicator of what the perception is of the participants. Analyzing of test scores will help determine in comparison at what level the student is scoring at relative to the rest of the participants within the school district as well as the state. Observation is going to be a key data collection tool, as it will help determining commonalties among staff and their integration of technology into their curriculum

As with any research project, one has to remember that there are many factors influencing the data collection since a variety of sources are being used. Teachers, parents and students all have preconceived ideas about technology and its impact on student learning. These outside factors have to be taken into consideration, therefore the reason for the multiple evaluation data collection tools.

Also, the information gathered is such that it cannot be done in a short period of time. In order to measure if technology is enhancing student learning at Conde the evaluation will be conducted over a three-year time span. The data collected will be used to analyses the impact technology is having on student learning at Conde and how teachers are integrating it effectively into their curriculums.

The analysis methods that will be used are quantitative review of Stanford test scores, scores from teacher created tests and data on articulation from post secondary schools. Qualitative forms of data collection will done via the surveys, questionnaires, the actual teacher generated tests, attitude scales and observations made within the classrooms. As well as being qualitatively measured, quantitative data will be collected on the surveys, questionnaires and scales to help determine the mean and standard deviations of the questions asked. This data will enable stakeholders to determine statistically where the data collected falls.

There are several different data collection methods that are going to be utilized during this technology evaluation plan. However, even though they are different the reporting technique will be the same for all of them.

It is important for the stakeholders and the participants to always be kept informed of what is taking place, therefore whenever data is collected or a report created they will receive appropriate documentation regarding it. Depending upon the circumstances and what is appropriate, this may be as simple as an email or memo or it might involve a full-length generated report. Besides keeping these key people informed, this will also allow for discrepancies within the evaluation to be caught and revised before publishing.

Upon completion of the evaluation, reports will be given to all of the stakeholders. A final report will be given to school board members, teachers and administration. Students, parents and other people within the community may request copy of the evaluation report in the administration office. After the report has been distributed, there will meeting held to process the information given in order to improve the use of technology in measuring student outcomes. Since this will be three-year evaluation plan, this will help measure the strides that are taken in the use of technology and assessment in the Conde School District. The following chart depicts the methods of data collection and data analysis interpretation.

Evaluation Questions

Why the Question

Is Important

Information

Needed

Data

Collection Methods

Analysis

Integration

1. Are classroom teachers using a variety of technology tools to enhance student learning, and if not, why?

  • Technology is an important part of not only the learning process, but also the working world.
  • Teachers need to utilize the variety of technology tools that are available to them to help students use them to their full capacity.
  • data on what technology tools are available in the classroom for teachers to use.
  • data on how much these technology tools are used in the classroom for student learning.
  • observation of lessons taught in the classroom
  • teacher surveys
  • student surveys
  • teacher checklist regarding hardware/software that is available to them
  • Both student and teacher surveys will be coded according to the question addressed so that the data compiled will be easier categorize. The surveys will be distributed during the fall of year one and three. Data compiled during year one will set the tone for what needs to be addressed during year two. Year three surveys will determine growth in each of the areas addressed. The date will be compiled in terms of percentages. The percentages will reflect the increase or lack thereof of technology integration into classrooms. This data will be used to help the school determine what technology pieces need to be purchased for integration into the curriculum, therefore creating a broader base of technology tools utilized within the curriculum.

2. Are student competencies in technology use being aligned with state and national standards?

  • Students need to meet the standards that are in place for technology to assure that they are getting the same technology background as other students in the state as well as across the nation to prepare them not only for post secondary education, but also the work world

 

  • objectives listed in teachers lesson plans and whether or not they address technology standards
  • data from state and national sources to use as a comparison
  • copy of state and national standards
  • view Teacher lesson plans.
  • teacher generated tests
  • student survey

 

  • When observations are done in the classroom, data recorded will be analyzed according to commalities and frequency of use. Data from observations will be compiled all three years.
  • Lesson plans will be collected weekly for the three-year time span. A checklist will be developed to aid in determining if technology use increases over the time period.
  • Data compiled will be used to move the district toward addressing and achieving the ISTE standards

3. Are classroom teachers using technology, hardware and software, for student assessment and learning, and if so how comfortable are they in using it?.

  • Students need to be exposed to a wide variety of technology tools in order to be prepared for post secondary education and the work world. They need to see the integration of technology into everyday life experiences.
  • Students need to use a variety of tools, including the Internet and different software applications to research and complete assessment projects.
  • the variety of student assessment methods using technology.
  • measurement of how often teachers use technology.
  • Data on how often technology is part of the assessment plan
  • Data collected from software evaluation plan
  • Data collected from WebSite evaluation plan
  • teacher survey
  • lesson plans
  • software evaluation form (appended)
  • website evaluation form (appended)
  • Teacher generated tests will be collected and assessed as to how many and how often questions address technology use. The data will be compared from year to year over the three-year time span to see technology assessment increases or levels of over time.
  • Data compiled will be used to determine what teacher inservices need to be developed to give teachers the skills needed to use technology as an assessment and teaching tool
  • Date collected from software evaluations and website evaluations will help determine if the teachers are comfortable with evaluating quality products and websites to use within their classrooms
  • All of the above date collected will help assess teachers’ levels of skill expertise in using technology as a teaching tool and as an assessment method in order to determine their needs for inservice and training in this area.

 

4. What resources and teacher training opportunities are available for teachers to aid them in raising their expertise and comfort level in integrating technology into the curriculum?

  • The more quality training and resources that are available to teachers, the more capable and confident the teacher will feel with integrating technology into their curriculum, which will benefit the student by making them more comfortable with technology.
  • A lot of money has been spent by school districts and the state to bring technology into the classroom for enhancing student learning. We must make sure that the teacher is comfortable in using the technology available to them.
  • data on what is available for teacher training.
  • criteria of what the district allows for training within the technology plan
  • information on what type of development activities teachers feel best prepares them for technology use and integration
  • teacher questionnaire
  • school technology plan
  • classroom observation
  • Questionnaires will be developed to determine teacher attitudes and feelings toward the technology issues addressed in the evaluation plan. They will be administered the first year and the third year. Data will then be compared and analyzed.
  • Data that is analyzed will be used to determine if inservices and classes are meeting the teachers needs in the technology area.

5. How well are students able to transfer technology skills learned at Conde into post secondary education programs or into the working world?

  • Students will be more successful and confident in post secondary education as well as the working world if they have a strong base of technology skills upon entering.
  • data on how many students go on to post secondary education or who enter the work world
  • data on how many articulate out of technology programs
  • data on students attitudes toward technology background upon entering post secondary institution or the work world
  • percentage of students who articulate into postsecondary schools
  • attitude scale given to graduating students
  • Data will be collected from post secondary education institutions that our graduating students attend. This will be done all three years of the study. The data will be compared at the end of the three years to determine if there is any significant increase in the number of students articulating into programs.
  • Attitude scales regarding technology education will be given to graduating seniors each of the three years to get their opinions on how they feel about their skills they have been taught. The results will be compared for commonalties among answers. The strengths and weakness of the technology program will be assessed and revision made to the to the technology plan to address the technology skills that students need in the work place.
  • 6.What impact on standardized tests can be attributed to technology use?

     

    • Assessment methods should be helping students increase their test scores and educators need to identify those technological skills that are aiding the student to raise those scores.
    • Standardized test score data
    • percentage of students who measure above the median score of the standardized test
  • Standardized tests scores will be compared and analyzed all three years. The data will then be compared to the mean and look at a frequency distribution to see if the students are above or below the mean and if this changes from year to year.
  • 7. Does the technology infrastructure that is in place at Conde support the instructional goals of the district?

    • Technology is part of the working world when students enter it; therefore they should have the skills needed to be successful in whatever endeavor they choose. Technology within a district needs to support those skills needed.
    • What hardware is in place at the moment and what hardware specifications are needed to support those skills needed by the student?
    • Hardware checklist audit
  • The technology checklist audit will be completed by teachers each of the three years. The information will be used to determine if hardware is being kept current and if its specifications are adequate to support the technology goals of the district, which are the ISTE standards.
  •  

     

     

     

     

     

     

     

     

     

     

     

     

    Section II

    Since the district, like a number of school districts across the state, does not have technology goals in place, the goals that will be targeted for this evaluation are the ISTE technology standards for students.

    Technology Foundation Standards for Students

    1.

    Basic operations and concepts

     

    Students demonstrate a sound understanding of the nature and operation of technology systems.

     

    Students are proficient in the use of technology

    2.

    Social, ethical, and human issues

     

    Students understand the ethical, cultural, and societal issues related to technology.

     

    Students practice responsible use of technology systems, information, and software.

     

    Students develop positive attitudes toward technology uses that support lifelong learning, collaboration, personal pursuits, and productivity.

    3.

    Technology productivity tools

     

    Students use technology tools to enhance learning, increase productivity, and promote creativity.

     

    Students use productivity tools to collaborate in constructing technology-enhanced models, prepare publications, and produce other creative works.

    4.

    Technology communications tools

     

    Students use telecommunications to collaborate, publish, and interact with peers, experts, and other audiences.

     

    Students use a variety of media and formats to communicate information and ideas effectively to multiple audiences.

    5.

    Technology research tools

     

    Students use technology to locate, evaluate, and collect information from a variety of sources.

     

    Students use technology tools to process data and report results.

     

    Students evaluate and select new information resources and technological innovations based on the appropriateness for specific tasks.

    6.

    Technology problem-solving and decision-making tools

     

    Students use technology resources for solving problems and making informed decisions.

     

    Students employ technology in the development of strategies for solving problems in the real world.

    To aid school districts in assessing whether their hardware is sufficient to aid their student in obtaining the standards set forth by ISTE, the following technology audit can be used as a guide.

    Technology Hardware Audit

    Directions: The following items refer to hardware items that may or not be located within your room. Check those items that apply to your room.

    Classroom Components:

    Teacher Workstation – 1 per teacher ________

    Student Workstation – 1 per 5 students ________

    Television ________

    VCR ________

    Cabling to connect Television/VCR to computer ________

    Printer ________(Color) ______ (Black)

    Telephone ________

    Computer Lab Components:

    Teacher Workstation – 1 per teacher ________

    Student Workstation – 1 per 5 students ________

    Television ________

    VCR ________

    Cabling to connect Television/VCR to computer ________

    Printer ________(Color) ______ (Black)

    Telephone ________

    Scanner ________

    Digital Camera ________

    Video Recorder ________

     

    Teacher and Student WorkStation Configurations:

    Operating System ______ Win95 ______ Win 98 _____ MacOS 8.0

    RAM ______ 32 MB ______ 64 MB _____ >64 MB

    Hard Drive ______ < 10 Gig ______ 10 Gig _____ > 10 Gig

    Microphone ______

    Video Card ______

    Speakers ______

     

    Network Configuration:

    Windows NT ______

    LAN connection(printers) ______

    T1 connection to WWW ______

    Cyberlibrary, Microsoft

    Proxy or equivalent for

    Caching and filtering ______

    Automated Library ______

    Distance Education Components:

    VTEL Equipment ______

    Internet Classes ______

    Support

    Technology Plan ______

    E-Rate Supported ______

    Network Administrator ______

    Technician ______

     

    Technology Ranking

    In your opinion rank the following hardware components placing a check in the range that you believe it falls for Conde.

     

    Above Average

    Average

    Below Average

    Nonexistent

    Teacher Workstation

           

    Student Workstation

           

    Computer Lab Components

           

    Classroom Components

           

    Network

           

    Distance Education

           

    Technology Support

           

     

    Section III

    Software Evaluation

    Following are the steps that need to be taken for software evaluation and in the end, purchase.

    Is it intended to teach or entertain?

    Is it to develop writing skills?

    Is it to develop programming/multimedia skills?

    Is it to reinforce what is taught in the curriculum already?

    Is it to replace existing curriculum?

    Is it to be used strictly as a tutorial?

    .

    *research

    *catalog

    *asking what other districts are using

    Software Evaluation

     

    Missing

    Poor

    Good

    Excellent

    Technical Considerations

           

    Easy to install

           

    Loads quickly

           

    Technically sound (works as expected/indicated)

           

    Does not take up excessive disk space

           

    Allows for teacher individualization

           

    Can be adapted for special needs students

           

    Instructional Content

           

    Clearly defined objectives

           

    Activities support objectives

           

    Activities engage the learner

           

    Content is in the right order

           

    Offers variability for repeat users

           

    Promotes Cultural Diversity

           

    Contains accurate information

           

    Cross Curriculum

           

    Instructional Design

           

    Summaries and reviews are provided

           

    Feedback is appropriate

           

    Material easy to review and go back to

           

    Progress report (record keeping and reporting)

           

    Student and/or teacher can control the rate, sequence and level of difficulty

           

    Variety of color, sound and graphics to hold interest of learner

           

    Sound can be turned on and off and is appropriate

           

    Handles a wide variety of student responses

           

    Can be used cooperatively

           

    Ease of Use

           

    Can be used independently

           

    Help command is easily accessed or available online

           

    User can easily manipulate between screens

           

    Manual is easy to read

           

    Navigation

           

    Clear directions

           

    Easy to navigate and control

           

    Easy to go back to prior steps

           

    Easy to check progress

           

    Support

           

    User guide/documentation

           

    Accompanying printed material and suggestions for use in curriculum

           

    Technical support via phone or WWW

           

    *Purpose of purchasing the software.

    *The educational objectives that the software will achieve.

    *Support of how the software will achieve the objectives.

    *Documentation of how the software will be used in conjunction with the curriculum.

    *Software evaluation forms completed by those previewing the programs.

     

     

    Section IV

    WebSite Evaluation

    In the past, students went to the library, newspapers, encyclopedias and books to find information that they needed to complete assignments. This is all changing as more and more students are choosing to use the Internet as a resource. As Internet use becomes a common means of obtaining information within schools, we have a duty to our students to give them the skills to screen this information for accuracy. Since almost anyone can place information on the Internet no one can really be sure of who is creating and placing the information on the Internet. Evaluating what is read on the Internet, therefore becomes a critical skill that must be taught to our students. Before educators can help students do this, they must be able to evaluate web sites themselves. Following is a guideline to help educators evaluate a web site and determine whether or not it meets quality and accuracy standards.

     

    Content:

    Missing

    Can’t Tell

    Poor

    Good

    Excellent

    Title Clearly Identified

    Author Identified

    Date of article within last 5 years

    Edition within last 5 years

    Credibility:

    Credentials listed for Author

    Author includes an email address to contact them

    Author is creator of information

    Author is compiler of information

    Producer of page clearly noted

    Producer is well-known organization

    Producers members are professionals

    Producers members are advocates

    Producers members are consumers

    Producer has a bias (political, religious, etc)

    URL clearly noted

    Ending suffix (.edu, .org, .com, .net)makes sense with the purpose of the document

     

    Publication:

    One page document

    Document part of a series

    Purpose of document is clear

    Updated and current

    Sources cited

    Copyright dates prominent

    Format:

    User Friendly

    Aesthetically Pleasing

    Downloads quickly and easily

    Text is easy to read

    Learning Process:

    Promotes Higher Order Thinking

    Engages the Learner

    Integrates Multiple Intelligence’s

    .

    Name of Website:___________________________________________________

    URL of Website:___________________________________________________

    Ranking of Website

    3=Excellent 2=Good 1=Poor

     

    3

    2

    1

    Credibility

         

    Ease of Use

         

    Usefulness within classroom

         

    Overall Ranking