Tag Archive 'assessment'

Jan 20 2009

When is it too much? AND When do we say “DO IT or GO!”?

Technology Integration with Science Content
Image by Old Shoe Woman via Flickr

This entry will be cross posted to the Leadertalk Blog

My colleagues and I got in an animated conversation the other day about the actual demonstrable skills teachers and administrators must have to be successful members of our school community.  Beyond the basics understandings that teachers must have of the new uses of the read/write web, what exactly do we expect our educational professionals to be able to use to enhance teaching and build better learners?

I’ve been pounding my fist of late in these meetings, demanding a well developed professional development plan that is clear, concise and has reasonable accountability build into it- with a sharp eye on the short term and a vision for what will be in year 2 and year 3 of the plan.  I personally feel it seems like a reasonable and common sense request, and as I have said over and over, I could probably sit down and write a draft myself, but that would not help us address what really needs to drive our school’s technology training strategy.  Then…out of the blue… it came out of one of the participants mouth. Their words (paraphrased and combined) were:

When are the school administration going to start holding teachers accountable and make them use technology and follow the technology plan?  We have NETS for Teachers in our performance evaluation program. We are working hard to ensure that training is in place for our teachers, but it will all be a huge waste of time if teachers are not held accountable.

Interesting thoughts indeed!  I didn’t say it but I wanted to hold someone else accountable.  Nonetheless, the conversation continued and what followed was a significant discussion about the frustrations of the technology specialists.  These folks are working long hours to prepare lessons for their peers in addition to preparing lessons for the students.  As we are all aware, adults are a lot more demanding than children and thus the time investment has been significant.  A typical PD session that is voluntary results in just a few “interested” teachers showing up, and the technology use being enhanced in classrooms where there is already integration already going on.  It is certainly not a loss, but it is not the gain we’re hoping for either.

So the question held in the air around us and we all were responsible for the answer.  Ultimately, we are talking about professional responsiblity and instructional excellence.  Ultimately, I feel it comes to making the standards and embedded skills in the standards managable and understandable for all members of the instructional community in a school.  One of the resources we are using to build from is a resource called “23 Things”. This group of educators has put together a great list of resources and concepts that they feel best addresses the current needs of a practicing teacher in a classroom. We took that list, analyzed it, and then added to it and adapted it in ways that will best meet our needs at our school.  What I think the 23 things and our additions and modifications does in this Professional Development Mashup is make the whole mess of what would seem to be disjointed applications, resources and skills into chunks of possibilities.  I would share it here, but it is not quite done. When it is, I will do so. But, the creation and formation of this structure does not answer the key question posed.  Are the administrators going to hold the teachers accountable?  If they are, do they have the will- the guts – the understanding of the technology to say “You must meet these standards or go find another school or another job?”

It is a tough call.  In 2000 the Center for Research on Information Technology and Organizations published a report called School Technology Leadership: Incidence and Impact.  In the report it states:

For technology to become an integral part of a school, it not only is necessary to help teachers use the technology but administrators must be involved in it, too. The importance of training for developing teachers in technology has long been recognized in the educational community. These findings indicate that administrative leadership and decision-making are equal, if not more important than spending on infrastructure to maintaining a successful technology program.

…Charismatic people may contribute to technology integration as well, but it is even more essential for a school to distribute leadership and become a “technology learning organization,” where administrators, teachers, students, and parents together work on how best to adapt new technologies to improve learning. (p. 17)

(Thank you Drape’s Takes for drawing my attention to this quote!)

After it is all said and done, I have to continue to believe that until we hold the ADMINISTRATORS accountable for understanding technology and exploiting the power of the web, we cannot and will not be able to hold our instructional staff accountable.  As was stated almost 9 years ago, it is the leaders who must build a “technology learning organization”.

What do you think?

Posted by Andrew Torris

——————————————————–

Reference:

Enhanced by Zemanta

9 responses so far

Nov 23 2008

Dispatch from the couch: I am about to step into rough waters- ASSESSMENT

It is a rainy, chilly dark day here in Shanghai.  My family is snuggled in to a quiet routine of artwork (my 5 year old), wikispace creation(my wife), toy chewing (dog) and napping (1 year old).  I just finished my lunch of left over pizza and left over indian food and am now contemplating the week ahead of me and the indigestion that will certainly kick in on me in just a few minutes (smile). 

______________________________

Christopher Harris, author of the Informancy blog was recently sent a note from CBS news pointing a story they did titled “Web Tests Kids’ Desire to Cheat”.    The note to Mr. Harris from a CBS news employee stated,

A story aired this week that I think your blog readers might be
interested in. Our science and technology correspondent Daniel Sieberg
examined videos made by kids, for kids, teaching each other just what
teacher’s don’t want them to learn: how to cheat.

I did a quick search on YouTube and found this particular search term set comes up with some pretty staggering results 

I am about to begin a process in my school where we examine at a profound and deep level our assessment practices in our classrooms. One of the concerns that each and every school has is the ability to accurate measure a students understanding of the skills and concepts that we have decided to measure in our classrooms.  In an attempt to state the obvious and to stick to some common sense here I would like to clearly state that if there is a test being given, there is most likely a human being trying cheat the test.  Even the simple peek over the neighbors shoulder will slant the results of an assessment and thus provide the instructor with inaccurate assessment data.  Cheating ultimately cannot be combatted by security, it must be combatted by demanding that our schools use authentic assessment methods.

Mr. Harris poses these questions:

  • Why are teachers using assessments on which students can cheat? Just
    like with The plagiarism on research papers, the problem is most often
    not in the copying, but in the failure of the initial assignment to
    present a rigorous and authentic assessment situation.
  • When is CBS going to take a stand and look at the need for rigorous,
    authentic work in our classrooms?
  • When is CBS going to stop focusing on
    cheating students and focus on cheating test companies and corrupt
    governmental departments that brought about the total failure of
    Reading First?
  • When is CBS going to stop focusing on fear-mongering and
    instead join in the effort to bring about real change in the
    educational system?

Let’s apply some common sense here. Teachers and administrators need to face facts that to prying public eyes, a “test” has some value in that it is a known quantity.  We have all taken tests and we know how they are measured.  Since we have all taken tests, we also know that people cheat on tests.  I believe most people are lying when they say they’ve never cheated on a test.  To err is human, and temptation is always there.  I will connect the dots here for you.  To an outsider, a test is a necessary evil, and since people cheat we should police tests to prevent “most” cheating (see YouTube if you need help here!).

As one commenter noted:

Doing well in school is mostly about gaming the system and not about learning or intelligence.  (Posted by sharkzone1 at 02:36 PM : Nov 21, 2008)

OR…..

As Mr. Harris and Mr(Ms?) Sharkzone1 aludes to in their response to CBS news, we could reconstruct and reorganize our assessment methods so the learner cannot “game” the system. 

The failure in tests are that they are not accurate measures of student learning.  Most tests, even the best ones, don’t require the learner to demonstrate, process, evaluate, integrate and extend learned concepts. The problem here is that we will be stepping into a space that most community members (and school employees) have not stepped into before.  Uncharted territory is both scary and contentious.  The good news is that we have mountains of quality educational research on our side and we have the opportunity to make substantial progress toward a more productive educational environment for our students.

I’m committed to this idea and I am excited about the work I am about to begin with my colleagues.  It is going to be rough going, but I know we will be successful if we address the needs of the students. 

Thoughts?

Image CC http://static.flickr.com/218/471335001_05c88b0155.jpg

Technorati Tags: , , ,

3 responses so far

Jul 15 2008

“Another” Conference! ETS Assessment Training Institute- Notes from Monday and Tuesday!

Published by Andrew under assessment

Location: Portland, Oregon
Date: July 14-16

First impression this AM after a relaxing commute to downtown Portland from my home in Hillsboro is that this workshop has a HUGE binder! The thing must weigh about 10 pounds… AND there is no wireless access in the session. The wireless session is available but…. no code is provided to give us access to the network! Grrr… what a pain! So I am blogging offline!

Shanghai American School has a nice contingency of almost 20 people. I am so proud to have reps from each of the divisions and a wide variety of departments and grade levels. I am hoping that we can use these folks’ new found enthusiasm and knowledge

Keynote address from Rudy Crews, currently Superintendent of Miami-Dade Public Schools. For a good summary go to Amanda DeCardy’s blog www.sometechsense.com for a review.

http://farm1.static.flickr.com/65/173274400_afca8966a4.jpg?v=0

My first of a concurrent session is Tapping the Full Potential of Assessment FOR Learning, presented by Rick Stiggins. I have been reading and rereading Rick’s book for several years.

Some important notes from Rick’s presentation-

A Revolution in Assessment Dynamics:

What STUDENTS think about and do with assessment results is as important as what adults think about and do with them…

Kids should go first when it comes to learning. What they think and do with their learning as a profound effect on the learning process. There is a thought process that goes into this… to build confidence with their learning and their own learning process. We need to encourage self-efficacy.

Self-Efficacy

Self-Effective People see themselves as:
-learners who are enhanced by human accomplishments
-Challenges to be mastered
-intrinsic interest in things they do.
-they contribute failure to insufficient effort, deficient knowledge and skills

In contrast… people who are not….

- shy away from difficult tasks
- Low aspirations
- dwell on personal deficiciencies
- slack in efforts
- view failure as a deficient aptitute

3 ways to develop academic self efficiacy
Student experiences real, credible success at learning
See other who are like me experiencing success
Talk learners into believing they can succeed.

To improve, students must:

- Know what good work looks like
– Compare their work to that standard
– Understand how to close the gaps

Know what good work looks like-
– Start instruction with student friendly versions of the target
– Accompany that with samples of student work

Compare their work to that standard-
– Provide continuous descriptive feedback (NOT JUDGEMENTAL)
– Teach students to generate their own feedback and set goals (self assessment!)

Understand how to close the gaps-
-Help them improve

Assessment Collaborative

Teachers

  • make key decisions
  • define targets
  • provide models
  • Assess
  • Provide feedback
  • Promote growth
  • judge sufficiency
  • Gain self -efficacy

Students

  • Make key decisions too
  • Understand those targets
  • Understand the models
  • self assess
  • Generate feedback
  • Understand growth
  • see sufficency
  • feel self-efficacy

4 assessment methods

  • selected response
  • written response (essay)
  • performance assessment
  • direct personal interaction

Why we assess?

1. Inform instructional decisions- a quality system gives quality information

Always begin by asking:
What decisions?
Who’s making them?
What information will be helpful to them?

Information needs vary profoundly:
- Classroom level users
- Program-Level Users
- Institutional/Policy Users

We should build balanced assessments to meet the needs of all three groups, as they are important to all.

Why classroom?: Promote learning for all with FOCUS of mastery of pre-set standards. PREP for ASSESSMENTS: Standards arrayed in learning progressions to unfold within and across grade levels. ASSESS CHALLENGE: To know where each child is in their learning.

Classroom Assessment:

-Decision- What comes next in learning
-Who: Student, Teacher and Parents
Helpful Info??- Continuous information on learning progress

Program Level Assessment:
-Decision- What Standards mastered?
-Who: teachers, principals, curriculum specialists
Helpful Info??- Periodic but frequent information/evidence summarized across classrooms indicating standards being met.

Institutional Use:
-Decision- How many kids are reaching standard?
-Who: Community, Board, etc
Helpful Info??- % of sucess, annual reports, etc.

A revolution in assessment dynamics: BALANCED Assessment means …. If assessment isn’t working well in the classroom– if poor decisions arise from unsound assessments DURING the LEARNING– The other assessment levels don’t matter; THEY ARE WASTED; THEY CAN’T FIX THE PROGRAMS THAT RESULT…

A belief in balance in the power and quality of classroom assessment. We need to support the classroom teacher in quality assessment training.

  • All assessment must cent on high quality standards.
  • All assessment must yield accurate evidence
  • All assessments must lead to further student learning.

2. Encourage students to try to learn. (more on this in other session)

BOTH #1 and #2 are equally important.

Au 92 de la rue
Rick Stiggins has identified 5 Doors to Excellence in Assessment

Door 1: Clear Achievement Targets
Door 2: Meet ALL user needs (teacher, parents, students, admin, board, etc.)
Door 3: Assessment Quality
Door 4: Communicating Effectively
Door 5: Setting Sound Policies

What is behind Door 1: Clear Achievement Targets Essential Conditions

- Quality Standards?
- Appropriate number given the available resources?
- In learning progressions? From beginning to end?
- Each been deconstructged oinot scaffolding?
- Transformed into student friendly versions?
- TEACHERS are masters of the content they are expected the teach?

http://www.flickr.com/search/?q=door%2C%20creativecommons&w=all&s=int

What is behind Door #2: Meet ALL user needs?

Who needs:

  • Annual Accountability test scores? Why?
  • Interim assessment results? Why?
  • Classroom assessment results? Why?

What is behind Door #3: Assessment Quality

  • Do we gather dependable information?

Do Not And Or A poor quality common assessment is worse than NOT doing it at all!
http://farm1.static.flickr.com/47/137194122_820d3dbd4c_m.jpg

Report CardsWhat is behind Door #4: Communicating Effectively

“Report card reporting systems are a throw back to a time when we rank ordered students for further placement”

  • Agreed upon achievement targets?
  • Accurate information?
  • Balancing descriptive information and judgmental as appropriate?
  • Symbols have common meaning?
  • Message receiver open to hearing and acting on results?

http://flickr.com/photos/tiggywinkle/420446132/


Communications Options

  • Test Scores
  • Letter or number grades
  • standards-based report cards
  • portfolios
  • conferences

What is behind Door #5: Sound Policies to Guide Sound Practices

  • Curriculum Policy?
  • Assessment Policy?
  • Communications Policy?
  • Personnel Policy?

http://farm1.static.flickr.com/150/411212338_29d09bc56e.jpg?v=1173094453

“Are there any policies about a student’s role in assessment reporting?”

Questions for our team at SAS to ask each other are:

  • - Is our standards house in order?
  • - Are we meeting all information needs?
  • - Are all of our assessments accurate?
  • - Are we communicating effectively?
  • - Are we guided by sound policies?

Technorati Tags: , ,

No responses yet