I'll start this post out by saying that my Employment U. does Tenure and Promotion different than most. By contract the entire department is involved in the evaluation of all faculty, whether they submit an annual review (Asst. Profs), a tenure package or a semi-annual review (tenured profs). In a given year the department may have 4-6 people being reviewed, all at different stages on the ladder.
This is both a good and bad thing to me. It's certainly nice to have a better feel for the evaluation process and how things work. It turns out that there is no meeting in an underground chamber with candles and mead when it comes to tenure decisions. No conversations with hoods pulled down to obscure half the speaker's face.
I know, I'm a little bummed out that doesn't happen too. I totally thought there was a secret tenure chamber under the old lecture hall.
In any case, it's a bit odd being asked to provide comments on colleagues and their accomplishments after being here for a year. I don't really know the expectations unless I look around at who recently got tenure. Even in that case, our department is diverse enough that a candidate in one year might have a very different CV from one in the next. Some people's research costs $2000 per year and others need $800,000. Teaching expectations are different, depending on one's field, when a person joined the department and how aggressively someone negotiated to get teaching release when they were hired. There is no text book example of some who should get tenure, and I don't think my department is unique in that regard.
I'm sure the older faculty have a better feel for what does and does not fly when it comes to tenure and part of the annual review is to let untenured faculty know when they are off course. But I'm still being asked to evaluate everyone else and that makes me feel a little uneasy. They will never see my signed evaluation, but the chair does and part of me feels like I'm being evaluated on my ability to evaluate, if that makes any sense at all. Maybe it's just that untenured faculty feel like everything is a test, but not only am I thinking about each candidate, I'm also trying to figure out how my comments on each reflects back on me.
No wonder why I never get anything done.