Join the Common Corps!

They’ve got cookies…and you are going to be assimilated anyway.

So, what good is sitting, all alone in your room? Go on and join the data fray, become part of the collective.

Consider, if you will, the Kit Kat Club its celebration of sexual fetishes of all stripes.

Or, if a more dystopic future is your choice, maybe a visit to the Milk Bar with Alex and his droogs.

Across the net tonight data is flowing in unimaginable numbers of bytes. From simple communications like text messages and email, to the buying and bartering of 80 million Anthem records. Others are working with data, writing stories about data. Still others are creating and running organizations to encourage the collection and use of more data, while other organizations are opposing them.

With good reason on both sides.

My friend Barmak and others talk about the fetishism of data (or big data) frequently in the context of education data. Even though I am a data guy, I see his point. Once upon a time, when I was much younger, we learned about being parsimonious or frugal in our datasets for research. Today that seems completely out the window. There is a lot we can learn from big data, and a lot we can learn from much smaller datasets that are less intrusive that pose less risk to those we are trying to help by using their data. I suspect most of the time we can learn more from the smaller datasets where we sit and think about what we are doing.

Of course, while I write this, I am also working on a projection model based on more than 20 years worth of data that will produce results I am confident will be wrong in 15 years. The question is just how wrong and so I struggle to minimize the wrongness. There will be something like five million moving parts (with agency and motives of their own) affected by forces that have changed dramatically over the last two decades and others that didn’t exist.

Oh well, love is an imaginary number and the eagle arrives daily, and I remain modern and unbound…at least to the fetish of big data. I have a lot of data to work with, but it does not, I think, rise to the level of “big.”

While reading a completely unrelated blog post about Dominion and Eminent Domain, as granted to private companies (allegedly operating in the public service) I got to wondering about this. Are forces in motion to allow private companies, to declare eminent domain as it relates to data? Is it that much of leap to believe that some corporation is trying to find a way to ensure access to all the information it doesn’t have about us to better target its advertising? Perhaps Kroger or Food Lion argue that they need access to our health records to help us make healthier grocery purchases. Certainly that would be considered in the public good and if a power utility is a public service company, how is a grocery not? Food is far more necessary to the individual than power delivery.

Btw, how can one not appreciate the phrase “Dominion and Eminent Domain?”

Really random

Some of you will think less of me for this. “Joe Versus the Volcano” is one of my favorite movies. I know a lot of people didn’t like it, probably still don’t like it. I am not a movie critic like my nephew, so I won’t attempt to justify the movie’s goodness through its repetition of themes and icons, or its characters. It’s simpler than that. But how can I not like a movie that starts out under driving rhythm of “Sixteen Tons” sung by Eric Burdon?

Some things defy explanation or just don’t need it.

When I was a child in Oklahoma I remember watching Tennessee Ernie Ford sing this song and others on television. Later I rediscovered Johnny Cash and  his cover of Sixteen Tons. It is one of those songs that has always resonated with me. Perhaps because it is, in part, about the inability to catch up. There is always more to do.

Sixteen Tons is also one of the (many) reasons I love the movie “Heavy Metal” because of its thematic connection to the Devo cover of “Workin’ in a Coal Mine.” I just wish the movie held together better overall. However, it is more probably a bit more successful than “American Pop” which tries to do much and doesn’t really satisfy.

Anyhow, whatever you tomorrow, Monday (2/2), don’t drive angry.

And the search goes on

It’s happening again, the search for transparency. There is this belief that the right set of measures, over the right period of time, will clarify everything. About anything. Of course, the right measures are simple and don’t need explanation about what they measure and why they are important.

And that’s why the Quest for the Holy Grail did not happen…the Grail was sitting in the middle of a small church with a sign on it and a bright sourceless light above it.

According to the stories, that’s not what happened. (Speaking of stories, @jonbecker’s blog post is an excellent read.)

Time and data crashes in on each of us these days.

We too often struggle to sort through the signals and noise, at least I do, and so I understand the desire for something simple that tells me everything I need to know. But I never expect to find such a thing. In fact, my expectation is that if I want to know something and be able to act on it, I will have to do some work.

If I actually want to understand something, I know that I will likely have to work even harder.

So, this is pretty much the approach taken with research.schev.edu. You have to make an effort to know what you want and need, either before you get there or while on the site. Higher education is kind of a big business with a lot of complexity. This complexity derives not just from its size and variety, but also from its continual evolution. Some numbers, some measures are pretty simple – enrollment, and degrees conferred. Some of the buckets for these things may get a little complicated, but in our presentation of the data, actually in even our collection of the data, we have already simplified it through standardization.

Other measures, like graduation rates and measures of affordability, are more complex, if not to read, but to understand. The annual frequency of questions along the lines of “Don’t you have graduation rates for the four-year schools that are less than six years old?” has not noticeably reduced. As often as we explain the nature of a cohort measure, people still think we should have 2014 rate. Certainly, we could identify the reports based on the year the data are released, but some users will insist on being confused that the 2014 reports are about students that started at least six years prior, or three years for the two-year colleges. And in 2016 they would likely be confused again.

So we go for clarity and standards, even so, they are not such that they are instantly understood. Some things one just has to think about for a few moments. We also serve multiple constituencies with a varying levels of knowledge of higher ed and much different needs.

At the heart of it, this idea of a Holy Grail of measurement is the thinking behind the ratings system. Somehow one rating, or even a handful of different ratings, about an institution will tell one all they need to know. Or at least, all they need to know about an aspect of the institution related to the undergraduate experience. Except the educational aspect, because that is not measured consistently and reported systematically to USED.

PIRS though is only the natural evolution of the 2008 Higher Education Opportunity Act (HEOA). The reporting and disclosure requirements that came out of the HEOA are huge. In some ways they have transformed institutional websites, in others they have demonstrated institutional ability to bury information. Of course, who can blame institutions much for the latter when probably very few students are interested in some of the requirements?

Which makes me wonder what the next version of the HEA will bring. If Chad Aldeman’s post is any indicator, we could see a major shift away from current requirements. More likely, in my estimation, we will see an attempt towards the requiring the publication of the perfect number* or a half-dozen perfect numbers and their changes over time.

In any event, whatever happens with the next version of the HEA, PIRS, or any other effort at the federal or state level, I don’t expect the search for the Grail of Measures to end anytime soon.

Faded jaded fallen cowboy star
Pawn shops itching for your old guitar
Where you’ve gone, it ain’t nobody knows
The sequins have fallen from your clothes

Once you heard the Opry crowd applaud
Now you’re hanging out at 4th and Broad
On the rain wet sidewalk, remembering the time
When coffee with a friend was still a dime

Chorus:
Everything’s been sold American
The early times are finished and the want ads are all read
Everyone’s been sold American
Been dreaming dreams in a rollaway bed

Writing down your memoirs on some window in the frost
Roulette eyes reflecting another morning lost
Hauled in by the metro for killing time and pain
With a singing brakeman screaming through your veins

You told me you were born so much higher than life
I saw the faded pictures of your children and your wife
Now they’re fumbling through your wallet & they’re trying to find your name
It’s almost like they raised the price of fame

Kinky Friedman – Sold American Lyrics

*The perfect number is 17.

Daring to be stupid, but not too stupid

I leave too many browser tabs open on my phone. I’m also far too-focused on comments my father makes about my posts via email. Even at the age of 53, some things don’t change.

So anyhow,  I finished reading the article at InsideHigherEd about Carol Swain’s  comments about Islam, and as I flipped through browser tabs I saw this one explaining how we are all confident idiots. I’ve kept it open because I like it so much as an explanation for much of what I see and hear. Especially about politics. And religion. And education.

The article also reminds me to a bit more doubtful about the things I “know.”

I was also terribly amused by a Twitter exchange the other night. Actually by two or three different exchanges. I won’t name names, but there was an awful lot of confidence expressed about things where I certainly was not convinced that such confidence was deserved, there were  just too many shades of grey possible. It is often clear when believing has replaced knowing. But not always. And that is the scary thing to me, not knowing enough about someone or something to be able to discern belief from knowledge.

Yes, there have been many times in my life when I have had the arrogance of conviction in what I thought I knew. This alleged knowledge was stuff I could and would, ad nauseam, express without thought of nuance. As if I were ignorant the word. Looking back, it seems that there really were only a handful of times when I actually “knew” anything. In those cases that come to mind, they were about action, but while I knew what to do without question, I could not tell you why I knew what to do.

One of those is the story of becoming an art major. I am reminded of it because of today’s story in the Chronicle, Drawing a Path to College.

In August of 1985, I was five months out of the Army and returning to college. I was suffering though the ending of am unhappy marriage and the beginning of an unpleasant divorce. I wasn’t clear as to what I was returning to do, other than I was probably not heading back down the physics/math double-major rabbit hole, unless it was pre-engineering. On the first day of class in Art Composition to pick up a missing gen-ed requirement, when the professor passed around a sheet for the art majors to sign, something happened to me. I experienced a moment of clarity and commitment. I was an art major. Of course, I really didn’t know why I reached that decision, and I still don’t.

When I told my father that I had become an art major, the response was a bit less than supportive: “What? You’ve never shown any talent! What were you thinking?”

Sometimes intuition is better than thinking.

There have been other times when I had that same level of clarity in decisions. They seem to have gotten less frequent as the years have gone by. Today, that clarity is greatly desired. Or, in the place of clarity, the sure knowledge of the possible futures related to certain choices.

As my wife continues to recover from two surgeries to rebuild her foot and give her something of an arch, it has been become clear that the predicted knee replacements will not wait long. The inactivity and lack of normal walking associated with 11 weeks in a non-weight-bearing cast (for the second time since the first surgery failed) combined with her connective tissue disorder, has caused too much deterioration. Two knee replacements are ahead, followed by two more quite significant foot surgeries. There is also an abdominal surgery in the very near future. So, the question is, “What to do about our house?”

A two-story house is not ideal for someone with serious mobility issues. Most houses are not particularly well-designed for accessibility. We have spent the last months sleeping downstairs in what used to be my office and much of the time since surgery in May she has navigated life with a rolling knee walker. That is, until the cartilage in her knees gave out and we had to resort to a wheelchair until she was in a walking cast and could begin to use a regular walker. This was actually a terrible struggle, for her physically as well as technically. Neither a walker or a wheelchair will fit through a 24″ bathroom door. So I added grab bars allowing her to support herself on those and the vanity while she balanced and shifted around on here one good foot, but bad knee (actually “worse” knee).

Looking forward to the next two or three years I wonder where money and effort are best spent. It seems easiest to think about moving to a single-story house, but unless it is already fully accessible, it is simply more of the same. Lots of modifications to make. (And no, I am not ready to consider moving into a senior community where the houses are most likely fully accessible.) Adding on a new first-floor master suite seems doable, but very expensive. Likewise, converting the garage is doable, but expensive, and may hurt resale. Finally, I could keep making changes to our house to that make it more accessible (although it would never be truly fully accessible without some very major changes apart from additions).

In the end, I believe the net costs and return on investment of each choice is not so different, even with the work already done, to make the decision easy.  So I am left wondering what the right decision is. If I knew the future, it would no doubt be easier. It would also be easier if the housing market was in better shape locally, if the houses in my neighborhood would move off the market more quickly than they do.

Also, it’s not the money. It’s my wife’s comfort and ability to be at home.

With the aging of the Boomers, and I guess I am one, barely, there are a lot of products available for “aging in place” that help solve the accessibility issues. I keep sorting through those to study the options and to build a plan. I also run across references to “universal design” that I now wish were much more universal in their application and use. As I have said before, I have learned a lot about what accessibility really means  over the last eight months. So, it has been tough deciding what can be done, what should be done.

I keep waiting for that moment of clarity. The most recent time I recall it happening was when I was about to leave my neurosurgeon’s office at the end of our first meeting.

“Thank you for your time, doctor. I’m not sure, but I think I am looking forward to this.”

“Mr. Massa, I’m looking forward to this, as quite frankly, cases like yours bring out the best in me.”

A bit of honest arrogance. That was something I understood. The clarity that had been building by him saying many of the same things that specialist in Los Angeles had said had now clicked solidly into place. The surgery and my recovery, justified everything.

So, I am doing my due diligence to find clarity and not be too stupid. (I have learned a lot from stupid decisions though, I just prefer not to make them a habit.)

And the man on the radio won’t leave me alone
He wants to take my money for something that I’ve never been shown
And I saw my devil, and I saw my deep blue see
And I thought about a calico bonnet from Cheyenne to Tennessee

The news I could bring I met up with the king
On his head an amphetamine crown
He talked about unbuckling that old bible belt
And lighted out for some desert town
Out with the truckers and the kickers and the cowboy angels
And a good saloon in every single town

And I remember something you once told me
And I’ll be damned if it did not come true
Twenty thousand roads I went down, down, down
And they all lead me straight back home to you
Twenty thousand roads I went down, down, down
And they all lead me straight back home to you

Gram Parsons – Return Of The Grievous Angel 

One weird trick for understanding the free community college proposal

Wait.

Yes, Just wait. Sara Goldrick-Rab and others have made the same point on Twitter and elsewhere to those wanting details. Details would be nice, but at this point, but I think they would be meaningless. First, Congress will do what Congress will do, whether it makes sense or not. Along the way a lot of lobbyists and special interests will provide help and guidance and so what passes Congress in a year or 20 may have little semblance to what is proposed now.

More importantly, the states will also be involved in deciding what they may be able to accept as a new federal role in state higher education.

I think the first step is perhaps just getting enough people to agree that “two years of universal postsecondary education” is  desirable goal, perhaps even a citizen right. “Free community college” makes a nice talking point to have that discussion, but it does turn some folks off.

I’m enjoying the discussion, but my natural cynicism tends to dominate as I consider that the proposal is really about “free community college tuition and fees” which really only gets us part of the way to what is needed to support students enrolling full-time. I also appreciate those that have written about over-reliance on part-time faculty in community colleges. We need to address that situation.

Of course, another approach might be to simply a propose a model yourself. One does not have to respond the to details of a model if they are unavailable. How about just suggesting how you would do it?

My First Response to Free Community College

I want to believe, I surely do, but I just have yet to find a free lunch. From what I have pieced together today, it seems that the President’s proposal is more of a trick to drive more control to Washington. Free community college, from the student’s perspective is a good thing, but it is still only a fraction of the cost of attendance. That should be our target.

I have little else to say on this that isn’t said better by Brando.

On the day I left home to make my way in the world, my daddy took me to one side.

“Son,” my daddy says to me,

“I am sorry I am not able to bankroll you to a large start, but not having the necessary lettuce to get you rolling, instead, I’m going to stake you to some very valuable advice.”

“One of these days, a guy is going to show you a brand-new deck of cards on which the seal is not yet broken.”

“Then this guy is going to offer to bet you that he can make the jack of spades jump out of this brand-new deck of cards and squirt cider in your ear.”

“But, son, you do not accept this bet because, as sure as you stand there, you’re going to wind up with an ear full of cider.”

Nathan: A guy without a doll… If a guy does not have a doll, who would holler on him?

Sky:  A doll is a necessity.  I am not putting the knock on dolls.  But they are something to have only when they come in handy, like cough drops. And the proof that I am right is that dolls are available as far as the eye can see.

Nathan: Not dolls like Adelaide.

Sky:  Nathan, nothing personal and no offence, but, weight for age, all dolls are the same.

Nathan:  All dolls are the same, huh?

Sky:  As far as the eye can see.

Nathan: It seems to me the one place a doll would come in handy would be in Havana.

Nathan:  So how come you ain’t got one? How come you are going alone, without a doll?

Sky:  A matter of choice. I choose to travel alone, but if I wish to take a doll, the supply is more than Woolworths has got beads.

Nathan:  Not high-class dolls.

Sky:   There’s only one class: interchangeable. A doll is a doll. All dolls, any doll. You name her.

Nathan: Any doll? Will you bet on that? Will you bet a thousand bucks that if I name a doll, you can take the same doll to Havana with you tomorrow?

Sky:  You’ve got yourself a bet.

Nathan: I name her.

Sky:  Her?

Nathan:  Sergeant Sarah Brown.

Sky:  Daddy! I got cider in my ear.

Because I have, or will haven, hitchhiked the length and breadth of the galaxy, I always have my towel handy, and will glad to help you dry your ear.

More Ratings Nonsense

Yes, I am thinking too much about PIRS. Its not really my fault, other people start it in other places.

Really though, the proposal is unnecessary. We already have an implicit ratings system that has been in place for years. It is quite simple:

A. Institution participates in Title IV.

B. Institution is on accreditation warning/probation/other status less than fully accredited and thus At-risk of Losing Title IV participation.

C. Institution no longer eligible to participate in Title IV.

D. Institution has never participated in Title IV.

Clean. Simple. And already exists. Now all we need to do is tie a badge to it for institutions to use on their websites.

The only thing missing, apart from marketing,is  some kind of objective criteria to allow USED to sort institutions into the categories themselves. Quite frankly, they could have done that themselves, quietly, without all the fanfare. And angst.

If we really need a rating that is better than A above, then we can have an “Unconditional participant in Title IV” for those institutions who are in the first three years following reaffirmation of accreditation.

I’m still not clear why we need more than this from the feds. This essay about the upcoming changes to the Carnegie Classification System points to how something as innocuous as the original categories became a de facto ranking. I suspect anyone that has worked at an R2 can testify to the discussions to attempt to become an R1. Over time, the classifications have become more complex. I have little doubt that would happen to PIRS and in a dozen years or so we would wind up with something that is hideously complex.

By the way, read this. Apparently the whole ratings/rankings dichotomy is not universal.

Where are the Dancing Horses?

Jimmy Brown, made of stone
Charlie clown, no way home
Bring on the dancing horses
Headless and all alone
Shiver and say the words
Of every lie you’ve heard

First I’m gonna make it
Then I’m gonna break it
Till it falls apart
Hating all the faking
And shaking while I’m breaking
Your brittle heart

 Echo & The Bunnymen – Bring On The Dancing Horses

With the close of 2014 and the conventional change of the calendar to 2015, people are partying, reflecting on 2014, or making predictions for 2015.  I’m not very good about such short-term predictions, so I will leave those to others. I’m not partying because of my role as a caregiver and an ongoing lack of sleep. It’s also not my style. I’ve already reflected on 2014 through stating 27 of my 95 grievances (don’t worry, I will keep the other 68 to myself). So instead, I will engage in a few guesses.

First, I think the first draft of PIRS is going to shake things up when it hits the street. I’m confident it will get released, if only in a fit of anger to say, “See, we told you we could do this!” However, the graduation rate metrics that will be derived from the National Student Loan Data System (which was designed for purposes specifically NOT like this) will cause a great gnashing of teeth and rethinking of what folks really mean when they say they want something better than IPEDS. My hunch is that they will not like these metrics much and institutional research offices across the country will spend August trying to duplicate the metrics and create new ones that presidents will claim to be “better.”

They will need only to look at SCHEVResearch to see examples of what is possible.

I think PIRS will also send a very strong message: “If you don’t like these metrics, give us better data.”

Conquistador your stallion stands
in need of company
and like some angel’s haloed brow
you reek of purity
I see your armour-plated breast
has long since lost its sheen
and in your death mask face
there are no signs which can be seen

And though I hoped for something to find
I could see no maze to unwind

Procol Harum – Conquistador

SACS or another of the regional accreditors is going to do something that seems to be of unheard of: they will take action on an institution based on academic issues instead of merely fiscal issues. At least, that will appear to be the case for a few days. And it may even be a public institution. Too many lawmakers in Virginia have asked about the role of SACS in ensuring academic quality and been unimpressed and unsatisfied with the response.

 

Well you thought the leaden winter would bring you down forever
But you rode upon a steamer to the violence of the sun

And the colors of the sea blind your eyes with trembling mermaids
And you touch the distant beaches with tales of brave Ulysses
How his naked ears were tortured by the sirens sweetly singing
Sparkling waves are calling you to touch her white laced lips

Cream – Tales Of Brave Ulysses

2015 will not be the third consecutive year in which a private, nonprofit college closes. I think. There are several on my watch list though that I consider to be at-risk (Undergraduate only, fewer than 2000 students, first-year retention rate less than 60%). If I am wrong, and one does close, then I think we can formally declare that “a trend.” For the record, it was Virginia Intermont College that closed in 2014, and Saint Paul’s College that closed in 2013.

And throughout the year, we will see a lot of dancing ponies and dogs in tutus (disguised as technological solutions) as this will help draw attention away from the real issues.

Came the last night of sadness
And it was clear she couldn’t go on
Then the door was open and the wind appeared
The candles blew and then disappeared
The curtains flew and then he appeared
(Saying, “Don’t be afraid”)

Come on baby
(And she had no fear)
And she ran to him
(Then they started to fly)
They looked backward and said goodbye
(She had become like they are)
She had taken his hand
(She had become like they are)

Come on baby
(Don’t fear the reaper)

Blue Oyster Cult – Don’t Fear The Reaper

A Festivus miracle, and associated grievances to be aired

Okay, there really wasn’t one. The closest thing to a miracle was that my wife was able to walk around with cane both Christmas Eve and Christmas Day, after having spent the day before in a wheelchair. We got through the Airing of the Grievances. It simply could not all be done on the 23rd. The lists were long, and not without argument.

Somehow, we never got to mine. So, thus this post. I have a lot of grievances with you people!

1) Every time policy-wonks and do-gooders talk about reforming college costs, they look at me blankly when I suggest the first step is to take parental resources out of the equation. It’s too much like talking to an addict that can’t imagine giving up the clean, blue rush of a heroin (so I’ve read it described).

2) You still haven’t agreed who is responsible for paying for what and how much. Everything else you are talking about is just useless noise.

3)

You were not quite half so proud when I found you broken on the beach
Remember how I poured salt on your tongue and hung just out of reach
And the band, they played the homecoming theme as I caressed your cheek
That ragged, jagged melody, she still clings to me like a leech
But that medal you wore on your chest always got in the way
Like a little girl with a trophy so soft to buy her way
We were both hitchhikers but you had your ear tuned to the roar
Of some metal-tempered engine on an alien, distant shore

4. You still keep trying to sell the Common Core without honesty or integrity.

5. You keep telling USED to publish better data and information, but you fail to recognize (or accept) that it doesn’t have anything else useful about postsecondary education – and you prevent the Department from collecting what could be much better and more useful.

6. You continued to ignore your conflicts, or outright lie about them, while destroying the history of your greatness. All in the name of pushing your for-profit school over your newspaper.

7. Too many of you still do not understand student debt and the nature of the alleged or pending crisis, using big numbers without understanding.

8. You promised us a Ratings System in the fall, but the best you could do is give us a draft plan on the last business day of fall. When you asked for advice, we told you this was hard. But did you listen?

9. You continued to gripe and groan and whine about the IPEDS Graduation Rate and its limitation on first-time, full-time undergrad students but you never did anything more until APLU and others put together the Student Achievement Metric project. You also forget that you blocked more meaningful rates for two decades, and the current measure represents the collective obstruction of presidential associations and other special interests.

10. You supported the ratings idea as an expression of your anger with higher ed hoping they would do more good than harm while you also bemoaned the likely cost of the ratings on campus. In the end, you were right, and wrong.

11. You paid lip-service to all special snowflakes, but you never noticed the rainbows, nor could you describe them.

12. You STILL don’t really understand the cost of student debt, nor the cost of forgiveness and pay-as-you-earn. It’s like the law of conservation mass-energy: the total mass-energy of a system is constant. Only the phases change. Likewise with paying for college, the spend is still the same for a year, we just keep shifting around who pays…except some shifts cause real costs to grow over time in terms of opportunity costs elsewhere.

13. I am afraid you still don’t understand that there ain’t no such thing as a free lunch.

14. You still haven’t responded to the fact that I have told you how to rate colleges – for Title IV eligibility only – and made it as simple as possible. Especially since the theater of college presidents and association lobbyists appearing before Congress to argue that a 20% graduation rate is too high of a standard to obtain is just too delightful to miss.

15. You take delight in the negative. My most read posts are about a worst college and student debt.

16. You are STILL whining about the students you enrolled.

17. Will you accreditors ever take action against an institution for poor learning outcomes, or will it remain for fiscal reasons only?

18. You embarrass us all when a college of one dean and a dozen faculty can’t get in a room and talk things out. I’m not sure if this is a statement of Christianity’s inability to affect education, or education’s ability to affect Christianity. I am sure the devil is in the details somewhere.

19. You pissed me off and made me write defenses of liberal arts and liberal education. Those things should not be left to me.

20. You’ve made me negotiate narrow hallways, inappropriately small examining rooms and waiting, poorly constructed ramps, unmaintained sidewalks, and hard to open doors while pushing a wheelchair. You fail to understand that the principles of the Americans with Disabilities Act are MINIMUM standards and we should be thinking about the differently-abled.

21. You have been so focused on your area of specialization, you have far too often forgotten the patient.

22. You have done so many dumb things, that I could compare you to incompetent, wannabe mercenaries. And I didn’t feel bad about doing so.

23. Despite your lofty goals and ideas, you still see education as the filling of buckets.

24. You drank the Kool-Aid, came to the meetings, and still you don’t know you are a cultist. An elitist sure, though you deny it publicly, but a cultist nonetheless.

25. The new phonebooks were delivered and you found your name, or at least your fingerprints, and still you want to believe in the Holy Grail.

26. Despite all the criticisms of PIRS, like the Black Knight, with blood spurting from the stumps of both arms and both legs, you insist, “It’s just a flesh wound.”

27. You didn’t click on each link above and drive my page views higher.

Okay, those are my grievances against you, at least those I am willing to air publicly.

Let’s see what you make me say in 2015.

PIRS and the Quest for the Holy Grail

The ratings (framework) are out (more promises actually)! I wrote my semi-formal response over at my work blog. In that post I reference Stephen Porter’s post on why a single institutional performance metric is exactly like the Holy Grail. I’m kind of stuck on this comparison, and not because it arose as a response to Bob Morse of US News & World Report. Really, I am just a big fan of the Arthurian legend.

If one accounts for the general imperfection of law-making, it is not too difficult to believe that Richmond, VA is the real Camelot:

A law was made a distant moon ago here:
July and August cannot be too hot.
And there’s a legal limit to the snow here
In Camelot.
The winter is forbidden till December
And exits March the second on the dot.
By order, summer lingers through September
In Camelot.
Camelot! Camelot!
I know it sounds a bit bizarre,
But in Camelot, Camelot
That’s how conditions are.
The rain may never fall till after sundown.
By eight, the morning fog must disappear.
In short, there’s simply not
A more congenial spot
For happily-ever-aftering than here
In Camelot.

Law-making is imperfect. Often what the General Assembly decrees is not quite what happens, so really, it is just not much of a stretch to imagine the Quest for the Holy Grail occurring in the green hills of Virginia. I’ve walked much of the Appalachian Trail in Virginia, and at night, in the mist, on the trail or on the Blue Ridge Parkway, I have had little difficulty hearing the distant hoofbeats of a quest.

This is perhaps all the more true as I consider the Commonwealth’s endeavors over the last decades in developing and packaging performance indicators. While, I have played a role in those efforts the last 14 years, I have always tried for a package of measures, generally more than fewer. Institutions are simply too complex to be represented by a single aspect, let alone a single measure.  In fact, discussion such measures quickly become a rather intense and political discussion.

But now we have the a framework for the Postsecondary Institution Ratings System and the excitement was just like I suggested a couple weeks ago in tying PIRS to the arrival of the new phone books. We also have some new goal statements. For example, in a blog post, Jamienne Studley (of the It’s Just Like Rating a Blender comment) says:

The development of a college ratings system is an important part of the President’s plan to expand college opportunity by recognizing institutions that excel at enrolling students from all backgrounds; focus on maintaining affordability; and succeed at helping all students graduate with a degree or certificate of value. Our aim is to better understand the extent to which colleges and universities are meeting these goals. As part of this process, we hope to use federal administrative data to develop higher quality and nationally comparable measures of graduation rates and employment outcomes that improve on what is currently available.

So, we have language of equity,  affordability, combined with the new phrase of the realm the last year “certificate of value,” to describe the new goals being assigned to institutions. Some may/will argue this point, but the reality is that not all institutions were founded to be affordable, let alone open to all, or even “helping” students graduate. Some institutions, particularly one small college in the PNW, have been (please note the use of the past tense) famously proud of their low graduation rates. Completion was seen as a mark of distinction among super-smart and well-qualified students. But, these are all worthy goals and those footing the bill (or a large chunk of it through gifts and financing) get to make the rules. That is the Golden Rule: He who has the gold makes the rules. Also, sticking to our Arthurian theme, Might Makes Right.

“we hope to use federal administrative data to develop higher quality and nationally comparable measures of graduation rates and employment outcomes that improve on what is currently available.”

So, they are going to use the National Student Loan Data System (NSLDS) to create measures of graduation rates for Title IV students. This means they will build estimates that assume first appearance as Title IV recipients will be first enrollment in college. For many students this will work, but not all. To incorporate transfers into the mix will be a much greater challenge, particularly those from California community colleges where so very few students use Title IV to attend. There will be some estimation possible using annual loan amounts since maximum subsidized Stafford loans are different for third and fourth year students. However, the great many students transferring in fewer than two years from a community college will be damned hard to identify.

Of course, all this can be fixed going forward by making changes to the NSLDS collection.

Using NSLDS data to match to Social Security earnings is already tested at the program level for Gainful Employment. It should not be a stretch to do that at the institution level. The interesting thing will be to see how this figures compare to what states like Virginia, Texas, and others are reporting using UI Wage data. And Payscale data. I don’t know about my colleagues in the other states, but I am ready to assist.

To do this well though, they are really going to have to do more than ask for comments. They need to bring people together. (About 2 minutes in on the next clip.)

I appreciate what the president is trying to do. I just don’t think ratings are the way to go for a government. Save with this caveat: as long as the ratings are billed and described solely as Title 4 Performance Ratings and not Institutional Ratings, then I am happy and fully supportive. I have said all along it is completely appropriate for the Department to evaluate institutions based on their performance under Title IV. Program evaluation is part and parcel to government programs. Or should be. Let’s just keep the focus where it belongs and not try to be all things to all people, especially when neither the data nor the legitimate bounds of authority warrant more than that.

In any event, the Student Right-to-Know Before You Go Act is a better solution to the goals Studley’s post articulate and the goals presented within the draft framework. Better data,  better information, within an appropriate scope.

We can achieve a version of Camelot in the cult-word of higher ed data.

Just choose wisely.