Curiosity Self-Assessment – scoring

close up of the Mars Curiosity rover

@MarsCuriosity (twitter)


So I have been told that some people have already taken the Curiosity Self Assessment linked in the last post, and I thought I should probably post an explanation of the scoring – since it’s not really very transparent.

As I said in that post, this assessment is drawn from a set of longer instruments developed and tested by Jordan Litman (and a  variety of colleagues) over the last decade or so.

There is more than one type of curiosity identified in the literature, and we decided to focus on 3 of those in this instrument:  epistemic, perceptual and interpersonal.

Epistemic curiosity is triggered by a drive to know about things — to know about concepts and ideas, and to understand how things work.  This is the type of curiosity that we think probably comes to mind first when people think of school-related work.  Some of the items on the self-assessment that point to this type of curiosity are:

    • When I see a riddle I am interested in trying to solve it.
    • I enjoy discussing abstract concepts

Perceptual curiosity is triggered by a drive to know how things feel, taste, smell, look, and sound.  Some of the items that point to this one are:

    • I enjoy trying different foods.
    • When I see new fabrics, I want to touch and feel it.

We (the general “we” here) don’t usually think about the types of questions that would include a touching or perceiving component when we think of class-related research.

Interpersonal curiosity is triggered  by a desire to know more about other people.  Some of the items connected to this type have a snooping or spying connotation to them, and others focus more on the type of curiosity that happens during direct interactions with others:

    • People open up to me about how they feel.
    • I enjoy going into other houses to see how people live.

So, what do you need to know about this self-assessment to understand your scores?

1. Well, first, it is a self-assessment.  This isn’t intended to tell you anything about other people’s curiosity – or about how your curiosity compares to other people’s.  It’s intended to get you thinking about curiosity in more complicated ways — to think about things that spark your curiosity that you might not normally think about in a classroom setting.

2. Secondly, the self-assessment is based on a four-item Likert scale — and it really, really, shouldn’t be used to compare people to each other:

4 item likert scale ranging from almost never to almost always

The scale itself is an ordinal scale, but not an interval scale.  Why should you care?  Well, think about the difference between almost never and sometimes — is it the same as the difference between sometimes and often?  Some people may answer yes to that, and some people may answer no.

To put it another way, if I answer Often to an item and you answer Almost Always that might mean that you do the thing a little more than me, that you do it a lot more than me or that we actually both do it twice a day but to me, twice a day is “often” and to you it’s “almost always.”

So – your scores can’t tell you anything about how you compare to others.  They can’t even be effectively used to identify a “type” for a class or cohort of people.

But they can tell you something about yourself.

3. Finally, when you get your scores, you are going to see them as a fraction of 40. It’s important that you don’t think about those percentages as grades.

Let’s take a hypothetical example — Nadia gets scores of 28/40 for epistemic, 30/40 for interpersonal and 21/40 for perceptual.  It’s pretty normal to look at that 30/40 and think that “that’s only 75% – I’m not very curious.”

But remember how those scales work.

likert

So Nadia scored 30/40, which means that she answered “often” to most of the items that suggest interpersonal curiosity.  Her “low” score was about perceptual curiosity, but even there her answers averaged around the “sometimes” mark. So from this, she can infer that she is fairly broadly curious, but that her curiosity is quite likely to be sparked about questions relating other people, and about how things work.  She might look for research ideas in fields that combine these interests, like psychology.

Something clever about pictures, thousands of words and 140 characters

So it is probably not shocking that sometimes I can’t express myself in one tweet.

(It is probably more shocking that I ever can)

I was talking about the ACRL-OR/WA Fall Conference, which was hosted this year by ACRL-OR at the Menucha Retreat in the Columbia Gorge, and about which I went on in this post.

(View from Menucha)

Jim Holmes from Reed College did an amazing job running technology at the conference – and captured all of the amazing women noted above while he was doing so.  The results are available now.  If you weren’t able to join us (or even if you were) –

Barbara Fister gave an inspiring and thoughtful opening keynote.  Ignore the fangirl  giving the introduction.

Rachel Bridgewater put together a two hour program called Fair Use as Advocacy Laboratory, integrating a remote talk from Brandon Butler at ARL (who was also fantastic)

And Char Booth wrapped up the conference with a closing keynote that built on and wrapped around the themes of the previous two programs.  It was like magic.

Thanks again to everyone who put so much work into this conference, which means every single member of the ACRL-OR Board.  Interested in being a part of the next one?  ACRL-OR elections will be happening in the next few months.  Watch the ACRL-OR blog for the announcement.

this is the science of information, yes?

Impact factor.  No, not that impact factor – impact factor for news.  What would that look like?  In particular, what would that look like beyond “was it seen?”

The New York Times is hosting a Knight-Mozilla fellow to tackle that question.  I read today on Twitter that that fellow is going to be Brian Abelson.

I took a look back at the job description to see what “impact factor” looks like in the mind of someone not immersed in academia, and found this language, which could apply just as well to research (or to teaching, really, but this is not a learning assessment post):

What we do not have are ways of measuring how a piece of journalism changes the way people think or act. We don’t have a metric for impact.

What’s interesting is the implication here that the obvious solution is the data, particularly the immense amount of it now available:

But the math changes in the digital environment. We are awash in metrics, and we have the ability to engage with readers at scale in ways that would have been impossible (or impossibly expensive) in an analog world.

The iConnected Parent, Chapter 3

One thing that I maybe haven’t made clear is that this book isn’t intended to be an exhaustive treatment of this, or any, phenomenon — it’s a parenting book, designed to give advice to parents with kids heading off to college.

Some of my wishes for what might show up in these pages, therefore, should be read as unreasonable.

So, on to Chapter 3. Can College Kids Grow Up on an Electronic Tether?

This is the chapter that should be getting into where we might see connections between this research and the big body of student development research that exists out there.  The authors point out at start that there has been very little research on this specific phenomenon, but there is certainly a lot that we “know” about how students have developed in the past – and I am sure that research informed the present study.

Research question: What happens to the independence of college students who are in constant contact with their parents?

Method: To get at this question, they designed the surveys to also capture information about:

  • students’ psychological development
  • parental involvement in students’ lives
  • relationships between students and parents

The chapter starts by making with the argument that traditionally, students have been able to control the level of contact with parents, and parents have expected that the amount of contact they have with their offspring will go down. That separation from parents is essential for students to develop a mature relationship with their parents — if they stay too connected, then the dynamics that existed in high school won’t get a chance to change.

Most of this initial part is an exhortation for parents to let their students make their own decisions and their own mistakes. This is important not only for the students – who need to develop their own skills and to solve their own problems — but also for the parents.  It is only when the student develops autonomy that they are capable of seeing their parents as people – with with lives that aren’t entirely defined by their children.

Nothing here is cited, but it seems to be heavily informed by Arthur Chickering’s seven vectors of college student development.  Chickering’s revised third vector is called Moving through Autonomy toward Interdependence, and deals with the same issues of connectedness – and how the relationship between student and parent can improve and mature better when there is some autonomy, or separation.

In fact, Chickering’s initial model focused a great deal more on autonomy as leading to independence – it was in a relatively recent revision that he refined this category to recognize the ways that the relationships that students bring with them to college continue — and the ways that these relationships change.  Hence, interdependence. 

(Which I’ve always liked – I like the idea that one of the things we do in college is become capable of bringing more to our relationships – that we can become a source of support to people who have always supported us.)

So – then we move into a summary of results.  And the one-line summary?

…students who have the most frequent contact with their parents are less autonomous than other students.

Evidence? Those students are less likely to hit their benchmarks, according to the standard psychological tests that were embedded in the surveys.

Subtopics examined include: decision making, relationships, self-regulation and parental regulation

Photograph looking up at a college building against a blue sky with the words college of Business on it

some rights reserved by ucentralarkansas (flickr)

Decision Making — The focus in this section is on majors.  Parents are pushing “practical” majors where they can see an immediate employment benefit. Students are asking about other majors, and hearing they should change. At Michigan, only 2 students reported parents steering them away from econ or business, as opposed to many stories where the reverse was true. Of course, all parents aren’t the same – some were described as “not heavy handed” with their advice, others felt they needed to offer perspectives and warnings, even as they encouraged their children to follow their interests.

Student/Parent Relationships – Relationships are generally strong, but the researchers did find that those students who get called the most are more likely to have relationships with their parents that are “fraught” & marked by conflict.  Students who control the contact — who make the calls – report more positive feelings about their parents.  There are also students who are controlling the contact, but who are maybe calling too much – which the researchers describe as “trading independence for closeness.”

Self-Regulation & Parental Regulation — Students with good self regulation (what we might call “time management” and “study skills” in other contexts) get better grades AND report positive feelings about relationships with parents.  Students who reported high levels of parental regulation (parents taking responsibility for the timeliness and/or quality of the students’ work), on the other hand, reported negative outcomes.  Not surprisingly, those who scored high on the “parental regulation” scale also reported high levels of contact with parents.  They also reported MORE trouble with school.  So parental regulation doesn’t just hurt relationships – but in terms of academic success, it doesn’t work.

Conclusions & Advice for Parents

Not surprisingly – the main conclusion of this chapter is that parents need to back off and let their kids grow up.  This will have positive impacts not only on the students’ academic skills and success in college, but also leads to better parent/student relationships.

My reactions

From the start of the chapter, there’s the suggestion that there are two types of students here — those who want more independence, but find that college doesn’t really change anything in terms of the reminders and suggestions and direction they get on a daily basis from parents

AND those who maintain those lines of contact themselves – who actively resist the separation that the research suggests is necessary.

Probably not surprisingly, because of the “this is a guide for parents” nature of the book, the advice is heavily directed towards the first situation.  Parents, after all, can best control their own behavior and it makes sense that the book would focus on those situations where the parents’ behaviors are more problematic.

I was curious what advice they would have for parents who aren’t initiating the contact, but who have kids who are, as they say, sacrificing independence and development for contact.  How can parents diagnose a situation where their student might be relying on them too much?  What are the warning signs that your student is too dependent upon you? And then what do you do about it?  I hope this is addressed more in later chapters.

And the other thing  I found most striking from this chapter was the discussion of majors.  That’s something that I think we need to worry about – exploration is an important part of college and intellectual exploration is one of the most important kinds of exploration students do.  If that’s getting short-circuited, it needs to be addressed.

Research Immersion?

From Lee Bassette in last Thursday’s Inside Higher Edabout the Digital Humanities Summer Institute

I am excited because I am surrounded by people who are interested in similar research and skills as I am. I can talk about my project with people who a) actually know what and who I am talking about and b) are as excited by it as I am. People are interested in me and know me as a researcher, respect me as a researcher. My professional identity at home is so wrapped up in being a teacher, it’s nice to have this important other part of me recognized and, dare I say it, validated. I have a real intellectual community, not just a theoretical one.

I have lots of professor friends on other campuses who talk about this kind of isolation, but not librarians. When we talk about the issues of solo librarianship, we’re usually talking about something else — not about being the only metadata person, or instruction librarian, or archivist in the place.

And as librarians, we have both a (sometimes potential) research self, and a (usually actual) practice self — I could easily imagine that there are some librarians who are alone in their research interest, even with plenty of professional peers. Who needs this kind of shared experience more than us — what would it look like? Research Immersion?

Tutorials redux: the journey from blog post to article

An article that I wrote with my colleague Hannah Gascho Rempel just appeared in the new Communications in Information Literacy. It outlines some of our ideas about tutorial creation.  For those who like continuity in academic writing, the pre-cursors to this article appeared in this space here and here.

And these ideas formed the backbone of this presentation (in our institutional repository).

Enjoy!

Share and Share Alike: Barriers and Solutions to Tutorial Creation and Management

While using my iPad for article-reading, a blog post about Storify appeared

It has been ages since I talked about a new tool/service like this but Shaun came home talking about Storify the other day and it sounded good so I got myself an invite.

Basically, it lets you pull content from the dynamic web, including all of the social social media suspects plus search results, into a timeline-like interface. You add text (or not) and you have a story.

Reading the “one year out” iPad posts that have been popping up, I have been thinking about how I use mine — especially how I use it differently than I expected.  One thing I didn’t expect was the extent to which I have used it to replace some of the paper in my life.  Not all of it, but some of it.   And one of the most interesting pieces of that story, to me, has been the extent to which some of the papers being replaced are the reams and reams of paper worth of article printouts I used to create.

Those printouts were totally outside my workflow in so many ways – but I had to be able to:

  • Take them places (even my laptop is so much less mobile than a folder of paper and a pen).
  • Read them (which I could technically do, but not really do on my phone).
  • Take notes on them (typing doesn’t count for me.  I wish it did.  But it doesn’t).

With the iPad, some of that started to change.  Here’s a story about how.

 

Screenshot of the top few lines of a story created using the Storify tool

 

There are definitely some glitches – the integration with Flickr wasn’t working at all for me, for example.  But it was quick and intuitive and I like the output a lot.  I have some more interesting ideas for using it than this one.

Yes, we did write that up

Finally!

Kate and I finally got an article related to our LOEX of the West presentation (from 2008!) finished and published.  This peer-reviewed article delay had nothing to do with publishing cycles and everything to do with writing process.  But it’s available (in pre-print) now, and I pretty much like it.

Beyond Peer-Reviewed Articles: Using Blogs to Enrich Students’ Understanding of Scholarly Work

Critical Literacy for Research – Sort of Peer-Reviewed Friday

Unexpectedly it’s Peer Reviewed Friday.  Well sort of.  Harvard Educational Review is a student-run journal, with an editorial board made up of graduate students deciding which articles get published.

I was teaching a class in our small classroom – where I never teach – so I went up early to make sure that I still knew how to work the tech.  It’s on the 5th floor, where the L’s are shelved, so I was flipping through the Fall 2009 issue while I waited for them to show up.  This article caught my eye — well worth reading, both for the content/ideas and because it is very enjoyably written.

Harouni, Houman (Fall 2009). High School Research and Critical Literacy: Social Studies with and Despite Wikipedia. Harvard Educational Review, 79:3. 473-493.

It’s a reflective, case-study type description of the author’s experiences reworking his research assignments in high school social studies classes. There’s a ton here to talk about – the specific exercises he developed and describes, the way the piece works as an example of critical reflective practice — but mainly I want to unpack this bit, which I think is the central theme of the work:

If students do not engage in the process of research inside the classroom, then it is natural for them to view the assignment in a results-oriented manner — the only manifestation of their work being their final paper and presentation.  It is not surprising then, that they are willing to quickly accept the most easily accessible and seemingly accurate information that satisfies the assignment and spares them the anxiety of questioning their data.  And when their final products did not meet my expectations, the students responded not by rethinking the research process itself but by simply attempting to adjust the product in light of what they perceived to be personal preferences. (476-77)

(emphasis mine)

Basically, the narrative he lays out says that his research projects had been unsuccessful for a while, but it wasn’t until he noticed his students’ heavy and consistent reliance on Wikipedia as a source that he started digging into why, what that meant, what he really wanted to teach, and what he really wanted students to learn.  And he changed stuff based on those reflections.

Harouni’s thinking about information literacy (which he calls “critical literacy for research”) was initially sparked by students who were not evaluating sources or showing any sign of curiosity as they researched, but it was further sparked when his first attempts at addressing student gaps didn’t work, sparked by students who were trying, and failing, to evaluate texts they weren’t yet ready to evaluate.

Along the way, he talks about the limitations of a checklist, or “algorithmic” approach to evaluation — limitation he discovered when he reflected on what his students actually did when he tried to use that approach in his classroom:

Two observations confirmed the shallowness of the learning experience created through the exercise: first, the students did not apply their learning unless I asked them to do so; second, they remained dependent on the list of rules and questions to guide their inquiry. (480)

In other words, they could do the thing he asked them to do (apply the checklist to information sources) but it didn’t affect their actual practice as researchers, nor did it change how they viewed the information they were getting from Wikipedia.

And also why it is important to help students understand the openness and dynamism of Wikipedia, but that that itself is not enough:  “knowledge of the uncertainties of a source does not automatically translate into an awareness of one’s relationship with the information (477).”

This piece is, I think, essential at getting at what I think is the real value of his insights and experience — many of our students want to find certainty in their research processes.  They want to know that a source is good or bad.  Wikipedia bans feed that.  Checklists feed that too, especially when they are not taught as an initial step in an evaluation process, but as the process itself.  What we really want students to be able to do when they research is to manage uncertainty — to say I know this is uncertain and I can figure out what it means for me as I try to answer my real, important, and complex question.

Harouni’s process his is an excellent reminder of how teachers want clarity too – and how they have to be willing to embrace uncertainty themselves if they are to guide students through a process of authentic inquiry:

In teaching critical literacy for research, I have had to separate research from its dry, academic context and consider it as an everyday practice of becoming informed about issues that have an impact on students’ lives.  I must value not answers but instead questions that represent the continued renewal of the search.  I must value uncertainty and admit complexity in the study of all things. (490)

In this, he knocks on the door of a question that I frequently have as an instruction librarian (one which I think many instruction librarians have — how much can I really accomplish as a teacher on my own).  If the classroom instructor – the person creates, assigns, explains, and evaluates the research assignment isn’t actively engaged with the students’ research process – are there limits to what I can do?  I do think there are.  I don’t think those limits means that I should do nothing, far from it – but I do think those limits affect what I think I should be trying to accomplish on my own and affect the other ways I should be thinking about furthering my goals for students, inquiry and learning.

At the end of the day, one of Harouni’s basic assumptions is that it is part of his job as a social studies teacher to foster inquiry and curiosity in his students, “[f]or two semesters, research projects remained a part of my curriculum — not because they were wonderful learning experiences, but because I could not justify, to myself, a social studies class that did not work to improve the way students navigated the ocean of available information (474-5).”  In other words, he believes that teaching information literacy is an essential part of what he does.   And that is key.  You can’t have that perspective and also value coverage – of content information – above all else.  It’s one or the other.  (is it?  Yeah, I think it is).

Every faculty member isn’t going to have that idea of what their job is.  And every librarian isn’t either – but I think maybe for instruction librarian it should be.  It is true that rules and clarity make coverage easier.  There was a question on ILI-L yesterday from someone (responding to an ongoing discussion about teaching web evaluation)  asking “how do you even have time to talk about web evaluation when you have to cover all this other stuff.”

Rules make it easier to “cover” web evaluation.  Faculty want us to “cover” lots of different tools.  WE want to “cover” lots of different tools.

(N.B. I am not suggesting that everyone who engaged in the “web evaluation” discussion just “covers” it and doesn’t teach it.  Nor am I suggesting that the people who worry about covering what the faculty want them to cover are only interested in coverage.  I do think though that the pressure to “cover” is as true for us as it is for people in the disciplines and these discussions spark reminders of that)

But if we want students to think about research as a process, if we want research to BE a learning process, then we have to engage in teaching the process.  And that’s extra hard for us – we can’t do that in the one-shot by ourselves.  And we can’t do it if we’re worried about coverage — about covering everything the library has to offer.  And I’m not just saying that about “we can’t teach everything about the library in a one-shot” — I think we all know that.  I think I am saying that it can’t be about that at all – that the point has to be about the process, about authenticity, about this -

I now understand that whatever research strategies students use in their day-to-day lives, which no doubt will vary depending on who the learners are, must be investigated and taken into account by their teacher.  Neither this goal nor the goal of improving these strategies can be attained unless students have time to engage in research while they are in the classroom.  And inviting students to the computer lab and remaining attentive to their interaction with online sources is as important as accompanying students to the library. (490)

And maybe this means not worrying about teaching research as a recursive learning process in the one-shot.  Maybe this means rethinking what and where we teach and maybe it’s work with faculty that gets at that overarching goal.  I don’t know.  I do know, though, that I have some great ideas for rethinking my credit class next term.

Classroom activities to promote critical literacy for research:

1. A (relatively innocuous) vandalism example demonstrated in class.  He didn’t change the content of pages, just the accompanying photo to illustrate the process of editing.

2. Students work in pairs to evaluate a Wikipedia article on a topic they know a lot about (for example, one student used the article about her former high school). Through this exercise he was able to teach about:  skepticism & its place in the research process, identifying controversial claims in a text, citations and footnotes, and verifying claims by checking outside sources.

3. Judging a book by its first sentence. He brought in 5 history textbooks, showed the covers and provided the first sentence.  Then he asked students to describe what they could figure out about the book from that first sentence.  With this exercise he was able to teach: authorial bias or point of view; finding the author’s voice.

4. Research beyond the first sentence.  When they tried to apply these critical skills to the texts they found in their research projects, though, they still had trouble because they didn’t know enough about the stuff they were researching.  So he looked for a way through this problem. Enter Wikipedia.  He provided a list of pages identified by Wikipedia editors as biased or lacking a neutral point of view, and asked the students to choose an article on a somewhat familiar topic and write a brief essay, with specific references to the text, with suggestions for improving the piece to meet the Wikipedia’s neutrality standard.

5. Contributing as an author.  Similar to other projects like this, it was one option for his students as a final project.  Interesting in that he collaboratively developed the assignment and rubric with interested students.