WELKOM Research is any scholarly inquiry that is systematic, - - PDF document

welkom
SMART_READER_LITE
LIVE PREVIEW

WELKOM Research is any scholarly inquiry that is systematic, - - PDF document

5/20/2014 WELKOM Research is any scholarly inquiry that is systematic, intentional, and collaborative (integrative). Consuming and producing research is the collective responsibility of all members of the higher education advising


slide-1
SLIDE 1

5/20/2014 1

WELKOM

 Research is any scholarly inquiry that is

systematic, intentional, and collaborative (integrative).

 Consuming and producing research is

the collective responsibility of all members of the higher education advising community, including advisors, faculty, administrators and students.

slide-2
SLIDE 2

5/20/2014 2

 What do you want to know more about??  What are your “wonderings” . . . ??

  • Talk to your neighbor: “I wonder why . . . “
slide-3
SLIDE 3

5/20/2014 3

I. I. Arti Articulate an an in inqu quiry qu ques estion II. Establish theoretical framework and conduct literature review III. Identify appropriate design and methodology IV. Collect and interpret data V. Dissemination

 What are they?  Why are they used?  How are they useful?

 Revise at least one of your “wonderings” to

become research questions (pages 3-4)

 Share it with the rest of us!

slide-4
SLIDE 4

5/20/2014 4

People = words Data = numbers

 How do _________ describe _______________?  What are the perceptions of ________ about

__________?

slide-5
SLIDE 5

5/20/2014 5

 How do __________ describe _______________?

  • How do third year bachelor students describe the

importance of advising sessions on their academic success?

 What are the perceptions of ________ about

__________?

  • What are the perceptions of advisors about the use
  • f research in their day-to-day work?

 How frequently do _______ do this: ________?  How frequently do _______ do this: ________?

  • How frequently/how often do first year students . . .

seek assistance from study advisors on their own initiative?

slide-6
SLIDE 6

5/20/2014 6

 What is the relationship between ________ and

_______ on ______?

 Does _______ & _______ predict ___________?  Is there a relationship between _________ and

_______ on/in ______?

  • Is there a relationship between self-regulated

learning-strategy levels and self-efficacy in academic planning?

Erlich & Russ-Eft (2013)

 Do _______ & _______ predict ___________?

  • Do secondary education grades & choice of subject

cluster predict academic success in the first year?

 What is the difference between _________ and

_______ with regard to ____________?

slide-7
SLIDE 7

5/20/2014 7

 What is the difference between _________ and

_______ with regard to ____________?

  • What is the difference between first-generation

students and traditional (continuing-generation) college students with regard to their understanding

  • f faculty expectations? (Collier & Morgan, 2004)

 A research question is a clear,

clear, focuse focused, conci concise, comp complex x and and ar arguable le question around which you center your research.

 You should ask a question [or questions]

about an issue that you are genuinely curious about.

Source: http://writingcenter.gmu.edu/how-to-write-a-research-question/

slide-8
SLIDE 8

5/20/2014 8

 What is the educational issue you’d like to

explore in a research project? What’s the difference?

slide-9
SLIDE 9

5/20/2014 9

Statement of the Problem Purpose of the Study Research Questions/Hypotheses Theoretical Framework Literature Review Method Results Discussion and Implications  A problem statement defines the

research problem and identifies potential causes or solutions. It also introduces the importance of the problem and the population that is affected.

 Reflect and write – (pg. 6)  The purpose statement defines

the parameters of a study. Researchers use this statement to frame their research questions which will be answered through evidence (data).

 Reflect and write under statement

  • f the problem…
slide-10
SLIDE 10

5/20/2014 10

 The theoretical framework defines

the parameters of a study. Researchers use this framework to ground their questions and build

  • n existing knowledge.

 Reflect and write . . .  A process and synthesis of

current relevant research literature regarding a particular topic or subject of interest.

 The researcher reads, evaluates,

compares, draws conclusions, identifies limitations and gaps.

  • Previous research on this or related

topics

  • Trends motivating interest in the topic
  • Theoretical frameworks
  • Affected populations
  • Methods and techniques
  • Research materials

Reflect and write . . .

slide-11
SLIDE 11

5/20/2014 11

 States the topic as a question which the

researcher sets out to answer

 Important elements:

  • Can I answer this question with data I am

collecting/analyzing?

  • Is the question too broad, too narrow?
  • Question or hypothesis statement?

 The whom or what you will

study in order to collect your data-define target population.

 Identify who is available and

how you will study them.

 Determine how you will select a

sample and successfully recruit participants.

 What data are already available?  Data collection tools used in the

study.

 Describe the measure (what is

it) and give examples of items

  • r questions.

 Provide psychometric

properties.

slide-12
SLIDE 12

5/20/2014 12

 Description of how data are to

be collected using the measures you just described.

 How, when and where will data

be collected?

 Employ techniques involving

statistical programs or qualitative analyses

 Provide confidence to the reader

that you know what you are doing.

 Equations or description of

process of theme generation

 Presentation of the data

  • Statistics and tables for

quantitative data

  • Description of major themes

and supporting evidence; usually quotes or synthesis of field notes

slide-13
SLIDE 13

5/20/2014 13

 Brief summary of findings in light

  • f literature review

 Implicat

ications ions for a advisi sing p ng practi tice ce (the biggie!) (the biggie!)

 Discuss Limitations  Present ideas for future research

 Remember that anytime you’re conducting

research on HUMANS you need approval from the Ethic Ethics Commi Committee on your campus

 It is about protecting participants from harm

and minimizing risk:

  • Physical (injury, illness, or death)
  • Psychological (emotional distress or anxiety)
  • Social (financial standing, employability, reputation,

criminal or civil liability)

slide-14
SLIDE 14

5/20/2014 14

 Knowledge claims to enhance practice  Demonstration of impact on students and

institutions

 Advising is field with an important vantage

point to examine higher education

 Illuminate educational complexities that

  • thers care about, too

Erlich & Russ-Eft (2013) Pizzalato (2006)

 Some tips:

1) Decide on initial search terms 2) Choose a database to get started 3) Enter your first search term 4) Look at keywords and suggested terms (add to your list if needed) 5) Stick to “peer-reviewed” articles in scholarly journals 6) Examine titles and abstracts for relevance 7) Scan relevant articles 8) Keep track of your search strategies and articles

slide-15
SLIDE 15

5/20/2014 15

WELCOME BACK!

Share refined research

questions

Developing your research plan Writing time

slide-16
SLIDE 16

5/20/2014 16

slide-17
SLIDE 17

5/20/2014 17

 Designed to describe and measure the

behavior of participants as it occurs in everyday life.

  • We can look at these behaviors and turn them into

measured variables OR documentable trends .

 Advantage: The observer can see firsthand

the interaction between advisee and themselves.

 When conducting observations of

advising interactions, the advisor must decide whether or not to let the advisee know that s/he is being

  • bserved beyond the natural advising

meeting.

  • Acknowle

ledged dged P Partic icipa ipant: Advisee knows s/he is being observed.

 The largest problem is rea reacti tivity, which occurs when the advisee changes the way s/he would normally behave.

 Systematic observation involves specifying

ahead of time exactly which components of the advising meeting are being

  • bserved/recorded.
  • Decide what events are of interest in order to

choose what to observe.

  • Stay focused on specific behaviors while filtering
  • ut unimportant data (outside your research

questions).

  • But be willing to “see” what you never expected to

see.

slide-18
SLIDE 18

5/20/2014 18

 Even

Event Samp Sampli ling: focusing in on specific behaviors for all advisees over a given period of time

 Individual S

vidual Sampling ling: randomly select one

  • r more advisee for a particular reason

and focus for the observational time period

 Anec

Anecdotal Obse Observ rvation: The advisor freely writes what he or she recalls during the advising meeting.

  • Advantages and disadvantages?

 Semi-st

  • structur

uctured O d Observ rvation ation: Focus on particular components of the advising meeting (opening, middle,

  • r end).
  • Advantages and disadvantages?

 Ti

Time-T me-Topic

  • pic S

Sampling mpling: Recall a specific point in advising meeting (only the introduction; only the closing; only discussions of changing major)

  • Advantages and disadvantages?

 Behavior Ca

havior Categories tegories: Describe what behaviors

  • ccurred and when they occurred

 Event

nt Fre Frequen uencies ies: The number of times a particular event takes place

 Eve

Event Du Durati tion: The amount of time an event takes place

slide-19
SLIDE 19

5/20/2014 19

 Advisors are invested in their observations.

  • People pay more attention to dramatic events and

less attention to “everyday events.”

  • The information that people attend to is strongly

influenced by their past experiences.

  • The act of observing influences/changes the

situation (a.k.a. Reactivity).

Now, given YOUR research topic, what could you OBSERVE?

slide-20
SLIDE 20

5/20/2014 20

 A sheet to assist before the interview,

during the interview, and after the interview

 Use for note taking and organization  Useful when sharing information with

  • thers on a team

 Befo

Before re inter interview: Used to create questions

 Duri

During inte interview: Used to take notes, obtain consent, get important information

 Aft

After i r interview rview (field not ield notes) s): Contains important notes and information about interview

 He

Header ader

  • Date, time, location of interview
  • Notes about participant

 De

Description ription

  • Describes project and instructions for consent
  • Usually read aloud

 Openin

ing Q g Question tion

  • Introduces topic, gets participant talking

 Co

Core re Q Question tions

  • Address major research questions or major areas of

information you want to obtain

  • Not an exhaustive list of questions, just important ones
  • Space for notes

 Fi

Fina nal Cl l Closin ing g Co Commen ents ts

  • Thank participant, explain how to access results
  • May also include a question asking the participant if there

are other people who would be good to contact/interview

 Determine the type of interview (focus group,

  • ne-on-one, telephone, etc.)

 Audiotape interview (raises “risk”)

  • Test recording device before starting interview,

preferably in the interview setting with the advisees!

 Take brief notes; enough to follow advisees

main points but still pay attention

slide-21
SLIDE 21

5/20/2014 21

 Make questions clear, not vague  Avoid bias in your questions (i.e. presenting

an idea as negative, using negative or positive wording)

 Avoid technical jargon or complicated

statements

 Use language familiar to students  Remain neutral in both questions and

responses

 Check equipment after picking up  Arrive early  Greet advisee  Have advisee sign consent/get verbal consent  Read verbal introduction/description  Have a planned outline but be flexible

depending on where the advisee takes the interview (semi-structured interviewing)

 If the interview is long, you may want to take

a break

  • This allows the advisee to relax and get refreshed
  • This allows the interviewer to think about interview

and focus or refocus on concepts

 End interview courteously and professionally  Maintain as much eye contact as is possible,

comfortable, and natural

slide-22
SLIDE 22

5/20/2014 22

 What

What is is your career orienta your career orientation ion?

 Star

Starti ting fr from

  • m as ear

as early as you y as you can can r remember member, de describe you your car career or

  • rie

ientatio ion pr proce

  • cess.

 Having lo

Having looked at ed at this this proces ess, please id ease identi entify fy the the ke key y reason asons s for for ch choos

  • osing you

your car career or

  • rie

ientatio ion.

 Please id

Please identi entify the the key key reason asons for for ch choosi

  • osing you

your career orienta career orientation ion.

 What influenc

influences es sha shaped ed yo your ur decision

  • n (this

his could uld be be pe peopl

  • ple or
  • r oth
  • ther facto

factors)?

 How w

were re you s u specifical ically i ly influe uence nced? ?

 What campus

us reso resources urces (if a f any) y) d did yo you u use use in in makin making th this is de decis cision?

F15  If

If you you utiliz utilized campu campus resou resources, s, desc describe be how they did how they did

  • r
  • r did not

did not help you? help you?

 Who (if anyon

Who (if anyone) did you did you consu consult when t when you you were were consider nsidering thi ing this de decisio cision?

 Did you s

d you seek eek out

  • ut academ

academic ic advi advisin sing when when you were you were makin king t this is deci decision? Why o Why or why why no not?

 Plea

Please desc describe the the advi advising expe experience.

 Descr

scribe any di be any discussions that i s that involv volved ed as assist stan ance wi with th career eer p planning. ning.

 How

How did the adviso did the advisor r help help or

  • r not

not help help you? you?

 What chan

What changes would s would you recom you recommend to to enha enhance academ academic advisin ic advising f for s r stud uden ents who are ts who are in the proce the process s

  • f
  • f choo

choosin sing a a career ori career orientat atio ion?

 What advic

What advice would would you you give give a a new stud new student who is t who is in in the the process process of

  • f select

ctin ing g a a career career ori

  • rientation

ion?

Now, given YOUR research topic, who could you INTERVIEW?

slide-23
SLIDE 23

Slide 64 F15 The process of selecting a majo, so important in the US, is not very relevant to the Dutch situation. A lot

  • f study advising will be focusing on the FYE, on finishing the program oin time and study delay, and to

a lesser extent career orientation. It is difficutl for me to come up with alternatives, it would be easier to do so if there would be a hypothetical research question, that the interview should help answer. Any ideas? I definitely want to help help come up with new questions.

FJJBO, 5/5/2014

slide-24
SLIDE 24

5/20/2014 23

 What’s your purpose and what are the

research questions?

 What do you hope to glean from the

advisors/advisees?

 Can other instruments get at the same

data/add to it?

 Big decision: use existing instrument or

design your own?

 Instructions and purpose  Demographics (beginning or end)  Likert-type (4, 5, or 7 points)  Open-ended  On-line or hard copy?

slide-25
SLIDE 25

5/20/2014 24

 Issues of Reliability  Face and Construct Validity  Factor Analysis and Alpha Coefficients

Advising F ng First S t Satisf tisfac action tion Survey ey

Strongly Disagree Disagree Neutral Agree Strongly Agree N/A My academic advisor is knowledgeable about liberal studies/university-wide requirements.

O O O O O O

My academic advisor is knowledgeable about my major requirements.

O O O O O O

My academic advisor encourages me to meet with them regularly.

O O O O O O

My academic advisor assists me in planning my schedule and selecting my courses.

O O O O O O

My academic advisor helps me understand university policies and procedures.

O O O O O O

My academic advisor helps me understand my academic standing (warning, probation, dismissal, good academic standing).

O O O O O O

My academic advisor helps me match my academic abilities with potential majors.

O O O O O O

My academic advisor assists me with career planning.

O O O O O O

My academic advisor refers me to other

  • ffices or services when necessary.

O O O O O O

My academic advisor is easy to talk to.

O O O O O O

My academic advisor is available when I need help.

O O O O O O  What did

What did you find to u find to be be most helpfu st helpful durin l during your your aca academic ad advi vising ap appointment? __________ ______ _____ _____ _____ _____ ______ _____ _____ ______ _____ _____ ______ ____

 Is t

there a e anything w ything we could d d do to improve o

  • ve our

aca academic ic ad advi vising ser services? __________ ______ _____ _____ _____ _____ ______ _____ _____ ______ _____ _____ ______ ____

slide-26
SLIDE 26

5/20/2014 25

 Ag

Age: ________

 Gender

Gender: _____Male _____Female

 Classif

sifica catio tion: : _____ Bachelor 1 _____ Bachelor 2 _____ Bachelor 3 _____ Master

 What is

What is your curren ur current GPA? GPA?

 _____Below 6 _____ 8-8.9  _____ 6-6.9

_____ 9-10

 _____ 7-7.9

But be careful . . . .

 Means, Standard Deviations  Frequencies  Chi-square  Inferential (ANOVA and Correlations)  By the way, it’s okay to ask for help on this!  Great opportunity for collaboration!

Now, given YOUR research topic, is a survey useful?

slide-27
SLIDE 27

5/20/2014 26

 What other artifacts might be relevant?

 NACADA Research Committee

  • Research Agenda
  • Research Listserv
  • Research Grants and Awards
  • Research Symposium

 NACADA Clearinghouse

http://www.nacada.ksu.edu/clearinghouse /advisingissues/index.htm Developing your research plan Considering evidence (data)

available to you

  • Existing and/or researcher-

generated

  • Possible partnerships
slide-28
SLIDE 28

5/20/2014 27

Share data collection and

analysis approach with small group

“Critical Friends” round 2

slide-29
SLIDE 29

5/20/2014 28

 Discussion  Develop individual action plans  Commit to yourself  Ask for help from colleagues and collaborate

with others

 Follow sound research practices from the

start

 Take pride in your accomplishments and

share them (both formally and informally)!

 Stay in touch!

slide-30
SLIDE 30

5/20/2014 29

And don’t forget to complete the evaluation . . .