Big Data Matters - Aalhe 2020 Presentation

1. Which of the following career readiness competencies did BIG Ten students feel they improved the most while in college?

Critical Thinking

Oral/Written Communication

Digital Technology

Global/Intercultural Fluency

When asked to choose the top three career readiness competencies they have improved in during college, 59% of respondents indicated critical thinking/problem solving, 39% of respondents indicated Oral/Written Communication

Find the MSL 2018 Big Ten Career Readiness Research Brief here: https://leadership.illinois.edu/big-ten-collaboration/msl-big-ten

See the NACE Competencies here: https://www.naceweb.org/career-readiness/competencies/career-readiness-defined/

Explanation

When asked to choose the top three career readiness competencies they have improved in during college, 59% of respondents indicated critical thinking/problem solving, 39% of respondents indicated Oral/Written Communication

Find the MSL 2018 Big Ten Career Readiness Research Brief here: https://leadership.illinois.edu/big-ten-collaboration/msl-big-ten

See the NACE Competencies here: https://www.naceweb.org/career-readiness/competencies/career-readiness-defined/

2. Big Ten students were asked to estimate the percentage of classes they took that required a group project. What percentage of students indicated that at least half of their classes had required a group project.

40%

45%

50%

55%

55% of Big Ten students said that at least half of their classes required a group project. Find the MSL 2018 Big Ten Classroom Group Work Research Brief here: https://leadership.illinois.edu/big-ten-collaboration/msl-big-ten

Explanation

55% of Big Ten students said that at least half of their classes required a group project. Find the MSL 2018 Big Ten Classroom Group Work Research Brief here: https://leadership.illinois.edu/big-ten-collaboration/msl-big-ten

3. The Big Ten Coalition of the MSL was comprised of 8 institutions that each submitted a random sample of 4,000 undergraduate students. What was the response rate?

9%

13%

19%

23%

29%

The Big Ten MSL 2018 response rate was 23%. The coalition was pleased with the response rate.

Explanation

The Big Ten MSL 2018 response rate was 23%. The coalition was pleased with the response rate.

4. For the outcome of leadership efficacy (the belief you can lead) which of the following is true for the Big Ten 2019 sample.

Women scored statistically significantly higher than men

Men scored statistically significantly higher than women

There were no statistically significant differences between men and women

In the MSL 2018 there were no statistically significant difference between men and women on leadership efficacy for both the Big Ten sample and the National Sample (p <.01 however in previous administrations of the msl women have scored lower than men on this measure. there were significant group differences between both and when compared to transgender students. students reported a mean score.>

Explanation

In the MSL 2018 there were no statistically significant difference between men and women on leadership efficacy for both the Big Ten sample and the National Sample (p <.01 however in previous administrations of the msl women have scored lower than men on this measure. there were significant group differences between both and when compared to transgender students. students reported a mean score.>

5. What percentage of Big Ten students indicated that they participated in at least one formal leadership training experience (Leadership Lecture/Workshop, Emerging Leader Program, Positional leadership training, Course etc.)

10%

20%

30%

40%

30% of Big Ten respondents participated in at least one formal leadership training experience (n = 1705). The most popular types of leadership training experiences were Leadership Lecture/Workshop (19%), Leadership Conference (17%) Positional Leader Training (15%) and Leadership Course (15%).

Explanation

30% of Big Ten respondents participated in at least one formal leadership training experience (n = 1705). The most popular types of leadership training experiences were Leadership Lecture/Workshop (19%), Leadership Conference (17%) Positional Leader Training (15%) and Leadership Course (15%).

6. Which part of the collegiate experience did Big Ten students say were most influential in improving their leadership skills.

Co-Curricular Activities

Employment

Courses outside my major

Courses in my major/minor

51% of respondents (n = 2600) indicated that courses in their major/minor were most influential in improving leadership skills.

Explanation

51% of respondents (n = 2600) indicated that courses in their major/minor were most influential in improving leadership skills.

7. The MSL has a Delta Measure to determine change over time. For students who were seniors, their current scores were compared to a retroactive pre-test (e.g. Prior to College) to determine growth in college. In all outcome measures students reported higher scores during their senior year than prior to college. Which had the largest effect size?

Consciousness of Self

Congruence

Commitment

Collaboration

Consciousness of Self had a large effect size (Cohen's d = .8 and above)
Congruence, Collaboration, Controversy with Civility, Leadership Efficacy, Complex Cognitive Skills, Social Perspective Taking, Omnibus SRLS, Resiliency all had moderate effect sizes (Cohen's d = .5 and above)
Commitment, Citizenship, Social Generativity, and Hope had small effect sizes (Cohen's d = .2 and above)

Explanation

Consciousness of Self had a large effect size (Cohen's d = .8 and above)
Congruence, Collaboration, Controversy with Civility, Leadership Efficacy, Complex Cognitive Skills, Social Perspective Taking, Omnibus SRLS, Resiliency all had moderate effect sizes (Cohen's d = .5 and above)
Commitment, Citizenship, Social Generativity, and Hope had small effect sizes (Cohen's d = .2 and above)

8. Which of the following is NOT an outcome measure in the MSL.

Common Purpose

Leadership Efficacy

Collaboration

Complex Cognitive Skills

Concsiousness of Self

Campus Climate

Although common purpose is a value in the Social Change Model. The MSL no longer uses this as a measurement scale because it was highly correlated with the Collaboration scale.

Learn more about the MSL instrument here: https://www.leadershipstudy.net/instrument-psychometrics

Explanation

Although common purpose is a value in the Social Change Model. The MSL no longer uses this as a measurement scale because it was highly correlated with the Collaboration scale.

Learn more about the MSL instrument here: https://www.leadershipstudy.net/instrument-psychometrics

9. Which of the following high impact practices did Big Ten students engage in more than the national sample

Study Abroad

Internship

First- Year Experience Course

Senior Capstone

Research with Faculty

19% of Big Ten students indicated they participated in study abroad compared to 17% of the national sample.
47% of Big Ten students indicated they completed an internship compare to 42% of the national sample.
24% of Big Ten students indicated the participated in research with faculty compared to 18% of the national sample

Big Ten students indicated less participation in First-Year Course (53% compared to 60% national sample) and Senior Capstone (15% compared to 18% national sample).

Explanation

19% of Big Ten students indicated they participated in study abroad compared to 17% of the national sample.
47% of Big Ten students indicated they completed an internship compare to 42% of the national sample.
24% of Big Ten students indicated the participated in research with faculty compared to 18% of the national sample

Big Ten students indicated less participation in First-Year Course (53% compared to 60% national sample) and Senior Capstone (15% compared to 18% national sample).

Submit

10. Which of the following career readiness competencies did BIG Ten students feel they need to continue to develop the most?

Critical Thinking

Oral/Written Communication

Teamwork

Digital Technology

Big Ten students indicated that Oral/Written Communication was the areas they need to continue to develop.
Of the 2,903 respondents, 43%, second was Career Management, 42% of respondents.

Find the MSL 2018 Big Ten Career Readiness Research Brief here: https://leadership.illinois.edu/big-ten-collaboration/msl-big-ten

Explanation

Big Ten students indicated that Oral/Written Communication was the areas they need to continue to develop.
Of the 2,903 respondents, 43%, second was Career Management, 42% of respondents.

Find the MSL 2018 Big Ten Career Readiness Research Brief here: https://leadership.illinois.edu/big-ten-collaboration/msl-big-ten