Abstract

Science and society have always been intertwined. Today, scientists are increasingly encouraged to interact with the public by conducting transparent and participatory engaged scholarship, as opposed to the prevailing one-way transfer of information model. A renewed focus on the "broader impacts of science" from funding agencies has increased the urgency to train scientists equipped with an understanding of how their work intersects with the public interest. While aspiring scientists in STEM fields routinely develop disciplinary expertise and research skills, universities must also prepare undergraduate students for careers in STEM disciplines, where skills and knowledge to effectively engage with the public are increasingly necessary. This lesson guides students through an exploration of the broader impacts of scientific research, allowing students to situate their conceptual learning within a societal context. Through a jigsaw exercise, students examine specific examples of public engagement strategies used to translate science into the public sphere. A discussion of the article 'Science's new social contract with society' defines key concepts surrounding the shifting relationship between science and society (1). Finally, students synthesize their understanding of complex science-society interactions in a concept mapping exercise. Student understanding of the concept 'broader impacts of science' is assessed using formative (e.g., discussion, concept map) and summative (e.g., pre-post minute paper) assessment. Self-reported data and pre-post analysis indicates that students found the lesson engaging, emerging with a deeper and more nuanced understanding of the interactions between science and society.

Primary Image: "Students discuss the broader impacts of science in an active learning environment.” The primary image accompanying this lesson showcases students in a small group discussion as part of the lesson. Student permission was obtained for the use of this photograph, in compliance with the Institutional Review Board (IRB).

Citation

Alexander S, TeSlaa J. 2020. Exploring the broader impacts of science and society in an active learning environment. CourseSource. https://doi.org/10.24918/cs.2020.22

Lesson Learning Goals

Students will

• understand the complex relationships between science and society.
• understand how scientific research is translated into the public sphere.
• appreciate the importance of public engagement with science and scientists.

Lesson Learning Objectives

1. Students will be able to define the phrase ‘broader impacts of science.’
2. Students will be able to describe current and historical relationships between science and society.
3. Students will be able to identify methods by and contexts in which scientific research is applied in the public sphere.
4. Students will be able to map complex interactions between science and society.
5. Students will be able to evaluate the effectiveness of different public engagement strategies.

INTRODUCTION

Over the last century, the prevailing model of scholarship has been that new knowledge is developed in academic environments and subsequently shared with society at large for use by government, industry, and the general public (1-2). In the sciences, this one-way flow of knowledge assumes that the public need only be informed of the latest research findings, with minimal interaction between the producers and consumers of knowledge (2-5). Social science literature increasingly indicates that this model is ineffective (1,4,6). Rather, greater interaction between knowledge producers and users results in greater uptake of scientific knowledge and more effective solutions to public issues (7-13).

Scientists are increasingly encouraged to adopt a transparent and participatory model of public engagement (2,14). The National Science Foundation (NSF) began including broader impacts review criteria for funding in 1997, arguing that NSF projects should 'contribute more broadly to achieving societal goals' (15). Progress has been made in areas like citizen science and social media engagement, but the culture of science is changing slowly (14,16-17). Improving the education of early career scientists to build the skills necessary for engaged scholarship (e.g., science communication, public engagement) is a critical component of enhancing the societal impact of science research.

Undergraduate students in the science, technology, engineering, and mathematics (STEM) fields routinely develop disciplinary expertise and research skills. To adequately prepare STEM students to conduct engaged scholarship with direct societal interaction, STEM classrooms must also make space for students to examine how their discipline intersects with the public interest through the lens of society, culture, and place (18). Multiple organizations have recognized the need for students to understand public applications of new scientific knowledge. The AAAS Vision and Change report recommended that undergraduate biologists should 'understand the relationship between science and society' (19). The national initiative Science Education for New Civic Engagement and Responsibilities (SENCER) provides resources and impetus at the institutional and curricular level to "strengthen student learning and interest in science, technology, engineering, and mathematics (STEM) by connecting course topics to issues of critical local, national, and global importance" (20).

Teaching undergraduates about the broader societal impacts of research has implications for their understanding of research ethics, interdisciplinary problem-solving, science communication skills, and future civic engagement (21-22). Students entering the STEM disciplines are less inclined to be involved in public life and score lower on scales of social and civic disposition (23-24). STEM majors report feeling less agency to shape societal issues than non-STEM majors at graduation, suggesting scant opportunities for discussion of the social and civic responsibilities of scientists (23). Real-world connections and social relevance also impact the recruitment and retention of women and underrepresented minority groups within the STEM disciplines (25-26). These factors underscore the importance of exploring the interface of science and society as part of undergraduate curricula.

Courses that explicitly discuss the relationship between science and society are an important component of educating scientists with greater social agency (27). Infusing societal context and connections into science curricula at the level of individual activities and lessons is also critical. To the authors' knowledge, few lessons explicitly introduce STEM students to the broader impacts of scientific research and the relationship between science and society. Recognizing this gap in training future STEM students, we developed a lesson plan to explore the broader impacts of science for a STEM generalist audience at an introductory level. Students gain an understanding of the complex relationship between science and society, including how scientific research is translated into the public sphere, and appreciate the importance of scientists engaging with the public. This unique, and relatively brief, investigation of science and society does not place a large demand on instructor time or resources and is designed for easy adaptation into a disciplinary field of choice at a range of levels. We also share our findings from both formative and summative assessments of student understanding of the broader impacts of science.

Intended Audience

We created the broader impacts lesson plan for undergraduate STEM students at any level and disciplinary focus. The lesson has been implemented in a first-year undergraduate seminar Exploring Service in Science during the spring and fall 2018 semesters. The discussion-based course enrolls up to 20 students a semester and provides an introduction to public engagement for new STEM majors at a large research university. Open to all STEM majors, the majority of students who enroll are in the life sciences. The lesson plan is easily adapted to fit any specific STEM discipline of interest.

Required Learning Time

The total time allotted to the lesson should be approximately 75 minutes. If students are unfamiliar with the jigsaw and concept map formats, or the class size is large, the lesson may take up to 90 minutes to complete. An additional 15 minutes should be allotted for assessment, either directly following the lesson or during the next class session. Note: discussions and activities could be expanded upon if time permits.

Prerequisite student knowledge

No specific prior knowledge is required.

Prerequisite teacher knowledge

The instructor should be able to describe why public engagement is important and what types of scientific information are shared with the public. They should be able to identify examples of broader impacts in science and present an overview of these topics using the accompanying PowerPoint presentation (Supporting File S3. Exploring broader impacts of science – Overview presentation slides). Finally, the instructor should be able to identify a variety of ways scientific information is communicated to both expert and public audiences (e.g., citizen science initiatives, personal interactions, mass media, and primary literature).

SCIENTIFIC TEACHING THEMES

Active Learning

Our lesson employs a variety of active learning approaches. Students begin the lesson by responding to a minute paper prompt that activates their prior knowledge. A jigsaw activity provides opportunities for students to engage in small and large group discussion. Students work together to brainstorm common themes from the assigned readings, and actively synthesize their understanding through completion of a concept map in class. Finally, students share how their understanding of the central concept of broader impacts has changed through an online discussion after the class period. This spread of activities allows students to communicate and synthesize their thoughts in multiple modes (classroom writing exercise, in-person discussion with peers, and in an online forum).

Assessment

A minute paper prompt administered before and after the lesson provides insight into prior understanding of broader impacts and how that understanding changes as a result of the lesson. The concept maps students create can be analyzed using a rubric that gauges elements of their complexity and accuracy. Formative assessment is provided throughout the lesson during small- and large-group discussion as well as instructor feedback during concept map development.

Inclusive Teaching

The lesson centers on the connections between scientific research and its public applications, an approach of particular benefit to groups of students who are underrepresented in the STEM disciplines (24-26). The lesson utilizes a variety of diverse teaching strategies to be inclusive of mixed learning styles and engage diverse students. Written approaches are demonstrated in the form of individual reflection during class and online minute papers after class. Concepts are also summarized visually (slides and concept maps) and orally (small and large group discussion). Small groups assigned by the instructor provide an opportunity to cluster students into groups containing a variety of disciplinary interests, career goals, and student backgrounds to foster peer-to-peer learning. Intentional group arrangements can also foster discussion and reflection on diverse ideas.

LESSON PLAN

Pre-class Preparation

Prior to the lesson, instructors should assign students a pre-reading which highlights how the relationship between science and society has shifted through time (1; or similar, see 28-29). Instructors should also print handouts for the lesson (Supporting File S1. Exploring broader impacts of science – Jigsaw activity student handout and Supporting File S2. Exploring broader impacts of science – Concept map student handout) and select four case study articles that highlight different methods and contexts for translating research into practice (references 30-33 are used for this course - one case study article per student, divided evenly). To find relevant case studies, instructors should search by topic and communication pathway (e.g., "environmental chemistry + citizen science"). Adding one of the United Nations Sustainable Development Goals may enhance the search results (34). Articles should be two to three pages, moderate in difficulty with an approximately upper high school reading level. The set of four articles should each highlight a different topic and public engagement strategy (e.g., citizen science, mass media, primary literature, public policy) to allow for comparison. Instructors may choose to assign students case study articles to read in advance of class, rather than using in-class time for reading. Assigning case studies as pre-reading is a more inclusive teaching approach that would allow students more time to think about the content and any implications.

In-class Activities

Warm up

Instruct students to take one or two minutes to reflect on the following question individually: In one or two sentences, describe your understanding of the phrase 'broader impacts in science.' Minute paper responses help gauge pre-lesson knowledge of students on the topic for comparison with post-assessment. They also allow students time to activate prior knowledge and think individually before participating in group discussion.

Instructor overview on broader impacts in science

The lesson should continue with an introduction to the topic of broader impacts in science by the instructor through a short presentation. Use the PowerPoint slides (Supporting File S3. Exploring broader impacts of science – Overview presentation slides) to give a brief history of broader impacts, provide motivations for public engagement in science, and explore challenges such as communication or social/cultural considerations. Introduce the pathways for translating scientific understandings using real examples. These pathways include scientific literature, press/mass media, personal interaction, jointly written grant proposals, and citizen science initiatives. Case studies provide examples from a variety of disciplines, including (but not limited to) biology, technology, engineering, and mathematics. This overview reinforces the value of broader impacts, including examples of STEM content with direct application to society, overview of how STEM knowledge is communicated to different audiences, and introduction to the interplay between scientists and the larger community. As time allows, the interactive lecture could be expanded to further student engagement, for example: can students think of problematic examples involving lack of information, misinformation or authorities misrepresenting science?

Jigsaw activity on public engagement strategies

Following an overview of broader impacts, including possible engagement strategies, communication pathways, challenges, and considerations, a jigsaw activity allows students to connect these ideas with real-world examples and explore ways that scientific understandings from a variety of disciplines are translated to the public in attempt to impact society. Prior to the activity, the instructor should introduce the process of a jigsaw activity to students (if this is the students' first experience with a jigsaw activity, the introduction may take longer). Emphasize that once students wrap up their first small group discussion, they will be responsible for sharing their article and results of the first discussion with a new group.

Divide students into small groups. Hand each group a different article (each representing different public engagement strategies and disciplinary content) to read and discuss (30-33; see pre-class preparation for suggestions finding alternative articles). Instruct students to spend five minutes reading their one article and making notes on the jigsaw activity handout (Supporting File S1. Exploring broader impacts of science – Jigsaw activity student handout). Each group then transitions to discussing the guiding questions on the handout for 10 minutes, including key scientific understandings, stakeholders involved, engagement strategy, and challenges. For example, Weltzin aims to collect phenology data to understand changes in seasonality by using citizen science strategies to engage the public in learning about plant and animal species. Students might discuss how citizen science projects allow more direct transfer of information between scientists and the public (stakeholders), but identify data quality as a notable challenge (30). Alternatively, Morris takes a more traditional approach, where scientists share their findings linking exercise to improved cognition in an academic paper (32). Challenges to this approach include accessibility of the article and understanding of technical language.

Students can also compare the level of interaction between researchers and the public in various public engagement strategies (i.e., direct when researchers are testifying in government [31]; or indirect through an online citizen science interface [30] or mass media article [33]). The discussion and handout help students highlight the main ideas in each article, identifying and evaluating the public engagement strategy and method of communication (Supporting File S1. Exploring broader impacts of science – Jigsaw activity student handout; e.g., citizen science [30], public policy [31], primary literature [32], press/mass media [33]).

Once groups have talked through the guiding questions, mix students into new groups so each is comprised of students that read a different article. Instruct students to provide a brief summary of their article and the group's discussion. Next, instruct each group to discuss the next set of questions in reference to all case studies (approximately 10 minutes):

• Compare the methods used in the different case studies to translate research into the public sphere. How effective is each method at creating an impact on society?
• What social or cultural factors are at play in each case study? How do they impact the public engagement strategy? To what extent are these factors similar or different across cases?
• For each public engagement strategy, identify the challenges that might come up during their use. How are these challenges similar or different across the case studies?

The second small group discussion allows for peer-to-peer learning and teaching, as students pool their knowledge and explore different methods of communicating scientific information for broader impact.

Allow five minutes for students to share highlights of their discussion to the class. Instructor may briefly summarize key points on the jigsaw activity handout (Supporting File S1. Exploring broader impacts of science – Jigsaw activity student handout) to ensure that students grasp the similarities and differences between case studies. This is also an opportunity for the instructor to provide feedback on student understanding of the material so far and identify any gaps or misconceptions. At a minimum, the jigsaw discussion should highlight a variety of methods and contexts where scientific knowledge is translated to (or applied by) society for broader impacts, providing concrete examples for students to understand the definition of "broader impacts of science" (learning objectives 1, 3, 5).

Large group discussion on the relationship between science and society

The jigsaw discussion of specific examples sets the stage for a large group discussion of the pre-reading assignment concerning how scientific knowledge is increasingly required to be transparent and participatory (1). In this discussion, students contextualize the relationship between science and society broadly, including how this relationship has shifted throughout time (learning objective 2). This discussion allows the students to think more deeply about the value of science to society and understand key concepts discussed in the reading (italicized below). The large group discussion should take around 10 minutes. Instructors can pose the following questions, as time and student interest allow:

• What is meant by the phrase "science must leave the ivory tower and enter the agora?" How has the relationship between science and society evolved over time?
• Based on the articles we read and discussed today, what is the current relationship between scientists and society? What benefits and challenges does this relationship bring to science? To members of the public?
• Based on the jigsaw exercise and reading, what strategies for public engagement are most effective today? How can we evaluate the effectiveness of different public engagement strategies?
• How do cultural and social factors shape dissemination and understanding of science? What challenges exist?

Through this discussion, students understand that new scientific knowledge is increasingly expected to be socially robust, with emphasis on the validity of scientific findings both in and outside of the laboratory, and involvement from a variety of disciplinary experts and non-experts during development (co-production). Public engagement with science and scientists can help communicate key social, cultural, and place-based considerations that result in contextualized knowledge (1). Discussion also allows the instructor an opportunity to weave feedback on students' understanding of key concepts from the article into the conversation and highlight connections to course content.

Synthesizing science and society interactions through a concept map

Students now have an understanding of the phrase "broader impacts of science," have investigated a variety of public engagement strategies, and have explored the shifting relationship between science and society. We next use a concept map exercise to help students individually synthesize their learning, draw connections between lesson concepts, and as a method of formative assessment through which instructors can gauge students' learning and provide feedback. In a large group format, introduce the idea of a concept map (if this is the students' first experience with a concept map, the introduction may take longer). Tell students that a concept map consists of circled key words ('nodes') linked by directional arrows labeled with a 'linking term.' Explain that linking terms may be used multiple times, however each node word should only appear once. Provide each student a copy of the concept map handout, including prescribed node words and suggested linking terms (Supporting File S2. Exploring broader impacts of science – Concept map student handout), and a blank sheet of paper. Challenge students to think about the value of exchanges between science and society and develop a concept map to illustrate the complex interactions between them (learning objectives 2 and 4). For consistency, each student should use 'science' as their central node.

Give students 10 minutes to individually work on the concept map activity. If pressed for time, the instructor should set a minimum number of node words for students to use to encourage quality and understanding over quantity. Then, bring the class together for a final 10-minute discussion that allows students to share their experience distilling the science/society relationship in a concept map.

The following questions may be posed to the class:

• Which relationship(s) is/are most important?
• Which concepts or relationships are the most ambiguous?
• What was difficult? Are certain terms particularly easy or hard to place on the map?

Instructors may wish to clarify any inaccuracies in student concept maps during the discussion. After the large group discussion, students briefly compare their maps in pairs and discuss what similarities or differences reflect about interactions between science and society. The final pair discussion allows students to distill ideas learned throughout the lesson. Following the comparison, instruct students to use remaining time to revise their concept map before turning in at the end of the period.

Post-class Assignment

Following the lesson, pose another question to provide students a chance to reflect and self-assess their learning (approximately 5 minutes), as well as capture changes in student understanding of broader impacts from the beginning of the lesson. The post-lesson question we asked in an online discussion forum was, "Following our class on broader impacts in STEM, please revisit this question: In one-two sentences, describe your understanding of the phrase 'broader impacts in science.' Then share how you think your understanding has changed since you were first asked to consider it at the beginning of our last class period." Instructors may wish to provide students with their pre-class minute paper to compare against and type into the discussion forum. We used the pre/post responses as qualitative evidence of students' learning (post-lesson prompt and possible student answers are included in Supporting File S5. Exploring broader impacts of science – Post lesson prompt and rubric).

TEACHING DISCUSSION

This lesson engages students with the broader impacts of science. Students explore the meaning of the phrase "broader impacts of science," learn methods and contexts for communicating and applying science in the public sphere and investigate the complex intersections between science and society. The lesson is grounded in active learning strategies through which students interact with peers, review examples from popular media, and develop experience understanding and synthesizing academic prose. Lesson topics illuminate what types of understandings are shared (and not shared) between scientists and the public, and methods for making the application of science transparent and participatory. Outcomes of the lesson on student learning and possible modifications are described below.

Pre-post minute paper responses show achievement of learning objectives

We evaluated the effectiveness of these teaching materials in achieving the stated learning objectives using minute paper responses (pre-assessment) and online discussion forum responses (post-assessment). Concept maps were also used for post-assessment (discussed below). Minute paper responses assessed students' understanding of broader impacts prior to participating in the lesson. Most responses were vague but generally accurate, and frequently referred to science benefitting society. For example, "using one's knowledge of science to help the overall community" or "broader impacts in science have to do with how science plays a part in society and what impact research has outside the lab." Some students described "broader impacts of science" as the application of science to real problems but did not provide examples, for instance, "broader impacts are application" or "science learned in the classroom utilized to generate tangible/'real-world' benefits to a community or solutions to problems." We felt these responses revealed a fairly simplistic understanding of the complex relationship between science and society.

Following the lesson, all students shifted towards a more nuanced and complex understanding of the phrase "broader impacts of science." Many described specific methods and contexts in which scientific research is translated into practice. For example, one student stated, "it is clear that 'broader impacts in science' covers a huge array of topics within society, from government to mass media." Students acknowledged the importance of citizen and government engagement with science to enhance impact in reflections such as, "at the beginning of the class period I expected 'broader impacts in science' to mean the way in which scientists' work benefits our quality of life and influences our community. I did not expect society, citizens, government and policy to have an equally as important and strong influence on science itself." Rather than a one-way transfer of value from science to society, they discussed the importance of the public in creating socially-robust knowledge, multi-directional transfers of information, and the importance of two-way communication. For example, "throughout class, my mentality changed from solely the impacts of science on the community. I now think about 'broader impacts in science' as the ability for not only science to impact the community but also the ability for the community to impact science through pushing for change and communicating concerns. The community holds science accountable." Students also included other aspects of broader impacts such as trust, policy, and activism, for example, "for science to have a broad impact, there must be communication between society and scientist in order for society to accept and trust the information provided by scientists." Multiple students referenced a change in understanding as a direct result of the activities in the lesson. They highlighted that the jigsaw activity and concept map helped to expand their views of broader impacts in science and link concepts discussed throughout the course.

Concept map enhances student understanding of learning objectives

Concept maps are a recognized strategy for active learning that require students to move beyond declarative knowledge and understand how concepts relate to one another (35-37). The process of creating individual concept maps allows students to interweave lesson topics and organize a 'mental model' that links concepts and fosters retainment of knowledge (35-37). We designed the concept map to provide an opportunity for students to self-assess their learning, receive instructor feedback and measure students' learning as a result of the lesson. The concept map both created a platform for peer discussion and provided post-assessment. Nearly all students were able to utilize prescribed node words with appropriate linking words to directionally connect terms together, demonstrating basic understanding of key concepts. The diversity present in concept map structure was a valuable teaching and learning tool. Comparison with classmates' maps uncovered the complexity inherent to science-society interactions and led to meaningful discussion where students were able to articulate and solidify their learning (see examples in Figure 1).

We developed a simple rubric (Supporting File S4. Exploring broader impacts of science – Concept map rubric) to assess students' concept maps. The rubric accounted for the degree to which all node words were present, directional arrows suitable, and consideration of appropriate linking words. Each category was ranked from 0-2 points based upon whether concepts represented were all/mostly present (2 points), some present (1 point), or none present (0 points). While multiple prior studies have suggested assessment formats for student concept maps (38-39), we recognized that there is no one correct way to create a concept map for broader impacts of science. Our general rubric attempted to capture correct, insightful variations in student responses. The rubric determined the degree to which students grasped the concepts, while allowing us to quantify responses for assessment. Most students scored between 4-6 points (out of 6) on the concept map exercise, with an average of 4.5 points total. We observed a high level of engagement in this activity, demonstrating the value of the concept map activity in helping students to dissect and understand complex relationships. As part of a culminating assignment and post-course evaluation, a few students cited the concept map exercise specifically in aiding their learning of course concepts.

Lesson application across disciplines

The lesson offers students the opportunity to explore how scientific information is translated to the public for societal impact. While it was designed to be one class session during a first-year seminar on civic engagement in the sciences, the lesson may also fit well towards the end of an introductory STEM course, after students have explored a topic with societal ramifications (e.g., evolution, public health, genetic testing, sustainability, climate change). Depending on the discipline, objectives, and geographic content of the course, the lesson can be customized to align with course specific objectives. The core lesson plan and active teaching strategies are easily tailored through selection of readings, jigsaw articles, and concept map terms that align with the desired discipline or topic. For example, we drew examples from a wide range of disciplines for the jigsaw activity because our students are drawn from a variety of STEM disciplines. However, other articles may be substituted to provide locally relevant or more recent examples. If different jigsaw articles are substituted, ensure that a variety of methods of translating science into the public realm are represented, for best comparison in the second half of the jigsaw exercise. Depending on the disciplinary lens used with this lesson framework, the node and linking words for the concept map may also need to be amended. We suggest instructors require students to use a common word at the center of their concept map for consistency. While we used 'science' as our central node, this may differ based on the disciplinary focus of the course.

Lesson application across course formats

We developed and taught this lesson in a small seminar format, but the active learning strategies and lesson framework are transferable across course formats with minor modifications (e.g., large lectures, discussion sections, seminars, or labs). Depending on the number of students and classroom format, the jigsaw activity may require more instructor preparation. In a larger lecture format, the instructor may wish to assign groups in advance, convey the groupings to students ahead of the lesson, and ask students to sit in their groups upon arrival. However, the jigsaw format is flexible. Instructors may wish to add additional articles with a large number of students or split the class into sub-groups, with each sub-group performing the jigsaw activity as described through duplication of each article. For very large classes (> 200 students), students could randomly be assigned an article to read prior to class and be instructed to talk with others sitting nearby to limit movement during the exercise.

Similarly, modifications to the concept map activity can be adapted to fit many classroom environments and time constraints. If desired, the concept map activity could be moved to the following class session, split across multiple class sessions, performed in small groups, or assigned as an out-of-class assignment. Although the activity provides opportunity for student engagement in class, completion of the activity at a later time still allows students to map complex understandings between science and society (and may be more feasible in very large classes). Completing the map in small groups may increase interaction and learning. However, this may make it more difficult to track individual progress as a result of this lesson. Although it is possible to use a shorter post-assessment exercise, the concept map activity was favorably received by students and identified as an activity that facilitated learning and synthesis of lesson topics.

Conclusion

Broader impacts and public engagement are an increasingly important facet of working in the STEM disciplines. This lesson introduces the topic of broader impacts to students in an engaging, active environment that promotes development of key science process skills. Peer-to-peer learning is facilitated through small and large group discussion and student-centered activities, including jigsaw and concept mapping. Several assessment strategies illustrate the effectiveness of the lesson, and students highlight the key role of the concept map exercise in expanding their learning. Overall, this is a promising approach that can help students understand how their disciplinary knowledge intersects with the public interest and prepare them to champion engaged scholarship in future careers.

ACKNOWLEDGMENTS

The authors would like to acknowledge the Wisconsin Institute for Science Education and Community Engagement for supporting the pilot-program of the Service Fellows initiative and providing valuable insight during compilation of the manuscript. In particular, we thank the 2017-2018 pilot Service Fellows cohort for their thoughtful review of the lesson during development. Special thanks to those who offered input on and review of the article: Anna Bishop Courtier, Cara Theisen, and Sofia Machiavelli Baron.

SUPPORTING MATERIALS

• S1. Exploring broader impacts of science – Jigsaw activity student handout
• S2. Exploring broader impacts of science – Concept map student handout
• S3. Exploring broader impacts of science – Overview presentation slides
• S4. Exploring broader impacts of science – Concept map rubric
• S5. Exploring broader impacts of science – Post lesson prompt and rubric

References

1. Gibbons M. 1999. Science's new social contract with society. Nature 402:C81-C84. doi:10.1038/35011576
2. Boyer E. 1996. The scholarship of engagement. Journal of Public Service and Outreach 1(1):11-20.
3. Roux DJ, Rogers KH, Biggs HC, Ashton PJ, Sergeant A. 2006. Bridging the science-management divide: moving from unidirectional knowledge transfer to knowledge interfacing and sharing. Ecology and Society 11(1):4. doi:10.5751/es-01643-110104
4. Scheufele DA. 2013. Communicating science in social settings. Proceedings of the National Academy of Science 110(3):14040-14047. doi:10.1073/pnas.1213275110
5. Simis MJ, Madden H, Cacciatore MA, Yeo SK. 2016. The lure of rationality: Why does the deficit model persist in science communication? Public Understanding of Science 24(4):400-414. doi:10.1177/0963662516629749
6. Gilles JL, Valdivia C. 2009. Local forecast communication in the altiplano. Bulletin of the American Meteorological Society 90(1):85-92. doi:10.1175/2008BAMS2183.1
7. Lemos MC, Morehouse BJ. 2005. The co-production of science and policy in integrated climate assessments. Global Environmental Change 15: 57-68. doi:10.1016/j.gloenvcha.2004.09.004
8. Roncoli C. 2006. Ethnographic and participatory approaches to research on farmers' responses to climate predictions. Climate Research 33: 81-99. doi:10.3354/cr033081
9. Weaver CP, Lempert RJ, Brown C, Hall JA, Revell D, Sarewitz D. 2013. Improving the contribution of climate model information to decision making: the value and demands of robust decision frameworks. WIRE Climate Change 4: 39-60. doi:10.1002/wcc.202
10. Howarth C, Monasterolo I. 2017. Opportunities for knowledge co-production across the energy-food-water nexus: Making interdisciplinary approaches work for better climate decision making. Environmental Science and Policy 75: 103-110. doi:10.1016/j.envsci.2017.05.019
11. Pielke RA, Sarewitz D. 2005. Bringing society back into the climate debate. Population and Environment 26(3):255-268. doi:10.1007/s11111-005-1877-6
12. Gilbertson M, Craft M, Potter T. 2019. Planetary grand challenges: A call for interdisciplinary partnerships. Interdisciplinary Journal of Partnership Studies 6(1):1-17. doi:10.24926/ijps.v6i1.1976
13. Kythreotis AP, Mantyka-Pringle C, Mercer TG, Whitmarsh LE, Corner A, Paavola J, Chambers C, Miller BA, Castree N. 2019. Citizen Social Science for More Integrative and Effective Climate Action: A Science-Policy Perspective. Frontiers in Environmental Science, 7. doi:10.3389/fenvs.2019.00010
14. Stanton TK. 2008. New times demand new scholarship. Education, citizenship and social justice 3(1):19-42. doi:10.1177/1746197907086716
15. The National Science Foundation. 2013. Proposal and Award Policies and Procedures Guide Chapter III.A.1 (NSF 14-1), available at http://www.nsf.gov/pubs/policydocs/pappguide/nsf14001/nsf14_1.pdf
16. Pew Research Center. 2015. How Scientists Engage the Public, available at http://www.pewinternet.org/2015/02/15/how-scientists-engage-public/
17. National Academies of Sciences, Engineering, and Medicine. 2018. Learning Through Citizen Science: Enhancing Opportunities by Design. Washington, DC: The National Academies Press.
18. Chamany K, Allen D, Tanner K. 2008. Making Biology Learning Relevant to Students: Integrating People, History, and Context into College Biology Teaching. CBE-Life Sciences Education 7(3):267-278. doi:10.1187/cbe.08-06-0029
19. American Association for the Advancement of Science. 2011. Vision and Change in Undergraduate Biology Education. Washington, DC. Retrieved from: http://visionandchange.org/finalreport/.
20. Weston T, Seymour E, Thiry H. 2006. Evaluation of Science Education for New Civic Engagements and Responsibilities (SENCER) Project. Stony Brook, NY: The National Center for Science and Civic Engagement. Retrieved from: https://sencer.net/our-mission/.
21. Huang F, Beckwith J. 2005. Should we make a fuss? A case for social responsibility in science. Nature Biotechnology 23(12):1479-1480. doi:10.1038/nbt1205-1479
22. Keiler KC, Jackson KL, Jaworski L, Lopatto D, Ades SE. 2017. Teaching broader impacts of science with undergraduate research. PLoS Biology 15(3):e2001318. doi:10.1371/journal.pbio.2001318
23. Garibay JC. 2015. STEM Students' Social Agency and Views on Working for Social Change: Are STEM Disciplines Developing Socially and Civically Responsible Students? Journal of Research in Science Teaching 52(5):610-632. doi:10.1002/tea.21203
24. Nicholls GM, Wolfe H, Besterfield-Sacre M, Shuman LJ, Larpkiattaworn S. 2007. A Method for Identifying Variables for Predicting STEM Enrollment. Journal of Engineering Education 96(1):33-44. doi:10.1002/j.2168-9830.2007.tb00913.x
25. Carlone HB, Johnson A. 2007. Understanding the Science Experiences of Successful Women of Color: Science Identity as an Analytic Lens. Journal of Research in Science Teaching 44(8):1187-1218. doi:10.1002/tea.20237
26. Knight DB, Mappen EF, Knight S. 2011. A Review of the Literature on Increasing the Representation of Women Undergraduates in STEM Disciplines through Civic Engagement Pedagogies. Science Education and Civic Engagement 3(1):36-47.
27. Duffy LK, Godduhn A, Fabbri CE, Van Muelken M, Nicholas-Figueroa L, Middlecamp CH. 2011. Engaging Students in Science Courses: Lessons of Change from the Arctic. Interchange 42(2):105-136. doi:10.1007/s10780-011-9151-6
28. Mehta G, Hopf H, Krief A, Matlin SA. 2020. Realigning science, society and policy in uncertain times. Royal Society Open Science 7:200554. DOI: 10.1098/rsos.200554
29. Hessels LK, van Lente H, Smits R. 2009. In search of relevance: the changing contract between science and society. Science and Public Policy 36(5): 387-401. DOI: 10.3152/030234209X442034.
30. Weltzin J. 2016. Nature's Notebook: Citizen Scientists Track Seasonal Change. Federal Crowdsourcing and Citizen Science Toolkit. Accessed from: https://www.citizenscience.gov/natures-notebook/#.
31. Mervis J. 2017. Scientist tells her story in latest partisan battle on House science panel. Science Magazine. June 28. DOI:10.1126/science.aan7039
32. Morris JK. 2017. Feel the burn to improve cognition. Sci. Trans. Med. 9(418). DOI: 10.1126/scitranslmed.aar2444.
33. Lohr S. 2017. A.I. Will Transform the Economy. But How Much, and How Soon? New York Times. Retrieved from: https://nyti.ms/2ByMfjM.
34. United Nations Sustainable Development Goals. Available at: https://www.un.org/sustainabledevelopment/sustainable-development-goals/
35. Faust JL, Paulson DR. 1998. Active learning in the college classroom. Journal on Excellence in College Teaching 9(2):3-24.
36. Clayton LH. 2006. Concept Mapping: An effective, active teaching-learning method. Nursing Education Perspectives 27(4):197-203.
37. Nesbit JC, Adesope OO. 2006. Learning with concept and knowledge maps: A meta-analysis. Review of the Educational Research 76(3):413-448. doi:10.3102/00346543076003413
38. Anderson TH, Huang SC. 1989. On using concept maps to assess the comprehension effects of reading expository text. University of Illinois at Urbana-Champaign.
39. Rice DC, Ryan JM, Sampson SM. 1998. Using concept maps to assess student learning in the science classroom: Must different methods compete? Journal of Research in Science Teaching 35(10):1103-1127.