| Home | About BEAR | Events | Research Projects | Publications | Archives| Measurement | Contact BEAR |

 http://bear.berkeley.edu

B  E  A  R   C e n t e r

 
          BEAR Center Logo

Berkeley Evaluation & Assessment Research Center

Director: 

 

Mark Wilson

Convenor:

 

Carolyn Hofstetter

Coordinator: 

 

Mariella Ruiz

 

|BEAR Research Report Series|Other Publications Associated with BEAR Center|Professional Presentations |

 

BEAR Publications

 

BEAR Research Report Series

Wilson, M. & Xie, Y. (2004). The Imperial vs. Metric Study. BEAR Report Series, 2004-10-01. University of California, Bekeley, CA. PDF

Draney, K. & Peres, D. (1998, December). Multidimensional modeling of complex science assessment data. University of California, Berkeley. Click here to download the PDF file of this article.

Roberts, L. & Wilson, M. (1998, February). An integrated assessment system as a medium for teacher change and the organizational factors that mediate science teachers' professional development. University of California, Berkeley: BEAR Report Series, SA-98-2. Click here to download the PDF file of this article.

Roberts, L. & Wilson, M. (1998, January). Evaluating the effects of an integrated assessment system on science teachers' assessment perceptions and practice. University of California, Berkeley: BEAR Report Series, SA-98-1. Click here to download the PDF file of this article.

Roberts, L., Wilson, M., & Draney, K. (1997, June) The SEPUP Assessment System: An Overview. University of California, Berkeley: BEAR Report Series, SA-97-1. Click here to download the PDF  file of this article.

Wilson, M. & Draney, K. (1997, July). Developing maps for student progress in the SEPUP Assessment System. University of California, Berkeley: BEAR Report Series, SA-97-2. Click here to download the PDF file of this article.

Wilson, M. & Case. H. (1997). An Examination of Variation in Rater Severity Over Time: A Study in Rater Drift. University of California, Berkeley: BEAR Report Series, CD-97-1. Click here to download the PDF file of this article.

Roberts, L., Sloane, K., & Wilson, M. (1996). Assessment Moderation: Supporting Teacher Change while Improving Professional Practice. University of California, Berkeley: BEAR Report Series, SA-96-2.

Sloane, K., Wilson, M., & Samson, S. (1996). Designing an embedded assessment system: From principles to practice. University of California, Berkeley: BEAR Report Series, SA-96-1. Click here to download the PDF file of this article.

Roberts, L. (1995). SEPUP Assessment Development Centers: Site visit portfolio. University of California, Berkeley: BEAR Report Series, SA-95-1. Click here to download the PDF file of this article.

Wilson, M., Sloane, K., Roberts, L., & Henke, R. (1995). SEPUP Course I, Issues, Evidence and You: Achievement evidence from the pilot implementation. University of California, Berkeley: BEAR Report Series, SA-95-2. Click here to download the PDF file of this article.


Other Publications Associated with the BEAR Center

Briggs, D. & Wilson, M. (in press). Causal Inference and the Heckman Model. Journal of Educational and Behavioral Statistics.

Briggs, D. (2004). Evaluating SAT Coaching: Gains, Effects and Self-Selection. In R. Zwick (Ed.) Rethinking the SAT: Perspectives Based on the November 2001 Conference at the University of California, Santa Barbara. RoutledgeFalmer.

Briggs, D. & Wilson, M. (2003). An Introduction to Multidimensional Measurement Using Rasch Models. Journal of Applied Measurement, 4 (1), 87-100.

Kennedy, C. (2003, March). A Primer on Design Matrices. Click here to download this article.

Roberts, L. (2000). Using criterion-referenced maps to produce meaningful evaluation measures: Evaluating middle school science teacher change in assessment, collegial and instructional practices. In M. Wilson & G. Engelhard, Jr. (Eds.), Objective Measurement: Theory into Practice (Volume 5). Norwood, NJ: Ablex.

Kennedy, C. (2000, March). Measuring Student Variables Useful in the Study of Performance in an Online Learning Environment. Click here to download this article.

Kennedy, C. (2000, March). What Influences Student Learning in an Online Course? Click here to download this article.

Wilson, M., Roberts, L., Samson S., & Sloane K. (2000). SEPUP Assessment Resources Handbook. BEAR Center Research Reports, University of California, Berkeley.

Wilson, M. (in press). Relating the National Science Education Standards to an embedded assessment system. In K. Comfort (Ed.), How good is good enough? Setting performance standards for science learning. New York: AAAS.

Kennedy, C. (1998, December). Online Education: Pathway or Barrier to Academic Equity. Click here to download this article.

Kennedy, C. (1998, November). Turning the Tables: Engaging Teachers in the Learning Process. Click here to download this article.

Kennedy, C. (1998, October). Conflicting Purposes of Higher Education: Will Improving Access to Higher Education Undermine Quality? Click here to download this article.

Roberts, L. & Henke, R. (1997). Mapping Middle School Students' Perceptions of the Relevance of Science. In M. Wilson, G. Engelhard, Jr., & K. Draney (Eds.), Objective Measurement: Theory into Practice. (Volume 4) Norwood, NJ: Ablex.

Wilson, M. & Adams, R. (1996). Evaluating progress with alternative assessments: A model for Chapter 1. In M. B. Kane (Ed.), Implementing performance assessment: Promise, problems and challenges. Hillsdale, NJ: Erlbaum.

Wilson, M. & Wang, W. (1995). Complex composites: Issues that arise in combining different modes of assessment. Applied Psychological Measurement, 19 (1), 51-72.
 
 
Professional Presentations

For copies of professional presentations please contact the first author. Author contact names and addresses are provided on the last page of this document.

Kennedy, C. (2004, April). Technology Underlying task templates in the PADI design system: The scoring engine. Presented at the Annual Meeting of the American Educational Research Association, San Diego, CA, April 200

Kennedy, C. (2004, April). An example of a task template from the Full Option Science System (FOSS). Presented at the Annual Meeting of the American Educational Research Association, San Diego, CA, April 2004.

Kennedy, C. (2004, March). The BEAR Assessment System. Presentation introduced at the No Child Left Behind Technology Summit, St. Louis, MO, March 2004.

Kennedy, C. (2003, November). Constructing Measurement Model Fragments: An Example from BioKids.

Kennedy, C. (2003, October). A Template Construction Path. Click here to download this presentation.

Wilson, Mark & Kathleen Scalise (2003, June). Research on learning: Implications for assessment in higher education. Opening plenary address at the American Association for Higher Education Assessment Conference, Seattle. Click here to download this presentation.

Kennedy, C. (2003, June). Testing the Test: Did it measure what was intended? Poster presentation at the Assessment Conference of the American Association for Higher Education, Seattle, WA, June 2003.

Kennedy, C. (2003, April). Promoting Success in Online College Courses: Understanding Interactions Between Course Structure and Learner Readiness. Paper presented at the Annual Meeting of the American Educational Research Association, New Orleans, LA, April 2003. Click here to download this article.

Kennedy, C. (2003, March). Using the PADI Framework to Design an Item. Click here to download this presentation.

Kennedy, C. (2002, June). Formative Evaluation of an Online Teaching Strategy: Using Mixed Methods to Learn From the Student Experience. Paper presented at the American Evaluation Association 2002 Conference, Washington, D.C., November 2002. Click here to download this article.
Click here to download slides of the presentation.

Xie, Y. (2002, Spring). An Application of a Special Two-Class Item Response Model Using Markov Chain Monte Carlo Method. Position Paper; Policy, Organization, Measurement, & Evaluation; Graduate School of Education; University of California, Berkeley. Click here to download this paper. Click here to download appendix. Click here to download Item Map.

Xie, Y. (2001, Spring). Dimensionality, Dependence, or Both?: An Application of the Item Bundle Model to Multidimensional Data. Position Paper; Policy, Organization, Measurement, & Evaluation; Graduate School of Education; University of California, Berkeley. Click here to download this paper.

Kennedy, C. (1999, October). Reinventing Online Education From a Social Context. Presented at the "Online Education in California Community Colleges: Faculty Perspectives" Conference at College of San Mateo. Click here to download this article.

Kennedy, C. (1999, April). Community College Teaching: Divining the Future from the Past. Invited talk presented at the plenary Session of the Academic Senate of the California Community Colleges, Burlingame, CA, April 1999. Click here to download this article.

Draney, K. & Wilson, M. (1998, June). Creating composite scores and setting performance levels: Use of a scaling procedure. Council of Chief State School Officers National Conference on Large Scale Assessment. Colorado Springs, CO.

Wilson, M. & Draney, K. (1998, June). Creating composite scores and setting performance levels: Comparison of raw score and scaling procedures. Council of Chief State School Officers National Conference on Large Scale Assessment. Colorado Springs, CO.

Roberts, L. & Wilson, M. (1998, April). Evaluating the Effects of an Integrated Assessment System: Changing Teachers' Practices and Improving Student Achievement in Science. Paper presented at the annual meeting of the American Educational Research Association, San Diego, CA.

Wilson, M. (1998, July). Embedding developmental assessment into an instructional curriculum: The case of SEPUP’s Issues, Evidence and You. International Developmental Assessment Seminar, Royal Melbourne Institute of Technology, Melbourne, Australia.

Wilson, M. (1998, January). How do curriculum developers measure success? ScienceGate II Conference, Xerox Document University, VA.

Draney, K. & Wilson, M. (1997, July). Mapping student progress with embedded assessments: The challenge of making evaluation meaningful. Paper presented at the National Evaluation Institute Workshop, Indianapolis, IN.

Hoskens, M., Wilson, M., & Stavisky, H. (1997, June). Accounting for rater effects in large scale testing using IRT. Paper presented at the European meeting of the Psychometric Society.

Roberts, L. (1997, November). Data-Oriented Evaluation: Documenting the Rhetoric versus Reality of Assessment Reform in Science Education. Paper presented at the annual meeting of the American Evaluation Association, San Diego , CA.

Roberts, L. (1997, July). Evaluating Teacher Profession Development: Local Assessment Moderation and the Challenge of Multisite Evaluation. Paper presented at the sixth National Evaluation Institute, Indianapolis, IN.

Roberts, L. (1997, March). Using Maps to Produce Meaningful Evaluation Measures: Evaluating Middle School Science Teacher Change in Assessment, Collegial and Instruction Practices. Paper presented at the ninth International Objective Measurement Workshop, Chicago, IL.

Sloane, K. (1997, July). Innovative approach to program evaluation in science education. Paper presented at the sixth National Evaluation Institute, Indianapolis, IN.

Wilson, M. & Draney, K. (1997, March). Developing maps for student progress in the SEPUP assessment system. Paper presented at the ninth International Objective Measurement Workshop, Chicago, IL.

Wilson, M. & Draney, K. (1997, February). Mapping student progress in science with embedded assessments. Paper presented at the annual conference of the American Association for the Advancement of Science, Seattle.

Wilson, M. (1997, January). Assessment and evaluation together in the service of instruction and learning. National Science Foundation Status of Middle School Science Conference. Washington, DC.

Adams, R. & Wilson, M. (1996, April). Multilevel modeling of complex item responses in multiple dimensions: Why bother? Paper presented at the annual meeting of the American Educational Research Association. New York, NY.

Roberts, L., Sloane, K., & Wilson, M. (1996, April). Local Assessment Moderation in SEPUP. Paper presented at the annual meeting of the American Educational Research Association, New York, NY.

Sloane, K., Wilson, M., & Samson, S. (1996, April). Designing an embedded assessment system: From principles to practice. Paper presented at the annual meeting of the American Educational Research Association, New York, NY.

Wilson, M. & Case, H. (1996, June). An investigation of the feasibility and potential effects of rater feedback on rater errors. Paper presented at the Council of Chief State School Officers National Conference. Phoenix, AZ.

Wilson, M. & Draney, K. (1996, April). Mapping student progress with embedded assessments. Paper presented at the annual meeting of the American Educational Research Association, New York, NY.

Wilson, M., Hoskens, M., & Wang, W. (1996, April). Complex item responses: Rater effects and item dependency. Paper presented at the annual meeting of the American Educational Research Association. New York, NY.

Wilson, M. & Hoskens, M. (1996, April). Multidimensional item responses: Multimethod-multitrait perspectives. Paper presented at the annual meeting of the American Educational Research Association. New York, NY.

Wilson, M., Thier, H., Sloane, K., & Nagle, B. (1996, April). What have we learned from developing an embedded assessment system? Paper presented at the annual meeting of the American Educational Research Association, New York , NY

Roberts, L. & Henke, R. (1995, April). Evaluating the Science Education for Public Understanding Program: Combining Rasch Measurement and Hierarchical Linear Modeling. Paper presented at the annual meeting of the American Educational Research Association. San Francisco, CA.

Roberts, L. (1994, November). Evaluating the Science Education for Public Understanding Program: A hierarchical analysis of middle school science students' attitudes about the personal and social relevance of science. Paper presented at the annual meeting of the American Evaluation Association. Boston, MA.

Wilson, M. (1994, April). Multimode assessment involving raters. Paper presented at the annual meeting of the American Educational Research Association. Atlanta, GA.

Wilson, M. (1994, April). What technical issues might be major concerns in implementing new assessments and new technologies. Invited participant in a colloquium on “Assessment in the 21st century: Issues, technologies, and challenges”. National Council for Measurement in Education annual meeting. New Orleans, LA.

Wang, W. & Wilson, M. (1993, March). Comparing multiple-choice and performance-based items. Paper presented at the California Learning Assessment System Technical Advisory Committee meeting. San Francisco, CA. Also presented at the Seventh International Objective Measurement Workshop, Emory University, Atlanta, GA (1993, April).

Wilson, M. (1993, April). Invited participant in a colloquium on “The technical requirements of high stakes performance assessments: Answers to your questions”. National Council for Measurement in Education annual meeting, Atlanta, GA.

Wilson, M. & Adams, R. (1992, June). Evaluating progress with alternative assessments: A model for Chapter 1. Invited address to the conference on Curriculum and Assessment Reform. Boulder, CO.
 
 

Professional Presentations
Author Contact Names and Addresses

Draney, Karen
Graduate School of Education
University of California, Berkeley
3659 Tolman Hall #1670
Berkeley, CA 94720-1670
510-642-7968
kdraney@berkeley.edu 

Wang, Wen-Chung
National Chung-Cheng University
Department of Psychology
Chan-Hsing
Min-Hsiung, CHIA-YI
886-5-2720411 extension 6430
psywcw@ccunix.ccu.edu.tw

Hoskens, Machteld
CTB/McGraw-Hill

20 Ryan Ranch Rd

Monterey CA 93940

phone: (831) 393 6704

mmachteld_hoskens@ctb.com

Wilson, Mark
BEAR Center
Graduate School of Education
University of California, Berkeley
3659 Tolman Hall #1670
Berkeley, CA 94720-1670
bearcntr@berkeley.edu


Top of Page