Assessment of Research

            Chapter twelve is about research assessment which is critical to ensure the well being of business education, its practitioners, and their constituencies.  It is the quality control process that should determine which curricular and teaching practices are sound and subsequently implemented by business education professionals for the benefit of others.  In this chapter, understanding research, assessing business education research, and implementing business education research findings is discussed.

            Research serves as the foundation of the business education profession by offering information and guidance about many topics.  It is the foundation of a viable, thriving professional community.  It also develops the knowledge base, enhances teaching, facilitates real-world application, and strengthens the discipline and the researcher’s perceived image.  Research assessment seeks reliable and valid meanings and is the critical evaluation of the strengths and weaknesses of research.  Scientifically-based research is evidence-based practice.  It is the application of rigorous, systematic, and objective procedures to obtain reliable and valid knowledge relevant to education activities and programs.  It is required for all federally funded programs under the No Child Left Behind Act.  It also seeks to improve education and to develop a knowledge base about what actually works.

            There are many business education resources that educators are able to use.  The Business Education Index is an invaluable research tool when following research about a topic over a number of years.  There are also many databases that can be used to retrieve relevant literature.  Another type of literature is fugitive literature which is challenging to secure.  Many of the periodicals are not indexed in print or electronic form and can be found only if one personally knows about them and where they can be located.

            Business educators should assess business education research by understanding research assessment procedures commonality for all types of business educators, evaluating research outlets, understanding the research cycle, and evaluating research study components.  After the research is done, business education research findings should be implemented at various instructional levels.  Research findings enhance the quality of the instruction that they deliver to diverse audiences at various instructional levels.

Scott, J. C. & Blaszczynski, C. (2007). Assessment of Research. In M.L. Bush (Ed.), Assessment for an Evolving Business Education Curriculum (pp. 159-171). Reston, VA: National Business Education Association

Feedback for Professional Development

           Chapter eleven is about feedback for professional development.  It focuses on the need for professional development, the use of assessment to determine appropriate professional development, the assessment of professional development, and the methods of providing professional development.  Feedback for professional development has become a critical issue for administrators and teachers.  Expectations from multiple levels have increased for student achievement outcomes and more complex assessment techniques are required.

            Professional development is the process that improves the job-related knowledge, skills, and attitudes of business educators.  The goals of professional development are to advance students’ learning and to improve the practice of teaching.  Teachers must also stay current with changing technology, which require modification in assessment techniques.  Professional development activities are an excellent way to maintain current knowledge.  When teachers partake in professional development activities, they improve learning and teaching skills amid changes in delivery, subject-matter content, student needs, schools, society, and the workplace.

            Assessment can be used to determine appropriate professional development for a group of teachers.  Assessment-centered professional development focuses on assessment, curriculum, teaching, and learning.  It offers a range of activities that encompasses the teaching and learning process.  It includes establishing goals for student learning, developing assessment instruments and rubrics, implementing the assessment plan, assessing student performance, and evaluating the assessment process.  Educators must also verify the effectiveness of their program.  Individual courses, curricula, and entire programs must be examined frequently to ensure that students at each level are capable of progressing to the next phase.  National Standards, the Major Field Test, and the PRAXIS Series of examinations provide appropriate verification measures.

            Teachers must also be assessed of their own professional development.  Even though many teachers do not like being assessed of their own performance, administrators must ensure them that it is for their own good.  Administrators must show teachers how appropriate assessment can benefit them personally and then they must provide teachers with meaningful professional development opportunities.

            Professional development strategies can be many different forms.  These forms include reflection and inquiry, formal instruction, professional organizations, and mentoring and peer collaboration.  Each of these is very important for both teachers and students.  I know that when I am a teacher I will partake in many of these professional development forms.  When I was younger, I remember my mother going to workshops during the summer and learning new concepts and ideas for the classroom.  She is still going to workshops and teaching me new things.  She is also very active in professional organizations and learns so much when she goes to conferences.  I know that both of these professional development activities will greatly benefit me in the future.

Balachandran, M. E., Blair, R. B., & Lewis, S. (2007). Feedback for Professional Development. In M.L. Bush (Ed.), Assessment for an Evolving Business Education Curriculum (pp. 146-158). Reston, VA: National Business Education Association

Proof of Student Achievement

           Chapter ten discusses the types of assessment data, assessments related to course content and standards-based assessment as sources to verify student achievement, guides for the use of assessment data as proof of student achievement and ways to recognize and celebrate student accomplishments.

            Assessment data are used to validate course content, student knowledge and skills, and other expected learning outcomes.  Assessment objectives must be matched to curriculum and course objectives and the objectives are used as guides for various assessment tools developed and used by classroom teachers.  Performance standards must be translated into assessment and reporting methods that students, teachers, and other stakeholder understand and interpret appropriately to measure student performance meaningfully.  Rubrics can be used to describe and scale the levels of student achievement on tasks.  There are three types of rubrics which include task-specific rubric, developmental rubric, and relative rubric.  The most common type of assessment is teacher-made assessments.  These assessments are used to determine grades, group students, diagnose student strengths and weaknesses, motivate students to learn more, plan instructional content and pedagogy, communicate expectations to students, and evaluate instruction.

            The results of assessment should be considered as information, not just data.  Student achievement can be reported in different forms which can be pretest/posttest, on-demand, and over-time assessments.  Pretests can be given to see what the students might know about the subject before it is taught.  Posttests are given after the subject material is taught to see if the students learned and understand the material.  On-demand assessments can be formative or summative and is given over a short period of time, like a quiz.  Over-time assessment is a summary of student achievement and performance, like a final grade.

            Assessments are very important for teachers and students.  They measure student achievement or failure.  Assessments let the teacher know if they are being effective in the classroom and if they need to change how they are teaching the material.  There must be evidence that students are achieving in the classroom and that curriculum standards are being met.  Stakeholders, who include students, parents, administrators, general public, and local, state, and federal education agencies, must also know how students and teachers are doing in the classroom.  If students are achieving, they should also be rewarded for their accomplishments.  Teachers should acknowledge these outstanding students because it will only boost their confidence.  Also, if students who are not doing so well are see the benefits of being a good student, and then maybe they will try to improve also.  Assessments are critical in education.  It is important that teachers take them seriously and for students to understand how significant they are.

Brown, B. J. & Mundrak, G. A. (2007). Proof of Student Achievement. In M.L. Bush (Ed.), Assessment for an Evolving Business Education Curriculum (pp. 130-145). Reston, VA: National Business Education Association

Data-Driven Instruction

            Chapter nine is about the analysis of data that drives instructional decisions.  Chapter nine defines sources of data and identifies how to analyze the data to make curricular decisions.  Collecting, analyzing, and understanding how to use data effectively is a continuing process that is discussed.  This chapter discusses sources of data, analyzing data, and how to use data effectively.

            There are four sets of data which include student learning data, demographic data, program data, and perception data, that is examined to create a clear picture of what schools must do to meet the needs of all their students.  Before implementing any process for collecting and analyzing the data, teachers and administrators must understand what each of these four sources involves.  Student learning data can be derived from standardized tests, criterion-referenced tests, teacher observations of student abilities, and authentic assessments.  Standardized testing is able to provide assessments that are psychometrically valid and reliable.  Criterion-referenced tests are intended to measure how well a person has learned a specific body of knowledge and skills.  Teacher observation of students’ abilities is making note of how students are responding to the material being taught.  Authentic assessment incorporates real-world situations.

            Demographic data includes enrollment, attendance, ethnicity, and gender figures, grade levels, dropout rates, and socio-economic information.  The main reason for collecting this type of data is to have a clearer picture of a district’s students.  It is to understand who the students are, what trends are seen in the student population, and what factors outside of school may assist administrators and teacher to better understand students.

            Program data are a description of school programs, instructional and assessment strategies, and practices in the classroom.  It is seen as action research, which involves gathering data that will enlighten future decision making about programs and curricula.  Perception data consists of individual views, beliefs, and values about systems in the workplace and in academic settings.  Perception data can be collected through questionnaires, interviews, and observations.  Through this data, educators can recognize and respond to the opinions and ideas of the wider school community.

            Once all types of data have been collected, it can then be analyzed.  Analyzing data can be used to help improve and facilitate student learning.  Also, once data has been analyzed, educators will be able to use the information to place students in appropriate courses, to monitor quality of instruction for student learning, and to develop working relationships within the community in order to enhance the business program.

            Data is very beneficial in the school system.  The different types of data are used regularly and educators learn about their students and their own teaching styles.  Data can be used for many different reasons and it is important that educators take advantage of the benefits of data.

White, Raholanda. (2007). Data-Driven Instruction. In M.L. Bush (Ed.), Assessment for an Evolving Business Education Curriculum (pp. 117-129). Reston, VA: National Business Education Association

Online Learning and Assessment Solutions

           Chapter eight discusses online learning and assessment solutions.  It emphasizes the emerging role of assessment in the delivery of instruction from remote locations.  It discusses distance learning assessment issues, online assessment tools, aspects of security and authentication of test takers, alternative online assessment strategies, and evaluation of online student participation.

            There are many issues with distance learning assessment.  The book thoroughly discusses four of them.  Conducting a formal assessment transparently is a tricky arrangement in the traditional classroom.  An online assessment’s format can more closely match the subject matter to the students’ learning preferences.  Online assessment can be delivered as text, audio, graphics, or video, which means the instructor can design the most appropriate assessment that matches the online course media.  The last issue is authentic authorship in an online assessment is critical.

            There are online assessment tools that are used in online courses.  Stand-alone assessment software can be used which serves three purposes.  They reduce the time and cost in developing and maintaining web-based assessment tools; the exist for institutions that want to augment traditional on-campus courses or in-house training programs; and an assessment package can be added to distance learning courses that primarily function through e-mail discussion complemented by news groups or mailing lists.  There is also text-analysis software which analyzes and grades student writing based on text-recognition.  Teachers should evaluate online assessment software across eight dimensions which are versatility, adaptability, scope, responsiveness, flexibility, security, availability, and suitability.

            There are many security and authentication of test takers in online courses.  Verifying online authorship can be used which can use fingerprint recognition, voice authentication, online signature systems, and biometric system applications.  There are also issues of plagiarism and cheating.  There are many resources that can be used to check the authenticity of essays and previous essays.  I have had many teachers use programs to make sure we were not copying previous papers.

            There are also alternative online assessment strategies.  These include scratch-test, test-correction tactic, bid tests, and vignettes, and web-based portfolios.  I have actually used some of these various types of assessment strategies in previous online courses.  Personally, I like to have options when I am taking a test and I like when the teacher changes up the assessment format.

            I feel as if this chapter is more for college level educators.  I am not sure if many high school teachers really use online courses.  I know that if I ever teach an online course I will know what type of programs and forms of assessment to use.

Maeder, Dale, W. (2007). Online Learning and Assessment Solutions. In M.L. Bush (Ed.), Assessment for an Evolving Business Education Curriculum (pp. 102-116). Reston, VA: National Business Education Association

Technology Tools and the Assessment Process

            Chapter seven is about technology tools and the assessment process.  Teachers are able to blend various technology tools within assessment activities and it allows the teacher to match a student’s learning style with the appropriate assessment tool, which ensures that the instructor will connect with the student to obtain desired results.  This chapter discusses the topic of student-centered assessment within the context of a technological environment.  A connection between technology and learning is established, then specific technology tools available for the classroom is discussed, and online assessment is addressed.

            Student-centered assessment helps educators focus on students’ becoming self-directed in learning plans and activities.  Self-directed learners are defined as a student who takes responsibility for his or her learning.  Student-centered model of learning encourages teachers to view their students as academic partners who work together to produce relevant and meaningful learning experiences.  Technology provides educators with tools to develop alternative and individualized informal and formal assessments which provide feedback for students and educators.  Teachers have to understand though that technology must be used with a purpose.  There must be a connection between technology use and learning.

            Classrooms have changed throughout the years.  Now there are computers, projections screens, new software, and other technological devices.  Classrooms now have Smartboards which is a large screen that acts as a touch-sensitive computer monitor.  I had never used a Smartboard until my internship and they are very useful.  There are so many ways Smartboards are used and the students really enjoy using them also.  Some schools also use a laptop cart, which can change any classroom into a computer lab.  Another type of classroom is the hybrid classroom which is a face-to-face classroom that blends online tools into class content and assessment.

            Informal assessment is a way of measuring student learning and is very important.  It allows educators to make adjustments during the course.  Smartboards, student response systems, Breeze Presenter, simulations, reinforcement software, drill and practice software which is tutorials and games can be used.  I have only a couple of these assessment tools and they are great.  The students enjoy using a variety also.

            Formal assessment tools include web-based tools, course management tools, and online conferencing tools.  There are exam generators, application software, screen capture software, and online conferencing tools.  The only experience I have with this type is from the online courses in this program.

            The different tools and assessment processes discussed in this chapter are very helpful.  I know that I will be able to use many of them and I am looking forward to the feedback of my students to let me know if they gain anything out of the class.

Wilkinson, Kelly, L. (2007). Technology Tools and the Assessment Process. In M.L. Bush (Ed.), Assessment for an Evolving Business Education Curriculum (pp. 88-101). Reston, VA: National Business Education Association

Selecting Appropriate Assessment Methods

            Chapter six is about selecting the appropriate assessment methods needed to achieve three goals.  These three goals include:  to determine whether his or her instruction is successfully conveying material to the class in general; to assess the knowledge level of each individual student; and to formulate a plan to enhance student learning.  Enhancing student achievement through assessment, then the main categories of assessment is reviewed, and descriptions of various assessment tools are provided.

            Bloom’s Taxonomy is long trusted as the analytical framework for knowledge acquisition.  It can be characterized as a scheme to classify educational goals, objectives, and most recently, standards.  The original version categories included knowledge, comprehension; application, analysis, synthesis, and evaluation.  The revised version categories are remembering, understanding, applying, analyzing, evaluating, and creating.  When educators understand the principles of the taxonomy enables them to classify what exactly is being assessed.  The other model used is the Dynamic Instructional Design (DID) model.  It follows a six-step process for designing instruction that includes formative and summative feedback questions at each step.

            The next section discussed is about connecting theory to practice.  Authentic assessment is first mentioned.  Authentic assessment usually means presenting students with tasks that are directly meaningful to their education instead of indirectly meaningful.  One of the most important practices to emerge from authentic assessment are rubrics which are scaled descriptors of performance through which teachers could describe students’ level of mastery.  Alternative assessment is discussed next which refers to any type of assessment that does not include the classic objective formats of multiple-choice, true/false, fill-in-the-blank, and matching, continuing all the way to standardized achievement tests.  They provide formative and summative data for teachers and students.

            There are many assessment options teachers are able to use.  These include quick-check assessment vehicles which are three-minute writes, muddiest point, know-want-learn, think-pair-share; checklists, role plays, rubrics, portfolios, and written evaluations which include learning logs, journals, and reflections.

            This chapter is very informative about assessments which will help me in the classroom.  I know that I will be able to use the many assessment options mentioned in this chapter.  I have already used some of them when I was interning and they really do work.

Williams, S. R., Wattam, D. K., & Evans, R. D. (2007). Selecting Appropriate Assessment Methods. In M.L. Bush (Ed.), Assessment for an Evolving Business Education Curriculum (pp. 74-87). Reston, VA: National Business Education Association