14.2.2
Analytic marking

In this approach, the sub-components of writing are analyzed and included as categories to be marked separately - eg Content, Structure, Accuracy, Range of Language (see Appendix 1 for an example). Sometimes the sub-skills are equally weighted, sometimes they are differentially weighted (see Appendix 3).

The advantages of the analytic approach are:

  • the assessment scheme is a direct reflection of the teacher's understanding of the writing process;
  • it allows students to see clearly what they are to be assessed on and what marks will be allocated to each sub-skill;
  • in theory, such an approach, focusing attention on different sub- categories and their criteria, will produce a more accurate and a fairer assessment of a student's overall performance on the task;
  • it provides the student with more effective feedback on the different aspects of the task;
  • it can produce positive washback on teaching and learning.

The disadvantages of analytic marking are:

  • introducing several sets of criteria can make it more difficult to attain marker reliability, ie there are more descriptors to disagree about;
  • marking can take a lot of time if one has to assess a candidate under maybe five different headings;
  • in averaging marks awarded for different categories, the range of final marks awarded tends to be narrower than when impression marking is used;
  • criteria can only be written with the typical student in mind, but few students are typical;
  • criteria take a lot of time to devise and need to be revised in the light of experience;
  • it can sometimes be difficult to judge each of the categories independently of the others; a 'halo effect' can quickly develop when you are marking an able candidate, and the opposite can happen with a weak candidate.

During the interviews on assessment conducted for Module 13 a student made the following comment on the use of marking criteria in his university:

I don't think one half of our department really knows what the other half is doing. Different lecturers seem to have different ideas about marking, and although there is a grid for language work in the departmental handbook, when we do essays or an oral presentation, some don't seem to use the grid, while others seem to be using different sorts of grids.

Although it may not be practicable to devise different detailed criteria for every single language task, departments should have agreed criteria for the range of assessment tasks they most commonly employ. Typically, this might include oral presentations, oral interviews, FL essays, summaries and translations. Moreover, these criteria must be specific to language performance and should not be confused with general criteria for work in other areas of the curriculum, such as 'intellectual rigour', 'critical thinking', 'powers of analysis'.

Students should certainly be given copies of marking criteria in advance of doing the assessments, but it is just as important that they see all their tutors actually using them and doing so consistently. Furthermore, feedback ought to refer closely to them. You may like to consider whether students should be given exactly the same criteria as those used by tutors, since departmental criteria often feature needless metalanguage.

Activity 6

Have a look at Appendices 1, 2 and 3 and compare them with each other. Are there any problems here with metalanguage? Which, if any, would you prefer to give to your students?

Despite the importance of criteria, students need to realize that although criteria are there to provide a measure of objective guidance, a lot of assessment of FL writing remains subjective, and fine-grade decisions are a matter for academic judgement.

Activity 7

Imagine you have just arrived at a university in France to teach English as a foreign language. As one of your first tasks you are asked to mark a set of essays, such as the one below.

I have to say I am very ashamed be French at this moment here. This is because we have had a very poor election result and the representative of an far-right extreme political party, mister Jean-Marie Le Pen has won through to the second round of the presidential election race. I can not explain to myself why this has happened. Probably the reason for this shameful thing that shows France in a bad light to the international community is that the voters in France at this time here are not interested in politics. Also however the President mister Chirac has to be blamed because a lot of people think he is corrupt and has not used the office of President properly. It think it is a very bad thing that the socialist party has done so badly and I am angry that it's supporters have not gone out to vote (maybe in protest) and as result the extremists have been permitted to gain such a big 'victory'. I can hope and pray that in the next and final ballot the French people will realize the danger of the far-right extremists and will exit to vote in large number to stop Le Pen, even though the majority will not be supporters of Chirac. However there has been a lot of damage to France and its images abroad. It will take a long time to put this to right.

What would be your initial reaction to this request? What would you want to know? Why? After you have given this some thought, click on 'Commentary'.

Activity 8
Again you are going to be put in the position of a marker. This time you are going to be given a bit more information to help you. First, read this job advert.

Is this you?

Sociable and outgoing? A native speaker of French, German, Italian or Spanish? Keen to spend the summer in one of Europe's leading cities of culture? Looking to gain work experience in the tourist industry?

If so, then read on…

The Scottish Tourist Board is looking for four student reps to organize and accompany visits to Glasgow and Edinburgh by groups of school pupils from mainland Europe during the period July to September.
Please apply by letter with accompanying CV to the address below, mentioning relevant experience and stating your reasons for wanting the job.

The Scottish Tourist Board
Coldstream House
Mews Walk
Edinburgh
E2 5PQ

Imagine you have to mark the two letters below written by overseas students in response to the advert. Write appropriate analytic marking criteria for this exercise, bearing in mind the demands of the task and assuming the students are the equivalent of first-year post-A level students of modern foreign languages in the second week of their course. You might like to use the criteria in Appendix 1 as a starting point and adapt them to this particular task. What are the relative strengths and weaknesses of the two letters? And which scores higher on your criteria?

Letter 1

Dear Sir/Madam,

I write about your advertisement in Guardian newspaper to find student rep for the summer works.

I am all those things you write about and in particular am get on well with all people I know. I work in supermarket on evenings after my study. I French and Spanish speak very good and little Portuguese. I have last summer worked hardly in tourist office in Barcelona and so having had expereince of such work.

I apply for this job becaus I love your country a lot since I went on holiday there with my family and because I want in the future to do work in tourist industry and this will give me abundant expereince. Also I like work with young people in all ages and size and I think I will make up a good group leader for young groups.

I send with this letter my CV. I hope you like my application and I look forward to hearing your reply.

Yours faithfully,

Letter 2

Dear Scottish Tourist Board

I would very much like to work for you as a holiday rep for groups of overseas students on visits to Scotland. I saw your ad in the paper on 14th April. I am sure my knowledge of German and French (fluent) as well as my conversational Dutch would be extremely helpful to you. I am very easy going and manage to get on with most peoples. Although I have never worked in Scotland and I understand the accent can take a little getting used to, I am sure I shall be fine. Look forward to hearing from you soon,

Best wishes,

 

Click on 'Commentary' for feedback on this task.

 


previous button
next button

contents button