Skip to main content

Ofqual report: changes to A-level marking and grading

http://ofqual.gov.uk/news/improvements-made-level-foreign-languages/

Scroll down for links to a summary and the technical report carried out by Ofqual.

Ofqual have been looking into grading for A-level modern languages, partly in response to concern expressed by subject associations and teachers about the apparent lack of A* grades compared to other subjects. In essence, although MFL gets a reasonable share of A*/A grades (although still tougher than most subjects), of these only a relatively small percentage are A* grades.

As a teacher I was certainly aware of this issue and it is one factor behind the reluctance of students to take up MFL at A-level. When one also bears in mind that a small percentage of candidates are native speakers with, in many cases, a great advantage over their peers, getting an A* has been really tough in MFL.

So what did Ofqual find? Well, firstly they have to be commended for carrying out a very detailed technical report which gets right into the nitty gritty of question setting and mark schemes. Teachers would not believe how complex and technical this whole area is. I got a first insight into this at a recent AQA training meeting. Each exam board was looked at by Ofqual, exam papers, markschemes, marking and awarding were analysed, and specific recommendations have been made for each board, as well general instructions given in relation to summer 2015 and the future.

One example picked up by Ofqual relates to the mark scheme for the AQA essays at AS and A2 level. AQA is the most popular board and teachers have often complained about inconsistent and strict marking of essays. How do you get a really high mark? The issue here is that the level based assessment scheme puts a cap on marks for range/complexity and accuracy, depending on the content of the essay. This means that very able candidates with exceptional language skills are not being rewarded as highly as they should be because the content mark limits their overall mark. Teachers have often grumbled about this, as well as the fact that it is not clear what students have to do to achieve a very high content mark in the first place. Are students better advised to make lots of points relatively superficially or develop a smaller number of points more fully?

I think the original justification for this "limiting by content" approach was that it would stop candidates producing ready-made and totally irrelevant essays. Firstly, I doubt this happens very much, and secondly you can still mark irrelevance down in the content box, whilst still rewarding high quality language.

Ofqual also picks up the fact that exam boards are not thorough enough in how they produce a range of questions of varying challenge. For example, one board is criticised for making the listening questions generally too easy, so that candidates who are very good at listening and weaker at writing are insufficiently rewarded for listening compared with other candidates. In other words, the assessment fails, to some extent, to reward skills equally, marks may become compressed in the middle and rank order of candidates is less reliable than it should be.

As I say these are quite technical issues which exam boards may have been insufficiently hot on in the past and which Ofqual are now picking up. One has to ask the question: why was this not got right back around 2000 when the new specifications and their mark schemes were established? One answer to this may be that Ofqual is now more professional than its equivalent was in 2000 and that perhaps research is teaching us more about the fine detail of producing exams which are both reliable and valid.

I have only touched the surface of the issues involved here (because I only understand some of them!). Ofqual have a good deal to say about oral assessment, generally finding it too generous and unable to distinguish the very good from the exceptional student. Suffice it to say, that exam boards have been instructed to make changes to mark schemes and question setting which will allow for a fairer rank order and potential access to the higher grades. Ofqual state explicitly that changes may lead to more A*s. Some key changes must be made for this year's exams (notably mark scheme changes which will allow for more A*s), others must be kept in mind for new exams to come.

Ofqual are at pains to stress that this should mean no changes in teaching, but no doubt teachers will be keen to share any new essay mark schemes with students as soon as possible.

Comments

Popular posts from this blog

What is the natural order hypothesis?

The natural order hypothesis states that all learners acquire the grammatical structures of a language in roughly the same order. This applies to both first and second language acquisition. This order is not dependent on the ease with which a particular language feature can be taught; in English, some features, such as third-person "-s" ("he runs") are easy to teach in a classroom setting, but are not typically fully acquired until the later stages of language acquisition. The hypothesis was based on morpheme studies by Heidi Dulay and Marina Burt, which found that certain morphemes were predictably learned before others during the course of second language acquisition. The hypothesis was picked up by Stephen Krashen who incorporated it in his very well known input model of second language learning. Furthermore, according to the natural order hypothesis, the order of acquisition remains the same regardless of the teacher's explicit instruction; in other words,

What is skill acquisition theory?

For this post, I am drawing on a section from the excellent book by Rod Ellis and Natsuko Shintani called Exploring Language Pedagogy through Second Language Acquisition Research (Routledge, 2014). Skill acquisition is one of several competing theories of how we learn new languages. It’s a theory based on the idea that skilled behaviour in any area can become routinised and even automatic under certain conditions through repeated pairing of stimuli and responses. When put like that, it looks a bit like the behaviourist view of stimulus-response learning which went out of fashion from the late 1950s. Skill acquisition draws on John Anderson’s ACT theory, which he called a cognitivist stimulus-response theory. ACT stands for Adaptive Control of Thought.  ACT theory distinguishes declarative knowledge (knowledge of facts and concepts, such as the fact that adjectives agree) from procedural knowledge (knowing how to do things in certain situations, such as understand and speak a language).

La retraite à 60 ans

Suite à mon post récent sur les acquis sociaux..... L'âge légal de la retraite est une chose. Je voudrais bien savoir à quel âge les gens prennent leur retraite en pratique - l'âge réel de la retraite, si vous voulez. J'ai entendu prétendre qu'il y a peu de différence à cet égard entre la France et le Royaume-Uni. Manifestation à Marseille en 2008 pour le maintien de la retraite à 60 ans © AFP/Michel Gangne Six Français sur dix sont d’accord avec le PS qui défend la retraite à 60 ans (BVA) Cécile Quéguiner Plus de la moitié des Français jugent que le gouvernement a " tort de vouloir aller vite dans la réforme " et estiment que le PS a " raison de défendre l’âge légal de départ en retraite à 60 ans ". Résultat d’un sondage BVA/Absoluce pour Les Échos et France Info , paru ce matin. Une majorité de Français (58%) estiment que la position du Parti socialiste , qui défend le maintien de l’âge légal de départ à la retraite à 60 ans,