Increasing accountability through district school report cards: India’s National Achievement Survey

The NAS in itself is not new – it has been conducted with different grades every 3 years since 2002 – but  2017-18 marks the first time in which the survey has been undertaken with four different grades in one academic year: a huge undertaking, and one with the potential to generate a large amount of invaluable data on the educational attainment of students throughout primary and lower secondary school in India. 

Data for educational policy-making: district, state and national level

It’s not just the collection of data from multiple grades simultaneously – NAS 2017 is also the first time this national survey has collected attainment data that is representative at the district level, with data collected across 700 districts in India. With this data, NCERT aims for the NAS to be more than a benchmarking exercise – the intention being to ‘help the districts to develop evidenced-based programmes for improving the quality of education’.

To this end, district-level data is being shared with policymakers and educational stakeholders in the form of District Report Cards, available online. For Grades 3, 5 and 8, these report performance on a set of learning outcomes for each subject, highlighting those learning outcomes where performance is lowest (see Figure 1). This focus on learning outcomes is important, moving the NAS towards a focus on children’s understanding of the subjects being taught, rather than rote learning or memorisation. The diagnostic benefit of this for those working in education in the district is clear: at a glance, they can clearly see those areas which need more work – in the example below, these would appear to be topics relating to geometry.

Figure 1: Example of learning outcomes highlighted for poor performance in one district. (Source: Grade 8 Mathematics District Report Card, Anantapur, Andhra Pradesh. NCERT, 2018)

It’s not just at the district level: NAS findings have also been made available at state level, and a national level report looking across all states to understand what children know and can do is also due to be produced from the 2017 findings.

The bigger picture: NAS, the SDGs and accountability issues

An educational survey like this on such a large scale is clearly a huge undertaking, requiring a massive amount of effort and expenditure on sampling, design of tests and questionnaires, training of fieldworkers and so on. So why do it?

Within Sustainable Development Goal (SDG) 4, being able to track ‘effective and relevant learning’ is important for all countries. It’s no longer enough to monitor the number of children enrolled in school, or the exam pass rate (information that India also collects through the U-DISE system). In order to track progress towards the provision of ‘quality education for all’, governments need a means of identifying whether children are learning the skills, knowledge and competencies which they need. In this context, NAS offers the potential for increased accountability, a chance for ‘interpreting evidence, identifying problems and working out how to solve them’ throughout the education system. Such accountability is particularly important in a context such as India, where there is substantial research to show that learning levels are worrying low for many; further steps such as the public release of NAS data would enhance it, even more, giving opportunity for a wider and more open dialogue about the quality of education across India.

Unlike many countries, India does not have just one large-scale educational survey: the ASER studies which take place each year across rural India are well known; as are large-scale assessments by organisations such as Educational Initiatives. While these differ from NAS in their aims, methodologies and samples, they offer the potential for a comprehensive ‘health check’ of learning levels from different angles, and for discussion of their various strengths and weaknesses. After all, the collection of large-scale educational attainment data is really just the first step. It is what is done with data that really provides the opportunity to improve the quality and effectiveness of education – and with so-called ‘universal’ answers proving hard to find, analysing, discussing and really understanding what these large-scale surveys have to tell us seems likely to turn out to be a long and complex process in itself.

This blog first appeared on IIEP’s Learning Portal.