Well over a third of Britons lived in council homes at their peak in the early 1980s, and yet the subject of public housing is hardly to be found on bookshelves. There is some good academic writing, and there are some decent local histories – though traditional works are more likely to be taken by a surviving Georgian townhouse than a neo-Georgian council estate – but you’ll struggle to find anything in the mainstream. And in literary fiction, authentic interest in or real knowledge of the lives of the millions who have lived in council homes over the years is almost nonexistent. Journalism has filled the gap – once celebratory, but latterly often demonising and sensationalist as one-time municipal dreams were designated nightmares.

Awareness has only revived more recently, as the renewed failure of the free market to provide the decent, affordable homes we need has become more stark, and – more darkly – in the aftermath of the Grenfell fire.

Council housing represented a step up for millions, a social revolution arguably more important than other more celebrated aspects of what we once proudly called our welfare state. It’s time to tell the story of council housing again – to recall its ambition, idealism and achievements, to defend its legacy, and to understand what (sometimes) went wrong in a more informed, less caricatured way. The books I’ve selected offer a variety of approaches to help recast the narrative.

1. Homes and Places: A History of Nottingham’s Council Houses by Chris Matthews
Of local histories, this is undoubtedly the pick of the crop. Written by a historian, it gives a comprehensive and critical account of a wider council housing story – from low-rise to high-rise and back again. Matthews doesn’t shy away from the missteps and controversies but concludes that council housing, in Nottingham and elsewhere, provided the “biggest collective leap in living standards in British history”. Beautifully illustrated and well worth a read.

2. Council Housing and Culture: The History of a Social Experiment by Alison Ravetz
Although it reads like an epitaph, Ravetz’s book provides what comes closest to a comprehensive academic account of council housing history. She’s competent on origins and evolution, good on design and community, and critically insightful on management. But it’s unmistakably a product of the early 2000s. As with far more hostile commentators, too much weight is given to the charge of utopianism, both as a driver of council housing’s growth and as an explanation of its decline. With hindsight, the travails of public housing warrant a broader understanding and its practical ideals seem as relevant as ever.

3. NW by Zadie Smith
Smith grew up on a Willesden council estate, and NW depicts the lives of four others, now in their thirties, shaped – in very different ways – by their formative years on the fictional Caldwell estate: “five blocks connected by walkways and bridges and staircases, and lifts that were to be avoided almost as soon as they were built”.With its broad range of characters and forms, NW captures something important and authentic about the divergent realities of working-class life in London. It’s the only work of fiction I feel able to recommend here.

4. Tower Block: Modern Public Housing in England, Scotland, Wales and Northern Ireland (PDF) by Miles Glendinning and Stefan Muthesius
Even at its peak in the 1960s, housing of six storeys or more made up only a fifth of new schemes. But many consider the tower block to epitomise modern council housing and all that went wrong. Given its salience in public discourse, high-rise housing needs its chroniclers and it has found them in this magisterial book. This encyclopaedic description of the tower block’s brief boom and investigation of its causes – technical, political and ideological – runs to more than 400 pages, enough breadth to move beyond the crude caricatures and condemnation of most writing on the subject. It’s also available to download as a PDF.

5. Garden Suburbs of Tomorrow? A New Future for the Cottage Estates by Martin Crookston
While tower blocks loom large, so-called cottage estates – “corporation suburbia”, in the author’s phrase – have been received little attention, despite making up around one-sixth of England’s homes and 40% of the country’s remaining socially owned housing. Crookston provides a useful history and typology of these estates, but he is most concerned with their future. Some – the more sprawling, isolated and economically depressed – have their problems; often, ironically, the kind of problems held to characterise high-rise estates by reason of their design. Crookston’s thoughtful, empathetic study of these estates suggests how residents and councils might together renew the promise they once held.

6. Cook’s Camden: The Making of Modern Housing by Mark Swenarton
And then, in what has seemed council housing’s glorious swansong, came Camden. Sydney Cook, who was the borough’s architect from 1965 to 1973, rejected both high-rise and suburbia. His urban solution was low-rise, high-density housing, and the result was not some pale compromise but, in Swenarton’s words, “an architectural resolution unsurpassed not just in social housing in the UK but in urban housing anywhere in the world”. If you know Camden, that won’t seem like hype. Superbly researched, beautifully produced, copiously illustrated, this is a book that does justice to its subject.

7. People of Providence: A Housing Estate and Some of Its Inhabitants by Tony Parker
Parker spent five years interviewing residents of Providence (actually the Brandon Estate in Southwark) – it’s a postwar estate of tower blocks, medium-rise slab blocks and low-rise maisonettes and houses. A showpiece in its day but in many ways typical of its time. What did he find? Community, isolation, contentment and disillusion – all of human life in other words, in the faithfully transcribed words of its people. Asked to summarise the estate, they concluded it was “mixed”. Parker’s comprehensive record endorses that view. If it gets us beyond generalisation and stereotype, that simple judgment might speak to council housing more widely.

8. Estates by Lynsey Hanley
Hanley grew up on the late-60s Chelmsley Wood estate, east of Birmingham, and she’s delighted to have escaped it. This is a powerful account of all that could go wrong with such out-of-town estates, sensitively integrated with a survey of the impulses and dynamics behind council housing’s wider story. She’s strong on the internalised barriers of social exclusion – the “walls in the head” – that limit life chances on such estates, as well as the external prejudices that help form them (though her writing may inadvertently do little to challenge the latter). It’s an important, critical perspective and a passionate demand for the social housing we deserve.

9. Getting By: Estates, Class and Culture in Austerity Britain by Lisa McKenzie
A working-class academic who calls herself “a council estate girl”, Lisa McKenzie is uniquely qualified to tell the story of St Ann’s in Nottingham, where she lived as a young single mother for 20 years. She combines her insider status and academic perspective to create a rich sociological analysis of community, network, family and “belonging”. Above all, it’s a book which challenges the stigmatisation of those living in so-called sink estates. “Getting by” signifies not merely survival but also a community’s resilience and resourcefulness in the face of prejudice and a cruelly marginalising politics.

10. Mackworth Estate Jubilee: A Social History compiled by Mackworth Townswomen’s Guild
The ladies of Derby’s Mackworth Townswomen’s Guild who compiled this history – if any survive after nearly 40 years – might be surprised to feature in the Guardian, but this book is exemplary of its type. This is an alternative history of the 1950s estate’s new houses and modern through-lounges, its shops and schools, and a social life seemingly focused on church hall groups for the women and pubs for the men. It’s gentle and affectionate, alive to deficiencies but quietly celebratory of a “pleasant estate” few wished to leave.

• Municipal Dreams: The Rise and Fall of Council Housing by John Boughton is published by Verso. To order a copy for £16.14 (RRP £18.99) go to guardianbookshop.com or call 0330 333 6846.