This is a story about America, an America that, even today, exists largely beyond the serious attention of mainstream politics and news media. Rather, these institutions ignore or marginalize the story's deeper significance, at a great cost to the country. In other words, the story is not about the usual things that are said to have caused the crisis in American democracy: policy gridlock, electoral fraud, political corruption, even insurrection. Nor is it about the competition between the ideologies of capitalism and socialism, nor the various threats to democracy, such as autocracy, plutocracy and kleptocracy.
The story offers a different perspective on politics, based on different evidence, from that offered by most political analysis. It draws on people's profound disquiet about life in America, and on the existential challenges America faces, both physical and social. This condition is also true, to differing degrees, of other liberal democracies and beyond.
In 2013 I collaborated in a survey that investigated the perceived probability of future threats to humanity in four Western nations: the U.S., U.K., Canada and Australia. Across the four countries, over half (54%) of all people rated the risk of "our way of life ending" within the next 100 years at 50% or greater, and almost three-quarters (73%) rated the risk at 30% or greater. Almost a quarter (24%) rated the risk of "humans being wiped out" in this time at 50% or greater.
The U.S. stood out from the other three countries in several respects. It had the highest percentage (30%) who thought humans might be wiped out (this ranged from 19% to 24% in the other countries). It had a much higher level of agreement with fundamentalist responses to global threats, with 47% agreeing or strongly agreeing that "we are facing a final conflict between good and evil in the world" and 46% agreeing that "we need to return to traditional religious teachings and values to solve global problems and challenges." (These results presumably reflect the strength of religion in the U.S., especially "end times" thinking among evangelical Christians.) In the other three countries only 30% to 33% agreed with these two statements.
The survey also included questions about how concerned people were about a range of personal and societal issues. The U.S. stood out here too, with higher levels of concern about many societal issues, especially political and economic. Two-thirds (65%) were moderately or seriously concerned about "the state of politics in my country," compared to a range of 42% to 53% for the other three countries; 64% were concerned about "corruption of politicians/officials," compared to 39% to 47% in the other countries.
Other surveys around that time told a similar story. In 2011, Time magazine reported a poll showing that the U.S. was going through "one of its longest sustained periods of unhappiness and pessimism ever," adding that it was "hard to overstate what a fundamental change this represents." Two-thirds of Americans believed the past decade was one of decline, not progress, for the U.S. (68%), and that the greatest threat to the long-term stability of the U.S. came from within, not from outside, the country (66%).
A 2012 article in The Atlantic reported on a survey showing that Americans believed their country was heading in the wrong direction, that their generation was worse off than their parents' generation, and that their children would be still worse off:
Americans believe that political corruption, too much focus on material things, and the influence of money in politics are weakening our values and standing in the world. They believe elected officials reflect and represent mainly the values of the wealthy and think the economic system is unfair to middle- and working-class Americans. And they believe that Wall Street is more like a cancer than an engine for economic growth.
U.S. life expectancy began to stall around 2010, then fell between 2014 and 2017, the first three-year decline since World War I and the Spanish flu pandemic 100 years earlier. Contributing to the trend has been rising mortality among those in the prime of life, including from drug overdoses, alcohol use and suicides. The decline in life expectancy revealed a broad erosion in health, with no single "smoking gun," a health policy expert said. "There's something more fundamental…. People are feeling worse about themselves and their futures, and that's leading them to do things that are self-destructive and not promoting health."
This was Barack Obama's America. Yet Obama failed to see it. For him, progress was still progress: Life was continuing to get better; climate change and other environmental issues were being solved through orthodox policy initiatives. As he often avowed, the arc of history was long, but it bent towards justice. Obama's faith in progress provided the foundation of his ideological commitment to incremental, rather than radical, political change. As he said in a 2016 BBC interview:
My view of human progress has stayed surprisingly constant throughout my presidency. The world today, with all its pain and all its sorrow, is more just, more democratic, more free, more tolerant, healthier, wealthier, better educated, more connected, more empathetic than ever before. If you didn't know ahead of time what your social status would be, what your race was, what your gender was, or your sexual orientation was, what country you were living in, and you asked what moment in human history you would like to be born, you'd choose right now.
The surveys cited above show many Americans did not view their lives in this light — a situation that continues to this day.
Trump's America and the dominance of race
Enter Donald Trump. A political outsider, Trump did see the America I have described; he acknowledged people's anger and anxiety, most notably in the deindustrialized heartland of America that became his base. Writing this essay has made me aware that it is almost impossible to get people to see Trump in any other way than they are predisposed to see him, to see past him to my main message. So let me be clear: It is only in his awareness of people's unease, and in his shock to the political status quo, that I want to consider Trump's impact. It is what interested me in applying my work to U.S. politics. What follows is not an attempt to give a full account of his presidency, policies and behavior.
A recent study, "Bowling With Trump," says researchers have attributed Trump's success largely to "racialized economics," in which economic hardships are seen in racial terms, not personal; they are blamed on "other groups." But the study suggests that more fundamental to Trump's support has been heightened anxiety and a lack of social attachment or belonging. This increased racial and national identification, which, importantly, was politicized as racial prejudice and nationalism. This is how the authors of the study describe their findings:
We find that the oft-observed positive relationship between racial animus (prejudice) and Trump's vote share is eliminated by introducing an interaction between racial animus and a measure of the basic psychological need for relatedness. We also find that rates of worry have a strong and significant positive association with Trump's vote share, but this is offset by high levels of relatedness. Together, these two results imply that racial voting behavior in 2016 was driven by a desire for in-group affiliation as a way of buffering against economic and cultural anxiety. … This suggests that the economic roots of Trump's success may be overstated and that the need for relatedness is a key underlying driver of contemporary political trends in the U.S.
When societies come under increasing pressure and strain, as America has, they tend to fracture along traditional fault lines such as class, religion, ethnicity or race. Those in power promote and exploit these fractures. Profound disquiet is easily manipulated, and expressed as more obvious or tangible grievances. America is particularly susceptible to a political focus on racial divisions and antagonism. This tactic is obvious in recent politics, especially with Trump and the far right. However, the Democrats also played on these fractures in the sense of using them for political leverage or gain — as revealed in Hillary Clinton's infamous "basket of deplorables" remark.
The political focus on race is evident in a recent account of how the New York Times set up a project that attempted to understand the forces that led to Trump's election. Rather than digging deep into the "half of America" that had voted for the president, the author says, the newspaper "chose to blame the events of 2016 on the country's pervasive racism, not only here and now but everywhere and always." The preoccupation with race is also seen in the current furor over "critical race theory," which likewise looks at America's history through the lens of racism, arguing racism is systemic in the nation's institutions, which maintain the social dominance of white people.
Want a daily wrap-up of all the news and commentary Salon has to offer? Subscribe to our morning newsletter, Crash Course.
The danger in this fraying and fragmentation of public debate and discussion is that we lose sight of the bigger picture and its more fundamental elements, with the result that we are caught up in perpetual conflicts over what are, at least in part, derivative or secondary causes and consequences. Improving the lot of the marginalized and disadvantaged, however legitimate and however much it may help them, will not solve the deeper challenges facing humankind. Climate change provides a useful example of, and metaphor for, this perspective: The poor will suffer its consequences most, and this disparity demands attention, but climate change must be studied and addressed, first and foremost, as a planetary crisis that affects all of us.
The standpoint of "we are all in this together" offers the advantage of creating more generous and tolerant ways of understanding America, encouraging people to look past the rancor and conflict promoted by its politicians and media, their obsession with "identity" and "issue" politics and protest. For example, the "Bowling With Trump" study notes that Trump's supporters have been said to be "in mourning for a lost way of life." The liberal media interpreted this nostalgia in terms of historic white male privilege.
However, this is not the only possible meaning or interpretation: There have been many social, cultural, economic, environmental and technological changes since the 1950s (the oft-cited historic benchmark) — in income inequality, work, education, mainstream and social media, relationships, the family and climate, for example — that have increased a shared sense of isolation, insecurity, uncertainty, risk and precarity.
These changes fed into the growing and overarching political influence of postmodernism, with its multiple narratives, relative truths, ambiguities, pluralism, fragmentation and complex paradoxes. A consequence has been a flourishing of conspiracy theories. All this served to fracture and divide American society.
For all his faults and failings — and there were many — Trump achieved something the U.S. needed: He rocked the political establishment to its core. And while he tried to subvert democracy, he also reinvigorated democracy: voter turnout in 2020 was the highest in 120 years. In doing this, however negatively, Trump offered at least a small chance of triggering systemic change.
Environmental writer and activist Joanna Macy expressed this opportunity succinctly: Trump's election was "a very painful waking up," she said; if Clinton had won, "we would have stayed asleep." This was a relatively common view among environmental and leftist commentators, especially around the time of Trump's victory. They saw Trump's victory as exposing the failings of the entire U.S. political system and its pursuit of a capitalist, imperialist agenda. And they were scathing toward the Democrats, notably Clinton and Obama, for their complicity and collaboration in this agenda.
The elite liberal media spurned this chance for a deeper, wider inquiry, and instead devoted four years to trying to remove Trump from office. This was also largely true of the Democrats (with the exception of a progressive minority that championed a more radical policy package, the Green New Deal). Trump's relationship with the liberal media became one of mutual loathing and goading; it was hugely destructive. In showing such contempt for Trump, the liberal media also derided his supporters, deepening the national division they accused Trump himself of provoking.
It was only later in his term, when the COVID-19 pandemic was devastating the country, and Trump looked unlikely to win re-election, that some commentators in the mainstream liberal media began to acknowledge the need to look beyond Trump to understand America's troubles. But these occasional pieces did not reflect, or challenge, the editorial tone of these media outlets.
Generally speaking, during Trump's term, liberal commentary took as a benchmark, a frame of reference, the old political status quo. It was as if they had forgotten the legitimate grievances that took him into office, and believed the task was to restore politics to what it had been before his election, even though everything had changed and needs to change. Much of the coverage implied that there was little wrong with the U.S. that removing Trump would not fix. This focus distracted attention from the country's systemic failings.
The liberal media embraced Joe Biden's election victory with sighs of relief over his centrist policies and a return to political normalcy. "Cometh the hour, cometh the man," The Guardian proclaimed. But the story does not end with Trump's eviction from the White House. The liberal media's celebration of Biden's victory is another aspect of their failure to understand how profoundly things are changing.
Nothing has been settled, as has become clear since. Republicans' strong showing in the November 2021 state and local elections, especially winning the governorship of Virginia, a state Biden won handily in 2020, has several lessons for the Democrats, according to media commentators, including that they were mistaken in campaigning on anti-Trump sentiments and need "to go big and bold." This is consistent with my analysis.
With Trump, politics and the media "zeroed in" on him, when they should have also "drawn back" to consider the larger social context. I have targeted the liberal media here because their stand-off with Trump provides a striking example of my thesis about the failure of the cultures of politics and journalism to reflect and address people's concerns about life. This broader analysis, to which I return below, is not partisan, but applies across the political spectrum.
Politics and the media arbitrarily define what warrants debate and discussion; much that is important is excluded. Journalism historian Daniel Hallin, writing about the Vietnam War, distinguished between three spheres of political debate: the sphere of consensus, the sphere of legitimate controversy and the sphere of deviance. Only matters falling within the second sphere, the sphere of legitimate controversy, gained attention. However, the boundaries between the spheres shift as public opinion changes, and can differ between media.
My argument is that existing boundaries are lagging far behind — and so distorting — public opinion about life today. The forces reshaping America mean that debate needs to expand the sphere of legitimate debate to encompass more of the sphere of consensus, meaning what is understood to be broadly agreed and accepted, and the sphere of deviance, what is judged to be unworthy, ridiculous or dangerous.
Politics and progress
I am not American, but Australian, living on the far side of the world, so I have no direct experience of American life. I am not a political scientist or policy analyst, steeped in political history and policy detail, but a social researcher into human progress and well-being, and the future. But perhaps both these attributes allow me to see more clearly — or at least differently — the bigger picture of American life. As I said, this picture is also true, but mostly to lesser degrees, of other developed nations, including my own.
My research and writing address questions about whether life is getting better or worse. It includes how we conceptualize and measure progress, its sustainability, its impacts on people's health and well-being, and how these might shape our future. In a nutshell, the scientific evidence shows that there is a widening gap between the science and politics of human progress and development. Politics is based on an outmoded and increasingly destructive model of human progress that is environmentally, socially and economically unsustainable, and undermines the quality of life. This predicament is not reflected in the dominant indicators we use to measure progress, and which inform our politics.
The theory and methodology behind my work is transdisciplinary synthesis, which is undervalued in research. While empirical research seeks to improve understanding of the world by creating new knowledge, synthesis creates new understanding by integrating existing knowledge from across a range of fields, disciplines and sciences. It aims to develop new, common frameworks of understanding, striving for coherence in the overall conceptual picture rather than precision in empirical detail. It dispenses with expectations of scientific certainty and exactness, including with respect to cause and effect; everything is provisional, and relationships are often reciprocal.
Science favors depth of knowledge, but breadth also has its place: Synthesis adds value to existing specialized knowledge, reduces disciplinary biases, transcends interdisciplinary tensions, improves researchers' knowledge outside their specialization, generates new research questions and enhances the application of knowledge. Synthesis is particularly appropriate for addressing the increasing scale, complexity and interconnectedness of human problems, and suits the complex, diffuse processes of social change.
My work has focused especially on the "psychosocial dynamics" of progress, notably the social and personal relationships that shape our way of life, and the worldviews, cultural stories, myths and symbols that define reality and give meaning to our lives. My "American story" illustrates the importance of these dynamics. This has given me a perspective that differs radically from most other analysis, on both left and right.
Take, as an example, materialism and individualism, two defining qualities of modern Western culture. The research literature suggests that, when taken together and too far, they reduce social integration, self-worth, moral clarity and existential confidence and certainty. There is a shift from intrinsic to extrinsic values and goals; from self-transcendence to self-enhancement; from doing things for their own sake to doing things in the hope or expectation of other rewards, such as status, money and recognition. The result is an increasing focus on our own lives and an unrelenting need to make the most of life. Frustration, disappointment and failure become more likely; loneliness, anger, depression and anxiety are a greater risk.
Consumer culture has shifted its unceasing messaging beyond what we have to who we are and what we do; from the acquisition of things to the enhancement of the self. It both fosters and exploits the restless, insatiable expectation that there must be more to life. It has created a self that is socially and historically disconnected, discontented and insecure; pursuing constant gratification and external affirmation; a self at risk of addiction, obsession and excess. We find It harder to answer the fundamental questions of existence: Who am I? Where have I come from? Why am I here? Nietzsche said that "he who has a why to live for can bear almost any how." Western consumer culture over-emphasises the "how," at the expense of the "why."
As sociologist Zygmunt Bauman has observed, today's social ills have their source in an "individualized society of consumers," with consuming more being the "sole road to inclusion" and "existential uncertainty" now a universal human condition. Single-issue solutions might bring temporary and partial relief, he says, but short of reforming the individualistic way of life, they will not remove the cause.
This situation not only erodes social capital and diminishes our well-being, contributing to people's dismay about life and politics, as discussed above; the overconsumption it promotes is also a major driver of climate change and other environmental crises that confront America and the world, which I discuss below. Everything is linked.
The demise of the official future
In the four-nation survey cited above, 75% of Americans agreed that "we need to transform our worldview and way of life if we are to create a better future for the world"; 65% agreed that "hope for the future rests with a growing global movement that wants to create a more peaceful, fair and sustainable world." (Percentages were similar in the other countries, unlike those to the more fundamentalist responses reported above.)
In other words, the public is aware of the risks we face and the need for a radical change of course, a new paradigm of progress. Yet our journalistic and political cultures remain stuck in a paradigm that constrains electoral choice and is crippling democracy. The mutually reinforcing cultures of journalism and politics are outdated and dysfunctional, defined by conflict and contest rather than cooperation and consensus; deepening our difficulties rather than helping to solve them.
It is this failure that lies behind the unease, mistrust and disenchantment in the electorate, not just political corruption and incompetence and policy mistakes. It is part of a layered political complexity, resulting in what I have described as the "demise of the official future": a loss of faith in the future that governments promise, and on which they base their policies.
Put simply, the official future is one constructed around notions of continuing material progress and economic growth, and scientific and technological advances, with the aim of providing an ever-rising standard of living. It is increasingly being challenged by sustainable development as a framework for thinking about human betterment. Authentic sustainable development does not give economic growth overriding priority. Instead, it seeks a better balance and integration of social, environmental and economic goals and objectives to produce a high, equitable and enduring quality of life. The concept of sustainability is gaining ground in politics, but it still falls far short of what is required.
The demise of the official future is causing a cascade of consequences, including to the "psychosocial dynamics" of progress that I mentioned earlier. Our visions of the future are woven into the stories we create to make sense and meaning of our lives. This "storying" is important in linking individuals to a broader social or collective narrative, and affects both our own personal well-being (by enhancing our sense of belonging, identity and agency, for example), and societal functioning (by engaging us in the shared task of working for a better future).
The extent to which Obama's politics and policies reflected his worldview, his continuing belief in the "official future," shows why we need to place these fundamental frameworks of how we understand the world at the center of political debate. Such a debate would be very different from today's emphasis on "issue" and "identity" politics, whose elements are kept firmly within the conventional model of progress. The interconnected risks facing humanity cannot be solved by focusing only on the discrete, specific issues that characterize and define today's politics, however legitimate the concerns are in themselves.
In science, paradigms change when they are confronted by a growing body of anomalous and contradictory evidence that they cannot explain or resolve. So it is with politics, which also confronts a growing array of policy failures, unsolvable problems and bitter divisions — but is struggling to understand or resolve them. We need a new paradigm that better acknowledges and addresses the emerging realities of planetary conditions and limits, and our better understanding of human needs and well-being.
There is no reason why political debate cannot be reframed in this way — except for the entrenched cultures of politics and journalism, which are both too "short-sighted" and too "narrow-minded." Watching the four-part documentary series, "The Fourth Estate," about The New York Times and Trump, while I worked on this essay drove home to me just how removed from my "American story" political journalism has become, how absorbed and obsessed with Washington intrigue, tweets, scoops and the 24/7 news cycle. We need to change the "idea" of progress, and to do that we must change the "idea" of politics and journalism.
I am acutely conscious of how radical, even fanciful and improbable, my position is. But it is based on a wide range of scientific evidence, however much we choose to ignore that evidence. It is a long shot, but hope for the future now rests on long shots. Cultures are so ingrained that they appear to be the natural and right way to look at the world. They tend to be "transparent" or "invisible" to those living within them because they comprise deeply internalized assumptions and beliefs, making their effects hard to discern or study. It is all but impossible to see beyond them to allow for other, fresh perspectives. Yet this is what we must do.
I might add that this is also true of the cultures of scientific disciplines: Different disciplines see things differently; they develop different models for explaining and studying the world, which generate different research questions, produce different results and lead to different interpretations of reality. Transcending disciplinary boundaries and perspectives is not easy. But this, also, is what we must do.
The study of future threats cited at the beginning of the essay is about perceptions, not realities. Nor do those perceptions necessarily reflect an informed understanding of the risks. Rather, they are likely to be an expression of a more general uncertainty and fear about the future, as discussed in the previous section. Nonetheless, the science validates these perceptions.
Early in 2021 I took part in an online discussion of existential threats to humanity. The global risks include the decline of key natural resources; the collapse of ecosystems that support life, and the mass extinction of species; human population growth and demand beyond earth's carrying capacity; global warming, sea-level rise and change in the earth's climate affecting all human activity; widespread chemical pollution of earth systems; rising food insecurity and failing nutritional quality; nuclear arms and other weapons of mass destruction; pandemics of new and untreatable disease; advent of powerful and uncontrolled new technologies; and widespread human failure to understand and act preventively on these risks.
Participants agreed that solutions exist to all these threats — except a solution to our inability to get political traction on the solutions. We confront a huge scale anomaly, or reality gap, between the challenges and our responses. From the 1970s onward, we have declared each decade to be a decade of reckoning for Earth's environment, a time when humankind must deal decisively with growing global environmental crises. And as each decade passed without the necessary action, we deferred the reckoning to the next decade. Climate change became a focal issue, scientifically and politically. Now, it is the 2020s that we claim to be the last chance to avert catastrophic consequences. We are in the sixth decade of "The Reckoning."
This repeated "kicking the can down the road" means we have already missed critical chances, at least with some hazards. It is not that nothing worthwhile has been done but that not enough has been done, with the result that the gulf between what we are doing, and what we now know we need to do, continues to widen. In an email exchange after the online discussion, a leading climate-change scientist said of the latest research on the 2015 Paris Agreement goals: "The sober message is that 1.5oC is gone and a reasonable chance to cap temperature rise at 2oC will vanish quickly without a truly emergency approach to the challenge." He and other climate-change experts who participated agreed that achieving "net zero carbon emissions by 2050," the current political goal, would not be enough.
It will take time to gauge the success or failure of the Glasgow COP 26 climate-change meeting; judgments have been mixed. From a political perspective, we advanced on Paris; from a scientific one, we failed to close the gap between the reality of climate change and our response. As one journalist summed it up: "Whatever its outcome, it will be too little too late, but far better than nothing." Politics continues to produce incremental change while science demands urgent, radical action. Perhaps the central lesson from COP 26 is that the pressure on the political status quo is increasing, but has yet to crack it open; we are still kicking the can down the road.
Whatever the truth about what Glasgow did or did not achieve, it is also important to remember climate change is not the only physical challenge humanity faces; there is also the need to address the psychosocial deficits, which are jeopardizing our health and well-being and playing out in our precarious politics.
The evidence shows that the political systems of the United States and other Western liberal democracies are failing, unable to deal with the nature and scale of 21st-century realities. Blinkered by their cultures, most politicians and journalists do not see the extent of this failure. Without a transformational change in the cultures of politics and journalism, we will not and cannot "look outward" far enough or "look inward" deeply enough to address the two types of existential threat humankind confronts: the extrinsic, environmental and other tangible problems that pose a threat to human civilization and survival; and the intrinsic, intangible problems of finding meaning and belonging in today's world. This should be the most fundamental layer of political discourse, one which remains largely missing.
To respond effectively to this situation, political debate needs to incorporate and reflect all the complexity and depth of today's challenges, to encourage the conceptual space for a transformation in our worldview, beliefs and values as profound as any in human history.
Read more on American unhappiness and the failures of media and education: