New posts on book production

Over at Electric Book Works, we’re often deep in the plumbing of the Electric Book workflow, the software we created for making books in multiple formats. If you’re curious about that work, I have written a few pieces there that may be interesting.

Producing The Economy with the Electric Book workflow‘ is a case study in multi-format book production, explaining how we built a huge, open-access economics textbook for web and print publication. It’s a great example of the symbiosis of print and digital publishing:

… the practical matter of skills has framed the evolution of publishing as ‘print vs digital’, when of course the conversation should be about print and digital. Not just because we’re stuck with a multi-format world whether we like it or not, but because print and digital formats are symbiotic. …

Print books generate instant credibility. They carry a sense of permanence and authority that digital formats cannot muster.

… Web publications struggle to muster the authority of a printed book, but they scale instantly and allow for a range of funding models.

So, when a book needs to make an impact, it simply must be in print and digital formats. It cannot have impact without the authority of print. And it cannot have impact without the scale of the web.

In ‘Book production with CSS Paged Media’ I explain in more detail how we create print books using HTML and CSS. It has lots of pictures. And also explains:

In our team, we dedicate a significant piece of everyone’s time to technical skills development – both editors and designers – to reduce dependency on developers. And, as our technical lead, I have to spend at least half my time learning or training others. A commitment to digital-first publishing is a commitment to a serious learning curve.

And in ‘Publishing research in useful formats‘ I explain how and why it’s important not to bury research publications in inaccessible PDFs; and the exponential value to be had from publishing as web pages in particular. Ultimately, if you can publish in multiple formats at once, you get a bunch of value, since different people will have different needs and preferences:

  • It can be very powerful to hand a high-quality printed book to an influential person. A beautiful printed book lends a project real credibility.

  • Many people like to download and print out PDFs to read on paper, or to use PDFs in PDF-annotation apps on tablets. Those PDFs must be optimised for use on screens, including clickable navigation and reasonable image sizes. (That is, they are not the same as PDFs for book printing.)

  • Many people do their reading on their phones today. Mobile-friendly web pages are much easier to read and bookmark on a phone.

  • Many people like to read long-form content on an ereader, like Amazon Kindle. A key feature of this is the ability to highlight and annotate as you read, and to see what others are highlighting. If your research is available in the Kindle store (or other stores like iBooks), it’s easy for people to find and annotate it like this.

  • Web pages are easy to share on social media. Today, we get many of our recommendations from contacts sharing links on social media. So website versions of research can be critical for getting others to share your work in this way.

  • Search engines likely rate web pages higher than PDFs, for various reasons. So research published as web-page content (as opposed to PDFs for download) will be far more visible and popular in search results.

  • You can get in-depth analytics from website publications. Using a service like Google Analytics you can see what people read most, what they search for, and where they are, right down to city level.

  • Well-constructed web pages are better for accessibility: for instance, for read-aloud screen readers and high-contrast displays for the visually impaired. And good accessibility has the added advantage of being useful to voice-driven services, such as Google Assistant, which can read out web pages in response to a user’s voice requests.

  • Website versions can be updated instantly, should information change.

 

For publishers in a racist world, neutrality is not a virtue

In the days before the Göteborg Book Fair, its director Maria Källsson defended the fair’s decision to allow one (and only one) right-wing extremist publisher a platform there:

How we are to tolerantly deal with intolerance is a major dilemma in our time. It is true that we can expel extreme exhibitors from the fair. After all, we decide who is allowed to have a stand there. But we can’t expel them from society. In order to understand our approach and our principles, you have to understand what the book fair is. The book fair is an open arena for free association and freedom of expression, and it does not forbid opinions. That principle comes with a price—even detestable opinions can appear at a book fair.

The Frankfurt Book Fair faced similar ‘dilemmas’, and defended their decisions in similar ways.

The argument that we should ‘tolerantly deal with intolerance’ seems satisfyingly logical. But it hides an abdication of responsibility that leads to terrible things – especially when espoused by publishers, whose job it is to make ideas seem credible, and the fairs that celebrate them.

If you genuinely believed detestable opinions can appear at a book fair, you would allow child pornography, manuals on genital mutilation, recipes for chemical weapons, or handbooks on torturing information out of people. All of these publications doubtless exist, and yet we would never allow them space at a book fair. We recognise here, so clearly, that freedom of expression doesn’t apply to promoting cruelty. It would be absurd to tolerate even one of those publications at a book fair.

And yet right-wing extremist views, which are primarily racist, escape prohibition. Racism, inexplicably, is not considered as harmful, despite the fact that it has driven every genocide in history, and continues to fuel the neglect, bullying, oppression, torture, and murders of people across the world. And it thrives in a world, contorted by hypocrisy, that allows racists freedom to express themselves even as they silence others. Perhaps racism is so widespread and so common that this seems normal.

Like racism itself, Källsson’s argument that we should ‘tolerantly deal with intolerance’ is not rare. It’s a symptom of that particular disease of comfortable people: the mistaken belief that neutrality is a virtue. This dangerous myth suggests that it is possible to debate racism with racists, as if hatred had a logic we might disprove if only we could work it out. And, as a result, our penchant for debate gives racist organisations a platform to ride, like a perfect wave, right into the centre of our lives and our politics.

So we must remind each other, patiently, over and over again: for as long as racism exists, neutrality is not a virtue. The same goes for misogyny. At best, neutrality and debate reinforce a cruel status quo.

The shadows of the human mind will always harbour terrible ideas. There is neither value nor virtue in making them stronger. As the folktale goes, the wolf that wins is the one we feed, and no one bears a greater responsibility for that than publishers.

Markdown vs HTML – hoedown or showdown?

On a mailing list recently, a friend asked: should my workflow use an HTML editor or markdown? There is, of course, no easy answer. It depends what trade-offs you want to make. At Fire and Lion we use markdown for book production, and I know very smart people who think that’s crazy. They’d pick an HTML editor any day.

What worries me about working in an HTML editor is that it must make assumptions about what the user intends. That is, HTML editors abstract what you see from what you’re storing. What you see is what you hope you get. The real source format is what the user types, but HTML editors effectively discard it, jumping straight to rendered output and hiding its structures from view. Non-technical users often have no idea what they’re actually storing, and very little control over it.

And those assumptions are the root of all editor evil: they inevitably lead to a hidden mess of legacy markup. As users edit, and especially as they paste from other sources, their editing software has to make guesses about what formatting and what HTML elements the user wants to keep and what it can discard. You only have to glance at the source of a heavily edited WordPress page to find a teeming mass of unnecessary spans, redundant attributes and inline CSS.

Over time, the HTML gets messier, and that mess is swept under the rug of the WYSIWYG view. And as it gets messier, it becomes less portable, and conversion tools become less useful. Suddenly I can’t just reuse my HTML somewhere else without unpredictable results. For any given reuse I lose hours to cleaning up my HTML, effectively creating a whole new fork of my project, and losing the ‘single-source master’ feature of my workflow. I’m sure every new HTML editor aims to solve that problem, but I haven’t found one that’s solved it yet.

So that’s why I remain a champion of markdown-based workflows: there is no abstraction in the editor, because I’m only ever working in plain text. The simplicity of plain text means my content stays clean as I go, because there is no rug to sweep a mess under.

The bare bones of markdown have other spin-offs, too:

  • Markdown is more portable. By ‘portable’ I mean between people and between machines. For non-technical people, markdown is more open than HTML: it’s instantly readable and copy-pastable. A format that’s useful without a developer in the room is exponentially cheaper to work with, especially when you have to move it between machines.
  • The contraints of markdown force us to keep document structures simpler, sticking to fewer, standardised elements.
  • And diffs of plain-text markdown (in Git especially) are easy to read. We can use them in editorial workflows as is.

However! Those who prefer HTML editors are right that markdown has serious constraints. Or, rather, that HTML5 (like many markup languages) provides more features than markdown can provide natively. For instance, markdown can’t produce tables with merged cells, create plain divs and spans, or manage nested snippets for things like figures. They’d argue rightly that the markdown editing experience can be clunky, especially to those accustomed to Word-like UIs. And that non-technical users mostly don’t share my concerns about messy underlying markup: they just want an editor that looks great and is easy to use.

Like tabs versus spaces, I don’t expect this debate will ever be resolved. What matters is that we each pick our own trade-offs, and respect the trade-offs others make.

 

I love you, InDesign, but it’s time to let you go

I love you, InDesign, but it’s time to let you go. We just can’t be together in a multi-format world.

InDesign is expensive, so I can’t have my whole team working in it. It’s so powerful that it takes years of experience to use it without making a mess. And it’s fundamentally incapable of producing both print PDF and ready-to-use HTML from a single master file, despite some amazing hacks.

Adobe has tried valiantly to turn this page-based, hot-lead-replacement into a multi-format tool, but its roots in print are just too deep. Making books in InDesign and converting them to high-quality ebooks and websites is a rocky journey that leaves even the smartest typesetters bloodied and broke.

At Fire and Lion we make a lot of books for screen and paper (mostly for publishing companies and non-profits). To our clients, what matters most is that the books are well-crafted in every format, and that working with us is problem-free. Behind the scenes, we have to do something special to make that possible.

So the first thing we do is avoid using InDesign for setting everything but the most heavily illustrated books. We don’t do page-by-page layout and convert to HTML later. In fact, we do exactly the opposite: we make each book as a little website, and then output to PDF.

To put it another way: Fire and Lion makes responsive websites that respond not only to screen sizes but to the pages of a book. And we do it so well that, looking at the finished product, you can’t tell the difference between our books and those you’d get from a typesetter working in InDesign.

We’ve been lucky to work with clients who’ve let us make their books with this cutting-edge toolset. You have to be brave to accept a GitHub repository as your open files, rather than an InDesign package; but it’s brave people like that who move our industry forward.

Nothing we’re doing is a secret: our workflow is open. So when we’re not making books, we’ll be talking about how we make them. If you’re working with similar tools, or curious about ours, let us know.

Eleven ways to join the resistance from your desk

If you’re feeling bewildered, you’re not alone. So, once you’ve been thoroughly nauseated on Twitter and are keen to actually do something about this shit-show, here are a few non-profit projects that I wholeheartedly believe in, and whose people I’d trust with my life and my money. Volunteer, give money, say nice things – it all helps.

Majal runs several critically important web platforms for activists, migrants, musicians, and LGBT people, especially in the Middle East. Each of their projects has different needs, but you won’t do better than giving money straight to Majal. Kickass human: Esra’a El Shafei.

CASH Music – no one works harder for musicians and what they do for society than these guys. And no one quite believes what CASH does: they make and give away free software and services to musicians, only because it’s the right thing to do. It’s so unusually altruistic that many funders actually don’t like giving them money. But we can, because we’re not assholes. Kickass human: Jesse von Doom.

The Debt Collective. If you’re in the US, these amazing people are among very few directly challenging predatory lending – and winning. For the rest of us elsewhere, let’s learn from them and apply their strategies in our own countries. Predatory lending, especially student debt, is a plague that won’t go away on its own. Kickass human: Astra Taylor.

Africa Check, and any good fact-checking organisation right now, are doing what journalism used to do by default. And they’re only the seeds of what we’re going to need in the coming years. Every cent you give them literally buys truth and buries lies. Kickass human: Peter Cunliffe-Jones.

Safecast. Simply put: get a portable Geiger counter from these guys and help grow the world’s biggest, public-domain database of radiation data. They’re also trialling devices for measuring air quality. This is just the beginning: what really matters is that Safecast proves that we don’t need governments or big organisations to quality-control earth. We can just do it our big-brained-primate selves. Kickass human: Sean Bonner.

Fight for the Future. If we’ve learned anything this last year, it’s that the Internet is a battleground for hearts and minds. FFTF have already saved your Internet bacon more than once and you probably don’t even know it. There is a lot to learn from them about Internet activism when you take your own stand, big or small. Kickass human: Tiffiniy Cheng.

ContentMine. If you’re not in academia, you might not know there’s a pitched battle going on for ownership of new scientific knowledge. No kidding, there are actually big companies that own and control the science we pay for with our taxes. WTF. ContentMine have a plan to counter that. Apart from donating to their work, if you have technical skills you can use their open tech to make scientific facts public. Kickass human: Peter Murray-Rust.

The Open Knowledge Foundation. The first task of dictators is to hide information from the public. It’s OKFN’s job to stop that from happening. OKFN have a network of groups around the world, which do things like make government information easy for people to find and understand. Joining one might be the closest you’ll come to joining a rebel assault on the Scarif databank. Except it’s legal and you won’t get killed.

Bettercare (I’m a co-founder and board member) publishes open-access learning material for nurses and midwives in badly resourced clinics and hospitals. This stuff helps save lives every day, especially the lives of women and children. Every incoming cent helps to create new material and keep existing material up-to-date and openly available. If you have a medical background, you can also help by using and reviewing the material. Talk to me for details.

Book Dash (I’m a co-founder and board member) gathers volunteer designers, writers and illustrators to create free, high-quality children’s books that anyone can download, translate, print or distribute. Developers can contribute to the open-source Book Dash apps, or help improve the Book Dash website. Talk to me for details.

MyConstitution.co.za (I’m the founder and project maintainer) is a community project to put the South African constitution, in all official languages, in the public domain –here in South Africa, you would not believe how hard it is for citizens to read their own constitution. The project needs managers, the tech needs developers, and the content needs legal experts and experienced translators. Talk to me for details.

All of these projects are close to my heart, and have structures in place for volunteer contributions or donations. I’ve kept the list short so you’d read it, but I’d also vouch for any others funded by the Shuttleworth Foundation, and a bunch I’ll kick myself for forgetting here.

Do the right thing. Sleep better. Wake up stronger.