Why interactive text is crucial

Published by Frode Hegland on August 11, 2019

In a world of fake news, propaganda and weaponised social media optimised for one-click viral sharing, the velocity of text is far beyond anything seen in the days before computers or in the early days of computing. It is far easier to share blindly than it is to pose simple questions.

For some, this brings up the age-old question of who determines the truth and where truth can be found, since any text can assert that it is truthful and the author may very well have honestly believed it was. It is too easy to be stuck at this question and simply rank media based on some relative score of attempted objectivity or to fall the other way and state that truth is simply subjective.

But truth is not in the written words. Truth is in how they are connected.

Our access to truth is determined by our ability to read the text as written and to read its context. This is why text-interactions are important and this is why the future of text cannot simply be left up to giant corporations and governments which derive value from the current state of velocity driven, simple-share interaction.

And this is why we are conducting the largest survey of different perspectives on the future of text ever seen.

Making Information Self Aware

Published by Frode Hegland on July 14, 2019

We can fight fake news and find more useful information in the academic and scientific publishing tsunami if we make the information self aware–if the information knows what it is. This is not a suggestion of Harry Potter level magical fantasy but a concrete act we can start with today and lay for foundation for future massive improvement.

the intelligent environment

Many years ago I read an interview with one of the developers of the computer game Crysis where he was lauded with the quality of the AI of the opponents in the game. He said that making the AI was not really the hard part, making the different parts of the environment aware of their attributes was key. If a tree trunk is thick, then the enemy can hide behind it. If it is dense then it will also serve as a shield, up to a point.

the self aware document

This is what we can and must do to documents. We must encode the meaning in documents as clearly as possible so that the document may be read by software and human. The document must be aware of who authored it, when, what its title is and so on, to at least provide the minimal context for useful citations.

It should also know what citations it contains and what any charts and graphs means what glossary terms are used and how they connect. Of course, we call this ‘metadata’ – information about information and the term has been used in many ways for many years now, but the metadata has so far been hidden inside the document, away from direct human and system interaction. We should maybe instead call it ‘hiddendata’. For some media this is actively used, such as the EXIF data in photographs, but it is lost when the photograph changes format, is inserted into other media or is printed. For text-based documents this is certainly currently possible but seldom actually used and not usefully read by the reader software and lost on printing.

bibtex foundation

You may well feel that this is simply a call for yet another document format but it is not. This is simply a call for a new way to add academic ‘industry-standard’ BibTeX style formatting of metadata to any document, starting with PDFs, in a robust, useful and legacy friendly way, by simply adding a final appendix to the document which follows a visually human-readable (hence BibTeX) and therefore also machine parseable format.

As this will include who authored the information, which the reading software can ‘understand’ and make it possible for the user to simply copy text from the document and paste it as a full citation into a new document in one operation, making citations easier, quicker and more robust. Further information can be explained for reader-software parsing, such as how the headings are formatted (so that the reader software can re-format the document if required, to show academic citation styles in the preference of the reader if they are different from the presence of the author), what citations are used, what glossary terms are used and what the data in tables etc. contains and more.

more connected texts

This is making the document say what it is, where it comes from, how it’s connected, what it means, and what data it contains. This is, in effect, making the document self aware and able to communicate with the world. These are truly augmented documents.

This will power simple parsing today and enable more powerful AI in the future in order to much better ‘understand’ the ‘intention’ of the author producing the document, by making documents readable.

This explicitly applies to documents and has the added benefit that even if they are turned into different formats and even if they are printed and scanned they will still retain the metadata. The concept is extensible to other textual media, but that is beyond this proposal.

visual-meta

I call this approach Visual-Meta and it’s presented in more detail here liquid.info/visual-meta.html. I believe this is important and I have therefore started the process of hosting a dialog with industry and I have produced two proof-of-concept applications, one for authoring Visual-Meta documents and one for reading and parsing them: Liquid | Author and Liquid | Reader: www.liquid.info

paper

Digital capabilities run deeper than what previous substrates could, but even in the pursuit of more liquid information environments we should not ignore the power of the visual symbolic layer. We hide the meta at our peril – we reveal it and include it in the visual document and gain robustness through document format changes and even writing and scanning, gaining archival strength without any loss of deep digital interactivity, something which matters more and more as we live and discover how brittle our digital data is and how important rich interactivity is to enable the deeper literacy required to fight propaganda and to propagate academic discoveries often lost in the sheer volume of documents.

Furthermore, with the goal of more robust formats and supporting reading of printed books and documents, addressing information (as discussed in the Visual-Meta addressability post) can be printed on each page in the footer to allow for easy scanning of hand-annotated texts to be OCR’d and entered into the user’s digital workflow automatically. Digital is magic. Paper is also magic. One day they will merge, but until then there is value to be had to use both to their strengths.

As we make our information aware,
we increase the potential of our own awareness

A Clear & Present Opportunity

Published by Frode Hegland on January 7, 2019

Time for Better Literature Research

Universities and reading glasses were invented roughly simultaneously (coincidence?), during the 13th century. There were counties for students to have books copied for studying of which I won’t waste our time going through the details of how it wasted their time. It seems however, that not much has changed. Today’s academic is more likely to print out the sources for their literature review than to read it in digital form (Walsh, 2016), even though there are many different types of digital devices to read them on, from reflective to transmissive tablets and from laptops to desktops.

I am not writing about the pros and cons of paper versus digital for general reading but I do mean to highlight that there is a real opportunity to build an ecosystem where digital reading of professional material (someone one reads to learn, not for enjoyment primarily) can benefit from the potentially connected nature of digital text environments.

We will necessarily have to start with PDFs since they are the dominant form of academic knowledge transmission units, though of course support ePubs and other formats as well.

Workflow

The suggested flow is simply this:

annotate

A user reads a document for their research and highlights interesting sections, writes notes in the margin and also generally about the document. The user also also jots down ideas as the reading and research process progresses. Furthermore, the reading applications gives the user a rich set of facilities to view the document as she sees fit, including flexible ways to access keywords, summaries, abstracts, links, references and connections and so on, some of which we have implemented in Liquid Author and Flow.

access

All the literature review the user has read is accessible through keyword search, including specifying whether to only search highlighted text, annotations, notes or full text. When the user copies text from a document and pastes it into the document their are authoring, all the salient citation information is included and is copied across (since this is not possible by default, they system will need a fast and elegant way for the user to help add this to the document on opening/at leisure and in future automatically use what authoring systems will append as meta-information).

All the literature review the user has yet to read is also accessible through searches and can be bunched based on keywords, citations and other criteria.

All the literature the user has yet to access, which is connected to the users work by being cited in current work is also accessible.

The visual space of connecting literature can be developed by anyone since the connectors will be made clearly available. The weblau is one direction which can be powerfully useful in this regard.

A more Liquid Reader

This could make the literature review process a truly liquid, smooth and rich affair. This is not rocket science or heading far out into the unknown, this can provide clear and immediate benefits.

We have started experimental work around this workflow, with the Liquid | Reader but this will require more investment to continue til completion, particularly since the standards of searching for academic document is so incoherent and therefore many searches engines will need to be strung together.

1 Comment

Category: Symbol