Skip to content

Category: Thoughts

Un-Leash

When going to bed night before last I flipped through the recommended youTube channels and there was a live cast of the first time Elon Musk’s Falcon Heavy had all three boosts safely return to earth. I felt I was watching real human progress, it was amazing and uplifting.

This was also the easter weekend when my son Edgar and I took a (minor) part in the Climate Extinction protest which is also uplifting and inspiring.

This easter was the easter when the roof of the Notre Dame caught fire and had near-instant billion dollar pledges for support to fix it. As a species we have an amazing capacity to do amazing things, but often we don’t. The same human ego that drives massive wealth accumulation needs massive ego reward to spend the money–being important to the future of humanity or even to today isn’t enough.

Last night I watched Elon Musk’s Tesla’s Autonomy Day with my beautiful wife resting in my arms. It was hugely impressive, uplifting and inspiring. Last night’s far as I can piece together, I dreamt of many of these elements in poetic form.

Today I want to do something. Something big and useful.

I have worked on aspects of symbol manipulation for most of my career and I have had some progress but very limited compared with the potential.

Liquid | Flow is a powerful and, judging by actual user reviews, successful text manipulation utility with just 30,000 downloads but happy users. It allows the user to interact with their textual information far more rapidly than through other means, resulting in searches and references being carried out to check on whether news is fake or not much more often than through traditional means. The main problem with Flow is that it’s hard to communicate what it is, it is very hard to sell to someone who is not already interested in more powerful text.

Liquid | Author has had only 17,000 downloads but has not been on the market very long (a bit over a year) and has only had a brief period of being featured by Apple. Reviews are very good but people are not used to paying for software anymore and that severely lowers the cost per unit I can charge. The only effective marketing tool so far is to have Apple love it and feature it on the App Store and that is not a viable strategy for growth.

I can only see one way out of this and that is build and ship something which is so self-evidently more powerful than what we have today so that traditional and social media will spread the message virally.

To do that we need to explode the grey column traditional text layout but not in a demo-app or isn’t it cool kind of way, but in a way integrated into a useful workflow. Yes, this sounds like what I have been working on forever and it is, but it’s time to take it to the next level. I’ll park Author very soon, there are a few small issues needing fixing but I am concerned that they have turned into excuses as much as anything, so the final version of Author (for this round) will be submitted to Apple on Friday.

It will then be one month of work on the Dynamic View which is important for my PhD but also the most visually clear way I can explode the grey text column in a visually-impressive and work-useful way.

And from there on develop more interactions to usefully impress. How about infinite semantic zooming in both directions? How about graphed glossaries with auto-layout? How about gestures to expand and collapse text to fit the whim of the reader? We can do this and more and we can communicate it.

What happens when we unleash text?

Let’s find out.

Leave a Comment

FoT 2019 Invitation (draft)

We are hosting the 9th Annual Future of Text Symposium and would very much like it if you could join us as a speaker.

Announcing the 9th Annual Future of Text Symposium Summit on the theme of ‘Connecting Texts’

A major step in the story of our evolution was when we gained the ability to point out to each other what we could see. A further major step was when we gained the ability to point out what could not be seen and to interact with what could not be touched, through language and symbols.

As we stepped into the digital age our ability to point and interact rapidly increased by letting us point to documents for near-instant access from anywhere on the globe. We could interact with images to produce photograph-realistic portrayals of impossible scenes fed by our fertile imaginations for passive movie entertainment or active computer-game first person shooter experiences.

The promise of vastly increasing our ability to interact with what had through millennia given us mental powers to see further and understand deeper–our symbols in the form of text–received very little augmentation beyond spell check, copy and paste and the ability to link to documents.

Though digital text can be produced and transmitted at great speed, digital text is in most ways flat–disconnected with the contexts which created it and un-graspable by the receiver to manipulate it.

Here I would like to point out that if we do not vastly improve our capacity to point to and interact with our digital information, we will decrease our reach and narrow our opportunities in ways which will continue to have drastic impacts on how we deal with our information, our world–and each other.

interactivity is core

flattened information

flatter voice

The difference is between information presented to us in a flat or dimensional way and current trends is further flattening: When we ask Google, Bing or other search engines a question through a search, we get a ranked result based on how the company has pre-computed the relevance of all the available information’s veracity and relevance, listed under an increasingly frequent ‘position zero’ at the top of the screen showing ‘the’ answer. Though the position zero answer is increasingly accepted by the user, we have the option to choose an answer lower down on the list and to modify our search but when we ask Alexa, Cortana or Siri a question we only get a position zero answer and at the time of writing there is little opportunity for follow up with ‘why’ or ‘how do you know that’.

flatter links

The promise of ‘hypertext’ where a prime feature is the ability to link to other information is also flattened. The original web allowed for links between documents but this ability has been denied digital books and digital documents to the point of being even less powerful than paper citations to paper books and documents where at least page numbers could be referred to–it is not possible to link to, or more correctly, to address, an individual section such as a paragraph in digital book or document such as PDF or Word.

repercussions

In our high velocity information world, repercussions of this flattening of information allows for Fake News to propagate without interrogation. It also allows for citations in academic work to remain unchecked if the reader does not already know the source which at the same time hides useful information and obscures harmful information.

transmission & reception through infrastructures

Knowledge is fluid with a multiplicity of interconnections, whereas an argument–even in its simplest form of a simple assertion–is rigid and linear. In a thoughtfully created document the linear argument will be supported by connections to the fluidly connected knowledge space through explicit citations, links and pointers.

Mental energy is expended to surface read a text, however brief or big and information provided which hooks into our current models of the information will take the least effort to assimilate. Information which lies outside our model or which contradicts our mental models take considerably more effort to process as they do not simply rely on recognition but on re-wiring circuits, which is mentally taxing in terms of energy use. Any assistance to how the reader can more effectively deal with such new or contradictory information thus makes is more likely that the user will make the effort.

A quote making the rounds on Facebook attributed to Alexander den Heijer a Dutch inspirational speaker, trainer, and consultant, simply states: “If the flower fails to grow, you don’t change the flower, you change its environment”. Similarly, it is not enough for us to criticise the knowledge user, we must provide more effective knowledge tools and this starts with the underlying environment and here the key issue is addressability and interaction, two things with cannot be delivered by any single developer or company, it must by definition be supported by powerful open standards and best practices.

interactive words, interactive worlds

I read an interview with one of the developer of the very successful game Crysis in an issue of Edge magazine which I have not been able to find since, talks about the development of the very large scale and interactive world. In the Crysis world you can shoot through wooden walls, and do much of what you’d expect to be able to do in the real world. The designer said that the issue with making good AI was not in the bots the player would fight but in the environment. He said that a piece of wood would need to know all the attributes of wood in order to correctly interact with other elements in the game, such as a bullet. Modern games such as Battlefield take this even further, with buildings part collapsing when damaged and collapsing further when further disturbances disturb them. Fields of wheat move with the wind (and explosions) and so on.

These are examples of richly interactive dimensionally rich information environments. The information about the world presented in the graphical display can be interacted with through understood means which translates into an immersive and playful experience for the player.

Knowledge work environments do not have this. The illustration of a bullet above can be employed here as an evocative way to illustrate something which connects something, such as a gun and a target. To do this the user needs to be able to somehow address the target (through aiming) and the target needs to be addressable–there needs to be a way to describe the start and end of the path of the bullet. In knowledge work environments we refer to this under the loose term of ‘linking’ and our ability to link is very rough grained and arbitrarily available and this is a consequence of the poor support for addressability.

An open and available web document can be linked to by entering the address in terms of domain name and path on the server and the name of the document and what type of document it is, such as www.website.com/this_document.html If the creator of the website has entered anchor tags into the text, perhaps by paragraph, you could also link to anchor tags within the document, such as www.website.com/this_document.html#section1 but this is not standard for web creation systems nor are the generally accessible means through which the user can see and use such links so in practice it is not possible and with digital books its not possible for commercial reasons. You cannot ‘shoot’ across into a book on a specific virtual page or paragraph since the copyright owners consider the addressing a valuable commercial intellectual property, partly because it is the way text and audio books can sync-up.

a powerfully interactive future

In order to fight Fake News we must Arm The Citizenry with much more powerful means to deal with the information hurled at them and we must arm developers to build ever more powerful tools not only for what is inside their sandbox but also for how it relates to information elsewhere.

addressing our future

We can do this by supporting what some call deep linking and others high resolution addressability, otherwise developers can only provide rich interactions for the software they build and the data or documents the user uses within their environment.

To further support this we need to accept that links are only addresses and as such as we need to improve the flexibility and power of addressing, including splitting addresses in two; one for the document and another for locations inside the document. This way it would be possible for a user to link to inside a document, even a book or academic PDF behind a paywall) and the reader can choose to follow the link inside a copy of the document they already have to choose to buy a copy of the document and in either case the location part of the link will work.

We can, and must add dimensionality to the text being hurled around cyberspace, we cannot afford information ghettos, we will only thrive and be free when our information can be freely addressed and interacted with.

This is within our grasp.

join us

This is what we are meeting on the 9th International Future of Text Symposium in Washington DC in November to work towards. Will you join us on the day? Will you join our dialog to make the day as useful as it can be?

Leave a Comment

FoT 2019 Invitation (draft)

We are hosting the 9th Annual Future of Text Symposium and would very much like it if you could join us as a speaker.

Announcing the 9th Annual Future of Text Symposium Summit on the theme of ‘Connecting Texts’

A major step in the story of our evolution was when we gained the ability to point out to each other what we could see. A further major step was when we gained the ability to point out what could not be seen and to interact with what could not be touched, through language and symbols.

As we stepped into the digital age our ability to point and interact rapidly increased by letting us point to documents for near-instant access from anywhere on the globe. We could interact with images to produce photograph-realistic portrayals of impossible scenes fed by our fertile imaginations for passive movie entertainment or active computer-game first person shooter experiences.

The promise of vastly increasing our ability to interact with what had through millennia given us mental powers to see further and understand deeper–our symbols in the form of text–received very little augmentation beyond spell check, copy and paste and the ability to link to documents.

Though digital text can be produced and transmitted at great speed, digital text is in most ways flat–disconnected with the contexts which created it and un-graspable by the receiver to manipulate it.

Here I would like to point out that if we do not vastly improve our capacity to point to and interact with our digital information, we will decrease our reach and narrow our opportunities in ways which will continue to have drastic impacts on how we deal with our information, our world–and each other.

interactivity is core

flattened information

flatter voice

The difference is between information presented to us in a flat or dimensional way and current trends is further flattening: When we ask Google, Bing or other search engines a question through a search, we get a ranked result based on how the company has pre-computed the relevance of all the available information’s veracity and relevance, listed under an increasingly frequent ‘position zero’ at the top of the screen showing ‘the’ answer. Though the position zero answer is increasingly accepted by the user, we have the option to choose an answer lower down on the list and to modify our search but when we ask Alexa, Cortana or Siri a question we only get a position zero answer and at the time of writing there is little opportunity for follow up with ‘why’ or ‘how do you know that’.

flatter links

The promise of ‘hypertext’ where a prime feature is the ability to link to other information is also flattened. The original web allowed for links between documents but this ability has been denied digital books and digital documents to the point of being even less powerful than paper citations to paper books and documents where at least page numbers could be referred to–it is not possible to link to, or more correctly, to address, an individual section such as a paragraph in digital book or document such as PDF or Word.

repercussions

In our high velocity information world, repercussions of this flattening of information allows for Fake News to propagate without interrogation. It also allows for citations in academic work to remain unchecked if the reader does not already know the source which at the same time hides useful information and obscures harmful information.

transmission & reception through infrastructures

Knowledge is fluid with a multiplicity of interconnections, whereas an argument–even in its simplest form of a simple assertion–is rigid and linear. In a thoughtfully created document the linear argument will be supported by connections to the fluidly connected knowledge space through explicit citations, links and pointers.

Mental energy is expended to surface read a text, however brief or big and information provided which hooks into our current models of the information will take the least effort to assimilate. Information which lies outside our model or which contradicts our mental models take considerably more effort to process as they do not simply rely on recognition but on re-wiring circuits, which is mentally taxing in terms of energy use. Any assistance to how the reader can more effectively deal with such new or contradictory information thus makes is more likely that the user will make the effort.

A quote making the rounds on Facebook attributed to Alexander den Heijer a Dutch inspirational speaker, trainer, and consultant, simply states: “If the flower fails to grow, you don’t change the flower, you change its environment”. Similarly, it is not enough for us to criticise the knowledge user, we must provide more effective knowledge tools and this starts with the underlying environment and here the key issue is addressability and interaction, two things with cannot be delivered by any single developer or company, it must by definition be supported by powerful open standards and best practices.

interactive words, interactive worlds

I read an interview with one of the developer of the very successful game Crysis in an issue of Edge magazine which I have not been able to find since, talks about the development of the very large scale and interactive world. In the Crysis world you can shoot through wooden walls, and do much of what you’d expect to be able to do in the real world. The designer said that the issue with making good AI was not in the bots the player would fight but in the environment. He said that a piece of wood would need to know all the attributes of wood in order to correctly interact with other elements in the game, such as a bullet. Modern games such as Battlefield take this even further, with buildings part collapsing when damaged and collapsing further when further disturbances disturb them. Fields of wheat move with the wind (and explosions) and so on.

These are examples of richly interactive dimensionally rich information environments. The information about the world presented in the graphical display can be interacted with through understood means which translates into an immersive and playful experience for the player.

Knowledge work environments do not have this. The illustration of a bullet above can be employed here as an evocative way to illustrate something which connects something, such as a gun and a target. To do this the user needs to be able to somehow address the target (through aiming) and the target needs to be addressable–there needs to be a way to describe the start and end of the path of the bullet. In knowledge work environments we refer to this under the loose term of ‘linking’ and our ability to link is very rough grained and arbitrarily available and this is a consequence of the poor support for addressability.

An open and available web document can be linked to by entering the address in terms of domain name and path on the server and the name of the document and what type of document it is, such as www.website.com/this_document.html If the creator of the website has entered anchor tags into the text, perhaps by paragraph, you could also link to anchor tags within the document, such as www.website.com/this_document.html#section1 but this is not standard for web creation systems nor are the generally accessible means through which the user can see and use such links so in practice it is not possible and with digital books its not possible for commercial reasons. You cannot ‘shoot’ across into a book on a specific virtual page or paragraph since the copyright owners consider the addressing a valuable commercial intellectual property, partly because it is the way text and audio books can sync-up.

a powerfully interactive future

In order to fight Fake News we must Arm The Citizenry with much more powerful means to deal with the information hurled at them and we must arm developers to build ever more powerful tools not only for what is inside their sandbox but also for how it relates to information elsewhere.

addressing our future

We can do this by supporting what some call deep linking and others high resolution addressability, otherwise developers can only provide rich interactions for the software they build and the data or documents the user uses within their environment.

To further support this we need to accept that links are only addresses and as such as we need to improve the flexibility and power of addressing, including splitting addresses in two; one for the document and another for locations inside the document. This way it would be possible for a user to link to inside a document, even a book or academic PDF behind a paywall) and the reader can choose to follow the link inside a copy of the document they already have to choose to buy a copy of the document and in either case the location part of the link will work.

We can, and must add dimensionality to the text being hurled around cyberspace, we cannot afford information ghettos, we will only thrive and be free when our information can be freely addressed and interacted with.

This is within our grasp.

join us

This is what we are meeting on the 9th International Future of Text Symposium in Washington DC in November to work towards. Will you join us on the day? Will you join our dialog to make the day as useful as it can be?

Leave a Comment