kerjos-ARConcept
I want to develop an AR app in which you hunt for the words of a mystery poem or passage from literature from real-world text.
The flow of this game would work, as in the above sketch, like this:
- Based on a given list of words to find, the player finds the desired word from text existing in the real world. The player holds their phone up to the word and taps the screen to capture it and bring it into their inventory.
- The word moves into their inventory with a brief animation on the phone: a glowing circle appears above the words location on the screen and quickly moves into the inventory button in the corner of the screen.
- The player then checks their inventory to see both the words that they’ve found and the words they have left to find.
- The player may continue to look in the real world for their remaining words.
- Upon finding all the words in the scrambled poem or passage, the full text is read to the player by a narrator, their inventory is emptied, and a new list of words to find is generated from a new poem or passage and presented to the player.
This project relies on the Optical Character Recognition capabilities offered by the Google Cloud Vision API, of which thankfully I’ve been able to get the demo running in Unity.
There is potentially a different possible game to be built using OCR and AR: collecting words and using them towards the construction of some sort of generative poem or other piece. I am interested in getting some feedback regarding other exciting applications for OCR.