Digital Design + Development
Bhasha Van: An Augmented Reality experience for 70+ indigenous languages of India
Bhasha Research is a non-profit working towards preservation of indigenous languages all over India.
Execution
Application in Unity
Project Duration
2020 to 2022
UI Flow

The project started as an extension of an existing project at Bhasha Kendra(as it is locally called), Tejgarh. The project is called Bhasha Van - transliterating to forest of languages. The original project is an audio experience with an android app that gives content on 120 different languages - most of them popular, very widely used ones.

As an update to the existing project, Bhasha Van project was restarted as an Augmented Reality experience for 140 different indigenous languages. While the project originally sounded simple - the requirement was an app that scans a card and displays content related to that card - card contains information related to the language. A lot of explorations were done to find what was feasible, what ideas would make more sense than the others.

Marker/ Card Design

The cards that needed to be scanned required unique images on the marker. This was a challenge since there was no content available that connected all the languages together and still had a similar visual style. Originally the idea was to use textures from the academy - mostly adivasi drawings, that had a lot of interesting textures. The issue was they were available only in limited numbers and would require a huge amount of effort to get all the textures to a similar visual style for the cards.

To solve the issue with textures, another option that was explored was to use a map of India and use textures in the map - the textures will be unique, the map will also point to the location where the language is spoken. This was tested out in unity to figure out that since the borders in the map were one and the same all throughout, the maps were detective false positives - the languages detected weren't the actual languages on the marker image.

This required even more problem solving efforts, eventually settling down to markers of tree images done by Dr. Madan Meena, director of Adivasi Academy. The tree images also were limited in number, but it was possible to do adjustments to make it work for all the 70 languages. After a lot of composition trials, a final form was achieved for the markers.

3D printer
3D printer
3D printer
3D printer
3D printer

While other shapes were explored for the marker, it was kite festival, the first time I visited the academy. The festival had an important connection with the place. Kites everywhere - all kids playing with kites. This inspired the decision of making the marker into a rough kite shape - it had to be less obvious and more functional.

Introduction Board was also designed in a similar style

A glimpse of what the final marker images look like.

Final placement of the markers and introduction board in the campus

UI Design

UI Design was the more complex part of the project. There was a lot of unstructured data available to Bhasha. Mostly in audio and video. There had to be a balance in the amount of content and type of content to be provided in the application.

Original prototype for the application was made in Unity with ARFoundation. Many other AR libraries were also tried including ARCore and ARKit - ultimately, unity was the best bet - it had the capability to port the application effortlessly to a different platform as well. This was working good until I figured out most devices don't support AR and most available android tablets under a budget of ₹30,000 did not have the support. The application was rebuilt again later on for iOS only, iPads were also purchased.

Learnings & Takeaways
Unity development
Coding the whole application was a humongous task. The task required a lot of learning on unity's interface and C# programming. I also had to get external help to complete the work.
Balancing time and work
The time taken to complete this project cannot be justified in any way. A project that should've ended in 3 months took around 2 years to reach completion stage. The major issues were with working out a balance with deliverables from other individuals. The content editors and creators I had to work with had to learn much of their craft and work things out slowly.
AR's true potential
AR has a lot of potential - it might even become the operating system of the future. By starting out with small and simple projects like these - I'm able to slowly explore what the future holds for us.
Printing on acrylic
UV printing is a process I explored to make the printed markers.