NARRATIVE PRIMER: EMPOWERMENT THROUGH GENERATIVE STORYTELLING
Licensed under CC BY-NC-SA (ideas) mrGPL (code) :: DOI: 10.13140/RG.2.2.35486.34887
by Prof. Daniel Devatman Hromada, PhD. et PhD.
(daniel@udk-berlin.de)
@ 17th Int. Conference of Education, Research and Innovation (ICERI2024) 🇪🇸 Sevilla 🇪🇺
Prof. Daniel Devatman Hromada, PhD. et PhD.
Berlin University of the Arts
daniel@udk-berlin.de

presented at

17th Int. Conference of Education, Research and Innovation (ICERI2024) 🇪🇸 Sevilla 🇪🇺
CC BY-NC-SA (ideas) mrGPL (code)

Introduction

prompt%3A%20%22provide%20illustration%20for%20%22Once%20upon%20a%20time%2C%20a%20book%20had%20been%20made%2C%20a%20book%20which%20contained%20all%20the%20other%20books%20...%22%2C%20grayscale%2C%20in%20style%20of%20Gustav%20Doree

prompt: "provide illustration for "Once upon a time, a book had been made, a book which contained all the other books ...", grayscale, in style of Gustav Doree

Once upon a time, a book had been made, a book which contained all the other books, including its own construction & programming manual ...

What is this talk about ?

narrative education

embedded, "walled-garden" AI tutoring systems

AIED artefacts (both education-with-AI as well as education-about-AI artefacts)

magic

“Any sufficiently advanced technology is indistinguishable from magic” (Arthur C. Clark, 1962)

What is this talk NOT about ?

prompt%3A%20%22a%20woman%20teacher%20shows%20a%20raised%20middle%20finger%20to%20EdTech%20industry%2C%20cloud%20platfrom%20business%20men%20and%20other%20educational%20snake-oil%20sellers%22

prompt: "a woman teacher shows a raised middle finger to EdTech industry, cloud platfrom business men and other educational snake-oil sellers"

ChatGPT

cloud-based / online-learning solutions & "platforms"

EdTech "products"

"educating" millions of "customers"

Homo narrans

The concept of Homo narrans, or "the storytelling human," posits that humans uniquely create meaning and social bonds through narratives, using stories to interpret experiences, ACQUIRE KNOWLEDGE, and define cultural values. 

Beyond simple communication, storytelling allows humans to explore moral ideas, link events into coherent sequences, and build collective identities. 

Unlike other species, humans shape their personal and social worlds through narratives, making storytelling as essential as rationality or survival instincts. Homo narrans thus frames humans as storytellers, with narrative at the heart of both individual and collective consciousness.

Narrative AI in Education

Narrative AI in Education refers to the use of artificial intelligence to deliver learning experiences through storytelling, blending traditional educational methods with advanced, personalized digital tools. This approach leverages technologies such as speech-to-text, text-to-speech, language models and, optionally, image generation to create interactive, voice-driven narratives that adapt to each learner’s needs, preferences, and abilities. Unlike conventional screen-based learning, narrative AI fosters engagement through immersive storytelling, making education accessible also to children with visual impairment or from screen-critical communities. 

Personalized Storytelling

...for example, if the child’s favorite toy is a teddy bear named "Mr. Fluffy," the NP might create a story where Mr. Fluffy becomes the protagonist, embarking on an adventure to save the magical land of Ice Cream, where the child’s favorite type, such as chocolate mint, is at risk of melting. The narrative could further incorporate the child’s preferred outdoor activities—like cycling or playing soccer—where Mr. Fluffy must complete tasks that mirror these activities to solve problems within the story.

Learning Graph

Learning Graph consists of:

Learner States (Vertices) :: Represent child's current or potential level of knowledge and skill in a specific domain.

Activities (Edges) that move the learner from one state to another, categorized as:

Listen:: The child listens to a story or explanation.

Imitate:: The child repeats phrases or mimics patterns.

Narrate:: The child retells stories or creates new ones.

Test:: The child answers questions or solves problems.

Feedback:: The NP provides corrective or reinforcing feedback.

Narrative Templates

In narrative AIED, we employ a library of narrative templates derived from classic literature, including Aesop’s fables, the Panchatantra, and Grimm's fairy tales. 

These templates serve as FILL-IN-THE-SLOT FRAMEWORKS for story generation, allowing the LLM to customize narratives based on:

Pupil's Profile:: Personal interests, preferences, and learning needs.

Knowledge State:: Current mastery level in various subjects.

Learning Objectives:: Specific curricular goals targeted during the session.

HMPL

Table%201%20from%20article%20Hromada%20%26%20Kim%20(2023)%20Frontiers%20in%20Education

Table 1 from article Hromada & Kim (2023) Frontiers in Education

A human-machine peer learning curriculum (i.e., a HMPL-C) is a planned sequence of educational instructions–i.e., a curriculum–which involves:
1. At least one human learner G, H, I, ... which gradually develops her/his/their skill Γ.
2. At least one artificial learner a, b, c, ... which gradually develops its/her/his/their skill σ.
3. Activities by means of which G (resp. H, I, etc.) develops her/his/their skill Γ, which directly involve knowledge and competence exhibited by a (resp. b, c, etc.).
4. Activities by means of which a (resp. b, c, etc.) develops her/his/their skill σ, which directly involve knowledge and competence exhibited by G (resp. H, I, etc.).

Non-Player Educators

The concept of Non-Player Educators (NPEs) extends the idea of AI agents serving as interactive educational companions. In the NP system:

Role Modeling: NPEs can embody various characters or personas within stories, modeling behaviors and conveying lessons.

Diversity of Perspectives: Multiple NPEs can provide different viewpoints, enriching the educational content.

Consistency and Patience: As AI-driven entities, NPEs offer consistent interactions and infinite patience, accommodating the child’s pace.

In technical terms, NPEs are realized by means of individual Low-Rank Adaptors (LoRA) which are loaded and unloaded atop the underlying language model.

Narrative Primer Artefact

By integrating speech-to-text (STT), text-to-speech (TTS), mid-sized large-language models (MLMs) and sufficient and necessary knowledge base stored in the vector database, the NP provides a personalized and interactive learning experience. 

It emphasizes the traditional educational practice of storytelling, enhanced by modern AI capabilities, to promote basic literacy, arithmetic, musical skills and uncorruptable personality.

Hardware

form-factor: A5 size

computational core: NVIDIA Orin

main input modalities: microphone, gesture sensors,

main output modalities: speakers, electrophoretic (e-ink) display(s)

other peripherals attachable through standard USB-C and 40-pin GPIO connectors

NVMe disk, WLAN cards (both fully operational)

power-related: solar-panel positive

our current main challenge: thermal regulation

Software

Code%20snippet%20which%20identifies%20the%20identity%20of%20the%20pupil%20after%20he%2Fshe%20says%20%22Hallo%22.

Code snippet which identifies the identity of the pupil after he/she says "Hallo".

Linux

open-source voice identification (Speechbrain), speech-to-text (DeepSpeech 2, whisper), speech-to-text (XTTS2, bark) and text-to-image (Stable Diffusion)

small language models (Llama-3-SauerkrautLM-8b-Instruct, udkai/Turdus, Ministral...)

ChromaDB vector database (embeddings through NV-Embed-v1)

on-demand loading of LoRA adapter through LoRAx (loraexchange.ai)

Kastalia Knowledge Management System for lesson & learning graph management

https://github.com/hromi/personal_Primer https://github.com/hromi/primer-backend

Embooking

The "pupil" Primer prototypes have been awarded nomination in Science + Technology + Arts category of Prix Ars Electronica 2024.

The first property of the Primer is that it is either book-like—that is, it looks like a classic analog book—or "embooked," meaning it is physically embedded into a classic analog book. This first characteristic implies that the Primer:

uses reflected, non-emitted light (i.e., E-Ink rather than LED or OLED) to display content

ideally consists of multiple pages that can be read on both sides and are bound together using special binding techniques,

is equipped with both internal and external content encoding on the front and back covers and can include an additional layer of protection (e.g., a protective cover),

has a standardized format (e.g., A5) that allows it to be easily carried in existing wearables (e.g., school bags) and stored or archived in existing furniture (e.g., bookshelves)

Other properties

book-like; voluminous; modular; unique; adaptable; robust; bilateral; environmentally aware; circadian; moody; cooperative; behavior-oriented; habit-disrupting; playful and funny; mnemonic; multimodal; speech-based; narrative; cybertextual and encyclopedic; online-offline; protected; eye-to-eye; avatarized 

(c.f. Hromada, 2018; Hromada, Seidler & Kapanadze, 2020; Hromada & Kim, 2023 etc.)

Take home lesson

spectacular things are already happening in "open source" branch of AIED

with USA gradually becoming the prey of the dark side, immediate deployment of "walled garden" approaches is of utmost importance

all "bricks " to build Your educational "cathedral" are available out there (GitHub, Huggingface) and ready to serve

the future will be more weird than a dream and the key to that dream is ...

... education

Want to join forces in bringing dream closer to reality ?

Mail: daniel@udk-berlin.de / daniel@wizzion.com
Matrix: @d.hromada:medienhaus.udk-berlin.de
LinkedIn (@dhromada) / ResearchGate (Daniel-Hromada) / Instagram (@DigiEduBerlin)