This directory contains the necessary files for the Artistic Visual Storytelling task. For a short dataset description, please, read the README.md.

Import note: The Artistic Visual Storytelling dataset can be used only for non-commercial academic research purposes.

If you use this dataset, please cite it as below:

Efthymiou, A.; Rudinac, S.; Kackovic, M.; Worring, M.; Wijnberg, N.M. (2023): Artistic Visual Storytelling. University of Amsterdam / Amsterdam University of Applied Sciences. Dataset. https://doi.org/10.21942/uva.20050970.v2

Visual storytelling refers to the manner of describing a set of images rather than a single image, also known as multi-image captioning. Visual Storytelling Task (VST) takes a set of images as input and aims to generate a coherent story relevant to the input images. In this dataset, we bridge the gap and present a new dataset for expressive and coherent story creation. We present the Sequential Storytelling Image Dataset (SSID), consisting of open-source video frames accompanied by story-like annotations. In addition, we provide four annotations (i.e., stories) for each set of five images. The image sets are collected manually from publicly available videos in three domains: documentaries, lifestyle, and movies, and then annotated manually using Amazon Mechanical Turk. In summary, SSID dataset is comprised of 17,365 images, which resulted in a total of 3,473 unique sets of five images. Each set of images is associated with four ground truths, resulting in a total of 13,892 unique ground truths (i.e., written stories). And each ground truth is composed of five connected sentences written in the form of a story.

A new dataset describing textual stories for events.

This version of the Bloom Library data is developed specifically for the Visual Story Telling (VIST) task. It includes data from 363 languages across 36 language families, with many of the languages represented being extremely low resourced languages.

Visual and digital storytelling methods can reposition research participants as coproducers of knowledge, foster engagement and collaboration with marginalized peoples, and offer greater depth of self-expression. However, these methods are constituted in complex terrains of power. Without continual attenuation to power imbalances, the methods will contribute to the silencing and erasure of marginalized communities. This study outlines how reflexivity as a methodological tool and part of the Cultured-Centered Approach can enable the interrogation of terrains of power, allowing for the continual opening of democratic possibilities and community ownership of visual and digital storytelling infrastructures. Excerpts from the “Poverty Is Not Our Future” campaign illustrate the argument. The campaign's cocreated audio-visual advertisements communicate everyday stories of poverty among residents living in a poor suburban site in Auckland, Aotearoa New Zealand, and serve as a visual narrative of resistance to dominant structures. This study contributes to critical theorizing of culture and communication and the coconstruction of visual stories.

Video Storytelling is a dataset for generating text story/summarization for videos containing social events. It consists of 105 videos from four categories: birthday, camping, Christmas and wedding. For each video, we provide at least 5 human-written stories.

• Videos are contained in the .tar file with their corresponding category name.
• Text stories are contained in Text.tar.
• In each txt file, the first line is the video id. The start and end time (in seconds) of each sentence is also given.
• test_id.txt provides the id for videos in the test set

Please cite the following paper if you use the Video Storytelling dataset in your work (papers, articles, reports, books, software, etc):

• Video Storytelling: Textual Summaries for Events. J. Li, Y. Wong, Q.Zhao, M. Kankanhalli. IEEE Transactions on Multimedia.

This dataset comprises lianhuanhua articles published on Chinese media platforms from 2013 to 2023, collected to analyze the discourse style of "visual narrative news." Ten articles per year were randomly selected based on equal probability. From 110 initial articles, nine were excluded because they failed to conform to the lianhuanhua format (visual-narrative structure is core) or were classified as "soft news" (e.g., entertainment, gossip), which prioritizes entertainment over social issues, unlike hard news focused on politics or public affairs.

StoryReasoning Dataset

  Overview

The StoryReasoning dataset is a collection of visual storytelling data designed to address limitations in maintaining consistent identity across multiple images while generating coherent narratives. It contains 4,178 cohesive stories derived from 52,016 images, organizing temporally connected image sequences extracted from the same movie scenes to ensure narrative coherence.

  Key Features

Cross-Frame Consistency: Each story… See the full description on the dataset page: https://huggingface.co/datasets/daniel3303/StoryReasoning.

Linguistic syntax has often been claimed as uniquely complex due to features like anaphoric relations and distance dependencies. However, visual narratives of sequential images, like those in comics, have been argued to use sequencing mechanisms analogous to those in language. These narrative structures include “refiner” panels that “zoom in” on the contents of another panel. Similar to anaphora in language, refiners indexically connect inexplicit referential information in one unit (refiner, pronoun) to a more informative “antecedent” elsewhere in the discourse. Also like in language, refiners can follow their antecedents (anaphoric) or precede them (cataphoric), along with having either proximal or distant connections. We here explore the constraints on visual narrative refiners created by modulating these features of order and distance. Experiment 1 examined participants’ preferences for where refiners are placed in a sequence using a force-choice test, which revealed that refiners are preferred to follow their antecedents and have proximal distances from them. Experiment 2 then showed that distance dependencies lead to slower self-paced viewing times. Finally, measurements of event-related brain potentials (ERPs) in Experiment 3 revealed that these patterns evoke similar brain responses as those observed to referential dependencies in language (i.e., N400, LAN, Nref). Across all three studies, the constraints and (neuro)cognitive responses to refiners parallel those shown to anaphora in language, suggesting domain-general constraints on the sequencing of referential dependencies.

Visual narratives are promising tools for science and health communication, especially for broad audiences in times of public health crisis, such as during the COVID-19 pandemic. In this study, we used the Lifeology illustrated “flashcard” course platform to construct visual narratives about COVID-19, and then assessed their impact on behavioral intentions. We conducted a survey experiment among 1,775 health app users. Participants viewed illustrated (sequential art) courses about: 1) sleep, 2) what COVID-19 is and how to protect oneself, 3) mechanisms of how the virus works in the body and risk factors for severe disease. Each participant viewed one of these courses and then answered questions about their understanding of the course, how much they learned, and their perceptions and behavioral intentions toward COVID-19. Participants generally evaluated “flashcard” courses as easy to understand. Viewing a COVID-19 “flashcard” course was also associated with improved self-efficacy and behavioral intentions toward COVID-19 disease prevention as compared to viewing a “flashcard” course about sleep science. Our findings support the use of visual narratives to improve health literacy and provide individuals with the capacity to act on health information that they may know of but find difficult to process or apply to their daily lives.

The global visual content market is anticipated to reach a value of USD 9104.8 million by 2033, expanding at a CAGR of XX% during the forecast period 2025-2033. The growth of the market is attributed to the increasing demand for visual content in various end-use industries, such as media and entertainment, advertising, and marketing. The rising popularity of social media platforms and the increasing use of visual content in e-commerce and online learning are also contributing to the market's growth. The increasing adoption of mobile devices and the growing trend of visual storytelling are further driving the demand for visual content. Among the different segments of the market, stock photos are expected to hold the largest market share during the forecast period. The growth of this segment is attributed to the increasing demand for high-quality and royalty-free stock photos for use in various applications. The rising number of online platforms offering stock photos is also contributing to the growth of this segment. In terms of application, the commercial segment is expected to dominate the market during the forecast period. The increasing demand for visual content for use in advertising and marketing campaigns is driving the growth of this segment. The editorial segment is also expected to witness significant growth during the forecast period due to the increasing demand for visual content for use in news media and online publications.

Social interaction has been recognized as positively affecting learning, with dialogue–as a common form of social interaction–comprising an integral part of collaborative learning. Interactive storytelling is defined as a branching narrative in which users can experience different story lines with alternative endings, depending on the choices they make at various decision points of the story plot. In this research, we aim to harness the power of dialogic practices by incorporating dialogic activities in the decision points of interactive digital storytelling experiences set in a history education context. Our objective is to explore interactive storytelling as a collaborative learning experience for remote learners, as well as its effect on promoting historical empathy. As a preliminary validation of this concept, we recorded the perspective of 14 educators, who supported the value of the specific conceptual design. Then, we recruited 15 adolescents who participated in our main study in 6 groups. They were called to experience collaboratively an interactive storytelling experience set in the Athens Ancient Agora (Market) wherein we used the story decision/branching points as incentives for dialogue. Our results suggest that this experience design can indeed support small groups of remote users, in-line with special circumstances like those of the COVID-19 pandemic, and confirm the efficacy of the approach to establish engagement and promote affect and reflection on historical content. Our contribution thus lies in proposing and validating the application of interactive digital storytelling as a dialogue-based collaborative learning experience for the education of history.

This dataset is introduced by the paper "Understanding, Categorizing and Predicting Semantic Image-Text Relations". If you are using this dataset it in your work, please cite: @inproceedings{otto2019understanding, title={Understanding, Categorizing and Predicting Semantic Image-Text Relations}, author={Otto, Christian and Springstein, Matthias and Anand, Avishek and Ewerth, Ralph}, booktitle={In Proceedings of ACM International Conference on Multimedia Retrieval (ICMR 2019)}, year={2019} } To create the full tar use the following command in the command line: cat train.tar.part* > train_concat.tar Then simply untar it via tar -xf train_concat.tar The jsonl files contain metadata of the following format: id, origin, CMI, SC, STAT, ITClass, text, tagged text, image_path License Information: This dataset is composed of various open access sources as described in the paper. We thank all the original authors for their work. Pitt Image Ads Dataset: http://people.cs.pitt.edu/~kovashka/ads/ Image-Net challenge: http://image-net.org/ Visual Storytelling Dataset (VIST): http://visionandlanguage.net/VIST/ Wikipedia: https://www.wikipedia.org/ Microsoft COCO: http://cocodataset.org/#home

Digital Storytelling Courses Market Outlook

The digital storytelling courses market is experiencing significant growth, with a market size valued at approximately USD 2.1 billion in 2023 and projected to reach USD 4.5 billion by 2032, registering a robust compound annual growth rate (CAGR) of 8.3%. One of the primary growth factors for this market is the increasing demand for creative content across various platforms and industries, driven by the digital transformation that emphasizes engaging and authentic content delivery. The proliferation of social media and streaming platforms has amplified the need for individuals and businesses to convey their narratives effectively, thus fueling the demand for digital storytelling courses. Furthermore, as individuals seek to enhance their creative skills, the accessibility of online learning platforms has made it simpler for people worldwide to enroll in such courses, contributing substantially to market growth.

The corporate sector is another significant driver, as companies increasingly invest in storytelling to build brands, engage customers, and train employees. Businesses are realizing the value of storytelling in crafting compelling company narratives, marketing strategies, and internal communications. This realization has led to a surge in corporate training programs that focus on storytelling techniques, providing a lucrative opportunity for course providers. Additionally, the ongoing shift towards remote work and virtual collaboration has highlighted the necessity for effective digital communication skills, further expanding the reach and importance of digital storytelling courses in a corporate setting. Coupled with advancements in technology that facilitate enriched learning experiences, such as virtual and augmented reality, the scope for these courses continues to broaden, attracting more professionals to develop their storytelling abilities.

The education sector also plays a pivotal role in propelling market growth, as educational institutions integrate digital storytelling into their curricula to enhance student engagement and learning outcomes. Educators are increasingly recognizing storytelling as an effective educational tool that fosters creativity, critical thinking, and empathy among students. The integration of digital storytelling into lesson plans helps make abstract concepts more relatable and memorable, thereby improving the overall educational experience. Moreover, as educational technology evolves, incorporating digital storytelling into learning programs becomes more feasible and appealing. This trend not only benefits students but also encourages educators to upgrade their skills, which in turn expands the market for professional development courses in digital storytelling.

From a regional perspective, North America is expected to lead the market due to its well-established digital infrastructure and the presence of numerous educational and corporate giants that emphasize creative communications. The region's affinity for adopting new technologies and its mature e-learning market create a conducive environment for the growth of digital storytelling courses. Similarly, Europe follows closely, driven by a strong emphasis on cultural and educational development. Meanwhile, the Asia-Pacific region is projected to witness the fastest CAGR, attributed to its booming digital economy and the increasing popularity of online learning. This diverse regional demand underscores the global applicability and necessity of digital storytelling skills, catering to varied cultural contexts and industry needs.

Course Type Analysis

The digital storytelling courses market is segmented by course type into online courses, in-person workshops, and hybrid programs. Online courses have seen the most significant growth, driven by the widespread availability and convenience of digital platforms that offer flexible learning schedules. These courses cater to a global audience, eliminating geographical barriers and allowing learners to access content from renowned instructors worldwide. Online platforms often provide interactive and multimedia content, enhancing the storytelling learning experience. The integration of forums and peer interaction further enriches the learning process, making it an attractive option for those seeking to improve their storytelling abilities from the comfort of their homes.

In-person workshops, while impacted by the shift towards digital learning, continue to hold importance due to their hands-on and immersive nature. These workshops offer direct interaction with instructors and peers, which can be crucial for learners who thrive i

This project examined the processing of bridging inferences in visual narratives, i.e. when readers need to infer information missing in a previous panel in a comic sequence. Rather than omitting the key event, this study replaced the climax of the scene with a variety of five inferential techniques, which implicitly express the unseen event while each balancing several underlying features that describe their informativeness. The main question asked to what extent the processing of these techniques differed. Two self-paced reading experiments measured viewing times as well as comprehensibility ratings; experiment 1 directly compared the five types and experiment 2 explored the effect of combining techniques. Additionally, this project explored the underlying features as predictors for viewing times and ratings.

This dataset is introduced by the paper "Understanding, Categorizing and Predicting Semantic Image-Text Relations".

If you are using this dataset it in your work, please cite:

@inproceedings{otto2019understanding,
title={Understanding, Categorizing and Predicting Semantic Image-Text Relations},
author={Otto, Christian and Springstein, Matthias and Anand, Avishek and Ewerth, Ralph},
booktitle={In Proceedings of ACM International Conference on Multimedia Retrieval (ICMR 2019)},
year={2019}
}

To create the full tar use the following command in the command line:

cat train.tar.part* > train_concat.tar

Then simply untar it via

tar -xf train_concat.tar

The jsonl files contain metadata of the following format:

id, origin, CMI, SC, STAT, ITClass, text, tagged text, image_path

License Information:

This dataset is composed of various open access sources as described in the paper. We thank all the original authors for their work.

• Pitt Image Ads Dataset: http://people.cs.pitt.edu/~kovashka/ads/
• Image-Net challenge: http://image-net.org/
• Visual Storytelling Dataset (VIST): http://visionandlanguage.net/VIST/
• Wikipedia: https://www.wikipedia.org/
• Microsoft COCO: http://cocodataset.org/#home

The global digital storytelling market is poised for substantial growth over the forecast period, with a projected market size of USD 5940 million in 2023. Driven by the rising popularity of online content creation and the demand for engaging and immersive storytelling experiences, the market is anticipated to exhibit a CAGR of XX% during the period 2025-2033. The growing adoption of cloud-based platforms and the proliferation of mobile devices are further fueling market growth. Significant factors driving the market include the increasing use of digital storytelling in education, entertainment, and marketing. Educational institutions are leveraging digital storytelling platforms to create interactive and engaging learning experiences, while entertainment companies are using them to develop immersive films, games, and virtual reality experiences. Moreover, businesses are utilizing digital storytelling to connect with their audiences and deliver impactful messages. The market also benefits from technological advancements such as artificial intelligence and augmented reality, which enhance the storytelling experience and provide personalized content to users.

The digital storytelling market is projected to grow at a CAGR of XX% during the forecast period of 2025-2033. This growth can be attributed to the increasing popularity of digital storytelling in various industries such as education, marketing, and media. Digital storytelling allows organizations to create engaging and interactive content that can capture audience attention and deliver a message effectively. Market segments such as applications and types have witnessed significant development, with companies such as Coursera, Adobe Education Exchange, StoryCenter, Class Central, FutureLearn, Jisc, and Australian Centre for the Moving Image (ACMI) playing key roles in market growth. Regional analysis reveals that North America, Europe, and Asia Pacific are leading regions in the digital storytelling market. The increasing demand for personalized learning, employer training, and corporate communication in these regions contributes to market growth. The adoption of digital storytelling in education and training sectors has created new opportunities for market players. Furthermore, advancements in technology and the growing popularity of social media platforms have further fueled market growth. The market remains competitive, with both established and emerging players vying for market share. Key drivers include the growing demand for engaging and interactive content, the increasing adoption of digital storytelling across industries, and the advancements in digital storytelling tools and technologies.

Global Digital Storytelling Courses market size 2025 was XX Million. Digital Storytelling Courses Industry compound annual growth rate (CAGR) will be XX% from 2025 till 2033.

The global social media design app market, valued at $336 million in 2025, is projected to experience robust growth, driven by a Compound Annual Growth Rate (CAGR) of 9.6% from 2025 to 2033. This expansion is fueled by several key factors. The increasing prevalence of social media marketing necessitates visually appealing content, leading to high demand for user-friendly design tools. The rise of mobile usage and the ever-growing number of social media platforms further contribute to market growth. A shift towards visual storytelling in marketing strategies and the need for businesses of all sizes (from large enterprises to SMEs) to maintain a strong online presence are significant drivers. Furthermore, the continuous innovation in app features, such as AI-powered design suggestions and collaborative editing tools, enhances user experience and drives adoption. The market segmentation reveals a strong presence across both iOS and Android platforms, with a significant portion of the user base comprised of businesses leveraging these apps for efficient content creation. Competitive rivalry among established players like Canva and Adobe, alongside emerging players, fosters innovation and keeps the market dynamic. Geographic distribution shows a significant concentration in North America and Europe, but with strong growth potential in Asia Pacific regions as internet penetration and social media usage expand. The market faces some restraints, primarily centered around the competitive landscape and the potential for market saturation. Maintaining a competitive edge requires constant innovation and adaptation to evolving user needs and design trends. The need for continuous updates and feature improvements to stay relevant also poses a challenge. However, the overarching trend of increasing social media engagement and the need for professional-looking content are expected to outweigh these challenges, ensuring continued market growth throughout the forecast period. The market's success relies on the apps' ability to constantly adapt to new social media platforms, trends, and evolving design aesthetics, ensuring they remain integral tools for both personal and professional social media management.