On Creativity

Notes related to definitions of creativity and measures of creativity, both human and AI.

During my summer internship at Sony¹

¹ Shout out to the Sony people! It was a great summer.

So what is “creativity” anyways?

In a NSF workshop report Shneiderman et al. (2005) on creativity support tools, the participants provided some really nice takes. Specifically, the chapter on Creativity Support Tool Evaluation Methods and Metrics gave an overview on existing research on creativity.

Divergent and Convergent Thinking

…

Ways to measure creativity

Given the fact the creativity is multidimensional, one could imagine that trying to measure creativity is not an easy task.

One way to measure creativity is the Torrance Tests of Creative Thinking². It was first developed by XXX in XXX.

² … and here’s the Wiki link

There are also domain specific ways to measure creativity, such as the ones in music. XXX

The last thing I’ll mention briefly is that there is a Divergent Association Task³ (DAT). The research done by Olson et al. Olson et al. (2021) found that XXX. Given the fact that the DAT is administered in English, there has also been multi-lingual extensions to it, such as the one by Haase et al. […], as well as a Japanese version of DAT (https://www.jstage.jst.go.jp/article/jcss/32/1/32_2024.038/_article/-char/en)

³ Those interested can take the test here

Measuring creativity with Homogenization Analysis

In …,

Measuring and Benchmarking LLM Creativity

• Benchmarking LLM creativity
• How can we measure creativity?

…

References

Olson, Jay A., Johnny Nahas, Denis Chmoulevitch, Simon J. Cropper, and Margaret E. Webb. 2021. “Naming Unrelated Words Predicts Creativity.” Proceedings of the National Academy of Sciences 118 (25): e2022340118. https://doi.org/10.1073/pnas.2022340118.

Shneiderman, Ben, Gerhard Fischer, Mary Czerwinski, Brad Myers, and M Resnick. 2005. “NSF Workshop Report on Creativity Support Tools.” In NSF Workshop Report on Creativity Support Tools.