Enya Pan is an interdisciplinary designer, research rabbit hole enthusiast, and Brown|RISD Dual Degree Program student studying Computer Science and Business Economics @ Brown University and Graphic Design @ Rhode Island School of Design.
- A lover of all things linguistics, typography, biomaterials engineering, sustainable urban infrastructure, & ugly ceramic mugs.
Work →
Archive
About
Contact
Tags
FIG. 3
Phonetics-Based Machine Orthography
// MAY 2024Step 1: Converting from text to image. I wrote a script that extracts phonemes from the English language and utilized stable diffusion machine learning algorithms to iterate over the prompt ““Create an image that sounds like the letter ‘_’ in the English alphabet” 100 times for each letter in the English alphabet. In total, 2,600 letterforms were generated during this process.
Step 2: Converting from imge to text. These letterforms were then fed into an alt text generator to generate text descriptions for each of the images. I finally compared the text descriptions with the original letter inputted into the prompt to test the accuracy of text-to-image generation and image recognition.